[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:59.503840 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:34923
I20260709 13:07:59.505414 18095 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:59.506467 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:59.523409 18102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.523382 18101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.523360 18104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:00.708292 18103 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:08:00.708439 18095 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:08:00.712592 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:00.712831 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:00.713049 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602480713022 us; error 0 us; skew 500 ppm
I20260709 13:08:00.713857 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:00.720271 18095 webserver.cc:533] Webserver started at http://127.17.171.254:41329/ using document root <none> and password file <none>
I20260709 13:08:00.721407 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:00.721681 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:00.722175 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:00.727932 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "3d5b4e6a00994816b1ce5cadcf28b672"
format_stamp: "Formatted at 2026-07-09 13:08:00 on dist-test-slave-jhlz"
I20260709 13:08:00.735613 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:00.741238 18110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:00.742303 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.005s
I20260709 13:08:00.742660 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "3d5b4e6a00994816b1ce5cadcf28b672"
format_stamp: "Formatted at 2026-07-09 13:08:00 on dist-test-slave-jhlz"
I20260709 13:08:00.742980 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:00.800974 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:00.802559 18095 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:08:00.803002 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:00.873896 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:34923
I20260709 13:08:00.873970 18161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:34923 every 8 connection(s)
I20260709 13:08:00.881968 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:00.903406 18162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672: Bootstrap starting.
I20260709 13:08:00.909296 18162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.911329 18162 log.cc:826] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672: Log is configured to *not* fsync() on all Append() calls
I20260709 13:08:00.917984 18162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672: No bootstrap required, opened a new log
I20260709 13:08:00.939385 18162 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" member_type: VOTER }
I20260709 13:08:00.939942 18162 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.940263 18162 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d5b4e6a00994816b1ce5cadcf28b672, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.941246 18162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" member_type: VOTER }
I20260709 13:08:00.941758 18162 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:00.942047 18162 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:00.942384 18162 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.946436 18162 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" member_type: VOTER }
I20260709 13:08:00.947144 18162 leader_election.cc:304] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d5b4e6a00994816b1ce5cadcf28b672; no voters: 
I20260709 13:08:00.948876 18162 leader_election.cc:290] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:00.949227 18165 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.951890 18165 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 1 LEADER]: Becoming Leader. State: Replica: 3d5b4e6a00994816b1ce5cadcf28b672, State: Running, Role: LEADER
I20260709 13:08:00.952852 18165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" member_type: VOTER }
I20260709 13:08:00.953835 18162 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:00.964600 18166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" member_type: VOTER } }
I20260709 13:08:00.964877 18167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d5b4e6a00994816b1ce5cadcf28b672. Latest consensus state: current_term: 1 leader_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d5b4e6a00994816b1ce5cadcf28b672" member_type: VOTER } }
I20260709 13:08:00.965458 18166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:00.965534 18167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:00.968950 18175 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:00.981582 18175 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:00.984596 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:00.997931 18175 catalog_manager.cc:1383] Generated new cluster ID: f133604cad144f0caef5c2e07c248b2a
I20260709 13:08:00.998239 18175 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:01.025149 18175 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:01.026698 18175 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:01.039290 18175 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672: Generated new TSK 0
I20260709 13:08:01.040324 18175 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:01.051460 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:01.061391 18184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:01.064251 18185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:01.066164 18187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:01.066262 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:01.067327 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:01.067550 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:01.067755 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602481067716 us; error 0 us; skew 500 ppm
I20260709 13:08:01.068513 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:01.073381 18095 webserver.cc:533] Webserver started at http://127.17.171.193:40053/ using document root <none> and password file <none>
I20260709 13:08:01.073971 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:01.074194 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:01.074508 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:01.075719 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "5af6d976d1874d58acb6fe33e020d9fa"
format_stamp: "Formatted at 2026-07-09 13:08:01 on dist-test-slave-jhlz"
I20260709 13:08:01.082198 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:08:01.086616 18192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.087484 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:08:01.087781 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "5af6d976d1874d58acb6fe33e020d9fa"
format_stamp: "Formatted at 2026-07-09 13:08:01 on dist-test-slave-jhlz"
I20260709 13:08:01.088071 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:01.119257 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:01.120705 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:01.123467 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:01.127952 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:01.128222 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.128504 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:01.128679 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.236430 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:46679
I20260709 13:08:01.236519 18254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:46679 every 8 connection(s)
I20260709 13:08:01.243006 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:01.252002 18259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:01.257786 18260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:01.263238 18095 server_base.cc:1061] running on GCE node
W20260709 13:08:01.264715 18262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:01.265992 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:01.266314 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:01.266575 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602481266555 us; error 0 us; skew 500 ppm
I20260709 13:08:01.267422 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:01.270555 18095 webserver.cc:533] Webserver started at http://127.17.171.194:44379/ using document root <none> and password file <none>
I20260709 13:08:01.271091 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:01.271313 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:01.271595 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:01.272855 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "78532212afad4c71a99eead028712ce7"
format_stamp: "Formatted at 2026-07-09 13:08:01 on dist-test-slave-jhlz"
I20260709 13:08:01.279261 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:08:01.280486 18255 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34923
I20260709 13:08:01.281019 18255 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:01.282347 18255 heartbeater.cc:507] Master 127.17.171.254:34923 requested a full tablet report, sending...
I20260709 13:08:01.284767 18267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.285734 18095 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:01.286073 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "78532212afad4c71a99eead028712ce7"
format_stamp: "Formatted at 2026-07-09 13:08:01 on dist-test-slave-jhlz"
I20260709 13:08:01.286078 18127 ts_manager.cc:194] Registered new tserver with Master: 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679)
I20260709 13:08:01.286522 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:01.289310 18127 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47722
I20260709 13:08:01.314853 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:01.316246 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:01.318385 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:01.321319 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:01.321547 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.321790 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:01.321964 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.421286 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:38475
I20260709 13:08:01.421568 18329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:38475 every 8 connection(s)
I20260709 13:08:01.430469 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:01.440804 18333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:01.442147 18334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:01.444767 18330 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34923
I20260709 13:08:01.445281 18330 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:01.446336 18330 heartbeater.cc:507] Master 127.17.171.254:34923 requested a full tablet report, sending...
I20260709 13:08:01.448869 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:01.448979 18127 ts_manager.cc:194] Registered new tserver with Master: 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
W20260709 13:08:01.449977 18336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:01.450798 18127 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47736
I20260709 13:08:01.451197 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:01.451462 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:01.451705 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602481451655 us; error 0 us; skew 500 ppm
I20260709 13:08:01.452385 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:01.455041 18095 webserver.cc:533] Webserver started at http://127.17.171.195:41357/ using document root <none> and password file <none>
I20260709 13:08:01.455519 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:01.455755 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:01.456077 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:01.457185 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "574c0ab2f96d46239c0186b0420a508c"
format_stamp: "Formatted at 2026-07-09 13:08:01 on dist-test-slave-jhlz"
I20260709 13:08:01.461647 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:01.465410 18341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.466241 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:08:01.466626 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "574c0ab2f96d46239c0186b0420a508c"
format_stamp: "Formatted at 2026-07-09 13:08:01 on dist-test-slave-jhlz"
I20260709 13:08:01.466935 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:01.493212 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:01.494438 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:01.495944 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:01.499182 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:01.499416 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.499660 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:01.499835 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:01.596314 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:46815
I20260709 13:08:01.596413 18403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:46815 every 8 connection(s)
I20260709 13:08:01.612007 18404 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34923
I20260709 13:08:01.612489 18404 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:01.613232 18404 heartbeater.cc:507] Master 127.17.171.254:34923 requested a full tablet report, sending...
I20260709 13:08:01.615170 18127 ts_manager.cc:194] Registered new tserver with Master: 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:01.615820 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014550952s
I20260709 13:08:01.616838 18127 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47746
I20260709 13:08:01.666242 18127 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47750:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:01.670166 18127 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:01.784834 18218 tablet_service.cc:1511] Processing CreateTablet for tablet ac392caf8dad4e2fa3fe4bd7ffcb0fc2 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:01.786319 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac392caf8dad4e2fa3fe4bd7ffcb0fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.788743 18216 tablet_service.cc:1511] Processing CreateTablet for tablet 86b8faf5fcbf4e35856a31cd33baca9f (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:01.790076 18216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b8faf5fcbf4e35856a31cd33baca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.781840 18220 tablet_service.cc:1511] Processing CreateTablet for tablet fd9aaace24754ef08e62b6313f80cf79 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:01.805051 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9aaace24754ef08e62b6313f80cf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.805029 18217 tablet_service.cc:1511] Processing CreateTablet for tablet 304e93d7ec69495db351f759ef2d52a5 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:01.810503 18365 tablet_service.cc:1511] Processing CreateTablet for tablet 86b8faf5fcbf4e35856a31cd33baca9f (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:01.810601 18361 tablet_service.cc:1511] Processing CreateTablet for tablet a1cadefea8f54dd1b0ae5ba0ba5403e6 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:01.805512 18367 tablet_service.cc:1511] Processing CreateTablet for tablet ac392caf8dad4e2fa3fe4bd7ffcb0fc2 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:01.815546 18217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e93d7ec69495db351f759ef2d52a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.806663 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 84f6ef153aae4eecb1a6c532a62a81de (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:01.808976 18369 tablet_service.cc:1511] Processing CreateTablet for tablet fd9aaace24754ef08e62b6313f80cf79 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:01.813843 18213 tablet_service.cc:1511] Processing CreateTablet for tablet 0626539e0a7b41cf8d3513475a664cc7 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:01.809100 18362 tablet_service.cc:1511] Processing CreateTablet for tablet 0626539e0a7b41cf8d3513475a664cc7 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:01.812247 18363 tablet_service.cc:1511] Processing CreateTablet for tablet 706deafc69804f33ab880b1f5b079eb7 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:01.818324 18364 tablet_service.cc:1511] Processing CreateTablet for tablet 3db8187e72dd4f5a8e719ef7452c0891 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:01.814844 18214 tablet_service.cc:1511] Processing CreateTablet for tablet 706deafc69804f33ab880b1f5b079eb7 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:01.814814 18366 tablet_service.cc:1511] Processing CreateTablet for tablet 304e93d7ec69495db351f759ef2d52a5 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:01.823076 18214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706deafc69804f33ab880b1f5b079eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.825806 18365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b8faf5fcbf4e35856a31cd33baca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.822746 18212 tablet_service.cc:1511] Processing CreateTablet for tablet a1cadefea8f54dd1b0ae5ba0ba5403e6 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:01.814028 18368 tablet_service.cc:1511] Processing CreateTablet for tablet 84f6ef153aae4eecb1a6c532a62a81de (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:01.830982 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f6ef153aae4eecb1a6c532a62a81de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.834533 18213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0626539e0a7b41cf8d3513475a664cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.825325 18215 tablet_service.cc:1511] Processing CreateTablet for tablet 3db8187e72dd4f5a8e719ef7452c0891 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:01.837849 18295 tablet_service.cc:1511] Processing CreateTablet for tablet fd9aaace24754ef08e62b6313f80cf79 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:01.840296 18294 tablet_service.cc:1511] Processing CreateTablet for tablet 84f6ef153aae4eecb1a6c532a62a81de (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:01.841763 18212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cadefea8f54dd1b0ae5ba0ba5403e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.846328 18292 tablet_service.cc:1511] Processing CreateTablet for tablet 304e93d7ec69495db351f759ef2d52a5 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:01.849004 18291 tablet_service.cc:1511] Processing CreateTablet for tablet 86b8faf5fcbf4e35856a31cd33baca9f (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:01.862318 18290 tablet_service.cc:1511] Processing CreateTablet for tablet 3db8187e72dd4f5a8e719ef7452c0891 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:01.842639 18293 tablet_service.cc:1511] Processing CreateTablet for tablet ac392caf8dad4e2fa3fe4bd7ffcb0fc2 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:01.865043 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9aaace24754ef08e62b6313f80cf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.868419 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac392caf8dad4e2fa3fe4bd7ffcb0fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.877501 18366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e93d7ec69495db351f759ef2d52a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.883788 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac392caf8dad4e2fa3fe4bd7ffcb0fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.889652 18362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0626539e0a7b41cf8d3513475a664cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.874084 18215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db8187e72dd4f5a8e719ef7452c0891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.893011 18364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db8187e72dd4f5a8e719ef7452c0891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.899551 18361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cadefea8f54dd1b0ae5ba0ba5403e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.901679 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f6ef153aae4eecb1a6c532a62a81de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.903712 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f6ef153aae4eecb1a6c532a62a81de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.904964 18363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706deafc69804f33ab880b1f5b079eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.909329 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd9aaace24754ef08e62b6313f80cf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.916956 18291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b8faf5fcbf4e35856a31cd33baca9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.928777 18292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e93d7ec69495db351f759ef2d52a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.945297 18290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db8187e72dd4f5a8e719ef7452c0891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.005681 18289 tablet_service.cc:1511] Processing CreateTablet for tablet 706deafc69804f33ab880b1f5b079eb7 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:02.007099 18289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706deafc69804f33ab880b1f5b079eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.043356 18288 tablet_service.cc:1511] Processing CreateTablet for tablet 0626539e0a7b41cf8d3513475a664cc7 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:02.044911 18288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0626539e0a7b41cf8d3513475a664cc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:02.062196 18174 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:02.073783 18287 tablet_service.cc:1511] Processing CreateTablet for tablet a1cadefea8f54dd1b0ae5ba0ba5403e6 (DEFAULT_TABLE table=test-workload [id=e69d4cef73d242518525e0f0f47022e6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:02.075776 18287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1cadefea8f54dd1b0ae5ba0ba5403e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.125270 18422 tablet_bootstrap.cc:492] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.139467 18423 tablet_bootstrap.cc:492] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.191583 18422 tablet_bootstrap.cc:654] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.195943 18424 tablet_bootstrap.cc:492] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.201117 18423 tablet_bootstrap.cc:654] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.215708 18423 tablet_bootstrap.cc:492] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.217152 18423 ts_tablet_manager.cc:1403] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.006s
I20260709 13:08:02.218194 18422 tablet_bootstrap.cc:492] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.218616 18422 ts_tablet_manager.cc:1403] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.000s
I20260709 13:08:02.222767 18422 raft_consensus.cc:359] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.223045 18423 raft_consensus.cc:359] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.223553 18422 raft_consensus.cc:385] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.223780 18423 raft_consensus.cc:385] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.223918 18422 raft_consensus.cc:740] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.224184 18423 raft_consensus.cc:740] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.224676 18424 tablet_bootstrap.cc:654] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.225047 18423 consensus_queue.cc:260] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.225066 18422 consensus_queue.cc:260] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.234015 18423 ts_tablet_manager.cc:1434] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:08:02.234127 18424 tablet_bootstrap.cc:492] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.234859 18255 heartbeater.cc:499] Master 127.17.171.254:34923 was elected leader, sending a full tablet report...
I20260709 13:08:02.234918 18424 ts_tablet_manager.cc:1403] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.002s
I20260709 13:08:02.235160 18423 tablet_bootstrap.cc:492] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.242162 18423 tablet_bootstrap.cc:654] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:02.245704 18256 tablet.cc:2406] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:02.253330 18404 heartbeater.cc:499] Master 127.17.171.254:34923 was elected leader, sending a full tablet report...
I20260709 13:08:02.253362 18423 tablet_bootstrap.cc:492] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.253916 18422 ts_tablet_manager.cc:1434] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.021s
I20260709 13:08:02.253996 18423 ts_tablet_manager.cc:1403] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:08:02.254853 18422 tablet_bootstrap.cc:492] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.257625 18423 raft_consensus.cc:359] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.258366 18423 raft_consensus.cc:385] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.258646 18423 raft_consensus.cc:740] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.259354 18423 consensus_queue.cc:260] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.261670 18423 ts_tablet_manager.cc:1434] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:02.261817 18422 tablet_bootstrap.cc:654] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.261377 18424 raft_consensus.cc:359] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.262633 18423 tablet_bootstrap.cc:492] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.263537 18424 raft_consensus.cc:385] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.263954 18424 raft_consensus.cc:740] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.265841 18424 consensus_queue.cc:260] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.270401 18423 tablet_bootstrap.cc:654] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.280308 18330 heartbeater.cc:499] Master 127.17.171.254:34923 was elected leader, sending a full tablet report...
I20260709 13:08:02.282435 18424 ts_tablet_manager.cc:1434] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.005s
I20260709 13:08:02.283389 18424 tablet_bootstrap.cc:492] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.288781 18427 raft_consensus.cc:493] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.289386 18427 raft_consensus.cc:515] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.294683 18427 leader_election.cc:290] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.309783 18422 tablet_bootstrap.cc:492] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.310302 18422 ts_tablet_manager.cc:1403] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.005s
I20260709 13:08:02.313097 18422 raft_consensus.cc:359] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.313804 18422 raft_consensus.cc:385] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.314079 18422 raft_consensus.cc:740] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.314769 18422 consensus_queue.cc:260] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.320387 18423 tablet_bootstrap.cc:492] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.320575 18422 ts_tablet_manager.cc:1434] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:08:02.320894 18423 ts_tablet_manager.cc:1403] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.026s
I20260709 13:08:02.324862 18424 tablet_bootstrap.cc:654] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.327823 18423 raft_consensus.cc:359] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.328625 18423 raft_consensus.cc:385] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.328958 18423 raft_consensus.cc:740] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.329725 18423 consensus_queue.cc:260] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.332069 18423 ts_tablet_manager.cc:1434] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:02.332959 18423 tablet_bootstrap.cc:492] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.343521 18422 tablet_bootstrap.cc:492] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.344111 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.343429 18424 tablet_bootstrap.cc:492] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.345978 18424 ts_tablet_manager.cc:1403] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.000s
I20260709 13:08:02.350834 18422 tablet_bootstrap.cc:654] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:02.346190 18195 leader_election.cc:343] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.353998 18423 tablet_bootstrap.cc:654] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.349789 18424 raft_consensus.cc:359] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.357723 18424 raft_consensus.cc:385] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.358088 18424 raft_consensus.cc:740] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.358209 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:02.359115 18424 consensus_queue.cc:260] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
W20260709 13:08:02.359866 18195 leader_election.cc:343] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.360416 18195 leader_election.cc:304] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa; no voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7
I20260709 13:08:02.361228 18427 raft_consensus.cc:2749] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:02.362103 18424 ts_tablet_manager.cc:1434] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:02.363095 18422 tablet_bootstrap.cc:492] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.363587 18422 ts_tablet_manager.cc:1403] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.007s
I20260709 13:08:02.363767 18424 tablet_bootstrap.cc:492] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.369529 18422 raft_consensus.cc:359] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.370893 18423 tablet_bootstrap.cc:492] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.371305 18423 ts_tablet_manager.cc:1403] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.005s
I20260709 13:08:02.372849 18424 tablet_bootstrap.cc:654] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.370325 18422 raft_consensus.cc:385] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.374337 18422 raft_consensus.cc:740] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.373999 18423 raft_consensus.cc:359] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.374819 18423 raft_consensus.cc:385] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.375151 18423 raft_consensus.cc:740] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.375111 18422 consensus_queue.cc:260] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.376021 18423 consensus_queue.cc:260] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.378813 18423 ts_tablet_manager.cc:1434] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:02.382050 18423 tablet_bootstrap.cc:492] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.386554 18424 tablet_bootstrap.cc:492] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.387104 18424 ts_tablet_manager.cc:1403] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 13:08:02.387916 18423 tablet_bootstrap.cc:654] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.377395 18422 ts_tablet_manager.cc:1434] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:08:02.391690 18422 tablet_bootstrap.cc:492] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.395149 18432 raft_consensus.cc:493] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.395641 18432 raft_consensus.cc:515] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.398355 18424 raft_consensus.cc:359] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.404313 18424 raft_consensus.cc:385] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.404597 18422 tablet_bootstrap.cc:654] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.404677 18424 raft_consensus.cc:740] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.405761 18424 consensus_queue.cc:260] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.407420 18432 leader_election.cc:290] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.466038 18424 ts_tablet_manager.cc:1434] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.079s	user 0.011s	sys 0.024s
I20260709 13:08:02.467392 18424 tablet_bootstrap.cc:492] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.473667 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.474481 18230 raft_consensus.cc:2468] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 0.
I20260709 13:08:02.476016 18271 leader_election.cc:304] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.477061 18445 raft_consensus.cc:2804] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.477630 18445 raft_consensus.cc:493] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.480301 18445 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.483016 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
W20260709 13:08:02.484599 18270 leader_election.cc:343] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.487241 18424 tablet_bootstrap.cc:654] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.493041 18445 raft_consensus.cc:515] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.494890 18422 tablet_bootstrap.cc:492] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.495352 18422 ts_tablet_manager.cc:1403] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.104s	user 0.040s	sys 0.056s
I20260709 13:08:02.496245 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:02.496796 18230 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.498258 18422 raft_consensus.cc:359] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.498961 18422 raft_consensus.cc:385] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.499264 18422 raft_consensus.cc:740] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.502877 18423 tablet_bootstrap.cc:492] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.503336 18423 ts_tablet_manager.cc:1403] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.121s	user 0.028s	sys 0.044s
I20260709 13:08:02.506095 18230 raft_consensus.cc:2468] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 1.
I20260709 13:08:02.506297 18423 raft_consensus.cc:359] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.507104 18423 raft_consensus.cc:385] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.507400 18423 raft_consensus.cc:740] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.507551 18271 leader_election.cc:304] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.508458 18432 raft_consensus.cc:2804] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:02.508085 18423 consensus_queue.cc:260] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.499939 18422 consensus_queue.cc:260] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.510624 18423 ts_tablet_manager.cc:1434] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:02.510851 18422 ts_tablet_manager.cc:1434] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:02.511703 18423 tablet_bootstrap.cc:492] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.512068 18422 tablet_bootstrap.cc:492] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.518443 18423 tablet_bootstrap.cc:654] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.519259 18424 tablet_bootstrap.cc:492] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.519699 18424 ts_tablet_manager.cc:1403] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.022s
I20260709 13:08:02.522554 18424 raft_consensus.cc:359] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.523298 18424 raft_consensus.cc:385] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.523593 18424 raft_consensus.cc:740] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.524778 18422 tablet_bootstrap.cc:654] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.524295 18424 consensus_queue.cc:260] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.530267 18423 tablet_bootstrap.cc:492] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.530718 18423 ts_tablet_manager.cc:1403] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:08:02.536034 18423 raft_consensus.cc:359] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.536769 18423 raft_consensus.cc:385] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.537050 18423 raft_consensus.cc:740] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.537681 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:02.537714 18423 consensus_queue.cc:260] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.539419 18424 ts_tablet_manager.cc:1434] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.019s	user 0.017s	sys 0.001s
W20260709 13:08:02.539845 18270 leader_election.cc:343] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.541326 18423 ts_tablet_manager.cc:1434] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:02.542122 18422 tablet_bootstrap.cc:492] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.542261 18423 tablet_bootstrap.cc:492] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.542560 18422 ts_tablet_manager.cc:1403] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 13:08:02.543826 18427 raft_consensus.cc:493] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.544284 18427 raft_consensus.cc:515] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.545356 18422 raft_consensus.cc:359] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.546049 18422 raft_consensus.cc:385] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.546331 18422 raft_consensus.cc:740] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.546844 18427 leader_election.cc:290] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.547039 18422 consensus_queue.cc:260] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.547435 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.548045 18305 raft_consensus.cc:2468] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 0.
I20260709 13:08:02.549707 18422 ts_tablet_manager.cc:1434] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:02.549502 18195 leader_election.cc:304] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.550324 18427 raft_consensus.cc:2804] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.550614 18422 tablet_bootstrap.cc:492] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.550661 18427 raft_consensus.cc:493] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.550669 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:02.551177 18427 raft_consensus.cc:3060] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.551397 18379 raft_consensus.cc:2468] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 0.
I20260709 13:08:02.548069 18424 tablet_bootstrap.cc:492] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.557942 18427 raft_consensus.cc:515] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.559842 18427 leader_election.cc:290] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.562619 18423 tablet_bootstrap.cc:654] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.562894 18424 tablet_bootstrap.cc:654] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.563802 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:02.564384 18305 raft_consensus.cc:3060] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.566738 18422 tablet_bootstrap.cc:654] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.568286 18427 raft_consensus.cc:493] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.568668 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:02.568732 18427 raft_consensus.cc:515] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.569335 18379 raft_consensus.cc:3060] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.570806 18427 leader_election.cc:290] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.574201 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
W20260709 13:08:02.575702 18195 leader_election.cc:343] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.576232 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
W20260709 13:08:02.578228 18195 leader_election.cc:343] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.578895 18195 leader_election.cc:304] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa; no voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7
I20260709 13:08:02.579885 18427 raft_consensus.cc:2749] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:02.585063 18424 tablet_bootstrap.cc:492] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.585539 18424 ts_tablet_manager.cc:1403] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.009s
I20260709 13:08:02.588464 18424 raft_consensus.cc:359] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.589226 18424 raft_consensus.cc:385] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.589515 18424 raft_consensus.cc:740] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.590518 18422 tablet_bootstrap.cc:492] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.590220 18424 consensus_queue.cc:260] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.590958 18422 ts_tablet_manager.cc:1403] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.007s
I20260709 13:08:02.593775 18423 tablet_bootstrap.cc:492] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.593626 18422 raft_consensus.cc:359] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.594264 18423 ts_tablet_manager.cc:1403] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.002s
I20260709 13:08:02.594277 18422 raft_consensus.cc:385] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.594735 18422 raft_consensus.cc:740] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.595388 18422 consensus_queue.cc:260] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.597244 18423 raft_consensus.cc:359] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.597760 18422 ts_tablet_manager.cc:1434] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:02.597959 18423 raft_consensus.cc:385] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.598317 18423 raft_consensus.cc:740] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.598757 18422 tablet_bootstrap.cc:492] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.599009 18423 consensus_queue.cc:260] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.601614 18424 ts_tablet_manager.cc:1434] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:02.602566 18424 tablet_bootstrap.cc:492] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.605013 18428 raft_consensus.cc:493] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.605495 18428 raft_consensus.cc:515] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.587447 18305 raft_consensus.cc:2468] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 1.
I20260709 13:08:02.606228 18445 leader_election.cc:290] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.609110 18423 ts_tablet_manager.cc:1434] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 13:08:02.610677 18195 leader_election.cc:304] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.613511 18427 raft_consensus.cc:2804] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:02.615012 18428 leader_election.cc:290] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:02.616575 18428 raft_consensus.cc:493] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.619180 18423 tablet_bootstrap.cc:492] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.623838 18422 tablet_bootstrap.cc:654] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.619935 18428 raft_consensus.cc:515] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.617664 18379 raft_consensus.cc:2468] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 1.
I20260709 13:08:02.641029 18428 leader_election.cc:290] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:02.644330 18432 raft_consensus.cc:697] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:02.650518 18424 tablet_bootstrap.cc:654] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.650534 18427 raft_consensus.cc:697] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:02.653477 18432 consensus_queue.cc:237] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.663360 18427 consensus_queue.cc:237] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.682106 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.682977 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.684144 18229 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 0.
I20260709 13:08:02.685369 18230 raft_consensus.cc:2393] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 574c0ab2f96d46239c0186b0420a508c in current term 1: Already voted for candidate 78532212afad4c71a99eead028712ce7 in this term.
I20260709 13:08:02.684983 18423 tablet_bootstrap.cc:654] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.694324 18345 leader_election.cc:304] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:02.695963 18455 raft_consensus.cc:2804] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.697117 18455 raft_consensus.cc:493] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.697582 18455 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.701148 18428 raft_consensus.cc:493] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.702016 18428 raft_consensus.cc:515] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.700889 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.705430 18448 raft_consensus.cc:493] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.705641 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.706506 18304 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 0.
I20260709 13:08:02.706198 18448 raft_consensus.cc:515] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.709939 18448 leader_election.cc:290] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.712126 18428 leader_election.cc:290] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:02.712572 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.711799 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:02.713861 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.714165 18344 leader_election.cc:304] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c; no voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7
I20260709 13:08:02.718251 18456 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.718375 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.718892 18456 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.714903 18428 raft_consensus.cc:493] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.722831 18345 leader_election.cc:343] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.717837 18379 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 0.
W20260709 13:08:02.724088 18271 leader_election.cc:343] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.726641 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
W20260709 13:08:02.728435 18195 leader_election.cc:343] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.722242 18428 raft_consensus.cc:515] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.729346 18270 leader_election.cc:304] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:02.732529 18448 raft_consensus.cc:2804] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.732929 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.733244 18456 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.733789 18229 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 0.
I20260709 13:08:02.734609 18428 leader_election.cc:290] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:02.735201 18428 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.735291 18345 leader_election.cc:304] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:02.733050 18448 raft_consensus.cc:493] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.736713 18455 raft_consensus.cc:515] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.744535 18448 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.751262 18422 tablet_bootstrap.cc:492] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.751748 18422 ts_tablet_manager.cc:1403] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.153s	user 0.027s	sys 0.026s
I20260709 13:08:02.763154 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:02.763031 18422 raft_consensus.cc:359] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.763808 18229 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.764019 18422 raft_consensus.cc:385] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:02.766264 18344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:38475, user_credentials={real_user=slave}} blocked reactor thread for 52615.1us
I20260709 13:08:02.766603 18464 raft_consensus.cc:2804] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.765370 18455 leader_election.cc:290] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:02.769762 18424 tablet_bootstrap.cc:492] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.769767 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.767325 18422 raft_consensus.cc:740] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.770378 18424 ts_tablet_manager.cc:1403] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.168s	user 0.023s	sys 0.038s
I20260709 13:08:02.770768 18304 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 0.
I20260709 13:08:02.770462 18464 raft_consensus.cc:493] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.773274 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:02.774317 18305 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.774650 18423 tablet_bootstrap.cc:492] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.775077 18423 ts_tablet_manager.cc:1403] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.022s
I20260709 13:08:02.775887 18422 consensus_queue.cc:260] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.777108 18229 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 1.
I20260709 13:08:02.778244 18422 ts_tablet_manager.cc:1434] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:08:02.778319 18345 leader_election.cc:304] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:02.779163 18422 tablet_bootstrap.cc:492] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.781265 18455 raft_consensus.cc:2804] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:02.781863 18455 raft_consensus.cc:697] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:02.777892 18423 raft_consensus.cc:359] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.784598 18423 raft_consensus.cc:385] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.784992 18423 raft_consensus.cc:740] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.773423 18464 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.780475 18448 raft_consensus.cc:515] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.782127 18305 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 1.
I20260709 13:08:02.787537 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:02.787892 18423 consensus_queue.cc:260] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
W20260709 13:08:02.787388 18344 leader_election.cc:343] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.791250 18423 ts_tablet_manager.cc:1434] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:02.789958 18344 leader_election.cc:304] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c; no voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7
I20260709 13:08:02.792127 18423 tablet_bootstrap.cc:492] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: Bootstrap starting.
I20260709 13:08:02.789680 18455 consensus_queue.cc:237] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.794590 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:02.795715 18465 raft_consensus.cc:2749] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:02.795645 18195 leader_election.cc:343] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:02.795243 18229 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.796066 18424 raft_consensus.cc:359] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.796439 18195 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa; no voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7
I20260709 13:08:02.796844 18424 raft_consensus.cc:385] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.797798 18427 raft_consensus.cc:2749] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:02.798249 18428 raft_consensus.cc:2749] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:02.798199 18424 raft_consensus.cc:740] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.800993 18424 consensus_queue.cc:260] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.799397 18448 leader_election.cc:290] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.803555 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:02.804100 18379 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.804440 18424 ts_tablet_manager.cc:1434] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:08:02.805365 18424 tablet_bootstrap.cc:492] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.807297 18229 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 1.
I20260709 13:08:02.808645 18271 leader_election.cc:304] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.814788 18448 raft_consensus.cc:2804] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:02.816110 18424 tablet_bootstrap.cc:654] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.816695 18448 raft_consensus.cc:697] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:02.819372 18448 consensus_queue.cc:237] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.818516 18379 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 1.
I20260709 13:08:02.821736 18126 catalog_manager.cc:5697] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 1 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.826288 18423 tablet_bootstrap.cc:654] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.828698 18422 tablet_bootstrap.cc:654] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.829847 18127 catalog_manager.cc:5697] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 0 to 1, leader changed from <none> to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 1 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.833699 18464 raft_consensus.cc:515] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.839818 18464 leader_election.cc:290] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:02.840827 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:02.841127 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:02.841395 18229 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.841681 18305 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.847714 18305 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 1.
I20260709 13:08:02.847714 18229 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 1.
I20260709 13:08:02.855908 18344 leader_election.cc:304] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.856761 18464 raft_consensus.cc:2804] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:02.857415 18464 raft_consensus.cc:697] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:02.858887 18464 consensus_queue.cc:237] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.860471 18423 tablet_bootstrap.cc:492] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: No bootstrap required, opened a new log
I20260709 13:08:02.860909 18423 ts_tablet_manager.cc:1403] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 13:08:02.861187 18422 tablet_bootstrap.cc:492] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.861766 18422 ts_tablet_manager.cc:1403] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.006s
I20260709 13:08:02.863932 18423 raft_consensus.cc:359] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.864655 18423 raft_consensus.cc:385] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.864940 18423 raft_consensus.cc:740] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.865036 18422 raft_consensus.cc:359] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.865985 18422 raft_consensus.cc:385] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.865643 18423 consensus_queue.cc:260] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.866335 18422 raft_consensus.cc:740] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.867168 18422 consensus_queue.cc:260] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.868490 18423 ts_tablet_manager.cc:1434] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:02.870333 18422 ts_tablet_manager.cc:1434] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:08:02.870741 18424 tablet_bootstrap.cc:492] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.871249 18424 ts_tablet_manager.cc:1403] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.014s
I20260709 13:08:02.871510 18422 tablet_bootstrap.cc:492] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: Bootstrap starting.
I20260709 13:08:02.874486 18424 raft_consensus.cc:359] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.875162 18424 raft_consensus.cc:385] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.875505 18424 raft_consensus.cc:740] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.876344 18424 consensus_queue.cc:260] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.878752 18424 ts_tablet_manager.cc:1434] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:02.879688 18424 tablet_bootstrap.cc:492] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.882745 18422 tablet_bootstrap.cc:654] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.885964 18424 tablet_bootstrap.cc:654] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.899467 18422 tablet_bootstrap.cc:492] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: No bootstrap required, opened a new log
I20260709 13:08:02.900084 18422 ts_tablet_manager.cc:1403] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:08:02.901933 18424 tablet_bootstrap.cc:492] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.902356 18424 ts_tablet_manager.cc:1403] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:08:02.903754 18422 raft_consensus.cc:359] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.904652 18422 raft_consensus.cc:385] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.904997 18422 raft_consensus.cc:740] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.905265 18424 raft_consensus.cc:359] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.906143 18424 raft_consensus.cc:385] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.906425 18424 raft_consensus.cc:740] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.905912 18422 consensus_queue.cc:260] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.907398 18424 consensus_queue.cc:260] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.908609 18422 ts_tablet_manager.cc:1434] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:02.909569 18424 ts_tablet_manager.cc:1434] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:02.910405 18424 tablet_bootstrap.cc:492] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: Bootstrap starting.
I20260709 13:08:02.915880 18424 tablet_bootstrap.cc:654] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:02.916887 18125 catalog_manager.cc:5697] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.931546 18424 tablet_bootstrap.cc:492] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: No bootstrap required, opened a new log
I20260709 13:08:02.931986 18424 ts_tablet_manager.cc:1403] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 13:08:02.934521 18424 raft_consensus.cc:359] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.935148 18424 raft_consensus.cc:385] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:02.935410 18424 raft_consensus.cc:740] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Initialized, Role: FOLLOWER
I20260709 13:08:02.936031 18424 consensus_queue.cc:260] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.938170 18424 ts_tablet_manager.cc:1434] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:02.937789 18127 catalog_manager.cc:5697] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 0 to 1, leader changed from <none> to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 1 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.950552 18125 catalog_manager.cc:5697] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.960319 18448 raft_consensus.cc:493] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.960739 18448 raft_consensus.cc:515] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.962376 18448 leader_election.cc:290] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.963066 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:02.963670 18229 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 0.
I20260709 13:08:02.964217 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:02.964828 18379 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 0.
I20260709 13:08:02.964890 18271 leader_election.cc:304] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.965771 18448 raft_consensus.cc:2804] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.966110 18448 raft_consensus.cc:493] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.966362 18448 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.970959 18427 raft_consensus.cc:493] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.971426 18427 raft_consensus.cc:515] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.971683 18448 raft_consensus.cc:515] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.973419 18427 leader_election.cc:290] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.974298 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:02.974486 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:02.974948 18379 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.975108 18378 raft_consensus.cc:2468] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 0.
I20260709 13:08:02.977484 18195 leader_election.cc:304] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:02.974486 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:02.978631 18305 raft_consensus.cc:2468] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 0.
I20260709 13:08:02.980301 18427 raft_consensus.cc:2804] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:02.980661 18427 raft_consensus.cc:493] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.980980 18427 raft_consensus.cc:3060] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.982440 18379 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 1.
I20260709 13:08:02.984361 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:02.984908 18229 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.987758 18427 raft_consensus.cc:515] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.988888 18270 leader_election.cc:304] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:02.989588 18432 raft_consensus.cc:2804] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:02.990067 18432 raft_consensus.cc:697] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:02.990991 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:02.991075 18229 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 1.
I20260709 13:08:02.990846 18432 consensus_queue.cc:237] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.991587 18305 raft_consensus.cc:3060] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:02.994760 18448 leader_election.cc:290] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.995710 18456 raft_consensus.cc:493] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.996196 18456 raft_consensus.cc:515] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:02.997756 18427 leader_election.cc:290] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.998063 18456 leader_election.cc:290] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:02.999234 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:03.000090 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.000452 18304 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 0.
I20260709 13:08:03.000698 18379 raft_consensus.cc:3060] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.000267 18125 catalog_manager.cc:5697] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.002810 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:03.003374 18378 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 0.
I20260709 13:08:03.004588 18195 leader_election.cc:304] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:03.006111 18456 raft_consensus.cc:2804] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:03.006487 18456 raft_consensus.cc:493] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.006793 18456 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.007786 18379 raft_consensus.cc:2468] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 1.
I20260709 13:08:03.008865 18195 leader_election.cc:304] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:03.010696 18305 raft_consensus.cc:2468] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 1.
I20260709 13:08:03.012358 18427 raft_consensus.cc:2804] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:03.013484 18427 raft_consensus.cc:697] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.014441 18427 consensus_queue.cc:237] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.014546 18456 raft_consensus.cc:515] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.017141 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.017683 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.018429 18379 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.018462 18305 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.025056 18379 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 1.
I20260709 13:08:03.018128 18456 leader_election.cc:290] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.026239 18195 leader_election.cc:304] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:03.027458 18305 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 1.
I20260709 13:08:03.027947 18456 raft_consensus.cc:2804] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:03.028566 18456 raft_consensus.cc:697] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.029394 18456 consensus_queue.cc:237] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.030639 18125 catalog_manager.cc:5697] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 1 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.044787 18125 catalog_manager.cc:5697] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 1 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:03.064939 18174 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:03.065243 18448 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.065953 18464 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.065737 18448 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.066385 18464 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.067803 18448 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.068128 18464 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:03.069335 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:03.069339 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7" is_pre_election: true
I20260709 13:08:03.070058 18229 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 0.
I20260709 13:08:03.070381 18305 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 0.
I20260709 13:08:03.071449 18271 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.072443 18448 raft_consensus.cc:2804] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:03.072780 18448 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.073120 18448 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.072913 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa" is_pre_election: true
I20260709 13:08:03.072942 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c" is_pre_election: true
I20260709 13:08:03.073719 18344 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.074065 18379 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 0.
I20260709 13:08:03.073720 18229 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 0.
I20260709 13:08:03.075338 18464 raft_consensus.cc:2804] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:03.075687 18464 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.076020 18464 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.077561 18456 consensus_queue.cc:1048] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.080360 18448 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.084183 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:03.084760 18229 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.085230 18464 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.085523 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.085925 18448 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.086748 18379 raft_consensus.cc:2393] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 78532212afad4c71a99eead028712ce7 in current term 1: Already voted for candidate 574c0ab2f96d46239c0186b0420a508c in this term.
I20260709 13:08:03.090258 18464 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:03.091140 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:03.091228 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.091996 18305 raft_consensus.cc:2393] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 574c0ab2f96d46239c0186b0420a508c in current term 1: Already voted for candidate 78532212afad4c71a99eead028712ce7 in this term.
I20260709 13:08:03.093129 18344 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c; no voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7
I20260709 13:08:03.095254 18229 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 1.
I20260709 13:08:03.096827 18271 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 574c0ab2f96d46239c0186b0420a508c
I20260709 13:08:03.095749 18464 raft_consensus.cc:2749] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:03.097922 18448 raft_consensus.cc:2804] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:03.098387 18448 raft_consensus.cc:697] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.099346 18448 consensus_queue.cc:237] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.104151 18481 consensus_queue.cc:1048] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.118580 18127 catalog_manager.cc:5697] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.132654 18448 consensus_queue.cc:1048] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.145573 18445 consensus_queue.cc:1048] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.235046 18445 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.241088 18464 consensus_queue.cc:1048] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.251384 18450 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.272686 18464 consensus_queue.cc:1048] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.298288 18304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:08:03.298931 18304 raft_consensus.cc:606] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:03.304862 18304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:08:03.305336 18304 raft_consensus.cc:606] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:03.309911 18304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:38026
I20260709 13:08:03.310390 18304 raft_consensus.cc:606] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:03.323087 18379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:51080
I20260709 13:08:03.323619 18379 raft_consensus.cc:606] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:03.328614 18379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:51080
I20260709 13:08:03.329094 18379 raft_consensus.cc:606] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:03.343426 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:03.344041 18229 raft_consensus.cc:606] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:03.349270 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:03.349852 18229 raft_consensus.cc:606] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:03.359033 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:03.359607 18229 raft_consensus.cc:606] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Received request to transfer leadership to TS 574c0ab2f96d46239c0186b0420a508c
I20260709 13:08:03.438733 18464 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.445576 18450 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.452507 18428 raft_consensus.cc:993] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.453114 18465 raft_consensus.cc:1081] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.461699 18464 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.462838 18229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:08:03.463524 18229 raft_consensus.cc:493] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.463910 18229 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.469506 18445 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.470629 18229 raft_consensus.cc:515] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.472679 18229 leader_election.cc:290] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.474846 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.475394 18305 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.476792 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.477397 18378 raft_consensus.cc:3055] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.477751 18378 raft_consensus.cc:740] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:03.478600 18378 consensus_queue.cc:260] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.479839 18378 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.482404 18305 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.482422 18481 consensus_queue.cc:1048] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.483186 18304 raft_consensus.cc:1240] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Rejecting Update request from peer 574c0ab2f96d46239c0186b0420a508c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:03.490502 18195 leader_election.cc:304] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.491288 18481 raft_consensus.cc:2804] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.491772 18481 raft_consensus.cc:697] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.492622 18481 consensus_queue.cc:237] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.494309 18378 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.500965 18126 catalog_manager.cc:5697] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 1 to 2, leader changed from 574c0ab2f96d46239c0186b0420a508c (127.17.171.195) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 2 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.501629 18456 consensus_queue.cc:1048] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.506958 18456 consensus_queue.cc:1048] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:03.525506 18456 raft_consensus.cc:993] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:03.525943 18456 raft_consensus.cc:1081] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:03.527693 18304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:37998
I20260709 13:08:03.528260 18304 raft_consensus.cc:493] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.528620 18304 raft_consensus.cc:3060] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.535435 18304 raft_consensus.cc:515] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.536144 18427 consensus_queue.cc:1048] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.538277 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:03.538847 18230 raft_consensus.cc:3055] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.539170 18230 raft_consensus.cc:740] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.539913 18230 consensus_queue.cc:260] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.541090 18230 raft_consensus.cc:3060] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.545137 18445 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.556337 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db8187e72dd4f5a8e719ef7452c0891" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.556962 18378 raft_consensus.cc:3060] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.558707 18304 leader_election.cc:290] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 2 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.561035 18456 raft_consensus.cc:993] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:03.561456 18456 raft_consensus.cc:1081] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:03.563683 18378 raft_consensus.cc:2468] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 2.
I20260709 13:08:03.569043 18230 raft_consensus.cc:2468] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 2.
I20260709 13:08:03.570350 18448 raft_consensus.cc:993] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.570765 18448 raft_consensus.cc:1081] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.571931 18270 leader_election.cc:304] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.572886 18432 raft_consensus.cc:2804] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.573387 18432 raft_consensus.cc:697] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.573928 18304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:37998
I20260709 13:08:03.574599 18304 raft_consensus.cc:493] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.575044 18304 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.574208 18432 consensus_queue.cc:237] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.578187 18230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:08:03.578737 18230 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.579087 18230 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.583097 18304 raft_consensus.cc:515] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.585130 18304 leader_election.cc:290] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 2 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.586110 18230 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.586536 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.587108 18378 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.588227 18432 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.588860 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:03.589443 18229 raft_consensus.cc:3055] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.589457 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.589886 18229 raft_consensus.cc:740] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.590143 18379 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.590698 18229 consensus_queue.cc:260] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.591143 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.591696 18305 raft_consensus.cc:3055] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.592015 18305 raft_consensus.cc:740] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.592847 18305 consensus_queue.cc:260] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.593753 18305 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.591886 18229 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.600044 18305 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.601558 18379 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.602350 18377 raft_consensus.cc:1240] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Rejecting Update request from peer 78532212afad4c71a99eead028712ce7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:03.603310 18229 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 2.
I20260709 13:08:03.603829 18195 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.604765 18481 raft_consensus.cc:2804] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.604648 18271 leader_election.cc:304] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.604985 18230 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.605249 18481 raft_consensus.cc:697] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.606089 18481 consensus_queue.cc:237] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.606583 18378 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 2.
I20260709 13:08:03.608275 18445 raft_consensus.cc:2804] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.609284 18445 raft_consensus.cc:697] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.610106 18445 consensus_queue.cc:237] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.613071 18127 catalog_manager.cc:5697] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 1 to 2, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.621605 18125 catalog_manager.cc:5697] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 1 to 2, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 2 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.626842 18127 catalog_manager.cc:5697] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 1 to 2, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.643999 18427 raft_consensus.cc:993] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:03.644485 18427 raft_consensus.cc:1081] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Signalling peer 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:03.645874 18378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:51060
I20260709 13:08:03.646338 18378 raft_consensus.cc:493] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.646643 18378 raft_consensus.cc:3060] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.651170 18378 raft_consensus.cc:515] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.652741 18378 leader_election.cc:290] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 2 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:03.653550 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:03.653824 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1cadefea8f54dd1b0ae5ba0ba5403e6" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.654138 18230 raft_consensus.cc:3055] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.654436 18305 raft_consensus.cc:3060] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.654482 18230 raft_consensus.cc:740] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.655355 18230 consensus_queue.cc:260] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.656584 18230 raft_consensus.cc:3060] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.659458 18305 raft_consensus.cc:2468] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 2.
I20260709 13:08:03.662932 18344 leader_election.cc:304] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.663441 18230 raft_consensus.cc:2468] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 2.
I20260709 13:08:03.663699 18465 raft_consensus.cc:2804] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.664825 18465 raft_consensus.cc:697] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:03.665661 18465 consensus_queue.cc:237] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.672325 18127 catalog_manager.cc:5697] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 1 to 2, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 2 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.717648 18445 raft_consensus.cc:993] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.718156 18432 raft_consensus.cc:1081] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.719560 18230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:08:03.720022 18230 raft_consensus.cc:493] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.720410 18230 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.725101 18445 raft_consensus.cc:993] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.725551 18432 raft_consensus.cc:1081] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:03.726730 18230 raft_consensus.cc:515] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.727111 18229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:08:03.727632 18229 raft_consensus.cc:493] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.727990 18229 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.729013 18465 raft_consensus.cc:993] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:03.729426 18465 raft_consensus.cc:1081] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:03.729590 18230 leader_election.cc:290] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.731067 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.731823 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:38012
I20260709 13:08:03.731904 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.732334 18378 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.732548 18304 raft_consensus.cc:3055] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.732540 18305 raft_consensus.cc:493] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.733685 18304 raft_consensus.cc:740] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.733827 18305 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.734138 18229 raft_consensus.cc:515] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.734496 18304 consensus_queue.cc:260] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.735708 18304 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.736718 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:03.737323 18303 raft_consensus.cc:3055] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.737614 18303 raft_consensus.cc:740] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.738360 18303 consensus_queue.cc:260] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.739452 18303 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.740799 18305 raft_consensus.cc:515] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.743604 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:03.744226 18230 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.745805 18303 raft_consensus.cc:2468] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.746421 18304 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.746838 18195 leader_election.cc:304] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.747632 18481 raft_consensus.cc:2804] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.748060 18481 raft_consensus.cc:697] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.748844 18481 consensus_queue.cc:237] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.749660 18305 leader_election.cc:290] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 2 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.750727 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.751276 18379 raft_consensus.cc:3055] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.751597 18379 raft_consensus.cc:740] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:03.752485 18230 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 2.
I20260709 13:08:03.752539 18379 consensus_queue.cc:260] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.753703 18379 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.755633 18195 leader_election.cc:304] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.756464 18481 raft_consensus.cc:2804] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.756970 18481 raft_consensus.cc:697] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:03.757795 18481 consensus_queue.cc:237] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.758430 18127 catalog_manager.cc:5697] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 1 to 2, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 2 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.759670 18379 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 2.
I20260709 13:08:03.753722 18271 leader_election.cc:304] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:03.761137 18432 raft_consensus.cc:2804] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.761967 18378 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.763924 18432 raft_consensus.cc:697] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:03.765115 18229 leader_election.cc:290] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 2 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:03.765237 18432 consensus_queue.cc:237] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:03.774452 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:03.775053 18379 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.776115 18127 catalog_manager.cc:5697] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 1 to 2, leader changed from 574c0ab2f96d46239c0186b0420a508c (127.17.171.195) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.776762 18125 catalog_manager.cc:5697] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 1 to 2, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 2 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.781319 18379 raft_consensus.cc:2468] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 2.
I20260709 13:08:03.982287 18379 raft_consensus.cc:1275] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.983640 18432 consensus_queue.cc:1048] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.991156 18229 raft_consensus.cc:1275] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.992779 18448 consensus_queue.cc:1048] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.011966 18303 raft_consensus.cc:1275] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.013062 18481 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.022226 18379 raft_consensus.cc:1275] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.023591 18427 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.033720 18379 raft_consensus.cc:1275] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.034852 18509 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.043834 18303 raft_consensus.cc:1275] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.044996 18481 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.086437 18379 raft_consensus.cc:1275] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.087591 18448 consensus_queue.cc:1048] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.094732 18229 raft_consensus.cc:1275] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.097049 18448 consensus_queue.cc:1048] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.122128 18229 raft_consensus.cc:1275] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.123272 18455 consensus_queue.cc:1048] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.132604 18303 raft_consensus.cc:1275] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.133865 18512 consensus_queue.cc:1048] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.220212 18303 raft_consensus.cc:1275] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.221361 18481 consensus_queue.cc:1048] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.229672 18379 raft_consensus.cc:1275] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.231325 18509 consensus_queue.cc:1048] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.321475 18379 raft_consensus.cc:1275] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.322764 18509 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.331185 18303 raft_consensus.cc:1275] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.332662 18427 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.378556 18379 raft_consensus.cc:1275] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.379799 18448 consensus_queue.cc:1048] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.383725 18229 raft_consensus.cc:1275] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:04.385216 18448 consensus_queue.cc:1048] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.391119 18095 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:08:06.391943 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:06.412214 18303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:38034
I20260709 13:08:06.412751 18303 raft_consensus.cc:606] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Received request to transfer leadership to TS 574c0ab2f96d46239c0186b0420a508c
I20260709 13:08:06.422837 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:52094
I20260709 13:08:06.423377 18229 raft_consensus.cc:606] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Received request to transfer leadership to TS 574c0ab2f96d46239c0186b0420a508c
I20260709 13:08:06.424579 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:06.425185 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:06.578550 18427 raft_consensus.cc:993] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:06.578975 18524 raft_consensus.cc:1081] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Signalling peer 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:06.580319 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:51060
I20260709 13:08:06.580749 18379 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.581017 18379 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.584838 18379 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:06.586369 18379 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 3 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:06.587169 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:06.587483 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:06.587766 18229 raft_consensus.cc:3055] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:06.588047 18303 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.588122 18229 raft_consensus.cc:740] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:06.588977 18229 consensus_queue.cc:260] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:06.589792 18229 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.592959 18303 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 3.
I20260709 13:08:06.593470 18305 raft_consensus.cc:1240] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Rejecting Update request from peer 5af6d976d1874d58acb6fe33e020d9fa for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:06.593950 18229 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 3.
I20260709 13:08:06.595065 18345 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:06.595829 18512 raft_consensus.cc:2804] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:06.596704 18512 raft_consensus.cc:697] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:06.597352 18512 consensus_queue.cc:237] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:06.603533 18127 catalog_manager.cc:5697] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 2 to 3, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 3 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.636562 18531 raft_consensus.cc:993] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: : Instructing follower 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:06.637032 18531 raft_consensus.cc:1081] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Signalling peer 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:06.638408 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:51070
I20260709 13:08:06.638849 18379 raft_consensus.cc:493] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.639155 18379 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.642886 18379 raft_consensus.cc:515] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:06.644500 18379 leader_election.cc:290] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 2 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:06.645298 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:06.645539 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:06.645856 18229 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.646145 18303 raft_consensus.cc:3055] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.646483 18303 raft_consensus.cc:740] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:06.647248 18303 consensus_queue.cc:260] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:06.648355 18303 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.650815 18229 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 2.
I20260709 13:08:06.651681 18345 leader_election.cc:304] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:06.652477 18512 raft_consensus.cc:2804] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:06.652915 18512 raft_consensus.cc:697] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:06.653582 18303 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 2.
I20260709 13:08:06.653601 18512 consensus_queue.cc:237] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:06.663477 18127 catalog_manager.cc:5697] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 1 to 2, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 2 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.052394 18229 raft_consensus.cc:1275] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.053581 18512 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.061944 18303 raft_consensus.cc:1275] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.065080 18512 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.127727 18229 raft_consensus.cc:1275] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:07.128947 18525 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.136705 18305 raft_consensus.cc:1275] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:07.138267 18535 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.426005 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.435452 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:07.435962 18229 raft_consensus.cc:606] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:07.440524 18379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:51080
I20260709 13:08:07.440980 18379 raft_consensus.cc:606] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:07.445598 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:07.446156 18230 raft_consensus.cc:606] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:07.450312 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:52082
I20260709 13:08:07.450769 18230 raft_consensus.cc:606] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:07.461760 18379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
mode: GRACEFUL
new_leader_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:51080
I20260709 13:08:07.462211 18379 raft_consensus.cc:606] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Received request to transfer leadership to TS 78532212afad4c71a99eead028712ce7
I20260709 13:08:07.658784 18541 raft_consensus.cc:993] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.659299 18541 raft_consensus.cc:1081] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.659657 18542 raft_consensus.cc:993] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.660211 18541 raft_consensus.cc:1081] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.660981 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:38012
I20260709 13:08:07.661791 18303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:38012
I20260709 13:08:07.662010 18305 raft_consensus.cc:493] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.662356 18303 raft_consensus.cc:493] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.662422 18305 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:07.662817 18303 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.667826 18305 raft_consensus.cc:515] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.669183 18303 raft_consensus.cc:515] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.671033 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:07.671557 18379 raft_consensus.cc:3055] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:07.671821 18379 raft_consensus.cc:740] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:07.672290 18303 leader_election.cc:290] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:07.672515 18379 consensus_queue.cc:260] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.673159 18305 leader_election.cc:290] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 4 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:07.673571 18379 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:07.674441 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:07.674971 18228 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.671043 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84f6ef153aae4eecb1a6c532a62a81de" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:07.676992 18230 raft_consensus.cc:3060] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:07.679764 18379 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 4.
I20260709 13:08:07.680971 18270 leader_election.cc:304] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:07.681363 18228 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.681807 18520 raft_consensus.cc:2804] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:07.681831 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:07.682474 18378 raft_consensus.cc:3055] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.682559 18271 leader_election.cc:304] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af6d976d1874d58acb6fe33e020d9fa, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:07.682958 18378 raft_consensus.cc:740] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:07.684041 18378 consensus_queue.cc:260] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.685107 18520 raft_consensus.cc:697] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 4 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:07.685599 18378 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.685644 18544 raft_consensus.cc:2804] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.686293 18544 raft_consensus.cc:697] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:07.685952 18520 consensus_queue.cc:237] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.687374 18544 consensus_queue.cc:237] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.692916 18230 raft_consensus.cc:2468] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 4.
I20260709 13:08:07.694113 18378 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.693539 18125 catalog_manager.cc:5697] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 3 to 4, leader changed from 574c0ab2f96d46239c0186b0420a508c (127.17.171.195) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 4 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.703563 18546 raft_consensus.cc:993] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.704058 18524 raft_consensus.cc:1081] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.706086 18546 raft_consensus.cc:993] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.705964 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:37998
I20260709 13:08:07.706512 18305 raft_consensus.cc:493] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.706519 18524 raft_consensus.cc:1081] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.706928 18305 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.708272 18303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:37998
I20260709 13:08:07.708724 18303 raft_consensus.cc:493] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.709026 18303 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.713398 18303 raft_consensus.cc:515] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.715461 18305 raft_consensus.cc:515] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.716046 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:07.716601 18230 raft_consensus.cc:3055] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.716931 18230 raft_consensus.cc:740] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:07.717378 18303 leader_election.cc:290] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:07.717767 18230 consensus_queue.cc:260] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.718967 18305 leader_election.cc:290] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:07.719022 18230 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.718179 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:07.720431 18228 raft_consensus.cc:3055] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.720340 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:07.720769 18228 raft_consensus.cc:740] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:07.716711 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac392caf8dad4e2fa3fe4bd7ffcb0fc2" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:07.720907 18379 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.721374 18378 raft_consensus.cc:3060] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.721580 18228 consensus_queue.cc:260] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.722808 18228 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.727419 18379 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.727653 18378 raft_consensus.cc:2468] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.728871 18270 leader_election.cc:304] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:07.729745 18545 raft_consensus.cc:2804] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.730194 18545 raft_consensus.cc:697] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:07.730485 18125 catalog_manager.cc:5697] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 2 to 3, leader changed from 574c0ab2f96d46239c0186b0420a508c (127.17.171.195) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.731017 18545 consensus_queue.cc:237] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.731112 18230 raft_consensus.cc:2468] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.733124 18270 leader_election.cc:304] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:07.733363 18228 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.733945 18520 raft_consensus.cc:2804] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.734472 18520 raft_consensus.cc:697] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:07.735574 18524 raft_consensus.cc:993] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: : Instructing follower 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.735320 18520 consensus_queue.cc:237] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.735960 18524 raft_consensus.cc:1081] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Signalling peer 78532212afad4c71a99eead028712ce7 to start an election
I20260709 13:08:07.737622 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79"
dest_uuid: "78532212afad4c71a99eead028712ce7"
 from {username='slave'} at 127.0.0.1:37998
I20260709 13:08:07.738130 18305 raft_consensus.cc:493] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.738468 18305 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.743470 18305 raft_consensus.cc:515] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.746276 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:07.746537 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "78532212afad4c71a99eead028712ce7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:07.746791 18305 leader_election.cc:290] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:07.746840 18228 raft_consensus.cc:3055] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.747040 18379 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.747305 18228 raft_consensus.cc:740] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:07.748047 18228 consensus_queue.cc:260] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.749202 18228 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.750982 18125 catalog_manager.cc:5697] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 2 to 3, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.751953 18125 catalog_manager.cc:5697] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 2 to 3, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.752964 18379 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.753962 18270 leader_election.cc:304] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 78532212afad4c71a99eead028712ce7; no voters: 
I20260709 13:08:07.754719 18520 raft_consensus.cc:2804] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.755193 18520 raft_consensus.cc:697] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Leader. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:07.755357 18228 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78532212afad4c71a99eead028712ce7 in term 3.
I20260709 13:08:07.755990 18520 consensus_queue.cc:237] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:07.764763 18125 catalog_manager.cc:5697] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 reported cstate change: term changed from 2 to 3, leader changed from 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193) to 78532212afad4c71a99eead028712ce7 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "78532212afad4c71a99eead028712ce7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:08.131466 18379 raft_consensus.cc:1275] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.132607 18520 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.141199 18228 raft_consensus.cc:1275] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.142614 18545 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.150136 18230 raft_consensus.cc:1275] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.151360 18545 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.159286 18379 raft_consensus.cc:1275] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.160393 18520 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.166261 18228 raft_consensus.cc:1275] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.169377 18520 consensus_queue.cc:1048] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.181083 18379 raft_consensus.cc:1275] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.182243 18544 consensus_queue.cc:1048] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.219825 18379 raft_consensus.cc:1275] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:08.220976 18544 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.224509 18378 raft_consensus.cc:1275] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.225885 18544 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.230877 18228 raft_consensus.cc:1275] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:08.232250 18545 consensus_queue.cc:1048] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.242746 18228 raft_consensus.cc:1275] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Refusing update from remote peer 78532212afad4c71a99eead028712ce7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.247094 18544 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.466337 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:10.473723 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:38034
I20260709 13:08:10.474399 18305 raft_consensus.cc:606] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:10.476872 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:38034
I20260709 13:08:10.477290 18305 raft_consensus.cc:606] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:10.479413 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:38034
I20260709 13:08:10.479820 18305 raft_consensus.cc:606] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Received request to transfer leadership to TS 574c0ab2f96d46239c0186b0420a508c
I20260709 13:08:10.481801 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:38034
I20260709 13:08:10.482194 18305 raft_consensus.cc:606] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Received request to transfer leadership to TS 5af6d976d1874d58acb6fe33e020d9fa
I20260709 13:08:10.484086 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79"
dest_uuid: "78532212afad4c71a99eead028712ce7"
mode: GRACEFUL
new_leader_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:38034
I20260709 13:08:10.484486 18305 raft_consensus.cc:606] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Received request to transfer leadership to TS 574c0ab2f96d46239c0186b0420a508c
I20260709 13:08:10.485443 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:10.485854 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:10.607613 18520 raft_consensus.cc:993] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:10.608109 18571 raft_consensus.cc:1081] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:10.609508 18228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:08:10.610021 18228 raft_consensus.cc:493] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.610402 18228 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.615617 18228 raft_consensus.cc:515] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.617475 18228 leader_election.cc:290] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 4 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:10.618395 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:10.618858 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e93d7ec69495db351f759ef2d52a5" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:10.619127 18305 raft_consensus.cc:3055] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:10.619390 18378 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.619438 18305 raft_consensus.cc:740] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:10.620361 18305 consensus_queue.cc:260] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.621616 18305 raft_consensus.cc:3060] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.626540 18378 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 4.
I20260709 13:08:10.627965 18195 leader_election.cc:304] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:10.628119 18305 raft_consensus.cc:2468] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 4.
I20260709 13:08:10.629616 18572 raft_consensus.cc:2804] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:10.630453 18572 raft_consensus.cc:697] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:10.631399 18572 consensus_queue.cc:237] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.637620 18126 catalog_manager.cc:5697] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 3 to 4, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 4 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.656450 18520 raft_consensus.cc:993] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: : Instructing follower 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:10.656872 18571 raft_consensus.cc:1081] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Signalling peer 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:10.658263 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:51070
I20260709 13:08:10.658624 18379 raft_consensus.cc:493] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.658854 18379 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.662942 18379 raft_consensus.cc:515] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.664853 18379 leader_election.cc:290] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 3 election: Requested vote from peers 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679), 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475)
I20260709 13:08:10.665378 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:10.665271 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706deafc69804f33ab880b1f5b079eb7" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:10.665910 18305 raft_consensus.cc:3055] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:10.665961 18228 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.666318 18305 raft_consensus.cc:740] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:10.667011 18305 consensus_queue.cc:260] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.668123 18305 raft_consensus.cc:3060] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.672544 18228 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 3.
I20260709 13:08:10.674091 18345 leader_election.cc:304] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:10.674185 18305 raft_consensus.cc:2468] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 3.
I20260709 13:08:10.674887 18543 raft_consensus.cc:2804] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:10.676003 18543 raft_consensus.cc:697] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:10.676890 18543 consensus_queue.cc:237] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.683156 18126 catalog_manager.cc:5697] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 2 to 3, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 3 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.771488 18520 raft_consensus.cc:993] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:10.771889 18571 raft_consensus.cc:1081] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:10.773313 18228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:08:10.773834 18228 raft_consensus.cc:493] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.774164 18228 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.779603 18228 raft_consensus.cc:515] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.781471 18228 leader_election.cc:290] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 4 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:10.782061 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:10.782353 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0626539e0a7b41cf8d3513475a664cc7" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:10.782610 18305 raft_consensus.cc:3055] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:10.782845 18379 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.782910 18305 raft_consensus.cc:740] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:10.783735 18305 consensus_queue.cc:260] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.784876 18305 raft_consensus.cc:3060] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.788802 18379 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 4.
I20260709 13:08:10.789902 18195 leader_election.cc:304] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:10.790649 18572 raft_consensus.cc:2804] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:10.790710 18305 raft_consensus.cc:2468] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 4.
I20260709 13:08:10.791163 18572 raft_consensus.cc:697] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:10.792006 18572 consensus_queue.cc:237] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.797963 18126 catalog_manager.cc:5697] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 3 to 4, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 4 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.818681 18520 raft_consensus.cc:993] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: : Instructing follower 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:10.819104 18571 raft_consensus.cc:1081] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Signalling peer 574c0ab2f96d46239c0186b0420a508c to start an election
I20260709 13:08:10.820442 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79"
dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
 from {username='slave'} at 127.0.0.1:51070
I20260709 13:08:10.820905 18379 raft_consensus.cc:493] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.821203 18379 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.825455 18379 raft_consensus.cc:515] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.826856 18379 leader_election.cc:290] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 4 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679)
I20260709 13:08:10.827764 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:10.827932 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd9aaace24754ef08e62b6313f80cf79" candidate_uuid: "574c0ab2f96d46239c0186b0420a508c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
I20260709 13:08:10.828334 18305 raft_consensus.cc:3055] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:10.828449 18228 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.828670 18305 raft_consensus.cc:740] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:10.829449 18305 consensus_queue.cc:260] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.830555 18305 raft_consensus.cc:3060] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.834683 18228 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 4.
I20260709 13:08:10.835758 18345 leader_election.cc:304] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:10.836532 18305 raft_consensus.cc:2468] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 574c0ab2f96d46239c0186b0420a508c in term 4.
I20260709 13:08:10.836671 18543 raft_consensus.cc:2804] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:10.837216 18543 raft_consensus.cc:697] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 4 LEADER]: Becoming Leader. State: Replica: 574c0ab2f96d46239c0186b0420a508c, State: Running, Role: LEADER
I20260709 13:08:10.838194 18543 consensus_queue.cc:237] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:10.845170 18126 catalog_manager.cc:5697] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c reported cstate change: term changed from 3 to 4, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 574c0ab2f96d46239c0186b0420a508c (127.17.171.195). New cstate: current_term: 4 leader_uuid: "574c0ab2f96d46239c0186b0420a508c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.004791 18520 raft_consensus.cc:993] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: : Instructing follower 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:11.005209 18571 raft_consensus.cc:1081] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Signalling peer 5af6d976d1874d58acb6fe33e020d9fa to start an election
I20260709 13:08:11.006605 18228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f"
dest_uuid: "5af6d976d1874d58acb6fe33e020d9fa"
 from {username='slave'} at 127.0.0.1:52058
I20260709 13:08:11.007019 18228 raft_consensus.cc:493] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.007272 18228 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.011776 18228 raft_consensus.cc:515] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:11.013456 18228 leader_election.cc:290] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 3 election: Requested vote from peers 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475), 574c0ab2f96d46239c0186b0420a508c (127.17.171.195:46815)
I20260709 13:08:11.014138 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "78532212afad4c71a99eead028712ce7"
I20260709 13:08:11.014432 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86b8faf5fcbf4e35856a31cd33baca9f" candidate_uuid: "5af6d976d1874d58acb6fe33e020d9fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "574c0ab2f96d46239c0186b0420a508c"
I20260709 13:08:11.014674 18305 raft_consensus.cc:3055] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:11.014899 18379 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.014989 18305 raft_consensus.cc:740] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 78532212afad4c71a99eead028712ce7, State: Running, Role: LEADER
I20260709 13:08:11.015718 18305 consensus_queue.cc:260] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:11.016834 18305 raft_consensus.cc:3060] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.020892 18379 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 3.
I20260709 13:08:11.021946 18195 leader_election.cc:304] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 574c0ab2f96d46239c0186b0420a508c, 5af6d976d1874d58acb6fe33e020d9fa; no voters: 
I20260709 13:08:11.022737 18572 raft_consensus.cc:2804] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:11.022848 18305 raft_consensus.cc:2468] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5af6d976d1874d58acb6fe33e020d9fa in term 3.
I20260709 13:08:11.023253 18572 raft_consensus.cc:697] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 3 LEADER]: Becoming Leader. State: Replica: 5af6d976d1874d58acb6fe33e020d9fa, State: Running, Role: LEADER
I20260709 13:08:11.024118 18572 consensus_queue.cc:237] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } }
I20260709 13:08:11.030764 18126 catalog_manager.cc:5697] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa reported cstate change: term changed from 2 to 3, leader changed from 78532212afad4c71a99eead028712ce7 (127.17.171.194) to 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193). New cstate: current_term: 3 leader_uuid: "5af6d976d1874d58acb6fe33e020d9fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.109371 18228 raft_consensus.cc:1275] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:11.110592 18543 consensus_queue.cc:1048] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.113273 18305 raft_consensus.cc:1275] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:11.114444 18572 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.125378 18305 raft_consensus.cc:1275] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:11.129866 18587 consensus_queue.cc:1048] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:11.138295 18379 raft_consensus.cc:1275] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:11.140326 18573 consensus_queue.cc:1048] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:11.175541 18305 raft_consensus.cc:1275] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:11.176707 18591 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.184419 18379 raft_consensus.cc:1275] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:11.186168 18591 consensus_queue.cc:1048] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.243676 18305 raft_consensus.cc:1275] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:11.244998 18587 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.253268 18228 raft_consensus.cc:1275] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Refusing update from remote peer 574c0ab2f96d46239c0186b0420a508c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:11.254720 18543 consensus_queue.cc:1048] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af6d976d1874d58acb6fe33e020d9fa" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 46679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.406374 18305 raft_consensus.cc:1275] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:11.407507 18591 consensus_queue.cc:1048] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "78532212afad4c71a99eead028712ce7" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.415747 18379 raft_consensus.cc:1275] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Refusing update from remote peer 5af6d976d1874d58acb6fe33e020d9fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:11.417398 18573 consensus_queue.cc:1048] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "574c0ab2f96d46239c0186b0420a508c" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.486656 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:11.492277 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:08:11.516461 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.517275 18095 tablet_replica.cc:333] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.518237 18095 raft_consensus.cc:2243] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.518853 18095 raft_consensus.cc:2272] T fd9aaace24754ef08e62b6313f80cf79 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.521713 18095 tablet_replica.cc:333] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.522269 18095 raft_consensus.cc:2243] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.522689 18095 raft_consensus.cc:2272] T 84f6ef153aae4eecb1a6c532a62a81de P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.524591 18095 tablet_replica.cc:333] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.525107 18095 raft_consensus.cc:2243] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.525630 18095 raft_consensus.cc:2272] T 3db8187e72dd4f5a8e719ef7452c0891 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.527570 18095 tablet_replica.cc:333] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.528239 18095 raft_consensus.cc:2243] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.529121 18095 raft_consensus.cc:2272] T 0626539e0a7b41cf8d3513475a664cc7 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.530956 18095 tablet_replica.cc:333] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.531375 18095 raft_consensus.cc:2243] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.531967 18095 raft_consensus.cc:2272] T 86b8faf5fcbf4e35856a31cd33baca9f P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.533720 18095 tablet_replica.cc:333] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.534150 18095 raft_consensus.cc:2243] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.534587 18095 raft_consensus.cc:2272] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 5af6d976d1874d58acb6fe33e020d9fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.536376 18095 tablet_replica.cc:333] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.536849 18095 raft_consensus.cc:2243] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.537273 18095 raft_consensus.cc:2272] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.538803 18095 tablet_replica.cc:333] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.539238 18095 raft_consensus.cc:2243] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.539635 18095 raft_consensus.cc:2272] T 706deafc69804f33ab880b1f5b079eb7 P 5af6d976d1874d58acb6fe33e020d9fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.541692 18095 tablet_replica.cc:333] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa: stopping tablet replica
I20260709 13:08:11.542125 18095 raft_consensus.cc:2243] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.542809 18095 raft_consensus.cc:2272] T 304e93d7ec69495db351f759ef2d52a5 P 5af6d976d1874d58acb6fe33e020d9fa [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:11.547516 18271 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:11.550741 18271 consensus_peers.cc:597] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 -> Peer 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679): Couldn't send request to peer 5af6d976d1874d58acb6fe33e020d9fa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.648823 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
W20260709 13:08:11.649673 18345 consensus_peers.cc:597] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c -> Peer 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679): Couldn't send request to peer 5af6d976d1874d58acb6fe33e020d9fa. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:46679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.666065 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
W20260709 13:08:11.691901 18345 consensus_peers.cc:597] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c -> Peer 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679): Couldn't send request to peer 5af6d976d1874d58acb6fe33e020d9fa. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:46679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.694196 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.694804 18095 tablet_replica.cc:333] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.695348 18095 raft_consensus.cc:2243] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.696106 18095 raft_consensus.cc:2272] T 84f6ef153aae4eecb1a6c532a62a81de P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.697928 18095 tablet_replica.cc:333] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.698431 18095 raft_consensus.cc:2243] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.699221 18095 raft_consensus.cc:2272] T 3db8187e72dd4f5a8e719ef7452c0891 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.701150 18095 tablet_replica.cc:333] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.701803 18095 raft_consensus.cc:2243] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.702191 18095 raft_consensus.cc:2272] T 0626539e0a7b41cf8d3513475a664cc7 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:11.702780 18344 consensus_peers.cc:597] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c -> Peer 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475): Couldn't send request to peer 78532212afad4c71a99eead028712ce7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.704450 18095 tablet_replica.cc:333] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.704912 18095 raft_consensus.cc:2243] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.705228 18095 raft_consensus.cc:2272] T 86b8faf5fcbf4e35856a31cd33baca9f P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.706905 18095 tablet_replica.cc:333] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.707325 18095 raft_consensus.cc:2243] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.707647 18095 raft_consensus.cc:2272] T 706deafc69804f33ab880b1f5b079eb7 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.709394 18095 tablet_replica.cc:333] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.709805 18095 raft_consensus.cc:2243] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.710119 18095 raft_consensus.cc:2272] T 304e93d7ec69495db351f759ef2d52a5 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.712337 18095 tablet_replica.cc:333] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.712950 18095 raft_consensus.cc:2243] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.713393 18095 raft_consensus.cc:2272] T fd9aaace24754ef08e62b6313f80cf79 P 78532212afad4c71a99eead028712ce7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.715540 18095 tablet_replica.cc:333] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
W20260709 13:08:11.715761 18345 consensus_peers.cc:597] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c -> Peer 5af6d976d1874d58acb6fe33e020d9fa (127.17.171.193:46679): Couldn't send request to peer 5af6d976d1874d58acb6fe33e020d9fa. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:46679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.716055 18095 raft_consensus.cc:2243] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.716516 18095 raft_consensus.cc:2272] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 78532212afad4c71a99eead028712ce7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.718088 18095 tablet_replica.cc:333] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7: stopping tablet replica
I20260709 13:08:11.718514 18095 raft_consensus.cc:2243] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.719343 18095 raft_consensus.cc:2272] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 78532212afad4c71a99eead028712ce7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:11.739322 18344 consensus_peers.cc:597] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c -> Peer 78532212afad4c71a99eead028712ce7 (127.17.171.194:38475): Couldn't send request to peer 78532212afad4c71a99eead028712ce7. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38475: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.746546 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
I20260709 13:08:11.762120 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
I20260709 13:08:11.788326 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.788893 18095 tablet_replica.cc:333] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.789395 18095 raft_consensus.cc:2243] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.789809 18095 raft_consensus.cc:2272] T 0626539e0a7b41cf8d3513475a664cc7 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.792299 18095 tablet_replica.cc:333] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.792730 18095 raft_consensus.cc:2243] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.793076 18095 raft_consensus.cc:2272] T 84f6ef153aae4eecb1a6c532a62a81de P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.794643 18095 tablet_replica.cc:333] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.795045 18095 raft_consensus.cc:2243] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.795392 18095 raft_consensus.cc:2272] T 3db8187e72dd4f5a8e719ef7452c0891 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.796885 18095 tablet_replica.cc:333] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.797294 18095 raft_consensus.cc:2243] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.797909 18095 raft_consensus.cc:2272] T fd9aaace24754ef08e62b6313f80cf79 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.799629 18095 tablet_replica.cc:333] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.800122 18095 raft_consensus.cc:2243] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.800846 18095 raft_consensus.cc:2272] T 706deafc69804f33ab880b1f5b079eb7 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.802551 18095 tablet_replica.cc:333] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.803011 18095 raft_consensus.cc:2243] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.803411 18095 raft_consensus.cc:2272] T 304e93d7ec69495db351f759ef2d52a5 P 574c0ab2f96d46239c0186b0420a508c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.805286 18095 tablet_replica.cc:333] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.805743 18095 raft_consensus.cc:2243] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.806128 18095 raft_consensus.cc:2272] T ac392caf8dad4e2fa3fe4bd7ffcb0fc2 P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.807631 18095 tablet_replica.cc:333] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.808058 18095 raft_consensus.cc:2243] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.808768 18095 raft_consensus.cc:2272] T a1cadefea8f54dd1b0ae5ba0ba5403e6 P 574c0ab2f96d46239c0186b0420a508c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.810199 18095 tablet_replica.cc:333] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c: stopping tablet replica
I20260709 13:08:11.810633 18095 raft_consensus.cc:2243] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.811023 18095 raft_consensus.cc:2272] T 86b8faf5fcbf4e35856a31cd33baca9f P 574c0ab2f96d46239c0186b0420a508c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.837484 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
I20260709 13:08:11.854038 18095 master.cc:562] Master@127.17.171.254:34923 shutting down...
I20260709 13:08:12.067139 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:12.067725 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:12.068077 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3d5b4e6a00994816b1ce5cadcf28b672: stopping tablet replica
I20260709 13:08:12.087536 18095 master.cc:584] Master@127.17.171.254:34923 shutdown complete.
574c0ab2f96d46239c0186b0420a508c  1
5af6d976d1874d58acb6fe33e020d9fa  4
78532212afad4c71a99eead028712ce7  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12626 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:08:12.128021 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:39977
I20260709 13:08:12.129194 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.134806 18604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.135296 18606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.135464 18603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.136562 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:12.137317 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:12.137524 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.137683 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602492137666 us; error 0 us; skew 500 ppm
I20260709 13:08:12.138175 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.140491 18095 webserver.cc:533] Webserver started at http://127.17.171.254:45399/ using document root <none> and password file <none>
I20260709 13:08:12.140972 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.141171 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.141458 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.142539 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "5afe21968a9340bcb26c53210ab595ed"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.146960 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:08:12.150086 18611 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.150893 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:12.151118 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "5afe21968a9340bcb26c53210ab595ed"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.151356 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.172803 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.173980 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.210173 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:39977
I20260709 13:08:12.210239 18662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:39977 every 8 connection(s)
I20260709 13:08:12.213771 18663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.222846 18663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed: Bootstrap starting.
I20260709 13:08:12.227272 18663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.231148 18663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed: No bootstrap required, opened a new log
I20260709 13:08:12.233186 18663 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afe21968a9340bcb26c53210ab595ed" member_type: VOTER }
I20260709 13:08:12.233568 18663 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.233834 18663 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5afe21968a9340bcb26c53210ab595ed, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.234390 18663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afe21968a9340bcb26c53210ab595ed" member_type: VOTER }
I20260709 13:08:12.234823 18663 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:12.235019 18663 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:12.235342 18663 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.239313 18663 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afe21968a9340bcb26c53210ab595ed" member_type: VOTER }
I20260709 13:08:12.239815 18663 leader_election.cc:304] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5afe21968a9340bcb26c53210ab595ed; no voters: 
I20260709 13:08:12.240973 18663 leader_election.cc:290] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:12.241369 18666 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.242636 18666 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 1 LEADER]: Becoming Leader. State: Replica: 5afe21968a9340bcb26c53210ab595ed, State: Running, Role: LEADER
I20260709 13:08:12.243216 18666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afe21968a9340bcb26c53210ab595ed" member_type: VOTER }
I20260709 13:08:12.243816 18663 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:12.248351 18668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5afe21968a9340bcb26c53210ab595ed. Latest consensus state: current_term: 1 leader_uuid: "5afe21968a9340bcb26c53210ab595ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afe21968a9340bcb26c53210ab595ed" member_type: VOTER } }
I20260709 13:08:12.249038 18668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:12.249032 18667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5afe21968a9340bcb26c53210ab595ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5afe21968a9340bcb26c53210ab595ed" member_type: VOTER } }
I20260709 13:08:12.249738 18667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:12.250998 18674 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:12.255932 18674 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:12.259163 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:12.263765 18674 catalog_manager.cc:1383] Generated new cluster ID: 01ce55dc6ae44349912f2fd87e453dce
I20260709 13:08:12.264030 18674 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:12.287106 18674 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:12.288334 18674 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:12.304526 18674 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed: Generated new TSK 0
I20260709 13:08:12.305090 18674 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:12.325346 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.330855 18684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.332049 18685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.333542 18687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.333992 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:12.334721 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:12.334892 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.335006 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602492334996 us; error 0 us; skew 500 ppm
I20260709 13:08:12.335467 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.337620 18095 webserver.cc:533] Webserver started at http://127.17.171.193:39721/ using document root <none> and password file <none>
I20260709 13:08:12.338037 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.338186 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.338394 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.339360 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "3852a08afc364925bf86a197ebbcb3f3"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.343668 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:12.346884 18692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.347594 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:12.347890 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "3852a08afc364925bf86a197ebbcb3f3"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.348160 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.361774 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.363008 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.364502 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.366696 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.366874 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.367166 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.367328 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.408893 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:42215
I20260709 13:08:12.408984 18754 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:42215 every 8 connection(s)
I20260709 13:08:12.413720 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.421226 18759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.422212 18760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.424522 18762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.425390 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:12.426285 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:12.426539 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.426718 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602492426701 us; error 0 us; skew 500 ppm
I20260709 13:08:12.427244 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.429409 18095 webserver.cc:533] Webserver started at http://127.17.171.194:40987/ using document root <none> and password file <none>
I20260709 13:08:12.429877 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.430117 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.430400 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.431486 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "37588bf480cd41839ce9c9f75aefdb83"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.433784 18755 heartbeater.cc:344] Connected to a master server at 127.17.171.254:39977
I20260709 13:08:12.434157 18755 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.434875 18755 heartbeater.cc:507] Master 127.17.171.254:39977 requested a full tablet report, sending...
I20260709 13:08:12.436652 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:08:12.437021 18628 ts_manager.cc:194] Registered new tserver with Master: 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215)
I20260709 13:08:12.438962 18628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34100
I20260709 13:08:12.440632 18767 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.441517 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:08:12.441859 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "37588bf480cd41839ce9c9f75aefdb83"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.442117 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.455327 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.456521 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.457898 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.459982 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.460230 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.460469 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.460636 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.499332 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:45155
I20260709 13:08:12.499437 18829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:45155 every 8 connection(s)
I20260709 13:08:12.503880 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.510844 18833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.512683 18834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.514122 18095 server_base.cc:1061] running on GCE node
W20260709 13:08:12.514340 18837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.515352 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:12.515643 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.515843 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602492515805 us; error 0 us; skew 500 ppm
I20260709 13:08:12.515738 18830 heartbeater.cc:344] Connected to a master server at 127.17.171.254:39977
I20260709 13:08:12.516307 18830 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.516556 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.517078 18830 heartbeater.cc:507] Master 127.17.171.254:39977 requested a full tablet report, sending...
I20260709 13:08:12.519096 18628 ts_manager.cc:194] Registered new tserver with Master: 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:12.519477 18095 webserver.cc:533] Webserver started at http://127.17.171.195:33489/ using document root <none> and password file <none>
I20260709 13:08:12.519964 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.520203 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.520478 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.520624 18628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34112
I20260709 13:08:12.522037 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "024e6da43121494298bf12a8fef267d0"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.526556 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:12.529889 18841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.530675 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:08:12.530987 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "024e6da43121494298bf12a8fef267d0"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-jhlz"
I20260709 13:08:12.531324 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.548950 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.550336 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.551918 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.554591 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.554841 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.555130 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.555346 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.596472 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:45963
I20260709 13:08:12.596544 18903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:45963 every 8 connection(s)
I20260709 13:08:12.609930 18904 heartbeater.cc:344] Connected to a master server at 127.17.171.254:39977
I20260709 13:08:12.610335 18904 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.611111 18904 heartbeater.cc:507] Master 127.17.171.254:39977 requested a full tablet report, sending...
I20260709 13:08:12.612972 18628 ts_manager.cc:194] Registered new tserver with Master: 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:12.613091 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013270465s
I20260709 13:08:12.614290 18628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34124
I20260709 13:08:12.636512 18628 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34126:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:12.639288 18628 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:12.709517 18795 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea3223a95914773ba85d67fd0ed628e (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:12.710947 18795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea3223a95914773ba85d67fd0ed628e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.712411 18793 tablet_service.cc:1511] Processing CreateTablet for tablet b8c4e986f9bd41d0a3d78bf1b6da1fe1 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:12.713726 18793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c4e986f9bd41d0a3d78bf1b6da1fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.715278 18720 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea3223a95914773ba85d67fd0ed628e (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:12.716593 18720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea3223a95914773ba85d67fd0ed628e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.717398 18794 tablet_service.cc:1511] Processing CreateTablet for tablet 125a99d88f144304a34fa5d4d41383f3 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:12.718643 18794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125a99d88f144304a34fa5d4d41383f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.720103 18869 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea3223a95914773ba85d67fd0ed628e (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:12.721326 18869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea3223a95914773ba85d67fd0ed628e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.722781 18865 tablet_service.cc:1511] Processing CreateTablet for tablet d3c3883ccd374fc1aad1583099f58fc8 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:12.723995 18865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c3883ccd374fc1aad1583099f58fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.725291 18866 tablet_service.cc:1511] Processing CreateTablet for tablet 6c601a6e886140f08768d71d34a67475 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:12.726990 18867 tablet_service.cc:1511] Processing CreateTablet for tablet b8c4e986f9bd41d0a3d78bf1b6da1fe1 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:12.732313 18719 tablet_service.cc:1511] Processing CreateTablet for tablet 125a99d88f144304a34fa5d4d41383f3 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:12.733512 18719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125a99d88f144304a34fa5d4d41383f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.737772 18789 tablet_service.cc:1511] Processing CreateTablet for tablet 5246b63227e549cab5c3bf4e6a3b5d79 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:12.737975 18863 tablet_service.cc:1511] Processing CreateTablet for tablet 5246b63227e549cab5c3bf4e6a3b5d79 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:12.727591 18864 tablet_service.cc:1511] Processing CreateTablet for tablet 60b69e4d3caa4bf7bdb8492135e1091f (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:12.728678 18868 tablet_service.cc:1511] Processing CreateTablet for tablet 125a99d88f144304a34fa5d4d41383f3 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:12.739034 18789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5246b63227e549cab5c3bf4e6a3b5d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.730221 18718 tablet_service.cc:1511] Processing CreateTablet for tablet b8c4e986f9bd41d0a3d78bf1b6da1fe1 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:12.741329 18790 tablet_service.cc:1511] Processing CreateTablet for tablet 60b69e4d3caa4bf7bdb8492135e1091f (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:12.742578 18790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b69e4d3caa4bf7bdb8492135e1091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.742267 18862 tablet_service.cc:1511] Processing CreateTablet for tablet b8da61420a6f4303890ae6c175dcfeab (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:12.743641 18718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c4e986f9bd41d0a3d78bf1b6da1fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.744799 18791 tablet_service.cc:1511] Processing CreateTablet for tablet d3c3883ccd374fc1aad1583099f58fc8 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:12.746093 18791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c3883ccd374fc1aad1583099f58fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.747951 18861 tablet_service.cc:1511] Processing CreateTablet for tablet 633732d01fd44faeb53cd5efbbcb45fa (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:12.748471 18864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b69e4d3caa4bf7bdb8492135e1091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.749940 18792 tablet_service.cc:1511] Processing CreateTablet for tablet 6c601a6e886140f08768d71d34a67475 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:12.751391 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c601a6e886140f08768d71d34a67475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.751960 18792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c601a6e886140f08768d71d34a67475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.752573 18717 tablet_service.cc:1511] Processing CreateTablet for tablet 6c601a6e886140f08768d71d34a67475 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:12.753878 18717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c601a6e886140f08768d71d34a67475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.754099 18716 tablet_service.cc:1511] Processing CreateTablet for tablet d3c3883ccd374fc1aad1583099f58fc8 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:12.754760 18867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c4e986f9bd41d0a3d78bf1b6da1fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.755347 18716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c3883ccd374fc1aad1583099f58fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.756655 18863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5246b63227e549cab5c3bf4e6a3b5d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.757335 18715 tablet_service.cc:1511] Processing CreateTablet for tablet 60b69e4d3caa4bf7bdb8492135e1091f (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:12.758234 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8da61420a6f4303890ae6c175dcfeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.758605 18715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b69e4d3caa4bf7bdb8492135e1091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.765040 18714 tablet_service.cc:1511] Processing CreateTablet for tablet 5246b63227e549cab5c3bf4e6a3b5d79 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:12.765400 18713 tablet_service.cc:1511] Processing CreateTablet for tablet b8da61420a6f4303890ae6c175dcfeab (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:12.766302 18714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5246b63227e549cab5c3bf4e6a3b5d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.768388 18788 tablet_service.cc:1511] Processing CreateTablet for tablet b8da61420a6f4303890ae6c175dcfeab (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:12.769685 18788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8da61420a6f4303890ae6c175dcfeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.772262 18868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125a99d88f144304a34fa5d4d41383f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.772507 18713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8da61420a6f4303890ae6c175dcfeab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.780525 18861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633732d01fd44faeb53cd5efbbcb45fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.805190 18712 tablet_service.cc:1511] Processing CreateTablet for tablet 633732d01fd44faeb53cd5efbbcb45fa (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:12.806881 18712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633732d01fd44faeb53cd5efbbcb45fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.824214 18787 tablet_service.cc:1511] Processing CreateTablet for tablet 633732d01fd44faeb53cd5efbbcb45fa (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:12.825524 18787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633732d01fd44faeb53cd5efbbcb45fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.830585 18711 tablet_service.cc:1511] Processing CreateTablet for tablet f4071ca08a124b44b9df5d14d868d218 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:12.831875 18711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4071ca08a124b44b9df5d14d868d218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.834822 18920 tablet_bootstrap.cc:492] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:12.837073 18863 tablet_service.cc:1511] Processing CreateTablet for tablet f4071ca08a124b44b9df5d14d868d218 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:12.838310 18863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4071ca08a124b44b9df5d14d868d218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.848357 18795 tablet_service.cc:1511] Processing CreateTablet for tablet f4071ca08a124b44b9df5d14d868d218 (DEFAULT_TABLE table=test-workload [id=63357052387c4ccfbaf584d09e53dcca]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:12.868604 18919 tablet_bootstrap.cc:492] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:12.858325 18920 tablet_bootstrap.cc:654] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.849707 18795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4071ca08a124b44b9df5d14d868d218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.894671 18921 tablet_bootstrap.cc:492] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:12.919752 18919 tablet_bootstrap.cc:654] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.926596 18921 tablet_bootstrap.cc:654] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.929042 18920 tablet_bootstrap.cc:492] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:12.929504 18920 ts_tablet_manager.cc:1403] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.012s
I20260709 13:08:12.931882 18920 raft_consensus.cc:359] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:12.932581 18920 raft_consensus.cc:385] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.932945 18920 raft_consensus.cc:740] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.933840 18920 consensus_queue.cc:260] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:12.939723 18830 heartbeater.cc:499] Master 127.17.171.254:39977 was elected leader, sending a full tablet report...
I20260709 13:08:12.940253 18921 tablet_bootstrap.cc:492] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:12.940321 18920 ts_tablet_manager.cc:1434] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:08:12.940789 18921 ts_tablet_manager.cc:1403] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.009s
I20260709 13:08:12.940850 18919 tablet_bootstrap.cc:492] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:12.941282 18920 tablet_bootstrap.cc:492] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:12.941540 18919 ts_tablet_manager.cc:1403] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.007s
I20260709 13:08:12.943547 18921 raft_consensus.cc:359] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:12.944304 18921 raft_consensus.cc:385] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.944648 18921 raft_consensus.cc:740] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.944713 18919 raft_consensus.cc:359] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:12.945662 18919 raft_consensus.cc:385] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.945511 18921 consensus_queue.cc:260] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:12.946115 18919 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.946952 18919 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:12.947896 18920 tablet_bootstrap.cc:654] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.954813 18755 heartbeater.cc:499] Master 127.17.171.254:39977 was elected leader, sending a full tablet report...
I20260709 13:08:12.955385 18921 ts_tablet_manager.cc:1434] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 13:08:12.956305 18921 tablet_bootstrap.cc:492] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:12.962908 18921 tablet_bootstrap.cc:654] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.965734 18920 tablet_bootstrap.cc:492] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:12.966351 18920 ts_tablet_manager.cc:1403] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 13:08:12.970090 18920 raft_consensus.cc:359] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:12.971048 18920 raft_consensus.cc:385] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.971433 18920 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.973523 18904 heartbeater.cc:499] Master 127.17.171.254:39977 was elected leader, sending a full tablet report...
I20260709 13:08:12.973872 18919 ts_tablet_manager.cc:1434] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.032s	user 0.018s	sys 0.010s
I20260709 13:08:12.982924 18919 tablet_bootstrap.cc:492] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:12.989804 18919 tablet_bootstrap.cc:654] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.993090 18920 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:12.995643 18920 ts_tablet_manager.cc:1434] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.006s
I20260709 13:08:12.996243 18919 tablet_bootstrap.cc:492] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:12.996811 18920 tablet_bootstrap.cc:492] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:12.996847 18919 ts_tablet_manager.cc:1403] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:08:13.000761 18919 raft_consensus.cc:359] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.001708 18919 raft_consensus.cc:385] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.002089 18919 raft_consensus.cc:740] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.003925 18920 tablet_bootstrap.cc:654] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.003655 18919 consensus_queue.cc:260] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.005571 18921 tablet_bootstrap.cc:492] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.005873 18919 ts_tablet_manager.cc:1434] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:08:13.006040 18921 ts_tablet_manager.cc:1403] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.020s
I20260709 13:08:13.007831 18919 tablet_bootstrap.cc:492] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.008896 18921 raft_consensus.cc:359] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.009583 18921 raft_consensus.cc:385] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.009876 18921 raft_consensus.cc:740] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.010730 18921 consensus_queue.cc:260] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.013134 18921 ts_tablet_manager.cc:1434] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:13.013972 18921 tablet_bootstrap.cc:492] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.014529 18919 tablet_bootstrap.cc:654] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.021292 18921 tablet_bootstrap.cc:654] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.047142 18920 tablet_bootstrap.cc:492] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.047667 18919 tablet_bootstrap.cc:492] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.047655 18920 ts_tablet_manager.cc:1403] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.027s
I20260709 13:08:13.048270 18919 ts_tablet_manager.cc:1403] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.041s	user 0.025s	sys 0.015s
I20260709 13:08:13.048451 18921 tablet_bootstrap.cc:492] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.048904 18921 ts_tablet_manager.cc:1403] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.011s
I20260709 13:08:13.051409 18919 raft_consensus.cc:359] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.051589 18920 raft_consensus.cc:359] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.051676 18921 raft_consensus.cc:359] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.052188 18919 raft_consensus.cc:385] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.052341 18920 raft_consensus.cc:385] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.052551 18921 raft_consensus.cc:385] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.052707 18920 raft_consensus.cc:740] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.052609 18919 raft_consensus.cc:740] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.052955 18921 raft_consensus.cc:740] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.053763 18921 consensus_queue.cc:260] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.053741 18919 consensus_queue.cc:260] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.053737 18920 consensus_queue.cc:260] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.055840 18921 ts_tablet_manager.cc:1434] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:08:13.056051 18919 ts_tablet_manager.cc:1434] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:13.056058 18920 ts_tablet_manager.cc:1434] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:13.056777 18921 tablet_bootstrap.cc:492] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.057143 18919 tablet_bootstrap.cc:492] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.063253 18921 tablet_bootstrap.cc:654] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.063277 18919 tablet_bootstrap.cc:654] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.065238 18920 tablet_bootstrap.cc:492] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:13.073555 18920 tablet_bootstrap.cc:654] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.078758 18921 tablet_bootstrap.cc:492] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.079167 18921 ts_tablet_manager.cc:1403] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:08:13.080097 18919 tablet_bootstrap.cc:492] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.080729 18919 ts_tablet_manager.cc:1403] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:08:13.081274 18921 raft_consensus.cc:359] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:13.081809 18921 raft_consensus.cc:385] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.082054 18921 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.082659 18921 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:13.084632 18921 ts_tablet_manager.cc:1434] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:08:13.084443 18919 raft_consensus.cc:359] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.085397 18919 raft_consensus.cc:385] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.085613 18921 tablet_bootstrap.cc:492] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.085693 18919 raft_consensus.cc:740] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.086720 18919 consensus_queue.cc:260] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.087891 18920 tablet_bootstrap.cc:492] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.088326 18920 ts_tablet_manager.cc:1403] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.001s
I20260709 13:08:13.090962 18919 ts_tablet_manager.cc:1434] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:08:13.091161 18920 raft_consensus.cc:359] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.091886 18919 tablet_bootstrap.cc:492] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.091836 18920 raft_consensus.cc:385] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.092346 18921 tablet_bootstrap.cc:654] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.092293 18920 raft_consensus.cc:740] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.093323 18920 consensus_queue.cc:260] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.098225 18920 ts_tablet_manager.cc:1434] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:13.098555 18919 tablet_bootstrap.cc:654] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.099241 18920 tablet_bootstrap.cc:492] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:13.108865 18920 tablet_bootstrap.cc:654] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.110352 18919 tablet_bootstrap.cc:492] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.110800 18919 ts_tablet_manager.cc:1403] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:08:13.113622 18921 tablet_bootstrap.cc:492] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.114084 18921 ts_tablet_manager.cc:1403] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.021s
I20260709 13:08:13.113791 18919 raft_consensus.cc:359] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.114532 18919 raft_consensus.cc:385] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.114611 18920 tablet_bootstrap.cc:492] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.114902 18919 raft_consensus.cc:740] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.115146 18920 ts_tablet_manager.cc:1403] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:08:13.115849 18919 consensus_queue.cc:260] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.117091 18921 raft_consensus.cc:359] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.117852 18921 raft_consensus.cc:385] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.118167 18921 raft_consensus.cc:740] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.118072 18920 raft_consensus.cc:359] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.118870 18920 raft_consensus.cc:385] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.119168 18920 raft_consensus.cc:740] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.119122 18921 consensus_queue.cc:260] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.120535 18919 ts_tablet_manager.cc:1434] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:13.120114 18920 consensus_queue.cc:260] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.121505 18921 ts_tablet_manager.cc:1434] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:13.121479 18925 raft_consensus.cc:493] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.122160 18925 raft_consensus.cc:515] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.122641 18921 tablet_bootstrap.cc:492] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.122846 18920 ts_tablet_manager.cc:1434] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:13.123767 18920 tablet_bootstrap.cc:492] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:13.124693 18925 leader_election.cc:290] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.121479 18919 tablet_bootstrap.cc:492] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.133679 18927 raft_consensus.cc:493] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.134171 18927 raft_consensus.cc:515] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:13.137413 18927 leader_election.cc:290] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215)
I20260709 13:08:13.146615 18920 tablet_bootstrap.cc:654] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.155040 18919 tablet_bootstrap.cc:654] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.179442 18919 tablet_bootstrap.cc:492] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.179953 18919 ts_tablet_manager.cc:1403] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.007s
I20260709 13:08:13.163187 18921 tablet_bootstrap.cc:654] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.181411 18926 raft_consensus.cc:493] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.182133 18926 raft_consensus.cc:515] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.183373 18919 raft_consensus.cc:359] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.184057 18919 raft_consensus.cc:385] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.184370 18919 raft_consensus.cc:740] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.185093 18919 consensus_queue.cc:260] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.186007 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.187301 18926 leader_election.cc:290] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.207803 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.208750 18920 tablet_bootstrap.cc:492] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.209263 18920 ts_tablet_manager.cc:1403] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.086s	user 0.040s	sys 0.019s
W20260709 13:08:13.210172 18769 leader_election.cc:343] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.212697 18920 raft_consensus.cc:359] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.213474 18920 raft_consensus.cc:385] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.214735 18920 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.215576 18920 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.214192 18921 tablet_bootstrap.cc:492] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.217675 18921 ts_tablet_manager.cc:1403] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.001s
I20260709 13:08:13.218829 18920 ts_tablet_manager.cc:1434] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 13:08:13.219522 18771 leader_election.cc:343] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.219738 18920 tablet_bootstrap.cc:492] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:13.220578 18921 raft_consensus.cc:359] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.221282 18921 raft_consensus.cc:385] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.221076 18771 leader_election.cc:304] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83; no voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.221614 18921 raft_consensus.cc:740] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.216528 18919 ts_tablet_manager.cc:1434] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:08:13.222277 18925 raft_consensus.cc:2749] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.222412 18921 consensus_queue.cc:260] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.223948 18919 tablet_bootstrap.cc:492] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.227690 18920 tablet_bootstrap.cc:654] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.227713 18921 ts_tablet_manager.cc:1434] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:08:13.226028 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.228396 18805 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.228883 18921 tablet_bootstrap.cc:492] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.235304 18927 raft_consensus.cc:493] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.235822 18927 raft_consensus.cc:515] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.237903 18927 leader_election.cc:290] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.239070 18921 tablet_bootstrap.cc:654] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.239832 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.240495 18805 raft_consensus.cc:2468] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.242139 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.242779 18920 tablet_bootstrap.cc:492] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.242712 18805 raft_consensus.cc:2468] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.243603 18920 ts_tablet_manager.cc:1403] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 13:08:13.245749 18696 leader_election.cc:304] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.246438 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.246897 18920 raft_consensus.cc:359] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.247387 18926 raft_consensus.cc:2804] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.247574 18920 raft_consensus.cc:385] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.247781 18926 raft_consensus.cc:493] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.247917 18920 raft_consensus.cc:740] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.248145 18926 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.248888 18920 consensus_queue.cc:260] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.249408 18919 tablet_bootstrap.cc:654] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.251374 18920 ts_tablet_manager.cc:1434] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:08:13.252362 18920 tablet_bootstrap.cc:492] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
W20260709 13:08:13.254097 18676 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:13.254099 18927 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.254663 18927 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
W20260709 13:08:13.255363 18694 leader_election.cc:343] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.256606 18927 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.261826 18926 raft_consensus.cc:515] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.265612 18954 raft_consensus.cc:493] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.266001 18920 tablet_bootstrap.cc:654] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.273537 18956 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.274008 18956 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.275760 18956 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.276836 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.277420 18805 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.278697 18696 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.279112 18845 leader_election.cc:304] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.279848 18927 raft_consensus.cc:2804] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.280231 18927 raft_consensus.cc:493] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.280566 18927 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.281745 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.282321 18879 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.266103 18954 raft_consensus.cc:515] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.286645 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.287220 18805 raft_consensus.cc:2468] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.287504 18927 raft_consensus.cc:515] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:13.288530 18696 leader_election.cc:304] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.292358 18956 raft_consensus.cc:2804] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.290218 18927 leader_election.cc:290] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215)
I20260709 13:08:13.293040 18845 leader_election.cc:304] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.296056 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.294512 18926 leader_election.cc:290] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.297020 18926 raft_consensus.cc:2804] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.296965 18879 raft_consensus.cc:2468] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.297518 18926 raft_consensus.cc:493] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.293507 18956 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.296211 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:13.293980 18954 leader_election.cc:290] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.297884 18926 raft_consensus.cc:3060] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.298348 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.299404 18805 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.300025 18919 tablet_bootstrap.cc:492] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.300689 18919 ts_tablet_manager.cc:1403] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.031s
W20260709 13:08:13.302527 18694 leader_election.cc:343] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.303557 18919 raft_consensus.cc:359] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.304291 18919 raft_consensus.cc:385] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.304333 18954 raft_consensus.cc:493] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.304275 18927 raft_consensus.cc:2804] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.304868 18919 raft_consensus.cc:740] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.305006 18954 raft_consensus.cc:515] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.305163 18927 raft_consensus.cc:493] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.305980 18927 raft_consensus.cc:3060] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.305646 18919 consensus_queue.cc:260] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.306911 18956 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.310344 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.309958 18920 tablet_bootstrap.cc:492] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.311892 18878 raft_consensus.cc:2468] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.312676 18920 ts_tablet_manager.cc:1403] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.002s
I20260709 13:08:13.307399 18954 leader_election.cc:290] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.313766 18694 leader_election.cc:304] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.314859 18954 raft_consensus.cc:2804] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.315313 18954 raft_consensus.cc:493] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.315711 18954 raft_consensus.cc:3060] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.317875 18926 raft_consensus.cc:515] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.321460 18959 raft_consensus.cc:493] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.322981 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:13.323393 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.323933 18805 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.324142 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.324738 18730 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.330667 18921 tablet_bootstrap.cc:492] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.331252 18921 ts_tablet_manager.cc:1403] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.017s
I20260709 13:08:13.333745 18805 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.333994 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.334777 18730 raft_consensus.cc:2393] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 024e6da43121494298bf12a8fef267d0 in current term 1: Already voted for candidate 3852a08afc364925bf86a197ebbcb3f3 in this term.
I20260709 13:08:13.322594 18959 raft_consensus.cc:515] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.335018 18921 raft_consensus.cc:359] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.336367 18845 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.337212 18959 leader_election.cc:290] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.337255 18845 leader_election.cc:304] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.337921 18959 raft_consensus.cc:2804] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.338321 18959 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.338690 18956 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.335947 18921 raft_consensus.cc:385] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.339394 18805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.322494 18926 leader_election.cc:290] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.339803 18729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.340184 18919 ts_tablet_manager.cc:1434] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.008s
I20260709 13:08:13.349002 18729 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.340909 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.349870 18730 raft_consensus.cc:2393] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 024e6da43121494298bf12a8fef267d0 in current term 1: Already voted for candidate 3852a08afc364925bf86a197ebbcb3f3 in this term.
I20260709 13:08:13.342063 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.347105 18920 raft_consensus.cc:359] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.347983 18925 raft_consensus.cc:493] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.347787 18959 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.351373 18925 raft_consensus.cc:515] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
W20260709 13:08:13.339993 18696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:45155, user_credentials={real_user=slave}} blocked reactor thread for 51541.1us
I20260709 13:08:13.348055 18921 raft_consensus.cc:740] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.353494 18925 leader_election.cc:290] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.354080 18921 consensus_queue.cc:260] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.360318 18802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.360574 18728 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.354506 18805 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.360972 18729 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.362679 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.362623 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.363404 18877 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 0.
I20260709 13:08:13.363454 18801 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.364436 18769 leader_election.cc:304] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.354892 18920 raft_consensus.cc:385] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.365043 18920 raft_consensus.cc:740] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.365370 18925 raft_consensus.cc:2804] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.365516 18845 leader_election.cc:304] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.365746 18925 raft_consensus.cc:493] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.365739 18920 consensus_queue.cc:260] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.366328 18925 raft_consensus.cc:3060] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.367085 18960 raft_consensus.cc:2804] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.355742 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.368444 18730 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 0.
I20260709 13:08:13.368628 18921 ts_tablet_manager.cc:1434] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:08:13.357167 18804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.369560 18921 tablet_bootstrap.cc:492] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.369521 18804 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.358736 18803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.359175 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:13.350854 18927 raft_consensus.cc:515] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.373386 18878 raft_consensus.cc:2393] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3852a08afc364925bf86a197ebbcb3f3 in current term 1: Already voted for candidate 024e6da43121494298bf12a8fef267d0 in this term.
I20260709 13:08:13.375828 18927 leader_election.cc:290] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.376452 18927 raft_consensus.cc:2804] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.376787 18927 raft_consensus.cc:493] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.377116 18927 raft_consensus.cc:3060] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.381699 18804 raft_consensus.cc:2468] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 1.
I20260709 13:08:13.356647 18954 raft_consensus.cc:515] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.359593 18956 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.360927 18802 raft_consensus.cc:3060] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.385545 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:13.386142 18878 raft_consensus.cc:3060] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:13.387470 18696 leader_election.cc:343] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.388460 18696 leader_election.cc:304] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 024e6da43121494298bf12a8fef267d0
I20260709 13:08:13.389366 18958 raft_consensus.cc:493] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.389849 18958 raft_consensus.cc:515] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.390409 18803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.391808 18926 raft_consensus.cc:2804] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.392629 18958 leader_election.cc:290] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.393424 18801 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 1.
I20260709 13:08:13.351837 18919 tablet_bootstrap.cc:492] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.394954 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.394188 18802 raft_consensus.cc:2468] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 1.
I20260709 13:08:13.395641 18877 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 0.
I20260709 13:08:13.396569 18878 raft_consensus.cc:2468] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 1.
I20260709 13:08:13.397048 18694 leader_election.cc:304] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.397863 18956 raft_consensus.cc:2804] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.398041 18694 leader_election.cc:304] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.398324 18956 raft_consensus.cc:493] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.398938 18965 raft_consensus.cc:2804] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.400266 18965 raft_consensus.cc:697] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:13.399045 18956 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.401145 18965 consensus_queue.cc:237] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
W20260709 13:08:13.402269 18696 leader_election.cc:343] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.403044 18926 raft_consensus.cc:697] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:13.402958 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.404385 18926 consensus_queue.cc:237] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.404680 18954 leader_election.cc:290] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.402956 18696 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.407845 18958 raft_consensus.cc:2804] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.408017 18696 leader_election.cc:304] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 024e6da43121494298bf12a8fef267d0
W20260709 13:08:13.409305 18696 leader_election.cc:343] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.359475 18959 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.414206 18920 ts_tablet_manager.cc:1434] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.005s
I20260709 13:08:13.406700 18925 raft_consensus.cc:515] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.418496 18920 tablet_bootstrap.cc:492] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:13.409652 18954 raft_consensus.cc:2804] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.419106 18954 raft_consensus.cc:697] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:13.410537 18879 raft_consensus.cc:2393] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3852a08afc364925bf86a197ebbcb3f3 in current term 1: Already voted for candidate 024e6da43121494298bf12a8fef267d0 in this term.
I20260709 13:08:13.415138 18964 raft_consensus.cc:493] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.422044 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.422148 18964 raft_consensus.cc:515] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.423072 18919 tablet_bootstrap.cc:654] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.422816 18730 raft_consensus.cc:3060] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.428524 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
W20260709 13:08:13.429955 18771 leader_election.cc:343] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.431519 18958 raft_consensus.cc:697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:13.432395 18958 consensus_queue.cc:237] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.433914 18730 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 1.
I20260709 13:08:13.435364 18771 leader_election.cc:304] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.436693 18962 raft_consensus.cc:2804] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.437305 18919 tablet_bootstrap.cc:492] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.437494 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:13.437759 18919 ts_tablet_manager.cc:1403] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.000s
W20260709 13:08:13.438802 18769 leader_election.cc:343] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.439250 18769 leader_election.cc:304] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83; no voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.440580 18962 raft_consensus.cc:697] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:13.440680 18919 raft_consensus.cc:359] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.441598 18919 raft_consensus.cc:385] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.441962 18919 raft_consensus.cc:740] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.441773 18962 consensus_queue.cc:237] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.443181 18970 raft_consensus.cc:2749] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.442871 18919 consensus_queue.cc:260] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.445281 18919 ts_tablet_manager.cc:1434] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:08:13.446090 18919 tablet_bootstrap.cc:492] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.446141 18954 consensus_queue.cc:237] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.446594 18927 raft_consensus.cc:515] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.444564 18921 tablet_bootstrap.cc:654] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.419858 18959 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.453195 18925 leader_election.cc:290] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.449368 18964 leader_election.cc:290] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.460355 18956 raft_consensus.cc:515] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.465224 18919 tablet_bootstrap.cc:654] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:13.463040 18845 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:45155, user_credentials={real_user=slave}} blocked reactor thread for 97606.9us
I20260709 13:08:13.466678 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
W20260709 13:08:13.469214 18696 leader_election.cc:343] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.469805 18960 raft_consensus.cc:697] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:13.465108 18927 leader_election.cc:290] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.471293 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:13.475988 18879 raft_consensus.cc:2393] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37588bf480cd41839ce9c9f75aefdb83 in current term 1: Already voted for candidate 024e6da43121494298bf12a8fef267d0 in this term.
I20260709 13:08:13.477172 18956 leader_election.cc:290] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.481235 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:13.481968 18879 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.483392 18920 tablet_bootstrap.cc:654] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.486702 18971 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.486421 18921 tablet_bootstrap.cc:492] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.491264 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.479524 18628 catalog_manager.cc:5697] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.494185 18921 ts_tablet_manager.cc:1403] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.001s
I20260709 13:08:13.497905 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c4e986f9bd41d0a3d78bf1b6da1fe1" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.499452 18801 raft_consensus.cc:2393] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 024e6da43121494298bf12a8fef267d0 in current term 1: Already voted for candidate 3852a08afc364925bf86a197ebbcb3f3 in this term.
I20260709 13:08:13.493005 18971 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.503547 18971 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:13.503676 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
W20260709 13:08:13.506129 18771 leader_election.cc:343] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.506443 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
W20260709 13:08:13.508313 18769 leader_election.cc:343] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.508905 18769 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83; no voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.471052 18960 consensus_queue.cc:237] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:13.515311 18971 raft_consensus.cc:2749] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.518064 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.520901 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.522956 18801 raft_consensus.cc:2393] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 024e6da43121494298bf12a8fef267d0 in current term 1: Already voted for candidate 3852a08afc364925bf86a197ebbcb3f3 in this term.
I20260709 13:08:13.524747 18921 raft_consensus.cc:359] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.525465 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.526881 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.528580 18879 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 1.
I20260709 13:08:13.529166 18845 leader_election.cc:304] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024e6da43121494298bf12a8fef267d0; no voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.527670 18730 raft_consensus.cc:2393] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 024e6da43121494298bf12a8fef267d0 in current term 1: Already voted for candidate 37588bf480cd41839ce9c9f75aefdb83 in this term.
I20260709 13:08:13.531739 18919 tablet_bootstrap.cc:492] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.533934 18963 raft_consensus.cc:2749] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.534089 18694 leader_election.cc:304] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:13.534868 18919 ts_tablet_manager.cc:1403] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.001s
I20260709 13:08:13.525388 18921 raft_consensus.cc:385] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.532868 18845 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024e6da43121494298bf12a8fef267d0; no voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.536340 18921 raft_consensus.cc:740] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.536670 18963 raft_consensus.cc:2749] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.537323 18921 consensus_queue.cc:260] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.538862 18921 ts_tablet_manager.cc:1434] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.043s	user 0.000s	sys 0.004s
I20260709 13:08:13.539760 18921 tablet_bootstrap.cc:492] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.540338 18965 raft_consensus.cc:2804] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.540817 18965 raft_consensus.cc:697] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:13.541009 18845 leader_election.cc:304] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 024e6da43121494298bf12a8fef267d0; no voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.541023 18919 raft_consensus.cc:359] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.541841 18919 raft_consensus.cc:385] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.542016 18963 raft_consensus.cc:2749] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.542146 18919 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.543100 18919 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.545063 18627 catalog_manager.cc:5697] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.546175 18921 tablet_bootstrap.cc:654] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.545799 18919 ts_tablet_manager.cc:1434] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:08:13.547214 18919 tablet_bootstrap.cc:492] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0: Bootstrap starting.
I20260709 13:08:13.541605 18965 consensus_queue.cc:237] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.554010 18921 tablet_bootstrap.cc:492] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.554374 18921 ts_tablet_manager.cc:1403] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:08:13.554526 18920 tablet_bootstrap.cc:492] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.555079 18920 ts_tablet_manager.cc:1403] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.007s
I20260709 13:08:13.556303 18921 raft_consensus.cc:359] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.556960 18921 raft_consensus.cc:385] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.557235 18921 raft_consensus.cc:740] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.557940 18921 consensus_queue.cc:260] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.558609 18919 tablet_bootstrap.cc:654] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.558372 18920 raft_consensus.cc:359] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.559250 18920 raft_consensus.cc:385] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.559597 18920 raft_consensus.cc:740] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.560223 18921 ts_tablet_manager.cc:1434] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:13.561086 18921 tablet_bootstrap.cc:492] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: Bootstrap starting.
I20260709 13:08:13.560657 18920 consensus_queue.cc:260] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.563632 18920 ts_tablet_manager.cc:1434] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:13.565265 18963 raft_consensus.cc:493] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.565846 18963 raft_consensus.cc:515] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.570024 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.570819 18730 raft_consensus.cc:2468] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.571110 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.571931 18801 raft_consensus.cc:2468] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.572388 18845 leader_election.cc:304] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.568833 18921 tablet_bootstrap.cc:654] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.573309 18960 raft_consensus.cc:2804] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.573264 18963 leader_election.cc:290] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.573915 18960 raft_consensus.cc:493] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.574270 18960 raft_consensus.cc:3060] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.564761 18920 tablet_bootstrap.cc:492] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83: Bootstrap starting.
I20260709 13:08:13.585165 18960 raft_consensus.cc:515] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.589164 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.589903 18730 raft_consensus.cc:3060] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.594997 18921 tablet_bootstrap.cc:492] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: No bootstrap required, opened a new log
I20260709 13:08:13.595466 18921 ts_tablet_manager.cc:1403] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.015s
I20260709 13:08:13.597556 18730 raft_consensus.cc:2468] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.598059 18921 raft_consensus.cc:359] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.598663 18921 raft_consensus.cc:385] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.598775 18845 leader_election.cc:304] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.598932 18921 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.599576 18963 raft_consensus.cc:2804] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.600250 18963 raft_consensus.cc:697] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:13.600390 18921 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.601574 18919 tablet_bootstrap.cc:492] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0: No bootstrap required, opened a new log
I20260709 13:08:13.602020 18919 ts_tablet_manager.cc:1403] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.014s
I20260709 13:08:13.601313 18963 consensus_queue.cc:237] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.602520 18921 ts_tablet_manager.cc:1434] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:13.605053 18920 tablet_bootstrap.cc:654] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.606703 18919 raft_consensus.cc:359] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.607827 18919 raft_consensus.cc:385] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.608131 18919 raft_consensus.cc:740] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.608992 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.608826 18919 consensus_queue.cc:260] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.609555 18801 raft_consensus.cc:3060] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.611431 18919 ts_tablet_manager.cc:1434] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:13.607458 18960 leader_election.cc:290] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.617564 18626 catalog_manager.cc:5697] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.620049 18626 catalog_manager.cc:5697] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.621212 18920 tablet_bootstrap.cc:492] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83: No bootstrap required, opened a new log
I20260709 13:08:13.621603 18920 ts_tablet_manager.cc:1403] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.005s
I20260709 13:08:13.624230 18920 raft_consensus.cc:359] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.624845 18920 raft_consensus.cc:385] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.625093 18920 raft_consensus.cc:740] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.625711 18920 consensus_queue.cc:260] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.627861 18920 ts_tablet_manager.cc:1434] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:13.628252 18801 raft_consensus.cc:2468] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.631560 18628 catalog_manager.cc:5697] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.643667 18626 catalog_manager.cc:5697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.645241 18626 catalog_manager.cc:5697] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.646486 18626 catalog_manager.cc:5697] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.657555 18963 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.657985 18963 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.659705 18963 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.660382 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.660722 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.660993 18730 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.661298 18801 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.662042 18845 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.662640 18963 raft_consensus.cc:2804] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.662992 18963 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.663271 18963 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.667791 18963 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.669638 18963 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.670339 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.670554 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.670910 18730 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.671082 18801 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.675627 18801 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.676615 18845 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:13.676716 18730 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.677335 18963 raft_consensus.cc:2804] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.677829 18963 raft_consensus.cc:697] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:13.678530 18963 consensus_queue.cc:237] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.685851 18626 catalog_manager.cc:5697] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.716260 18963 raft_consensus.cc:493] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.716884 18963 raft_consensus.cc:515] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.718549 18963 leader_election.cc:290] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.719372 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:13.719569 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83" is_pre_election: true
I20260709 13:08:13.719885 18730 raft_consensus.cc:2468] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.720108 18801 raft_consensus.cc:2468] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 0.
I20260709 13:08:13.720906 18845 leader_election.cc:304] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.721585 18963 raft_consensus.cc:2804] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.721921 18963 raft_consensus.cc:493] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.722211 18963 raft_consensus.cc:3060] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.726577 18963 raft_consensus.cc:515] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.728087 18963 leader_election.cc:290] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:13.728750 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:13.729038 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:13.729305 18730 raft_consensus.cc:3060] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.729547 18801 raft_consensus.cc:3060] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.735881 18730 raft_consensus.cc:2468] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.735884 18801 raft_consensus.cc:2468] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 1.
I20260709 13:08:13.737112 18845 leader_election.cc:304] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:13.737701 18963 raft_consensus.cc:2804] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.738194 18963 raft_consensus.cc:697] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:13.738867 18963 consensus_queue.cc:237] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:13.746264 18626 catalog_manager.cc:5697] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.794792 18965 consensus_queue.cc:1048] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.805459 18879 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.812765 18965 consensus_queue.cc:1048] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.823325 18801 raft_consensus.cc:3060] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.829982 18965 consensus_queue.cc:1048] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.840276 18965 consensus_queue.cc:1048] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.862910 18878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:08:13.863505 18878 raft_consensus.cc:606] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.875042 18965 consensus_queue.cc:1048] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.876539 18801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:08:13.877147 18801 raft_consensus.cc:606] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.887403 18958 consensus_queue.cc:1048] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.888852 18926 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.889037 18878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c601a6e886140f08768d71d34a67475"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:08:13.889674 18878 raft_consensus.cc:606] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.895517 18879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:08:13.896312 18879 raft_consensus.cc:606] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:13.904599 18958 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.923067 18730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:45470
I20260709 13:08:13.923651 18730 raft_consensus.cc:606] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Received request to transfer leadership to TS 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:13.930008 18730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:45470
I20260709 13:08:13.930675 18730 raft_consensus.cc:606] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Received request to transfer leadership to TS 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:13.935868 18730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:45470
I20260709 13:08:13.936564 18730 raft_consensus.cc:606] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Received request to transfer leadership to TS 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:13.941236 18879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
mode: GRACEFUL
new_leader_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:08:13.941654 18879 raft_consensus.cc:606] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Received request to transfer leadership to TS 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:13.946336 18730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:45470
I20260709 13:08:13.946825 18730 raft_consensus.cc:606] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Received request to transfer leadership to TS 024e6da43121494298bf12a8fef267d0
I20260709 13:08:13.995975 18971 consensus_queue.cc:1048] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.998626 18971 raft_consensus.cc:493] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.999022 18971 raft_consensus.cc:515] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.001678 18971 leader_election.cc:290] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.001971 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3852a08afc364925bf86a197ebbcb3f3" is_pre_election: true
I20260709 13:08:14.002375 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024e6da43121494298bf12a8fef267d0" is_pre_election: true
I20260709 13:08:14.003149 18878 raft_consensus.cc:2393] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37588bf480cd41839ce9c9f75aefdb83 in current term 1: Already voted for candidate 3852a08afc364925bf86a197ebbcb3f3 in this term.
I20260709 13:08:14.004186 18769 leader_election.cc:304] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83; no voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:14.005012 18971 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:14.021477 19010 consensus_queue.cc:1048] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.025367 18971 raft_consensus.cc:2749] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:14.031144 19010 raft_consensus.cc:993] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.031560 18971 raft_consensus.cc:1081] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.032954 18730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45450
I20260709 13:08:14.033437 18730 raft_consensus.cc:493] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.033720 18730 raft_consensus.cc:3060] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.038236 18730 raft_consensus.cc:515] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.039710 18730 leader_election.cc:290] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.040537 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:14.040822 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "125a99d88f144304a34fa5d4d41383f3" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.041126 18801 raft_consensus.cc:3055] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.041370 18879 raft_consensus.cc:3060] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.041478 18801 raft_consensus.cc:740] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:14.042372 18801 consensus_queue.cc:260] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.043676 18801 raft_consensus.cc:3060] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.044239 18963 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.048238 18879 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.049458 18694 leader_election.cc:304] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:14.050295 18958 raft_consensus.cc:2804] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.050745 18958 raft_consensus.cc:697] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.051348 18963 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.051451 18801 raft_consensus.cc:2468] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.051501 18958 consensus_queue.cc:237] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.058037 18963 raft_consensus.cc:993] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.058454 18963 raft_consensus.cc:1081] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.060305 18958 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.062649 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:08:14.063180 18728 raft_consensus.cc:493] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.063558 18728 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.070315 18628 catalog_manager.cc:5697] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 1 to 2, leader changed from 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.073727 18728 raft_consensus.cc:515] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:14.076707 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:14.077288 18801 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.077442 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.078050 18879 raft_consensus.cc:3055] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.078370 18879 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:14.079166 18879 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:14.080227 18879 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.081998 18728 leader_election.cc:290] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.083567 18926 raft_consensus.cc:993] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.084012 18926 raft_consensus.cc:1081] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Signalling peer 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.084061 18801 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.088532 18879 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.089143 18696 leader_election.cc:304] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:14.088809 18958 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:14.090523 18965 raft_consensus.cc:2804] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.091050 18965 raft_consensus.cc:697] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.091847 18965 consensus_queue.cc:237] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:14.093822 18801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:40814
I20260709 13:08:14.094421 18801 raft_consensus.cc:493] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.094791 18801 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.101684 18801 raft_consensus.cc:515] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.104360 18628 catalog_manager.cc:5697] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 1 to 2, leader changed from 024e6da43121494298bf12a8fef267d0 (127.17.171.195) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.105530 18801 leader_election.cc:290] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.107944 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:14.108515 18728 raft_consensus.cc:3055] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.108832 18728 raft_consensus.cc:740] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.109575 18728 consensus_queue.cc:260] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.110680 18728 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.111989 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.113405 18879 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.117545 18728 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.118841 18771 leader_election.cc:304] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:14.119182 18879 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.119741 18971 raft_consensus.cc:2804] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.120242 18971 raft_consensus.cc:697] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:14.120940 18971 consensus_queue.cc:237] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.127012 18627 catalog_manager.cc:5697] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 1 to 2, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.156041 18963 consensus_queue.cc:1048] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.161880 18960 raft_consensus.cc:993] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.162379 18927 raft_consensus.cc:1081] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.164109 18730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c601a6e886140f08768d71d34a67475"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:08:14.164685 18730 raft_consensus.cc:493] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.165057 18730 raft_consensus.cc:3060] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.166916 18927 consensus_queue.cc:1048] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.172207 18730 raft_consensus.cc:515] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.173382 18728 raft_consensus.cc:1240] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Rejecting Update request from peer 024e6da43121494298bf12a8fef267d0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:14.175102 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:14.175700 18801 raft_consensus.cc:3060] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.175866 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c601a6e886140f08768d71d34a67475" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.176499 18879 raft_consensus.cc:3055] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.176818 18879 raft_consensus.cc:740] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:14.177584 18879 consensus_queue.cc:260] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.178629 18879 raft_consensus.cc:3060] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.175280 18730 leader_election.cc:290] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.182515 18801 raft_consensus.cc:2468] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.183581 18696 leader_election.cc:304] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:14.184347 18958 raft_consensus.cc:2804] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.184801 18958 raft_consensus.cc:697] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.185145 18879 raft_consensus.cc:2468] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.186722 18958 consensus_queue.cc:237] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.191144 18927 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.193363 18627 catalog_manager.cc:5697] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 1 to 2, leader changed from 024e6da43121494298bf12a8fef267d0 (127.17.171.195) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.197868 18963 raft_consensus.cc:993] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.198263 18963 raft_consensus.cc:1081] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:14.200155 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:08:14.200703 18728 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.201066 18728 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.201853 18927 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.206579 18927 consensus_queue.cc:1048] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.209229 18728 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.210427 18730 raft_consensus.cc:1240] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Rejecting Update request from peer 024e6da43121494298bf12a8fef267d0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:14.211692 18728 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.212786 18802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:14.214618 18927 consensus_queue.cc:1059] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.215404 18927 raft_consensus.cc:3055] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.216607 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.215709 18927 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:14.218362 18960 raft_consensus.cc:993] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: : Instructing follower 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.218060 18927 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.218753 18960 raft_consensus.cc:1081] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Signalling peer 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.219233 18927 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.221163 18804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:40810
I20260709 13:08:14.221732 18804 raft_consensus.cc:493] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.222157 18804 raft_consensus.cc:3060] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.230952 18804 raft_consensus.cc:515] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.231266 18879 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 2.
I20260709 13:08:14.231869 18960 consensus_queue.cc:1048] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.233675 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:14.234447 18694 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:14.234740 18804 leader_election.cc:290] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.235821 18958 raft_consensus.cc:2804] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.236344 18958 raft_consensus.cc:697] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.237064 18958 consensus_queue.cc:237] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.235953 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "633732d01fd44faeb53cd5efbbcb45fa" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.239624 18879 raft_consensus.cc:3055] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.239928 18879 raft_consensus.cc:740] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:14.240701 18879 consensus_queue.cc:260] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.241844 18879 raft_consensus.cc:3060] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.245038 18628 catalog_manager.cc:5697] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 1 to 2, leader changed from 024e6da43121494298bf12a8fef267d0 (127.17.171.195) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.246753 18879 raft_consensus.cc:2468] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.247810 18769 leader_election.cc:304] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:14.248518 18971 raft_consensus.cc:2804] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.248984 18971 raft_consensus.cc:697] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:14.249744 18971 consensus_queue.cc:237] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.256279 18628 catalog_manager.cc:5697] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 1 to 2, leader changed from 024e6da43121494298bf12a8fef267d0 (127.17.171.195) to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.278306 18958 raft_consensus.cc:993] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:14.278824 18926 raft_consensus.cc:1081] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Signalling peer 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:14.280289 18879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:08:14.280838 18879 raft_consensus.cc:493] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.281204 18879 raft_consensus.cc:3060] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.285888 18879 raft_consensus.cc:515] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.287523 18879 leader_election.cc:290] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 2 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:14.288985 18804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:14.289186 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4071ca08a124b44b9df5d14d868d218" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:14.289553 18804 raft_consensus.cc:3060] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.289669 18730 raft_consensus.cc:3055] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.289919 18730 raft_consensus.cc:740] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.290526 18730 consensus_queue.cc:260] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.291461 18730 raft_consensus.cc:3060] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.296651 18730 raft_consensus.cc:2468] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 2.
I20260709 13:08:14.297653 18804 raft_consensus.cc:2468] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 2.
I20260709 13:08:14.297852 18845 leader_election.cc:304] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:14.298702 18960 raft_consensus.cc:2804] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.299149 18960 raft_consensus.cc:697] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 2 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:14.299926 18960 consensus_queue.cc:237] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.306913 18627 catalog_manager.cc:5697] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 1 to 2, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.339010 18958 raft_consensus.cc:993] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.339438 18926 raft_consensus.cc:1081] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Signalling peer 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.340773 18804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:40814
I20260709 13:08:14.341192 18804 raft_consensus.cc:493] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.341436 18804 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.346032 18804 raft_consensus.cc:515] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.347479 18804 leader_election.cc:290] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.348251 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:14.348448 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.348853 18730 raft_consensus.cc:3055] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.348997 18879 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.349247 18730 raft_consensus.cc:740] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.349956 18730 consensus_queue.cc:260] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.350831 18730 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.354024 18879 raft_consensus.cc:2468] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.355026 18769 leader_election.cc:304] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:14.355526 18730 raft_consensus.cc:2468] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.355708 18971 raft_consensus.cc:2804] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.356247 18971 raft_consensus.cc:697] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:14.357000 18971 consensus_queue.cc:237] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.363095 18627 catalog_manager.cc:5697] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 1 to 2, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.477908 18804 raft_consensus.cc:1275] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.479094 18926 consensus_queue.cc:1048] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.485967 18879 raft_consensus.cc:1275] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.487536 18958 consensus_queue.cc:1048] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.519968 18958 raft_consensus.cc:993] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.520386 18926 raft_consensus.cc:1081] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Signalling peer 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:14.521636 18804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:40814
I20260709 13:08:14.522214 18804 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.522469 18804 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.528620 18804 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.530259 18804 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:14.530840 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:14.531198 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:14.531417 18730 raft_consensus.cc:3055] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.531682 18879 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.531797 18730 raft_consensus.cc:740] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:14.532527 18730 consensus_queue.cc:260] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.533496 18730 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.536463 18879 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.537355 18769 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:14.537930 18730 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 2.
I20260709 13:08:14.537974 18971 raft_consensus.cc:2804] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.538507 18971 raft_consensus.cc:697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:14.539217 18971 consensus_queue.cc:237] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:14.545029 18627 catalog_manager.cc:5697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 1 to 2, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.603127 18804 raft_consensus.cc:1275] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.604388 18926 consensus_queue.cc:1048] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.611656 18879 raft_consensus.cc:1275] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.613068 18958 consensus_queue.cc:1048] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.620124 18879 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.621510 18926 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.629001 18804 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.630393 18958 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.638820 18804 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.644199 18804 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.645668 18958 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.645852 18879 raft_consensus.cc:1275] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.647150 18971 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.656859 18730 raft_consensus.cc:1275] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.658577 18878 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.660106 18926 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.661211 19023 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.684689 18804 raft_consensus.cc:1275] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.685936 18960 consensus_queue.cc:1048] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.693039 18730 raft_consensus.cc:1275] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.694707 18963 consensus_queue.cc:1048] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.741366 18879 raft_consensus.cc:1275] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.742503 19023 consensus_queue.cc:1048] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.749209 18730 raft_consensus.cc:3060] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.755832 18730 raft_consensus.cc:1275] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.757007 19023 consensus_queue.cc:1048] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.856261 18730 raft_consensus.cc:1275] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.857367 19023 consensus_queue.cc:1048] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.864774 18879 raft_consensus.cc:1275] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.866520 19023 consensus_queue.cc:1048] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.983676 18730 raft_consensus.cc:1275] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.984946 19023 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.001597 18879 raft_consensus.cc:1275] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:15.002849 19023 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:16.978639 18095 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:08:16.979678 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:16.997438 18730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:45484
I20260709 13:08:16.997913 18730 raft_consensus.cc:606] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Received request to transfer leadership to TS 024e6da43121494298bf12a8fef267d0
I20260709 13:08:17.000161 18730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:45484
I20260709 13:08:17.000761 18730 raft_consensus.cc:606] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Received request to transfer leadership to TS 024e6da43121494298bf12a8fef267d0
I20260709 13:08:17.001873 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:17.002431 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:17.291518 18926 raft_consensus.cc:993] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:17.291922 19030 raft_consensus.cc:1081] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Signalling peer 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:17.293289 18879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:08:17.293794 18879 raft_consensus.cc:493] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.294129 18879 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.300572 18879 raft_consensus.cc:515] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:17.302390 18879 leader_election.cc:290] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 3 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215)
I20260709 13:08:17.303514 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:17.303791 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:17.304092 18730 raft_consensus.cc:3055] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:17.304430 18801 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.304524 18730 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:17.305408 18730 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:17.306361 18730 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.311225 18801 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 3.
I20260709 13:08:17.311548 18730 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 3.
I20260709 13:08:17.312273 18845 leader_election.cc:304] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:17.312867 19029 raft_consensus.cc:2804] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:17.313815 19029 raft_consensus.cc:697] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:17.314507 19029 consensus_queue.cc:237] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:17.320354 18626 catalog_manager.cc:5697] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 2 to 3, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.543128 18926 raft_consensus.cc:993] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:17.543540 19030 raft_consensus.cc:1081] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Signalling peer 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:17.545132 18879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:08:17.545614 18879 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.545903 18879 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.550033 18879 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:17.551467 18879 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 3 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:17.552150 18730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:17.552584 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:17.552726 18730 raft_consensus.cc:3055] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:17.553222 18730 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:17.553227 18801 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.554075 18730 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:17.554981 18730 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.559523 18730 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 3.
I20260709 13:08:17.559815 18801 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 3.
I20260709 13:08:17.560367 18845 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:17.561125 19029 raft_consensus.cc:2804] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:17.561529 19029 raft_consensus.cc:697] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:17.562265 19029 consensus_queue.cc:237] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:17.567749 18626 catalog_manager.cc:5697] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 2 to 3, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.706535 18801 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:17.707603 19029 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:17.717231 18730 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:17.720656 19043 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:17.950114 18728 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:17.951427 19043 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:17.960542 18801 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:17.962941 19029 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.003310 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:18.013934 18879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:08:18.014428 18879 raft_consensus.cc:606] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:18.026158 18879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:08:18.026633 18879 raft_consensus.cc:606] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:18.030930 18801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:08:18.031448 18801 raft_consensus.cc:606] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:18.036631 18801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:08:18.037002 18801 raft_consensus.cc:606] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:18.040995 18801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
mode: GRACEFUL
new_leader_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:40818
I20260709 13:08:18.041363 18801 raft_consensus.cc:606] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Received request to transfer leadership to TS 3852a08afc364925bf86a197ebbcb3f3
I20260709 13:08:18.113631 19043 raft_consensus.cc:993] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.114104 19029 raft_consensus.cc:1081] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.115568 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:08:18.116137 18728 raft_consensus.cc:493] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.116487 18728 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.120820 18728 raft_consensus.cc:515] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:18.122289 18728 leader_election.cc:290] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 4 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:18.122957 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:18.123183 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:18.123503 18801 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.123638 18879 raft_consensus.cc:3055] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:18.123961 18879 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:18.124667 18879 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:18.125713 18879 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.129383 18801 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 4.
I20260709 13:08:18.130364 18696 leader_election.cc:304] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:18.131088 19030 raft_consensus.cc:2804] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:18.131506 18879 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 4.
I20260709 13:08:18.132040 19030 raft_consensus.cc:697] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:18.132964 19030 consensus_queue.cc:237] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:18.138211 18627 catalog_manager.cc:5697] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 3 to 4, leader changed from 024e6da43121494298bf12a8fef267d0 (127.17.171.195) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 4 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.168618 19031 raft_consensus.cc:993] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.169075 19053 raft_consensus.cc:1081] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.170533 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45450
I20260709 13:08:18.170981 18728 raft_consensus.cc:493] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.171277 18728 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.175616 18728 raft_consensus.cc:515] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.177191 18728 leader_election.cc:290] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 3 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:18.177902 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:18.178184 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8da61420a6f4303890ae6c175dcfeab" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:18.178454 18801 raft_consensus.cc:3055] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.178669 18879 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.178766 18801 raft_consensus.cc:740] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:18.179513 18801 consensus_queue.cc:260] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.180593 18801 raft_consensus.cc:3060] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.184706 18879 raft_consensus.cc:2468] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 3.
I20260709 13:08:18.185760 18694 leader_election.cc:304] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:18.186444 18801 raft_consensus.cc:2468] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 3.
I20260709 13:08:18.186582 19030 raft_consensus.cc:2804] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.187067 19030 raft_consensus.cc:697] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:18.187755 19030 consensus_queue.cc:237] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.193949 18627 catalog_manager.cc:5697] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 2 to 3, leader changed from 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 3 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.316182 19031 raft_consensus.cc:993] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.316712 19053 raft_consensus.cc:1081] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.318207 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45450
I20260709 13:08:18.318715 18728 raft_consensus.cc:493] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.319021 18728 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.323827 18728 raft_consensus.cc:515] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.325650 18728 leader_election.cc:290] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 3 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:18.326315 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:18.326648 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:18.326887 18801 raft_consensus.cc:3055] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.327147 18879 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.327186 18801 raft_consensus.cc:740] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:18.327987 18801 consensus_queue.cc:260] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.329078 18801 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.333269 18879 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 3.
I20260709 13:08:18.334293 18694 leader_election.cc:304] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:18.334782 18801 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 3.
I20260709 13:08:18.334944 19030 raft_consensus.cc:2804] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.335409 19030 raft_consensus.cc:697] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:18.336228 19030 consensus_queue.cc:237] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.342187 18627 catalog_manager.cc:5697] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 2 to 3, leader changed from 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 3 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.538275 19043 raft_consensus.cc:993] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.538687 19043 raft_consensus.cc:1081] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.539980 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:08:18.540509 18728 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.540865 18728 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.545382 18728 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.547077 18728 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 4 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:18.547786 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:18.548100 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:18.548336 18801 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.548653 18879 raft_consensus.cc:3055] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:18.548919 18879 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:18.549574 18879 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.550416 18879 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.552451 18801 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 4.
I20260709 13:08:18.553426 18696 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37588bf480cd41839ce9c9f75aefdb83, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:18.554157 19030 raft_consensus.cc:2804] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:18.554569 19030 raft_consensus.cc:697] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:18.555480 18879 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 4.
I20260709 13:08:18.555377 19030 consensus_queue.cc:237] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.561022 18627 catalog_manager.cc:5697] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 3 to 4, leader changed from 024e6da43121494298bf12a8fef267d0 (127.17.171.195) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 4 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.567891 19031 raft_consensus.cc:993] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: : Instructing follower 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.568351 19031 raft_consensus.cc:1081] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Signalling peer 3852a08afc364925bf86a197ebbcb3f3 to start an election
I20260709 13:08:18.569818 18728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
 from {username='slave'} at 127.0.0.1:45450
I20260709 13:08:18.570236 18728 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.570474 18728 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.574740 18728 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.576301 18728 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 3 election: Requested vote from peers 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:18.576997 18801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:18.577267 18879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "3852a08afc364925bf86a197ebbcb3f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:18.577468 18801 raft_consensus.cc:3055] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.577759 18879 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.577761 18801 raft_consensus.cc:740] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:18.578544 18801 consensus_queue.cc:260] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.579330 18801 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.581801 18879 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 3.
I20260709 13:08:18.582644 18694 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 3852a08afc364925bf86a197ebbcb3f3; no voters: 
I20260709 13:08:18.583267 19030 raft_consensus.cc:2804] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.583441 18801 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3852a08afc364925bf86a197ebbcb3f3 in term 3.
I20260709 13:08:18.583649 19030 raft_consensus.cc:697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Becoming Leader. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:18.584826 19030 consensus_queue.cc:237] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:18.590994 18627 catalog_manager.cc:5697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 reported cstate change: term changed from 2 to 3, leader changed from 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194) to 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193). New cstate: current_term: 3 leader_uuid: "3852a08afc364925bf86a197ebbcb3f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.596549 18801 raft_consensus.cc:1275] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.598055 19049 consensus_queue.cc:1048] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.607203 18879 raft_consensus.cc:1275] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.608480 19030 consensus_queue.cc:1048] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.698218 18801 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.699381 19059 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.706964 18879 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.708657 19049 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.767448 18801 raft_consensus.cc:1275] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.768611 19049 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.776786 18879 raft_consensus.cc:1275] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.778180 19030 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.992226 18801 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.993429 19030 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.998890 18879 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:19.000283 19049 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:19.020323 18801 raft_consensus.cc:1275] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:19.021585 19049 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:19.029354 18879 raft_consensus.cc:1275] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Refusing update from remote peer 3852a08afc364925bf86a197ebbcb3f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:19.031050 19030 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.047760 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:21.056658 18728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:45484
I20260709 13:08:21.057329 18728 raft_consensus.cc:606] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Received request to transfer leadership to TS 024e6da43121494298bf12a8fef267d0
I20260709 13:08:21.059775 18728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:45484
I20260709 13:08:21.060243 18728 raft_consensus.cc:606] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Received request to transfer leadership to TS 024e6da43121494298bf12a8fef267d0
I20260709 13:08:21.062314 18728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:45484
I20260709 13:08:21.062729 18728 raft_consensus.cc:606] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Received request to transfer leadership to TS 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:21.064798 18728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
mode: GRACEFUL
new_leader_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:45484
I20260709 13:08:21.065217 18728 raft_consensus.cc:606] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Received request to transfer leadership to TS 37588bf480cd41839ce9c9f75aefdb83
I20260709 13:08:21.066177 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:21.066642 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:21.133176 19030 raft_consensus.cc:993] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:21.133682 19071 raft_consensus.cc:1081] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Signalling peer 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:21.135217 18878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:08:21.135700 18878 raft_consensus.cc:493] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.136045 18878 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.141718 18878 raft_consensus.cc:515] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.143579 18878 leader_election.cc:290] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 4 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:21.144433 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:21.144752 18804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5246b63227e549cab5c3bf4e6a3b5d79" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:21.145257 18728 raft_consensus.cc:3055] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:21.145349 18804 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.145624 18728 raft_consensus.cc:740] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:21.146416 18728 consensus_queue.cc:260] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.147401 18728 raft_consensus.cc:3060] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.150044 18804 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 4.
I20260709 13:08:21.151322 18845 leader_election.cc:304] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:21.152319 19043 raft_consensus.cc:2804] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:21.153316 19043 raft_consensus.cc:697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 4 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:21.153800 18728 raft_consensus.cc:2468] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 4.
I20260709 13:08:21.154263 19043 consensus_queue.cc:237] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.160861 18626 catalog_manager.cc:5697] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 3 to 4, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 4 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.211941 19030 raft_consensus.cc:993] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:21.212445 19071 raft_consensus.cc:1081] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Signalling peer 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:21.213624 18804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:40814
I20260709 13:08:21.213974 18804 raft_consensus.cc:493] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.214219 18804 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.218428 18804 raft_consensus.cc:515] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.219889 18804 leader_election.cc:290] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 5 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963)
I20260709 13:08:21.220527 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:21.220949 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c3883ccd374fc1aad1583099f58fc8" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:21.221099 18728 raft_consensus.cc:3055] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:21.221447 18878 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.221442 18728 raft_consensus.cc:740] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:21.222302 18728 consensus_queue.cc:260] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.223181 18728 raft_consensus.cc:3060] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.226125 18878 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 5.
I20260709 13:08:21.227300 18769 leader_election.cc:304] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:21.227598 18728 raft_consensus.cc:2468] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 5.
I20260709 13:08:21.228312 19031 raft_consensus.cc:2804] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:21.229391 19031 raft_consensus.cc:697] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 5 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:21.230216 19031 consensus_queue.cc:237] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.237133 18626 catalog_manager.cc:5697] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 4 to 5, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 5 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.247251 19030 raft_consensus.cc:993] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:21.247682 19071 raft_consensus.cc:1081] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Signalling peer 024e6da43121494298bf12a8fef267d0 to start an election
I20260709 13:08:21.249008 18878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f"
dest_uuid: "024e6da43121494298bf12a8fef267d0"
 from {username='slave'} at 127.0.0.1:34920
I20260709 13:08:21.249692 18878 raft_consensus.cc:493] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.249951 18878 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.255381 18878 raft_consensus.cc:515] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.257035 18878 leader_election.cc:290] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 4 election: Requested vote from peers 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215), 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155)
I20260709 13:08:21.257577 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:21.258020 18804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b69e4d3caa4bf7bdb8492135e1091f" candidate_uuid: "024e6da43121494298bf12a8fef267d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
I20260709 13:08:21.258126 18728 raft_consensus.cc:3055] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:21.258481 18728 raft_consensus.cc:740] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:21.258483 18804 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.259264 18728 consensus_queue.cc:260] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.260067 18728 raft_consensus.cc:3060] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.262548 18804 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 4.
I20260709 13:08:21.263350 18845 leader_election.cc:304] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:21.264016 19043 raft_consensus.cc:2804] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:21.264197 18728 raft_consensus.cc:2468] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024e6da43121494298bf12a8fef267d0 in term 4.
I20260709 13:08:21.264518 19043 raft_consensus.cc:697] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 4 LEADER]: Becoming Leader. State: Replica: 024e6da43121494298bf12a8fef267d0, State: Running, Role: LEADER
I20260709 13:08:21.265304 19043 consensus_queue.cc:237] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } }
I20260709 13:08:21.271780 18626 catalog_manager.cc:5697] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 reported cstate change: term changed from 3 to 4, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 024e6da43121494298bf12a8fef267d0 (127.17.171.195). New cstate: current_term: 4 leader_uuid: "024e6da43121494298bf12a8fef267d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.445075 19030 raft_consensus.cc:993] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: : Instructing follower 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:21.445518 19071 raft_consensus.cc:1081] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Signalling peer 37588bf480cd41839ce9c9f75aefdb83 to start an election
I20260709 13:08:21.446957 18804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e"
dest_uuid: "37588bf480cd41839ce9c9f75aefdb83"
 from {username='slave'} at 127.0.0.1:40814
I20260709 13:08:21.447438 18804 raft_consensus.cc:493] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.447708 18804 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.451671 18804 raft_consensus.cc:515] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:21.453146 18804 leader_election.cc:290] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 5 election: Requested vote from peers 024e6da43121494298bf12a8fef267d0 (127.17.171.195:45963), 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215)
I20260709 13:08:21.453826 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "024e6da43121494298bf12a8fef267d0"
I20260709 13:08:21.454146 18728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea3223a95914773ba85d67fd0ed628e" candidate_uuid: "37588bf480cd41839ce9c9f75aefdb83" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3852a08afc364925bf86a197ebbcb3f3"
I20260709 13:08:21.454349 18878 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.454654 18728 raft_consensus.cc:3055] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:21.454917 18728 raft_consensus.cc:740] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3852a08afc364925bf86a197ebbcb3f3, State: Running, Role: LEADER
I20260709 13:08:21.455526 18728 consensus_queue.cc:260] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:21.456404 18728 raft_consensus.cc:3060] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.459244 18878 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 5.
I20260709 13:08:21.460126 18769 leader_election.cc:304] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024e6da43121494298bf12a8fef267d0, 37588bf480cd41839ce9c9f75aefdb83; no voters: 
I20260709 13:08:21.460322 18728 raft_consensus.cc:2468] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37588bf480cd41839ce9c9f75aefdb83 in term 5.
I20260709 13:08:21.460866 19031 raft_consensus.cc:2804] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:21.461319 19031 raft_consensus.cc:697] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 5 LEADER]: Becoming Leader. State: Replica: 37588bf480cd41839ce9c9f75aefdb83, State: Running, Role: LEADER
I20260709 13:08:21.462082 19031 consensus_queue.cc:237] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } }
I20260709 13:08:21.468142 18626 catalog_manager.cc:5697] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 reported cstate change: term changed from 4 to 5, leader changed from 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193) to 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194). New cstate: current_term: 5 leader_uuid: "37588bf480cd41839ce9c9f75aefdb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.599974 18804 raft_consensus.cc:1275] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:21.601231 19043 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:21.612742 18728 raft_consensus.cc:1275] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:21.614274 19043 consensus_queue.cc:1048] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:21.643803 18878 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:21.645143 19031 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.654264 18728 raft_consensus.cc:1275] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:21.657095 19089 consensus_queue.cc:1048] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:21.793395 18728 raft_consensus.cc:1275] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:21.794427 19043 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:21.802901 18801 raft_consensus.cc:1275] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Refusing update from remote peer 024e6da43121494298bf12a8fef267d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:21.804358 19085 consensus_queue.cc:1048] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37588bf480cd41839ce9c9f75aefdb83" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 45155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:21.891964 18728 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:21.893122 19089 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3852a08afc364925bf86a197ebbcb3f3" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.901233 18878 raft_consensus.cc:1275] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Refusing update from remote peer 37588bf480cd41839ce9c9f75aefdb83: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:21.902722 19094 consensus_queue.cc:1048] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "024e6da43121494298bf12a8fef267d0" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 45963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:22.067556 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.074751 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:08:22.098642 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:22.099337 18095 tablet_replica.cc:333] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.099933 18095 raft_consensus.cc:2243] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.100373 18095 raft_consensus.cc:2272] T d3c3883ccd374fc1aad1583099f58fc8 P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.102540 18095 tablet_replica.cc:333] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.103081 18095 raft_consensus.cc:2243] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.103502 18095 raft_consensus.cc:2272] T 633732d01fd44faeb53cd5efbbcb45fa P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.105567 18095 tablet_replica.cc:333] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.106040 18095 raft_consensus.cc:2243] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.106738 18095 raft_consensus.cc:2272] T 6c601a6e886140f08768d71d34a67475 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.108336 18095 tablet_replica.cc:333] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.108807 18095 raft_consensus.cc:2243] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.109488 18095 raft_consensus.cc:2272] T 125a99d88f144304a34fa5d4d41383f3 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.111080 18095 tablet_replica.cc:333] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.111616 18095 raft_consensus.cc:2243] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.112342 18095 raft_consensus.cc:2272] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 3852a08afc364925bf86a197ebbcb3f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.113914 18095 tablet_replica.cc:333] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.114364 18095 raft_consensus.cc:2243] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.114750 18095 raft_consensus.cc:2272] T 9ea3223a95914773ba85d67fd0ed628e P 3852a08afc364925bf86a197ebbcb3f3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.117347 18095 tablet_replica.cc:333] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.117834 18095 raft_consensus.cc:2243] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.118227 18095 raft_consensus.cc:2272] T f4071ca08a124b44b9df5d14d868d218 P 3852a08afc364925bf86a197ebbcb3f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.119814 18095 tablet_replica.cc:333] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.120303 18095 raft_consensus.cc:2243] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.120682 18095 raft_consensus.cc:2272] T 5246b63227e549cab5c3bf4e6a3b5d79 P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.122450 18095 tablet_replica.cc:333] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.122895 18095 raft_consensus.cc:2243] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.123253 18095 raft_consensus.cc:2272] T 60b69e4d3caa4bf7bdb8492135e1091f P 3852a08afc364925bf86a197ebbcb3f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.125219 18095 tablet_replica.cc:333] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3: stopping tablet replica
I20260709 13:08:22.125651 18095 raft_consensus.cc:2243] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.126545 18095 raft_consensus.cc:2272] T b8da61420a6f4303890ae6c175dcfeab P 3852a08afc364925bf86a197ebbcb3f3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:22.127796 18845 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:08:22.132987 18845 consensus_peers.cc:597] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 -> Peer 3852a08afc364925bf86a197ebbcb3f3 (127.17.171.193:42215): Couldn't send request to peer 3852a08afc364925bf86a197ebbcb3f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.156917 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
I20260709 13:08:22.175014 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
I20260709 13:08:22.197892 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:22.198776 18095 tablet_replica.cc:333] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.199463 18095 raft_consensus.cc:2243] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.199965 18095 raft_consensus.cc:2272] T f4071ca08a124b44b9df5d14d868d218 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.201831 18095 tablet_replica.cc:333] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.202371 18095 raft_consensus.cc:2243] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.203080 18095 raft_consensus.cc:2272] T 633732d01fd44faeb53cd5efbbcb45fa P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.204824 18095 tablet_replica.cc:333] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.205277 18095 raft_consensus.cc:2243] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.205693 18095 raft_consensus.cc:2272] T 60b69e4d3caa4bf7bdb8492135e1091f P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.208269 18095 tablet_replica.cc:333] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.208737 18095 raft_consensus.cc:2243] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.209122 18095 raft_consensus.cc:2272] T 5246b63227e549cab5c3bf4e6a3b5d79 P 37588bf480cd41839ce9c9f75aefdb83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.211030 18095 tablet_replica.cc:333] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.211485 18095 raft_consensus.cc:2243] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.212064 18095 raft_consensus.cc:2272] T d3c3883ccd374fc1aad1583099f58fc8 P 37588bf480cd41839ce9c9f75aefdb83 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.213864 18095 tablet_replica.cc:333] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.214288 18095 raft_consensus.cc:2243] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.214627 18095 raft_consensus.cc:2272] T b8da61420a6f4303890ae6c175dcfeab P 37588bf480cd41839ce9c9f75aefdb83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.216010 18095 tablet_replica.cc:333] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.216497 18095 raft_consensus.cc:2243] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.216847 18095 raft_consensus.cc:2272] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 37588bf480cd41839ce9c9f75aefdb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.218550 18095 tablet_replica.cc:333] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.218961 18095 raft_consensus.cc:2243] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.219340 18095 raft_consensus.cc:2272] T 125a99d88f144304a34fa5d4d41383f3 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.220837 18095 tablet_replica.cc:333] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.221226 18095 raft_consensus.cc:2243] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.221555 18095 raft_consensus.cc:2272] T 6c601a6e886140f08768d71d34a67475 P 37588bf480cd41839ce9c9f75aefdb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.223021 18095 tablet_replica.cc:333] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83: stopping tablet replica
I20260709 13:08:22.223395 18095 raft_consensus.cc:2243] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.224021 18095 raft_consensus.cc:2272] T 9ea3223a95914773ba85d67fd0ed628e P 37588bf480cd41839ce9c9f75aefdb83 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.243063 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
W20260709 13:08:22.253372 18845 consensus_peers.cc:597] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 -> Peer 37588bf480cd41839ce9c9f75aefdb83 (127.17.171.194:45155): Couldn't send request to peer 37588bf480cd41839ce9c9f75aefdb83. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:45155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.263458 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
I20260709 13:08:22.283722 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:22.284430 18095 tablet_replica.cc:333] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.285028 18095 raft_consensus.cc:2243] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.285528 18095 raft_consensus.cc:2272] T b8da61420a6f4303890ae6c175dcfeab P 024e6da43121494298bf12a8fef267d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.287281 18095 tablet_replica.cc:333] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.287767 18095 raft_consensus.cc:2243] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.288215 18095 raft_consensus.cc:2272] T d3c3883ccd374fc1aad1583099f58fc8 P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.290702 18095 tablet_replica.cc:333] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.291200 18095 raft_consensus.cc:2243] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.291615 18095 raft_consensus.cc:2272] T 633732d01fd44faeb53cd5efbbcb45fa P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.293259 18095 tablet_replica.cc:333] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.293707 18095 raft_consensus.cc:2243] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.294138 18095 raft_consensus.cc:2272] T 6c601a6e886140f08768d71d34a67475 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.295603 18095 tablet_replica.cc:333] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.296072 18095 raft_consensus.cc:2243] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.296813 18095 raft_consensus.cc:2272] T f4071ca08a124b44b9df5d14d868d218 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.298269 18095 tablet_replica.cc:333] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.298710 18095 raft_consensus.cc:2243] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.299091 18095 raft_consensus.cc:2272] T 125a99d88f144304a34fa5d4d41383f3 P 024e6da43121494298bf12a8fef267d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.300622 18095 tablet_replica.cc:333] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.301054 18095 raft_consensus.cc:2243] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.301409 18095 raft_consensus.cc:2272] T b8c4e986f9bd41d0a3d78bf1b6da1fe1 P 024e6da43121494298bf12a8fef267d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.302906 18095 tablet_replica.cc:333] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.303326 18095 raft_consensus.cc:2243] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.303973 18095 raft_consensus.cc:2272] T 5246b63227e549cab5c3bf4e6a3b5d79 P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.305704 18095 tablet_replica.cc:333] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.306156 18095 raft_consensus.cc:2243] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.306798 18095 raft_consensus.cc:2272] T 60b69e4d3caa4bf7bdb8492135e1091f P 024e6da43121494298bf12a8fef267d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.308435 18095 tablet_replica.cc:333] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0: stopping tablet replica
I20260709 13:08:22.308849 18095 raft_consensus.cc:2243] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.309309 18095 raft_consensus.cc:2272] T 9ea3223a95914773ba85d67fd0ed628e P 024e6da43121494298bf12a8fef267d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.327142 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
I20260709 13:08:22.343771 18095 master.cc:562] Master@127.17.171.254:39977 shutting down...
I20260709 13:08:22.368304 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.368759 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.369032 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5afe21968a9340bcb26c53210ab595ed: stopping tablet replica
I20260709 13:08:22.388340 18095 master.cc:584] Master@127.17.171.254:39977 shutdown complete.
024e6da43121494298bf12a8fef267d0  1
37588bf480cd41839ce9c9f75aefdb83  4
3852a08afc364925bf86a197ebbcb3f3  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10299 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:08:22.428151 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:34425
I20260709 13:08:22.429271 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.434784 19098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.435122 19099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.435686 19101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.436579 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:22.437258 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.437425 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.437543 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602502437533 us; error 0 us; skew 500 ppm
I20260709 13:08:22.437971 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.440292 18095 webserver.cc:533] Webserver started at http://127.17.171.254:33295/ using document root <none> and password file <none>
I20260709 13:08:22.440702 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.440846 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.441066 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.442200 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "2d55bdccad9c419a8710b6e2897c2f38"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.446249 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:22.449187 19106 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.449829 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:22.450107 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "2d55bdccad9c419a8710b6e2897c2f38"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.450378 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.465389 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.466557 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.502732 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:34425
I20260709 13:08:22.502817 19157 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:34425 every 8 connection(s)
I20260709 13:08:22.506414 19158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:22.515604 19158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Bootstrap starting.
I20260709 13:08:22.520045 19158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.523850 19158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: No bootstrap required, opened a new log
I20260709 13:08:22.525724 19158 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d55bdccad9c419a8710b6e2897c2f38" member_type: VOTER }
I20260709 13:08:22.526079 19158 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.526248 19158 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d55bdccad9c419a8710b6e2897c2f38, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.526707 19158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d55bdccad9c419a8710b6e2897c2f38" member_type: VOTER }
I20260709 13:08:22.527100 19158 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:22.527280 19158 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:22.527527 19158 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.531211 19158 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d55bdccad9c419a8710b6e2897c2f38" member_type: VOTER }
I20260709 13:08:22.531635 19158 leader_election.cc:304] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d55bdccad9c419a8710b6e2897c2f38; no voters: 
I20260709 13:08:22.532680 19158 leader_election.cc:290] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:22.533041 19161 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.534299 19161 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 1 LEADER]: Becoming Leader. State: Replica: 2d55bdccad9c419a8710b6e2897c2f38, State: Running, Role: LEADER
I20260709 13:08:22.534943 19161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d55bdccad9c419a8710b6e2897c2f38" member_type: VOTER }
I20260709 13:08:22.535586 19158 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:22.539911 19162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d55bdccad9c419a8710b6e2897c2f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d55bdccad9c419a8710b6e2897c2f38" member_type: VOTER } }
I20260709 13:08:22.540103 19163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d55bdccad9c419a8710b6e2897c2f38. Latest consensus state: current_term: 1 leader_uuid: "2d55bdccad9c419a8710b6e2897c2f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d55bdccad9c419a8710b6e2897c2f38" member_type: VOTER } }
I20260709 13:08:22.540730 19162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:22.541119 19163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:22.543608 19169 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:22.549768 19169 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:22.550838 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:22.557991 19169 catalog_manager.cc:1383] Generated new cluster ID: 888c184042d6487caba3fb131bcd174a
I20260709 13:08:22.558274 19169 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:22.580058 19169 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:22.581321 19169 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:22.594575 19169 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Generated new TSK 0
I20260709 13:08:22.595146 19169 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:22.617340 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.622819 19179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.624276 19180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.627271 19182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.628432 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:22.629451 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.629666 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.629827 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602502629807 us; error 0 us; skew 500 ppm
I20260709 13:08:22.630330 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.632412 18095 webserver.cc:533] Webserver started at http://127.17.171.193:34907/ using document root <none> and password file <none>
I20260709 13:08:22.632875 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.633072 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.633328 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.634358 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "56df67425e6f45d3b2b42441e3c143ba"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.638779 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:22.641907 19187 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.642562 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:08:22.642843 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "56df67425e6f45d3b2b42441e3c143ba"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.643127 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.664995 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.666247 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.667659 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:22.669997 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:22.670225 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.670454 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:22.670632 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.708607 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:44875
I20260709 13:08:22.708695 19249 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:44875 every 8 connection(s)
I20260709 13:08:22.713325 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.721465 19254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.722172 19255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.724022 18095 server_base.cc:1061] running on GCE node
W20260709 13:08:22.724774 19257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.725553 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.725771 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.725941 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602502725927 us; error 0 us; skew 500 ppm
I20260709 13:08:22.726449 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.728896 18095 webserver.cc:533] Webserver started at http://127.17.171.194:44479/ using document root <none> and password file <none>
I20260709 13:08:22.729481 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.729718 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.730018 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.731180 19250 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34425
I20260709 13:08:22.731361 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "0316f581086f40549fea44a772fc2dec"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.731545 19250 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:22.732338 19250 heartbeater.cc:507] Master 127.17.171.254:34425 requested a full tablet report, sending...
I20260709 13:08:22.734248 19123 ts_manager.cc:194] Registered new tserver with Master: 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:22.735881 19123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58822
I20260709 13:08:22.736340 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:08:22.739776 19262 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.740466 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:22.740746 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "0316f581086f40549fea44a772fc2dec"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.741007 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.750742 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.751907 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.753345 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:22.755455 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:22.755673 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.755894 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:22.756071 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.793251 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:37985
I20260709 13:08:22.793380 19324 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:37985 every 8 connection(s)
I20260709 13:08:22.797758 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:22.804471 19328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.805565 19329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:22.808319 19331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:22.808452 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:22.809576 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:22.809827 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:22.810065 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602502810045 us; error 0 us; skew 500 ppm
I20260709 13:08:22.810137 19325 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34425
I20260709 13:08:22.810506 19325 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:22.810813 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:22.811349 19325 heartbeater.cc:507] Master 127.17.171.254:34425 requested a full tablet report, sending...
I20260709 13:08:22.813274 18095 webserver.cc:533] Webserver started at http://127.17.171.195:39149/ using document root <none> and password file <none>
I20260709 13:08:22.813581 19123 ts_manager.cc:194] Registered new tserver with Master: 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:22.813885 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:22.814141 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:22.814445 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:22.815304 19123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58832
I20260709 13:08:22.815953 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.820724 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:22.824144 19336 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.824895 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:22.825227 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
format_stamp: "Formatted at 2026-07-09 13:08:22 on dist-test-slave-jhlz"
I20260709 13:08:22.825505 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:22.844463 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:22.845695 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:22.847254 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:22.849428 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:22.849608 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.849885 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:22.850039 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:22.891865 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:46545
I20260709 13:08:22.891963 19398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:46545 every 8 connection(s)
I20260709 13:08:22.906725 19399 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34425
I20260709 13:08:22.907084 19399 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:22.907774 19399 heartbeater.cc:507] Master 127.17.171.254:34425 requested a full tablet report, sending...
I20260709 13:08:22.909643 19123 ts_manager.cc:194] Registered new tserver with Master: c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:22.910024 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01472172s
I20260709 13:08:22.911409 19123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58842
I20260709 13:08:22.935884 19123 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58850:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:22.942013 19123 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:23.135828 19364 tablet_service.cc:1511] Processing CreateTablet for tablet 539f966b2e414ce2b1c2096d339a2147 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:23.137379 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539f966b2e414ce2b1c2096d339a2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.141324 19363 tablet_service.cc:1511] Processing CreateTablet for tablet 5d425f48ed5b488e9080214e593ef6fc (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:23.142679 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d425f48ed5b488e9080214e593ef6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.147140 19362 tablet_service.cc:1511] Processing CreateTablet for tablet ce726108fd4e452b9a0b91d535939c7d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:23.148525 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce726108fd4e452b9a0b91d535939c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.153364 19361 tablet_service.cc:1511] Processing CreateTablet for tablet 03d4cdd71fcc4422813ad324c5c5f5e5 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:23.156477 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d4cdd71fcc4422813ad324c5c5f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.162354 19414 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:23.162647 19360 tablet_service.cc:1511] Processing CreateTablet for tablet 3301e091b13b45e8833e94ab3073d14a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:23.164012 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3301e091b13b45e8833e94ab3073d14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.169354 19414 tablet_bootstrap.cc:654] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.171124 19359 tablet_service.cc:1511] Processing CreateTablet for tablet b8639f6119a14d6bb7cd841127c14e48 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:23.172497 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8639f6119a14d6bb7cd841127c14e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.175602 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 5d425f48ed5b488e9080214e593ef6fc (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:23.176955 19358 tablet_service.cc:1511] Processing CreateTablet for tablet f2c0dc5e5d2542c88c79527e70d218e3 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:23.177415 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d425f48ed5b488e9080214e593ef6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.178275 19358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0dc5e5d2542c88c79527e70d218e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.178686 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 539f966b2e414ce2b1c2096d339a2147 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:23.179927 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539f966b2e414ce2b1c2096d339a2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.181354 19357 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed1a12d65a24a9cbdd9846e6437132d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:23.181502 19288 tablet_service.cc:1511] Processing CreateTablet for tablet ce726108fd4e452b9a0b91d535939c7d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:23.182718 19357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1a12d65a24a9cbdd9846e6437132d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.182914 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce726108fd4e452b9a0b91d535939c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.183857 19414 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:23.184366 19414 ts_tablet_manager.cc:1403] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 13:08:23.185178 19364 tablet_service.cc:1511] Processing CreateTablet for tablet 03efca40b3ba4ad5b0122303a9a227a2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:23.185269 19287 tablet_service.cc:1511] Processing CreateTablet for tablet 03d4cdd71fcc4422813ad324c5c5f5e5 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:23.186455 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efca40b3ba4ad5b0122303a9a227a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.186578 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d4cdd71fcc4422813ad324c5c5f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.187399 19414 raft_consensus.cc:359] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:23.188158 19414 raft_consensus.cc:385] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.188573 19414 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.189280 19286 tablet_service.cc:1511] Processing CreateTablet for tablet 3301e091b13b45e8833e94ab3073d14a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:23.189811 19356 tablet_service.cc:1511] Processing CreateTablet for tablet 2348394564c140f3aec293661379e650 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:23.190598 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3301e091b13b45e8833e94ab3073d14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.191115 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2348394564c140f3aec293661379e650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.191978 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 5d425f48ed5b488e9080214e593ef6fc (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:23.193352 19285 tablet_service.cc:1511] Processing CreateTablet for tablet 03efca40b3ba4ad5b0122303a9a227a2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:23.194672 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efca40b3ba4ad5b0122303a9a227a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.194417 19213 tablet_service.cc:1511] Processing CreateTablet for tablet ce726108fd4e452b9a0b91d535939c7d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:23.197350 19284 tablet_service.cc:1511] Processing CreateTablet for tablet b8639f6119a14d6bb7cd841127c14e48 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:23.198719 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8639f6119a14d6bb7cd841127c14e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.198498 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 03efca40b3ba4ad5b0122303a9a227a2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:23.200040 19212 tablet_service.cc:1511] Processing CreateTablet for tablet 03d4cdd71fcc4422813ad324c5c5f5e5 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:23.201335 19283 tablet_service.cc:1511] Processing CreateTablet for tablet f2c0dc5e5d2542c88c79527e70d218e3 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:23.202716 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0dc5e5d2542c88c79527e70d218e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.204698 19282 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed1a12d65a24a9cbdd9846e6437132d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:23.205346 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed1a12d65a24a9cbdd9846e6437132d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:23.205996 19282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1a12d65a24a9cbdd9846e6437132d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.190253 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 539f966b2e414ce2b1c2096d339a2147 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:23.202348 19209 tablet_service.cc:1511] Processing CreateTablet for tablet b8639f6119a14d6bb7cd841127c14e48 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:23.197352 19211 tablet_service.cc:1511] Processing CreateTablet for tablet 3301e091b13b45e8833e94ab3073d14a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:23.204087 19208 tablet_service.cc:1511] Processing CreateTablet for tablet f2c0dc5e5d2542c88c79527e70d218e3 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:23.207949 19281 tablet_service.cc:1511] Processing CreateTablet for tablet 2348394564c140f3aec293661379e650 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:23.193360 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d425f48ed5b488e9080214e593ef6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.210330 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 2348394564c140f3aec293661379e650 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:23.211694 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539f966b2e414ce2b1c2096d339a2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.214097 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0dc5e5d2542c88c79527e70d218e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.215345 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d4cdd71fcc4422813ad324c5c5f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.216846 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8639f6119a14d6bb7cd841127c14e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.221692 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce726108fd4e452b9a0b91d535939c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.224537 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efca40b3ba4ad5b0122303a9a227a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.225356 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1a12d65a24a9cbdd9846e6437132d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.227788 19281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2348394564c140f3aec293661379e650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.228364 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3301e091b13b45e8833e94ab3073d14a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.232151 19414 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:23.235572 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2348394564c140f3aec293661379e650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.244485 19355 tablet_service.cc:1511] Processing CreateTablet for tablet 50bda02534b549db92f2a72e046dedf4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:23.249106 19356 tablet_service.cc:1511] Processing CreateTablet for tablet f5aeada323a94b289fcf904795167d43 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:23.256795 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aeada323a94b289fcf904795167d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.257445 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bda02534b549db92f2a72e046dedf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.258298 19361 tablet_service.cc:1511] Processing CreateTablet for tablet e795450462624104a515893162f51e61 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:23.259546 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e795450462624104a515893162f51e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.271529 19417 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.272157 19414 ts_tablet_manager.cc:1434] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.002s
I20260709 13:08:23.272042 19417 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:23.273017 19399 heartbeater.cc:499] Master 127.17.171.254:34425 was elected leader, sending a full tablet report...
I20260709 13:08:23.276198 19417 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:23.276942 19414 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:23.283365 19414 tablet_bootstrap.cc:654] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.291368 19283 tablet_service.cc:1511] Processing CreateTablet for tablet f5aeada323a94b289fcf904795167d43 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:23.294361 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 50bda02534b549db92f2a72e046dedf4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
W20260709 13:08:23.297750 19340 leader_election.cc:343] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Not found: Tablet not found: 539f966b2e414ce2b1c2096d339a2147
I20260709 13:08:23.307268 19356 tablet_service.cc:1511] Processing CreateTablet for tablet eba0c928a13f4f5ab22f30b9971564fd (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
W20260709 13:08:23.326026 19339 leader_election.cc:343] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Not found: Tablet not found: 539f966b2e414ce2b1c2096d339a2147
I20260709 13:08:23.326367 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba0c928a13f4f5ab22f30b9971564fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.327310 19339 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:23.328799 19362 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0355f53de74ee2afbb9a27c7449d75 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:23.330040 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0355f53de74ee2afbb9a27c7449d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.331426 19286 tablet_service.cc:1511] Processing CreateTablet for tablet e795450462624104a515893162f51e61 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:23.333925 19416 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.335424 19418 tablet_bootstrap.cc:492] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:23.355459 19213 tablet_service.cc:1511] Processing CreateTablet for tablet f5aeada323a94b289fcf904795167d43 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:23.358502 19363 tablet_service.cc:1511] Processing CreateTablet for tablet c86cbc75bead4640b156a7262753a86d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:23.359826 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86cbc75bead4640b156a7262753a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.364743 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bda02534b549db92f2a72e046dedf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.366677 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e795450462624104a515893162f51e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.367280 19289 tablet_service.cc:1511] Processing CreateTablet for tablet eba0c928a13f4f5ab22f30b9971564fd (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:23.368587 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba0c928a13f4f5ab22f30b9971564fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.369902 19418 tablet_bootstrap.cc:654] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.371991 19284 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0355f53de74ee2afbb9a27c7449d75 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:23.376431 19288 tablet_service.cc:1511] Processing CreateTablet for tablet c86cbc75bead4640b156a7262753a86d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:23.384727 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aeada323a94b289fcf904795167d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.388486 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aeada323a94b289fcf904795167d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.388343 19206 tablet_service.cc:1511] Processing CreateTablet for tablet 50bda02534b549db92f2a72e046dedf4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:23.396143 19207 tablet_service.cc:1511] Processing CreateTablet for tablet e795450462624104a515893162f51e61 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:23.404945 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bda02534b549db92f2a72e046dedf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.412948 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e795450462624104a515893162f51e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.414896 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0355f53de74ee2afbb9a27c7449d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.420524 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86cbc75bead4640b156a7262753a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.424964 19420 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:23.427170 19209 tablet_service.cc:1511] Processing CreateTablet for tablet eba0c928a13f4f5ab22f30b9971564fd (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:23.431627 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba0c928a13f4f5ab22f30b9971564fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.436053 19212 tablet_service.cc:1511] Processing CreateTablet for tablet c86cbc75bead4640b156a7262753a86d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:23.436892 19355 tablet_service.cc:1511] Processing CreateTablet for tablet 475b307cc1294b0da1fe31955e1eabc2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:23.432039 19211 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0355f53de74ee2afbb9a27c7449d75 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:23.440737 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 475b307cc1294b0da1fe31955e1eabc2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:23.445526 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475b307cc1294b0da1fe31955e1eabc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.448791 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86cbc75bead4640b156a7262753a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.452878 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0355f53de74ee2afbb9a27c7449d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.454268 19208 tablet_service.cc:1511] Processing CreateTablet for tablet f16746551ccf4c97861c6a0bab8d2847 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:23.454478 19285 tablet_service.cc:1511] Processing CreateTablet for tablet f16746551ccf4c97861c6a0bab8d2847 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:23.455497 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16746551ccf4c97861c6a0bab8d2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.461301 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475b307cc1294b0da1fe31955e1eabc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.461046 19362 tablet_service.cc:1511] Processing CreateTablet for tablet f16746551ccf4c97861c6a0bab8d2847 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:23.462376 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16746551ccf4c97861c6a0bab8d2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.487993 19414 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:23.488415 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16746551ccf4c97861c6a0bab8d2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.488680 19414 ts_tablet_manager.cc:1403] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.212s	user 0.028s	sys 0.020s
I20260709 13:08:23.492549 19414 raft_consensus.cc:359] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.493487 19414 raft_consensus.cc:385] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.493844 19414 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.494987 19414 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.503324 19414 ts_tablet_manager.cc:1434] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:08:23.504369 19414 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:23.510341 19414 tablet_bootstrap.cc:654] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.511201 19282 tablet_service.cc:1511] Processing CreateTablet for tablet 475b307cc1294b0da1fe31955e1eabc2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:23.512496 19282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475b307cc1294b0da1fe31955e1eabc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.526199 19416 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.526690 19416 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.530122 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:23.531131 19416 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:08:23.532219 19340 leader_election.cc:343] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.533910 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:23.535256 19339 leader_election.cc:343] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.535068 19210 tablet_service.cc:1511] Processing CreateTablet for tablet de803894748b488d81cb5c7007c78cce (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:23.535687 19339 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:23.536369 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de803894748b488d81cb5c7007c78cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.529898 19207 tablet_service.cc:1511] Processing CreateTablet for tablet f00a643f3a9e471980d5a732c373a17c (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:23.537297 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00a643f3a9e471980d5a732c373a17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.538549 19362 tablet_service.cc:1511] Processing CreateTablet for tablet f00a643f3a9e471980d5a732c373a17c (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:23.539721 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00a643f3a9e471980d5a732c373a17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.541533 19420 tablet_bootstrap.cc:654] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:23.548067 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:23.548254 19416 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.559109 19286 tablet_service.cc:1511] Processing CreateTablet for tablet de803894748b488d81cb5c7007c78cce (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:23.560580 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de803894748b488d81cb5c7007c78cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.565344 19213 tablet_service.cc:1511] Processing CreateTablet for tablet dc8043164d78443493704a95fae3b832 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:23.566521 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8043164d78443493704a95fae3b832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.568332 19209 tablet_service.cc:1511] Processing CreateTablet for tablet 1d40258a53ba4865adc2a744f3aa6256 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:23.569550 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d40258a53ba4865adc2a744f3aa6256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.569458 19285 tablet_service.cc:1511] Processing CreateTablet for tablet f00a643f3a9e471980d5a732c373a17c (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:23.571156 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00a643f3a9e471980d5a732c373a17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.571969 19288 tablet_service.cc:1511] Processing CreateTablet for tablet dc8043164d78443493704a95fae3b832 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:23.573555 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8043164d78443493704a95fae3b832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.577023 19361 tablet_service.cc:1511] Processing CreateTablet for tablet dc8043164d78443493704a95fae3b832 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:23.576958 19356 tablet_service.cc:1511] Processing CreateTablet for tablet 994bf3418aeb467ea0f5718bd6226a66 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:23.578434 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8043164d78443493704a95fae3b832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.577023 19363 tablet_service.cc:1511] Processing CreateTablet for tablet de803894748b488d81cb5c7007c78cce (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:23.584569 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de803894748b488d81cb5c7007c78cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.590977 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994bf3418aeb467ea0f5718bd6226a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.591776 19418 tablet_bootstrap.cc:492] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:23.592257 19418 ts_tablet_manager.cc:1403] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.257s	user 0.042s	sys 0.059s
I20260709 13:08:23.594631 19284 tablet_service.cc:1511] Processing CreateTablet for tablet 994bf3418aeb467ea0f5718bd6226a66 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:23.595325 19420 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:23.595840 19420 ts_tablet_manager.cc:1403] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.031s
I20260709 13:08:23.595996 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994bf3418aeb467ea0f5718bd6226a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.602847 19420 raft_consensus.cc:359] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.597007 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 994bf3418aeb467ea0f5718bd6226a66 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:23.613829 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994bf3418aeb467ea0f5718bd6226a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.614902 19211 tablet_service.cc:1511] Processing CreateTablet for tablet a7547528ebe74640917580adfe8092bd (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:23.608906 19420 raft_consensus.cc:385] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.616293 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7547528ebe74640917580adfe8092bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.622196 19414 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:23.622690 19414 ts_tablet_manager.cc:1403] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.013s
I20260709 13:08:23.595954 19418 raft_consensus.cc:359] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.624686 19418 raft_consensus.cc:385] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.625015 19418 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.625743 19418 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.628600 19282 tablet_service.cc:1511] Processing CreateTablet for tablet 1d40258a53ba4865adc2a744f3aa6256 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:23.629844 19282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d40258a53ba4865adc2a744f3aa6256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.617168 19420 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.643889 19286 tablet_service.cc:1511] Processing CreateTablet for tablet a7547528ebe74640917580adfe8092bd (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:23.645574 19363 tablet_service.cc:1511] Processing CreateTablet for tablet a7547528ebe74640917580adfe8092bd (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:23.645952 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 443db347d2a7465e8845fc3facf2ea26 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:23.653725 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443db347d2a7465e8845fc3facf2ea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.657779 19362 tablet_service.cc:1511] Processing CreateTablet for tablet 443db347d2a7465e8845fc3facf2ea26 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:23.659174 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443db347d2a7465e8845fc3facf2ea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.664510 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7547528ebe74640917580adfe8092bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.673825 19418 ts_tablet_manager.cc:1434] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.081s	user 0.019s	sys 0.023s
I20260709 13:08:23.674544 19325 heartbeater.cc:499] Master 127.17.171.254:34425 was elected leader, sending a full tablet report...
I20260709 13:08:23.675594 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7547528ebe74640917580adfe8092bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.681156 19359 tablet_service.cc:1511] Processing CreateTablet for tablet 1668ce4cb86e4e9daf99a53a2be8a396 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:23.682477 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1668ce4cb86e4e9daf99a53a2be8a396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.684298 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 1668ce4cb86e4e9daf99a53a2be8a396 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:23.685606 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1668ce4cb86e4e9daf99a53a2be8a396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.686045 19212 tablet_service.cc:1511] Processing CreateTablet for tablet 1668ce4cb86e4e9daf99a53a2be8a396 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:23.687299 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1668ce4cb86e4e9daf99a53a2be8a396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.692879 19414 raft_consensus.cc:359] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.695361 19414 raft_consensus.cc:385] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.695668 19414 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.696041 19287 tablet_service.cc:1511] Processing CreateTablet for tablet c32ecd0e2df44d9eace43b19017215ee (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:23.696570 19414 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.697304 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32ecd0e2df44d9eace43b19017215ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.699082 19414 ts_tablet_manager.cc:1434] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.004s
I20260709 13:08:23.699501 19420 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.699987 19414 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:23.707613 19364 tablet_service.cc:1511] Processing CreateTablet for tablet c32ecd0e2df44d9eace43b19017215ee (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:23.708904 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32ecd0e2df44d9eace43b19017215ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.708734 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 443db347d2a7465e8845fc3facf2ea26 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:23.709919 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443db347d2a7465e8845fc3facf2ea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.724756 19355 tablet_service.cc:1511] Processing CreateTablet for tablet 1d40258a53ba4865adc2a744f3aa6256 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:23.725497 19418 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:23.726361 19414 tablet_bootstrap.cc:654] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.726501 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d40258a53ba4865adc2a744f3aa6256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.738300 19250 heartbeater.cc:499] Master 127.17.171.254:34425 was elected leader, sending a full tablet report...
I20260709 13:08:23.744321 19418 tablet_bootstrap.cc:654] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.753235 19209 tablet_service.cc:1511] Processing CreateTablet for tablet f43f1e515be64813bb797fabd579621f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:23.755496 19214 tablet_service.cc:1511] Processing CreateTablet for tablet 95709490503b42e39a7b595994f42990 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:23.757010 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95709490503b42e39a7b595994f42990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.757390 19364 tablet_service.cc:1511] Processing CreateTablet for tablet f43f1e515be64813bb797fabd579621f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:23.758608 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43f1e515be64813bb797fabd579621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.764716 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43f1e515be64813bb797fabd579621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.767513 19290 tablet_service.cc:1511] Processing CreateTablet for tablet f43f1e515be64813bb797fabd579621f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:23.768770 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43f1e515be64813bb797fabd579621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.773059 19285 tablet_service.cc:1511] Processing CreateTablet for tablet 95709490503b42e39a7b595994f42990 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:23.773264 19356 tablet_service.cc:1511] Processing CreateTablet for tablet 95709490503b42e39a7b595994f42990 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:23.774345 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95709490503b42e39a7b595994f42990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.774479 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95709490503b42e39a7b595994f42990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.781834 19207 tablet_service.cc:1511] Processing CreateTablet for tablet f52aa7e17e68407492d15e97e52d910d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:23.783346 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52aa7e17e68407492d15e97e52d910d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.786826 19416 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.787318 19416 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.789321 19416 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:23.792778 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:23.796309 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:23.797622 19339 leader_election.cc:343] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.799037 19210 tablet_service.cc:1511] Processing CreateTablet for tablet c32ecd0e2df44d9eace43b19017215ee (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:23.800333 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32ecd0e2df44d9eace43b19017215ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:23.800843 19340 leader_election.cc:343] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.801484 19340 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:23.807597 19209 tablet_service.cc:1511] Processing CreateTablet for tablet bc29620a3fdb42269ab707a442ca6096 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:23.807858 19361 tablet_service.cc:1511] Processing CreateTablet for tablet f52aa7e17e68407492d15e97e52d910d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:23.808817 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29620a3fdb42269ab707a442ca6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.805640 19416 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.813189 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52aa7e17e68407492d15e97e52d910d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.821043 19213 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1ac12e26544cfc823327c519f83882 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:23.822342 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1ac12e26544cfc823327c519f83882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.825942 19360 tablet_service.cc:1511] Processing CreateTablet for tablet bc29620a3fdb42269ab707a442ca6096 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:23.829339 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1ac12e26544cfc823327c519f83882 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:23.830646 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1ac12e26544cfc823327c519f83882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.832775 19288 tablet_service.cc:1511] Processing CreateTablet for tablet f52aa7e17e68407492d15e97e52d910d (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:23.833067 19286 tablet_service.cc:1511] Processing CreateTablet for tablet bc29620a3fdb42269ab707a442ca6096 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:23.834090 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52aa7e17e68407492d15e97e52d910d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.837518 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29620a3fdb42269ab707a442ca6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.838354 19418 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:23.838819 19418 ts_tablet_manager.cc:1403] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.011s
I20260709 13:08:23.841923 19414 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:23.842424 19414 ts_tablet_manager.cc:1403] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.143s	user 0.022s	sys 0.007s
I20260709 13:08:23.842641 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc29620a3fdb42269ab707a442ca6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.845460 19414 raft_consensus.cc:359] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.846243 19414 raft_consensus.cc:385] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.846527 19414 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.847137 19414 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.849331 19414 ts_tablet_manager.cc:1434] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:23.850279 19414 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:23.850335 19424 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.850840 19424 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.841954 19418 raft_consensus.cc:359] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.853418 19424 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:23.852883 19418 raft_consensus.cc:385] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.859338 19418 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.860277 19418 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.870961 19418 ts_tablet_manager.cc:1434] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:23.877027 19420 ts_tablet_manager.cc:1434] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.277s	user 0.024s	sys 0.043s
I20260709 13:08:23.888926 19420 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:23.895785 19420 tablet_bootstrap.cc:654] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.872115 19418 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:23.910686 19282 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecbfdae2bef4b75b68f71759bd60f98 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:23.916639 19287 tablet_service.cc:1511] Processing CreateTablet for tablet de5df46c0c944a9ba1bf0fd628f9e9b3 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:23.918489 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5df46c0c944a9ba1bf0fd628f9e9b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.927981 19282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecbfdae2bef4b75b68f71759bd60f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.943974 19420 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:23.944607 19420 ts_tablet_manager.cc:1403] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.004s
I20260709 13:08:23.945398 19418 tablet_bootstrap.cc:654] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.959973 19425 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.960513 19425 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.963050 19425 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:23.948066 19414 tablet_bootstrap.cc:654] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.947664 19420 raft_consensus.cc:359] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.970347 19420 raft_consensus.cc:385] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.975706 19420 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.976915 19420 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:23.978371 19213 tablet_service.cc:1511] Processing CreateTablet for tablet de5df46c0c944a9ba1bf0fd628f9e9b3 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:23.979977 19420 ts_tablet_manager.cc:1434] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:08:23.981192 19420 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:23.986581 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5df46c0c944a9ba1bf0fd628f9e9b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:23.964200 19210 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecbfdae2bef4b75b68f71759bd60f98 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:23.998834 19364 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1ac12e26544cfc823327c519f83882 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:24.000191 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1ac12e26544cfc823327c519f83882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.011917 19360 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecbfdae2bef4b75b68f71759bd60f98 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:24.013217 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecbfdae2bef4b75b68f71759bd60f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.013134 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 52be2d3fd44446e288f920256640822f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:24.014366 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52be2d3fd44446e288f920256640822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.018379 19286 tablet_service.cc:1511] Processing CreateTablet for tablet 52be2d3fd44446e288f920256640822f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:24.019178 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecbfdae2bef4b75b68f71759bd60f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.019603 19286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52be2d3fd44446e288f920256640822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.030507 19290 tablet_service.cc:1511] Processing CreateTablet for tablet d5f7f3521ddc43959640091aefee2a11 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:24.031591 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f7f3521ddc43959640091aefee2a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.033671 19289 tablet_service.cc:1511] Processing CreateTablet for tablet 4a94e7b00544419ab2f3f84812c9b155 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:24.033990 19285 tablet_service.cc:1511] Processing CreateTablet for tablet aff34caf0ca44db08f7c49f51ca52966 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:24.034884 19289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a94e7b00544419ab2f3f84812c9b155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.035983 19284 tablet_service.cc:1511] Processing CreateTablet for tablet b9c15d7cf03241ffbeffba5fcfbb9d47 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:24.037225 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c15d7cf03241ffbeffba5fcfbb9d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.037111 19283 tablet_service.cc:1511] Processing CreateTablet for tablet c79ddd82cd084684a0080d4432222b09 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:24.037940 19414 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:24.038264 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ddd82cd084684a0080d4432222b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.038421 19414 ts_tablet_manager.cc:1403] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.010s
I20260709 13:08:24.041144 19285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff34caf0ca44db08f7c49f51ca52966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.041540 19414 raft_consensus.cc:359] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.042276 19414 raft_consensus.cc:385] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.043486 19414 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.065179 19418 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:24.065675 19418 ts_tablet_manager.cc:1403] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.194s	user 0.019s	sys 0.022s
I20260709 13:08:24.066900 19288 tablet_service.cc:1511] Processing CreateTablet for tablet c72e44ed47fd497bb5b8eb2891ce261a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:24.068202 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72e44ed47fd497bb5b8eb2891ce261a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.069429 19420 tablet_bootstrap.cc:654] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.070672 19211 tablet_service.cc:1511] Processing CreateTablet for tablet c79ddd82cd084684a0080d4432222b09 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:24.076298 19214 tablet_service.cc:1511] Processing CreateTablet for tablet aff34caf0ca44db08f7c49f51ca52966 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:24.071919 19211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ddd82cd084684a0080d4432222b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.084631 19208 tablet_service.cc:1511] Processing CreateTablet for tablet c72e44ed47fd497bb5b8eb2891ce261a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:24.086169 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 4a94e7b00544419ab2f3f84812c9b155 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:24.087729 19212 tablet_service.cc:1511] Processing CreateTablet for tablet b9c15d7cf03241ffbeffba5fcfbb9d47 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:24.088722 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.071659 19356 tablet_service.cc:1511] Processing CreateTablet for tablet de5df46c0c944a9ba1bf0fd628f9e9b3 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:08:24.092835 19265 leader_election.cc:343] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.093640 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5df46c0c944a9ba1bf0fd628f9e9b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.093518 19361 tablet_service.cc:1511] Processing CreateTablet for tablet b9c15d7cf03241ffbeffba5fcfbb9d47 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:24.061551 19414 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.101864 19359 tablet_service.cc:1511] Processing CreateTablet for tablet d5f7f3521ddc43959640091aefee2a11 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:24.104426 19355 tablet_service.cc:1511] Processing CreateTablet for tablet 4a94e7b00544419ab2f3f84812c9b155 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:24.106832 19363 tablet_service.cc:1511] Processing CreateTablet for tablet aff34caf0ca44db08f7c49f51ca52966 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:24.108987 19215 tablet_service.cc:1511] Processing CreateTablet for tablet d5f7f3521ddc43959640091aefee2a11 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:24.111071 19362 tablet_service.cc:1511] Processing CreateTablet for tablet c79ddd82cd084684a0080d4432222b09 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:24.114008 19358 tablet_service.cc:1511] Processing CreateTablet for tablet c72e44ed47fd497bb5b8eb2891ce261a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:24.094691 19360 tablet_service.cc:1511] Processing CreateTablet for tablet 52be2d3fd44446e288f920256640822f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:24.117743 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff34caf0ca44db08f7c49f51ca52966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.094722 19361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c15d7cf03241ffbeffba5fcfbb9d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.124694 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a94e7b00544419ab2f3f84812c9b155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.128650 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72e44ed47fd497bb5b8eb2891ce261a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.135886 19206 tablet_service.cc:1511] Processing CreateTablet for tablet df30e48897304c19b2d4f8683acbae54 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:24.163224 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:24.165449 19191 leader_election.cc:343] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.185724 19287 tablet_service.cc:1511] Processing CreateTablet for tablet df30e48897304c19b2d4f8683acbae54 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:24.187649 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30e48897304c19b2d4f8683acbae54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.193918 19414 ts_tablet_manager.cc:1434] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.155s	user 0.005s	sys 0.001s
I20260709 13:08:24.195443 19414 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:24.198113 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f7f3521ddc43959640091aefee2a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.198431 19416 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.201201 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f7f3521ddc43959640091aefee2a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.207903 19209 tablet_service.cc:1511] Processing CreateTablet for tablet d5c7a109008641aaa9e738f35f1abf42 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:24.209245 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ddd82cd084684a0080d4432222b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.205816 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30e48897304c19b2d4f8683acbae54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.204875 19416 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.214613 19416 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.216461 19209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c7a109008641aaa9e738f35f1abf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.217003 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:24.218430 19340 leader_election.cc:343] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.219260 19212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c15d7cf03241ffbeffba5fcfbb9d47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.220419 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a94e7b00544419ab2f3f84812c9b155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.222414 19358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72e44ed47fd497bb5b8eb2891ce261a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.226506 19288 tablet_service.cc:1511] Processing CreateTablet for tablet d5c7a109008641aaa9e738f35f1abf42 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:24.227372 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52be2d3fd44446e288f920256640822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.227762 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c7a109008641aaa9e738f35f1abf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.232950 19363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff34caf0ca44db08f7c49f51ca52966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.237450 19364 tablet_service.cc:1511] Processing CreateTablet for tablet df30e48897304c19b2d4f8683acbae54 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:24.238911 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30e48897304c19b2d4f8683acbae54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.243053 19357 tablet_service.cc:1511] Processing CreateTablet for tablet d5c7a109008641aaa9e738f35f1abf42 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:24.258641 19357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c7a109008641aaa9e738f35f1abf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.260834 19416 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.261480 19416 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.200598 19418 raft_consensus.cc:359] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:24.266237 19418 raft_consensus.cc:385] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.267290 19418 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.280454 19424 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.280961 19424 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.282990 19424 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:24.284708 19414 tablet_bootstrap.cc:654] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.285068 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:24.286547 19265 leader_election.cc:343] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.289726 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:24.290097 19420 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:24.290233 19284 tablet_service.cc:1511] Processing CreateTablet for tablet ba44c11bd3fc411ca166bf56c457490f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:08:24.291127 19340 leader_election.cc:343] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.303566 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.304474 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba44c11bd3fc411ca166bf56c457490f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.305398 19359 tablet_service.cc:1511] Processing CreateTablet for tablet ba44c11bd3fc411ca166bf56c457490f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:24.306655 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba44c11bd3fc411ca166bf56c457490f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.306918 19339 leader_election.cc:343] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.307418 19339 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:24.291498 19416 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.291744 19214 tablet_service.cc:1511] Processing CreateTablet for tablet ba44c11bd3fc411ca166bf56c457490f (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:24.309357 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba44c11bd3fc411ca166bf56c457490f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.294960 19283 tablet_service.cc:1511] Processing CreateTablet for tablet cbaa5acb8ba24137bd7a86d1598250e1 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:24.300550 19420 ts_tablet_manager.cc:1403] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.320s	user 0.063s	sys 0.067s
I20260709 13:08:24.312355 19418 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:24.312922 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa5acb8ba24137bd7a86d1598250e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.301937 19210 tablet_service.cc:1511] Processing CreateTablet for tablet cbaa5acb8ba24137bd7a86d1598250e1 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:24.302695 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.314905 19225 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:24.316386 19416 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.318400 19420 raft_consensus.cc:359] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.319175 19420 raft_consensus.cc:385] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.319542 19420 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.323485 19420 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.328744 19420 ts_tablet_manager.cc:1434] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:08:24.337157 19420 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:24.329473 19208 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88904f118f462b924e48beec293ae5 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:24.331370 19210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa5acb8ba24137bd7a86d1598250e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.331670 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:24.332602 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:08:24.341002 19266 leader_election.cc:343] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.341465 19266 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:08:24.346684 19266 leader_election.cc:343] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.347328 19208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88904f118f462b924e48beec293ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.347390 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:24.345773 19424 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.349611 19424 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.352401 19287 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88904f118f462b924e48beec293ae5 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:24.353775 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88904f118f462b924e48beec293ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.334601 19418 ts_tablet_manager.cc:1434] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.269s	user 0.009s	sys 0.000s
I20260709 13:08:24.363405 19418 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:24.377677 19213 tablet_service.cc:1511] Processing CreateTablet for tablet 3326b22da5604cba90d4a58baab1ac81 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:24.378970 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326b22da5604cba90d4a58baab1ac81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.380978 19420 tablet_bootstrap.cc:654] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.386745 19418 tablet_bootstrap.cc:654] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.388231 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 04d6d17ab159434aa4497a703c6856d6 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:24.389453 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d6d17ab159434aa4497a703c6856d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.392017 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 3326b22da5604cba90d4a58baab1ac81 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:24.393273 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326b22da5604cba90d4a58baab1ac81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.396265 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 89377.1us
I20260709 13:08:24.397953 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:24.399726 19441 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.399973 19359 tablet_service.cc:1511] Processing CreateTablet for tablet cbaa5acb8ba24137bd7a86d1598250e1 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:24.400586 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:24.401255 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa5acb8ba24137bd7a86d1598250e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.400156 19441 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.402055 19441 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:24.404902 19191 leader_election.cc:343] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.405313 19191 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:24.406342 19424 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.406767 19424 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:24.409467 19425 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.413183 19424 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:24.423794 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.425397 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:08:24.425743 19265 leader_election.cc:343] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.426249 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:24.427762 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:24.428668 19424 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.429064 19424 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.429350 19424 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.435405 19424 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:24.438032 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:24.438607 19374 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.438746 19424 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:24.445351 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:08:24.446791 19265 leader_election.cc:343] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.447235 19288 tablet_service.cc:1511] Processing CreateTablet for tablet 04d6d17ab159434aa4497a703c6856d6 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:24.447084 19360 tablet_service.cc:1511] Processing CreateTablet for tablet 3326b22da5604cba90d4a58baab1ac81 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:24.448707 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d6d17ab159434aa4497a703c6856d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.449247 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3326b22da5604cba90d4a58baab1ac81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.458428 19414 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:24.458983 19414 ts_tablet_manager.cc:1403] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.264s	user 0.016s	sys 0.016s
I20260709 13:08:24.470294 19441 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.471909 19414 raft_consensus.cc:359] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.474818 19414 raft_consensus.cc:385] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.475111 19414 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.476155 19414 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.478577 19414 ts_tablet_manager.cc:1434] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:08:24.485196 19355 tablet_service.cc:1511] Processing CreateTablet for tablet 04d6d17ab159434aa4497a703c6856d6 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:24.486481 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d6d17ab159434aa4497a703c6856d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.479553 19414 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:24.493040 19420 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:24.482818 19362 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88904f118f462b924e48beec293ae5 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:24.500648 19420 ts_tablet_manager.cc:1403] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.164s	user 0.027s	sys 0.038s
I20260709 13:08:24.502764 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:24.503592 19420 raft_consensus.cc:359] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.504313 19420 raft_consensus.cc:385] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.504588 19420 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.505311 19420 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.507469 19420 ts_tablet_manager.cc:1434] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:08:24.504031 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:24.518749 19424 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.519236 19424 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:24.519572 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88904f118f462b924e48beec293ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.520010 19424 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:24.524683 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:24.525281 19225 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.526052 19290 tablet_service.cc:1511] Processing CreateTablet for tablet 0bef21d2e4214a018d420d2f02b90db2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:24.527422 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bef21d2e4214a018d420d2f02b90db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.517908 19420 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:24.531442 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:24.533293 19340 leader_election.cc:343] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.533470 19357 tablet_service.cc:1511] Processing CreateTablet for tablet 0bef21d2e4214a018d420d2f02b90db2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:24.534361 19441 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.534660 19357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bef21d2e4214a018d420d2f02b90db2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.550495 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:24.550493 19283 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5150fb077a470497ba70512f18f476 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:24.552760 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5150fb077a470497ba70512f18f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.554170 19356 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5150fb077a470497ba70512f18f476 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:24.555392 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5150fb077a470497ba70512f18f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.555604 19414 tablet_bootstrap.cc:654] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.557799 19213 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5150fb077a470497ba70512f18f476 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:24.559307 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5150fb077a470497ba70512f18f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.564359 19441 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.565009 19441 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.571178 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.571635 19418 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:24.572201 19418 ts_tablet_manager.cc:1403] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.000s
W20260709 13:08:24.573031 19339 leader_election.cc:343] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.575258 19441 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.575368 19418 raft_consensus.cc:359] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.575857 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:24.600288 19418 raft_consensus.cc:385] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.591753 19356 tablet_service.cc:1511] Processing CreateTablet for tablet e0169774f68846529d675fe580574195 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:24.598905 19288 tablet_service.cc:1511] Processing CreateTablet for tablet 596e24ea147d4840a5e4645f5bac6bf1 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:24.600869 19418 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.601205 19206 tablet_service.cc:1511] Processing CreateTablet for tablet b95788528f474a568f6df71dd9018575 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:24.601591 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0169774f68846529d675fe580574195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.601738 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596e24ea147d4840a5e4645f5bac6bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.602427 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95788528f474a568f6df71dd9018575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.602051 19418 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.604389 19418 ts_tablet_manager.cc:1434] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:24.588634 19287 tablet_service.cc:1511] Processing CreateTablet for tablet e0169774f68846529d675fe580574195 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:24.605058 19207 tablet_service.cc:1511] Processing CreateTablet for tablet 0bef21d2e4214a018d420d2f02b90db2 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:24.605559 19359 tablet_service.cc:1511] Processing CreateTablet for tablet 596e24ea147d4840a5e4645f5bac6bf1 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:24.584867 19214 tablet_service.cc:1511] Processing CreateTablet for tablet e0169774f68846529d675fe580574195 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:24.609063 19225 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:24.636888 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bef21d2e4214a018d420d2f02b90db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.637070 19359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596e24ea147d4840a5e4645f5bac6bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.581439 19122 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.637713 19418 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:24.613564 19300 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:24.641078 19287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0169774f68846529d675fe580574195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.642645 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0169774f68846529d675fe580574195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.623893 19420 tablet_bootstrap.cc:654] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.595110 19215 tablet_service.cc:1511] Processing CreateTablet for tablet 596e24ea147d4840a5e4645f5bac6bf1 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:24.644701 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596e24ea147d4840a5e4645f5bac6bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.645798 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:24.647120 19441 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.647607 19441 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:24.648550 19441 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.651587 19340 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:24.654376 19416 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.654747 19416 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.655089 19416 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.654978 19288 tablet_service.cc:1511] Processing CreateTablet for tablet b95788528f474a568f6df71dd9018575 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:24.656271 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95788528f474a568f6df71dd9018575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.668123 19416 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.673106 19416 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.673949 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:24.676026 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:24.675977 19284 tablet_service.cc:1511] Processing CreateTablet for tablet 78d1dbf9a24f4b489920281c72245ab4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:24.676702 19300 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.677428 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d1dbf9a24f4b489920281c72245ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.679234 19360 tablet_service.cc:1511] Processing CreateTablet for tablet 78d1dbf9a24f4b489920281c72245ab4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:08:24.680440 19339 leader_election.cc:343] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.680596 19360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d1dbf9a24f4b489920281c72245ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.683595 19300 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:24.684741 19340 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:24.679666 19418 tablet_bootstrap.cc:654] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.687840 19416 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.688078 19207 tablet_service.cc:1511] Processing CreateTablet for tablet a9a6e62faf9e420795c6070c3109c9e4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:24.696249 19420 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:24.696841 19420 ts_tablet_manager.cc:1403] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.189s	user 0.014s	sys 0.012s
I20260709 13:08:24.700549 19420 raft_consensus.cc:359] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.701457 19420 raft_consensus.cc:385] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.701805 19420 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.702675 19420 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.712766 19355 tablet_service.cc:1511] Processing CreateTablet for tablet b95788528f474a568f6df71dd9018575 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:24.714751 19355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95788528f474a568f6df71dd9018575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.716799 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a6e62faf9e420795c6070c3109c9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.720564 19425 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.683735 19213 tablet_service.cc:1511] Processing CreateTablet for tablet 78d1dbf9a24f4b489920281c72245ab4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:24.733135 19416 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:24.735883 19416 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.736764 19414 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:24.737243 19414 ts_tablet_manager.cc:1403] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.258s	user 0.020s	sys 0.032s
I20260709 13:08:24.737790 19288 tablet_service.cc:1511] Processing CreateTablet for tablet a9a6e62faf9e420795c6070c3109c9e4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:24.738888 19288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a6e62faf9e420795c6070c3109c9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.741128 19214 tablet_service.cc:1511] Processing CreateTablet for tablet d8f20bf866b6473ca02552904ffcbe5a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:24.725299 19425 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.746961 19362 tablet_service.cc:1511] Processing CreateTablet for tablet a9a6e62faf9e420795c6070c3109c9e4 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:24.747779 19425 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:24.748242 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a6e62faf9e420795c6070c3109c9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.748380 19213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d1dbf9a24f4b489920281c72245ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.749583 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:24.750201 19374 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:24.751025 19214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f20bf866b6473ca02552904ffcbe5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.752282 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:24.752893 19283 tablet_service.cc:1511] Processing CreateTablet for tablet d8f20bf866b6473ca02552904ffcbe5a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:24.754122 19283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f20bf866b6473ca02552904ffcbe5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.755021 19191 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:24.756047 19123 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.759327 19215 tablet_service.cc:1511] Processing CreateTablet for tablet d825739f94b747959f93597edca9200a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:24.761564 19414 raft_consensus.cc:359] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.762252 19414 raft_consensus.cc:385] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.762543 19414 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.763127 19356 tablet_service.cc:1511] Processing CreateTablet for tablet d825739f94b747959f93597edca9200a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:24.763248 19414 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.764271 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d825739f94b747959f93597edca9200a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.764878 19425 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.764645 19290 tablet_service.cc:1511] Processing CreateTablet for tablet d825739f94b747959f93597edca9200a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:24.765235 19425 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.765570 19425 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.765736 19414 ts_tablet_manager.cc:1434] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:08:24.765897 19290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d825739f94b747959f93597edca9200a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.766743 19414 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
W20260709 13:08:24.764678 19191 leader_election.cc:343] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.769101 19206 tablet_service.cc:1511] Processing CreateTablet for tablet fa469320af8e4483baa8a2bb6187b226 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:24.773320 19215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d825739f94b747959f93597edca9200a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.780660 19420 ts_tablet_manager.cc:1434] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:08:24.780737 19206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa469320af8e4483baa8a2bb6187b226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.796505 19364 tablet_service.cc:1511] Processing CreateTablet for tablet fa469320af8e4483baa8a2bb6187b226 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:24.801110 19418 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:24.801604 19418 ts_tablet_manager.cc:1403] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.002s
I20260709 13:08:24.806010 19362 tablet_service.cc:1511] Processing CreateTablet for tablet cb03123528514382bd026ba70cefa81a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:24.807236 19418 raft_consensus.cc:359] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.807978 19418 raft_consensus.cc:385] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.807636 19282 tablet_service.cc:1511] Processing CreateTablet for tablet fa469320af8e4483baa8a2bb6187b226 (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:24.808306 19418 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.809345 19282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa469320af8e4483baa8a2bb6187b226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.809046 19418 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.812304 19418 ts_tablet_manager.cc:1434] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:24.821610 19357 tablet_service.cc:1511] Processing CreateTablet for tablet d8f20bf866b6473ca02552904ffcbe5a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:24.824386 19414 tablet_bootstrap.cc:654] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.797191 19425 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.827854 19364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa469320af8e4483baa8a2bb6187b226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.829309 19420 tablet_bootstrap.cc:492] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:24.828675 19418 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:24.837108 19416 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.837613 19416 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.837831 19207 tablet_service.cc:1511] Processing CreateTablet for tablet cb03123528514382bd026ba70cefa81a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:24.839663 19416 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.842203 19207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb03123528514382bd026ba70cefa81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.843497 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.844085 19225 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:24.845026 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:24.846312 19340 leader_election.cc:343] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.847352 19339 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:24.848428 19416 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.848771 19416 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.849081 19416 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.852829 19357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f20bf866b6473ca02552904ffcbe5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.854485 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:24.855023 19374 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.857234 19362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb03123528514382bd026ba70cefa81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.862268 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:24.868013 19416 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:24.872864 19191 leader_election.cc:343] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.852955 19425 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:24.879997 19425 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.881605 19425 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.885517 19374 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:24.886483 19425 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:24.886636 19191 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:24.887580 19416 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.888945 19414 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:24.889360 19414 ts_tablet_manager.cc:1403] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.123s	user 0.027s	sys 0.011s
I20260709 13:08:24.889209 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:24.889621 19425 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.890101 19425 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:24.890391 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:24.890949 19225 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.890906 19425 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.890213 19284 tablet_service.cc:1511] Processing CreateTablet for tablet cb03123528514382bd026ba70cefa81a (DEFAULT_TABLE table=test-workload [id=efd3e72ba93844a5a418950d935e853f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:24.891893 19414 raft_consensus.cc:359] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.892572 19414 raft_consensus.cc:385] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.892833 19414 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.893472 19414 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.894263 19284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb03123528514382bd026ba70cefa81a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:24.896898 19340 leader_election.cc:343] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.898972 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:24.899672 19300 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:24.901088 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:24.901988 19414 ts_tablet_manager.cc:1434] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:24.902845 19414 tablet_bootstrap.cc:492] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:24.904187 19225 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:24.899802 19418 tablet_bootstrap.cc:654] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.905364 19339 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:24.906670 19416 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.907282 19416 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:24.908087 19416 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.914386 19425 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.914826 19425 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.915223 19425 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.915961 19414 tablet_bootstrap.cc:654] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.918171 19120 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.920279 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:08:24.921705 19191 leader_election.cc:343] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.922124 19425 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.878868 19420 tablet_bootstrap.cc:654] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.924751 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:24.925335 19300 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.927896 19414 tablet_bootstrap.cc:492] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:24.930085 19414 ts_tablet_manager.cc:1403] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.002s
I20260709 13:08:24.929993 19418 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:24.930716 19418 ts_tablet_manager.cc:1403] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.002s
I20260709 13:08:24.932333 19300 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:24.932725 19414 raft_consensus.cc:359] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.933470 19414 raft_consensus.cc:385] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.933504 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:24.947037 19414 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.947499 19453 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.934861 19418 raft_consensus.cc:359] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.948052 19418 raft_consensus.cc:385] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.947916 19414 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.948516 19418 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.949892 19425 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:24.949553 19418 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.950423 19414 ts_tablet_manager.cc:1434] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:08:24.938792 19420 tablet_bootstrap.cc:492] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:24.951542 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:24.952194 19420 ts_tablet_manager.cc:1403] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.005s
I20260709 13:08:24.952297 19418 ts_tablet_manager.cc:1434] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.003s
W20260709 13:08:24.952956 19191 leader_election.cc:343] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.953637 19418 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:24.954972 19420 raft_consensus.cc:359] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.955457 19420 raft_consensus.cc:385] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.955644 19420 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.956288 19420 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.961957 19418 tablet_bootstrap.cc:654] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.963195 19453 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:24.963335 19420 ts_tablet_manager.cc:1434] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:24.964460 19420 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:24.964223 19453 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.965830 19416 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.966270 19416 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:24.969169 19416 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:24.951552 19414 tablet_bootstrap.cc:492] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:24.970754 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:24.971374 19300 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:24.972005 19420 tablet_bootstrap.cc:654] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.972611 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:24.974891 19416 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.975499 19416 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.974339 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:24.976547 19225 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:24.975929 19416 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.987803 19414 tablet_bootstrap.cc:654] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.988372 19122 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.991714 19122 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.016640 19416 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.020504 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:25.021298 19225 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.034422 19453 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.034963 19453 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.037109 19453 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.036504 19120 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.038892 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.038929 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.039604 19374 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:25.040825 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:08:25.041656 19191 leader_election.cc:343] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.042441 19453 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.042889 19453 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.043226 19453 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.047914 19225 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:25.049057 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.050007 19450 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.050463 19450 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:25.051275 19450 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:25.053112 19265 consensus_peers.cc:597] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.057624 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:25.058199 19300 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.058070 19453 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.060858 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:25.062215 19191 leader_election.cc:343] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.064226 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:25.064742 19374 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.066039 19300 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:25.069268 19420 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.069798 19420 ts_tablet_manager.cc:1403] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.106s	user 0.026s	sys 0.038s
I20260709 13:08:25.071416 19374 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:25.072590 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:25.072840 19420 raft_consensus.cc:359] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.073570 19464 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.074123 19416 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.074199 19464 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:25.075182 19464 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.076882 19453 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.073570 19420 raft_consensus.cc:385] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.079777 19420 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.082824 19418 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.083225 19450 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.083388 19418 ts_tablet_manager.cc:1403] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.054s
I20260709 13:08:25.082963 19420 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.083798 19450 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.085361 19420 ts_tablet_manager.cc:1434] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:08:25.082913 19414 tablet_bootstrap.cc:492] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.086001 19414 ts_tablet_manager.cc:1403] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.135s	user 0.038s	sys 0.032s
I20260709 13:08:25.086292 19420 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.086273 19418 raft_consensus.cc:359] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.087013 19418 raft_consensus.cc:385] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.087309 19418 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.086740 19120 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.087999 19418 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.089044 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.089718 19300 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:25.090909 19340 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.091845 19450 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.092588 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.093158 19420 tablet_bootstrap.cc:654] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.093413 19450 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:25.093794 19339 leader_election.cc:343] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.095817 19450 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.096412 19450 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.094596 19414 raft_consensus.cc:359] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.099344 19414 raft_consensus.cc:385] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.099779 19414 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.107241 19418 ts_tablet_manager.cc:1434] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:08:25.107873 19414 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.109840 19122 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.115425 19418 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:25.110728 19414 ts_tablet_manager.cc:1434] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:08:25.121018 19414 tablet_bootstrap.cc:492] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.126099 19414 tablet_bootstrap.cc:654] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.130565 19418 tablet_bootstrap.cc:654] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.132689 19424 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.136567 19420 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.137029 19420 ts_tablet_manager.cc:1403] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.027s
I20260709 13:08:25.139526 19420 raft_consensus.cc:359] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.140190 19420 raft_consensus.cc:385] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.140460 19420 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.141172 19420 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.132893 19450 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.145545 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:25.146510 19225 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.149150 19420 ts_tablet_manager.cc:1434] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:25.150086 19420 tablet_bootstrap.cc:492] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.155407 19225 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:25.156462 19420 tablet_bootstrap.cc:654] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.156737 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.161549 19416 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.167798 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:25.168655 19299 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.169250 19300 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.178903 19299 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:25.181443 19441 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.195302 19450 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.195742 19225 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.200443 19416 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:25.201666 19416 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.231321 19441 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.248589 19483 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.265430 19418 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.265938 19418 ts_tablet_manager.cc:1403] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.151s	user 0.038s	sys 0.084s
I20260709 13:08:25.268501 19418 raft_consensus.cc:359] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.269176 19418 raft_consensus.cc:385] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.269460 19418 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.270090 19418 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.271979 19418 ts_tablet_manager.cc:1434] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:25.275821 19418 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:25.276458 19414 tablet_bootstrap.cc:492] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.276980 19414 ts_tablet_manager.cc:1403] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.156s	user 0.026s	sys 0.039s
I20260709 13:08:25.279593 19414 raft_consensus.cc:359] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.274236 19420 tablet_bootstrap.cc:492] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.280102 19414 raft_consensus.cc:385] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.280396 19414 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.280515 19420 ts_tablet_manager.cc:1403] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.131s	user 0.041s	sys 0.066s
I20260709 13:08:25.281461 19418 tablet_bootstrap.cc:654] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.281314 19414 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.282986 19420 raft_consensus.cc:359] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.283452 19414 ts_tablet_manager.cc:1434] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:08:25.283658 19420 raft_consensus.cc:385] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.283941 19420 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.284592 19414 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.291462 19414 tablet_bootstrap.cc:654] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.292418 19450 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.284672 19420 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.295535 19420 ts_tablet_manager.cc:1434] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:08:25.296444 19420 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.301705 19420 tablet_bootstrap.cc:654] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.308495 19475 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.309155 19475 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.312839 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.313324 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.313936 19225 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:08:25.315490 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:25.316812 19482 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.319609 19122 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.325726 19482 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.330670 19475 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.347687 19420 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.348196 19420 ts_tablet_manager.cc:1403] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.018s
I20260709 13:08:25.349946 19414 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.350440 19414 ts_tablet_manager.cc:1403] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.022s
I20260709 13:08:25.350731 19420 raft_consensus.cc:359] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.351416 19420 raft_consensus.cc:385] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.351689 19420 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.352309 19420 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.353281 19418 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.353259 19414 raft_consensus.cc:359] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.354147 19418 ts_tablet_manager.cc:1403] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.042s
I20260709 13:08:25.354455 19414 raft_consensus.cc:385] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.354796 19414 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.355697 19414 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.356508 19416 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.356688 19418 raft_consensus.cc:359] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.356926 19416 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.357334 19418 raft_consensus.cc:385] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.357666 19418 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.358415 19418 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.360134 19299 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.361418 19416 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.360358 19418 ts_tablet_manager.cc:1434] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:25.362205 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.365963 19418 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
W20260709 13:08:25.366204 19340 leader_election.cc:343] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.362021 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.362900 19414 ts_tablet_manager.cc:1434] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
W20260709 13:08:25.368248 19339 leader_election.cc:343] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.368650 19339 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:25.369004 19414 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.369372 19416 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.369688 19420 ts_tablet_manager.cc:1434] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:08:25.373961 19418 tablet_bootstrap.cc:654] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.375012 19414 tablet_bootstrap.cc:654] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.375501 19464 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.378708 19420 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.386091 19418 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.386622 19418 ts_tablet_manager.cc:1403] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:08:25.387275 19420 tablet_bootstrap.cc:654] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.387569 19414 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.387996 19414 ts_tablet_manager.cc:1403] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:08:25.388846 19416 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.389302 19416 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.389484 19418 raft_consensus.cc:359] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.390187 19418 raft_consensus.cc:385] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.390499 19418 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.391409 19416 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.391182 19418 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.392890 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.393554 19418 ts_tablet_manager.cc:1434] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:25.393916 19414 raft_consensus.cc:359] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.394554 19418 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
W20260709 13:08:25.395133 19339 leader_election.cc:343] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.394532 19414 raft_consensus.cc:385] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.395495 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.395633 19414 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.396998 19414 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:25.398801 19340 leader_election.cc:343] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.399536 19414 ts_tablet_manager.cc:1434] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:25.399458 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:25.400624 19414 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.401099 19416 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.401921 19418 tablet_bootstrap.cc:654] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.403169 19416 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.407298 19414 tablet_bootstrap.cc:654] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.420563 19414 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.421231 19414 ts_tablet_manager.cc:1403] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 13:08:25.422914 19374 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.425069 19414 raft_consensus.cc:359] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.426033 19414 raft_consensus.cc:385] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.426420 19414 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.427517 19414 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.431152 19414 ts_tablet_manager.cc:1434] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:25.432387 19414 tablet_bootstrap.cc:492] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.436962 19464 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.438611 19414 tablet_bootstrap.cc:654] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.451195 19414 tablet_bootstrap.cc:492] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.451262 19475 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:25.452064 19414 ts_tablet_manager.cc:1403] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.013s
I20260709 13:08:25.452119 19475 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.455854 19414 raft_consensus.cc:359] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.456809 19414 raft_consensus.cc:385] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.457124 19414 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.457283 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.458030 19414 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.460566 19414 ts_tablet_manager.cc:1434] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:25.461436 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.461810 19414 tablet_bootstrap.cc:492] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.462232 19374 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:25.463920 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.464919 19482 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:25.465268 19482 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:25.465498 19475 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.465654 19482 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.471006 19414 tablet_bootstrap.cc:654] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.480301 19416 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.483666 19464 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.484930 19482 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.485414 19464 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.487692 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:25.489641 19482 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.491734 19299 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.496420 19482 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.496896 19482 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.497117 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:25.499542 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.500058 19453 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.500772 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:08:25.501283 19265 leader_election.cc:343] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.502003 19475 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.503106 19453 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.503450 19453 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:25.504367 19453 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.505656 19482 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.505709 19453 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.507237 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.507826 19373 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:25.509109 19418 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.509153 19266 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:25.509649 19418 ts_tablet_manager.cc:1403] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.115s	user 0.063s	sys 0.024s
I20260709 13:08:25.510494 19482 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.511987 19420 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.512408 19420 ts_tablet_manager.cc:1403] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.134s	user 0.031s	sys 0.040s
I20260709 13:08:25.517409 19482 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.517822 19482 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.517146 19418 raft_consensus.cc:359] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.520774 19418 raft_consensus.cc:385] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.521049 19418 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.522846 19418 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.526750 19418 ts_tablet_manager.cc:1434] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:08:25.527602 19418 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:25.527119 19482 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.528471 19414 tablet_bootstrap.cc:492] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.528968 19414 ts_tablet_manager.cc:1403] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.005s
I20260709 13:08:25.529781 19482 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.529901 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:25.531004 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:25.531724 19373 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.533488 19420 raft_consensus.cc:359] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.534107 19420 raft_consensus.cc:385] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.534366 19420 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.534981 19420 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.544798 19225 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.558439 19418 tablet_bootstrap.cc:654] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.559128 19483 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.560967 19373 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:25.562248 19266 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.563068 19482 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.563504 19482 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:25.564296 19482 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.568773 19414 raft_consensus.cc:359] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.569520 19414 raft_consensus.cc:385] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.569850 19414 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.572813 19414 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.580860 19425 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.581435 19425 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.583981 19425 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.585166 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.585784 19374 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:25.587220 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.587857 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.588384 19464 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.588721 19464 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.589061 19464 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.593636 19191 leader_election.cc:343] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.594463 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:25.594614 19425 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.595183 19425 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.598073 19425 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.599372 19225 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:25.601297 19414 ts_tablet_manager.cc:1434] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:08:25.602504 19414 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.608929 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.608961 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.614610 19464 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.616083 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:25.617728 19464 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:08:25.618273 19191 leader_election.cc:343] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.620018 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:25.622195 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:25.622764 19374 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.625434 19483 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.626053 19418 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.626471 19418 ts_tablet_manager.cc:1403] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.099s	user 0.004s	sys 0.007s
I20260709 13:08:25.625818 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:25.628507 19507 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.628934 19507 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.629282 19507 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.629009 19418 raft_consensus.cc:359] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.628787 19120 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.629725 19418 raft_consensus.cc:385] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.630045 19418 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
W20260709 13:08:25.627964 19191 leader_election.cc:343] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.630679 19418 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.632176 19374 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:25.633208 19414 tablet_bootstrap.cc:654] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.633246 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:25.622408 19420 ts_tablet_manager.cc:1434] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.107s	user 0.016s	sys 0.030s
I20260709 13:08:25.635426 19508 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.640403 19508 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:25.641530 19508 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.636312 19418 ts_tablet_manager.cc:1434] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:25.644078 19299 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.645017 19418 tablet_bootstrap.cc:492] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:25.639801 19507 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.656973 19505 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.657262 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:25.658106 19418 tablet_bootstrap.cc:654] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.658989 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:25.659526 19374 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.662744 19191 leader_election.cc:343] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.663146 19483 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.657271 19507 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.693336 19420 tablet_bootstrap.cc:492] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.709470 19505 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.715530 19441 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.739933 19414 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.740392 19414 ts_tablet_manager.cc:1403] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.044s
I20260709 13:08:25.744755 19121 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.745550 19414 raft_consensus.cc:359] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.746196 19414 raft_consensus.cc:385] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.746469 19414 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.747108 19414 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.749402 19482 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.750039 19482 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.749084 19414 ts_tablet_manager.cc:1434] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:25.752056 19414 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.754063 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:25.754752 19372 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:25.755939 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.756373 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:25.756800 19475 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.757184 19475 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.757507 19475 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.758411 19414 tablet_bootstrap.cc:654] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.758608 19420 tablet_bootstrap.cc:654] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.758960 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:25.760442 19265 leader_election.cc:343] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.764529 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:25.765878 19507 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.766310 19507 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:25.767082 19507 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.770776 19414 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.772049 19482 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.771351 19414 ts_tablet_manager.cc:1403] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 13:08:25.779222 19418 tablet_bootstrap.cc:492] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.782423 19418 ts_tablet_manager.cc:1403] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.138s	user 0.031s	sys 0.040s
I20260709 13:08:25.785750 19418 raft_consensus.cc:359] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.786636 19418 raft_consensus.cc:385] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.786968 19418 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.787806 19418 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.790421 19418 ts_tablet_manager.cc:1434] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:25.781162 19414 raft_consensus.cc:359] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.791330 19414 raft_consensus.cc:385] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.791707 19414 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.792554 19414 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.795647 19414 ts_tablet_manager.cc:1434] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:08:25.796871 19414 tablet_bootstrap.cc:492] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.798550 19475 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.802052 19475 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:25.803354 19418 tablet_bootstrap.cc:492] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:25.803752 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:25.804508 19373 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.804606 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:25.805843 19414 tablet_bootstrap.cc:654] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:25.805927 19265 leader_election.cc:343] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.811272 19373 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:25.817092 19418 tablet_bootstrap.cc:654] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.818593 19414 tablet_bootstrap.cc:492] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.819202 19414 ts_tablet_manager.cc:1403] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 13:08:25.819948 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:25.820871 19482 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.822042 19414 raft_consensus.cc:359] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.822737 19414 raft_consensus.cc:385] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.822991 19414 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.823764 19414 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.827476 19414 ts_tablet_manager.cc:1434] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:08:25.828644 19414 tablet_bootstrap.cc:492] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.829530 19420 tablet_bootstrap.cc:492] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.830044 19420 ts_tablet_manager.cc:1403] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.059s
I20260709 13:08:25.832649 19420 raft_consensus.cc:359] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.833385 19420 raft_consensus.cc:385] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.833704 19420 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.834451 19420 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.835290 19414 tablet_bootstrap.cc:654] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.836772 19420 ts_tablet_manager.cc:1434] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:25.837808 19420 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.843607 19420 tablet_bootstrap.cc:654] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.848040 19414 tablet_bootstrap.cc:492] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.848521 19414 ts_tablet_manager.cc:1403] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:08:25.850102 19482 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:25.851279 19482 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.851830 19414 raft_consensus.cc:359] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.853083 19414 raft_consensus.cc:385] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.853446 19414 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.854387 19414 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.857419 19414 ts_tablet_manager.cc:1434] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:08:25.859124 19414 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:25.868427 19420 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.869174 19420 ts_tablet_manager.cc:1403] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.006s
I20260709 13:08:25.868498 19121 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.873817 19420 raft_consensus.cc:359] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.875527 19420 raft_consensus.cc:385] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.875818 19420 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.876483 19420 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.878538 19420 ts_tablet_manager.cc:1434] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:25.878621 19414 tablet_bootstrap.cc:654] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.879434 19420 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.880911 19418 tablet_bootstrap.cc:492] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:25.883189 19418 ts_tablet_manager.cc:1403] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.032s
I20260709 13:08:25.887408 19420 tablet_bootstrap.cc:654] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.888659 19418 raft_consensus.cc:359] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.889552 19418 raft_consensus.cc:385] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.889887 19418 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.890764 19418 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.893734 19418 ts_tablet_manager.cc:1434] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:25.902984 19418 tablet_bootstrap.cc:492] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:25.907140 19120 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.908711 19418 tablet_bootstrap.cc:654] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.911947 19414 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.912518 19414 ts_tablet_manager.cc:1403] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.015s
I20260709 13:08:25.912647 19484 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.913120 19484 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.915287 19484 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.915756 19484 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.916095 19414 raft_consensus.cc:359] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.917016 19414 raft_consensus.cc:385] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.917361 19414 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.917538 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.918277 19420 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.918660 19450 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.918264 19414 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.919052 19420 ts_tablet_manager.cc:1403] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.021s
I20260709 13:08:25.919124 19450 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.921159 19450 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.921314 19414 ts_tablet_manager.cc:1434] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:08:25.922569 19414 tablet_bootstrap.cc:492] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
W20260709 13:08:25.923696 19340 leader_election.cc:343] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.923583 19420 raft_consensus.cc:359] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.924388 19420 raft_consensus.cc:385] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.924731 19420 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.925506 19420 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.926098 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.927369 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.928246 19420 ts_tablet_manager.cc:1434] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:25.929147 19420 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.930119 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:25.930711 19299 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:25.932268 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:25.933282 19477 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.933661 19477 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.933992 19477 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.935258 19420 tablet_bootstrap.cc:654] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:25.936924 19339 leader_election.cc:343] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.937386 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:08:25.938661 19339 leader_election.cc:343] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.940126 19414 tablet_bootstrap.cc:654] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.946900 19420 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.947388 19420 ts_tablet_manager.cc:1403] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:08:25.950112 19420 raft_consensus.cc:359] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:25.950906 19420 raft_consensus.cc:385] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.951247 19420 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.952114 19420 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:25.954355 19420 ts_tablet_manager.cc:1434] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:25.955729 19420 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.958765 19450 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.959718 19484 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.962543 19484 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:25.964988 19420 tablet_bootstrap.cc:654] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.971002 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:25.968442 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:25.976246 19340 leader_election.cc:343] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.978395 19339 leader_election.cc:343] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.978822 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:25.979501 19420 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:25.979749 19441 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.980262 19420 ts_tablet_manager.cc:1403] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:08:25.983376 19420 raft_consensus.cc:359] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.984441 19420 raft_consensus.cc:385] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.984804 19420 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.985558 19414 tablet_bootstrap.cc:492] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:25.985674 19420 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.986208 19414 ts_tablet_manager.cc:1403] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.018s
I20260709 13:08:25.988679 19420 ts_tablet_manager.cc:1434] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:25.989797 19420 tablet_bootstrap.cc:492] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:25.991420 19477 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:25.994707 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:08:25.996302 19339 leader_election.cc:343] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.996366 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:25.997156 19299 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.001108 19420 tablet_bootstrap.cc:654] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.002967 19414 raft_consensus.cc:359] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.004180 19414 raft_consensus.cc:385] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.004618 19414 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.003703 19477 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:26.006906 19414 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.008778 19418 tablet_bootstrap.cc:492] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:26.009220 19418 ts_tablet_manager.cc:1403] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.106s	user 0.047s	sys 0.053s
I20260709 13:08:26.009249 19414 ts_tablet_manager.cc:1434] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:08:26.010360 19414 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:26.010288 19482 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.010895 19482 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.011894 19418 raft_consensus.cc:359] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.012557 19418 raft_consensus.cc:385] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.012817 19418 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.012956 19482 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.013411 19418 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.015707 19418 ts_tablet_manager.cc:1434] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:26.018437 19414 tablet_bootstrap.cc:654] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.019747 19418 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:26.020483 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.021109 19373 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:26.022895 19524 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.023353 19524 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.025040 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:26.025484 19524 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.026021 19524 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.026476 19418 tablet_bootstrap.cc:654] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.027236 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.027920 19224 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:26.029093 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.030138 19373 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:26.030573 19420 tablet_bootstrap.cc:492] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:26.030998 19420 ts_tablet_manager.cc:1403] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 13:08:26.033617 19420 raft_consensus.cc:359] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.026326 19524 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.034238 19420 raft_consensus.cc:385] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.034387 19524 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.038125 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.040019 19450 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.040493 19450 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.042495 19450 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:26.042721 19524 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.043845 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.044219 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:26.044695 19524 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.045233 19524 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.034566 19420 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.045661 19475 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.046715 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:26.047289 19225 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.053078 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.053840 19373 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.056577 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:26.058193 19339 leader_election.cc:343] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:26.059289 19340 leader_election.cc:343] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.059850 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.060838 19450 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.064477 19225 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:26.076530 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:26.078655 19482 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.079270 19482 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:26.080101 19482 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.065496 19475 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.046461 19420 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.094465 19420 ts_tablet_manager.cc:1434] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:08:26.096400 19420 tablet_bootstrap.cc:492] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:26.097317 19450 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.098371 19450 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.101136 19450 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:26.108476 19420 tablet_bootstrap.cc:654] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.108337 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.114687 19299 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
W20260709 13:08:26.116415 19340 leader_election.cc:343] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.117403 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.118942 19450 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.119887 19450 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:26.121353 19450 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.132319 19505 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.132963 19505 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } }
I20260709 13:08:26.135600 19505 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:26.136636 19540 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:26.139307 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.140952 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.143473 19540 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.143920 19540 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.144795 19191 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:26.146238 19540 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.151275 19122 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.158245 19450 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.158986 19450 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.163727 19450 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:26.165392 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:26.167111 19340 leader_election.cc:343] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.163832 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.169335 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.170167 19223 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:26.171734 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:26.172792 19540 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.173238 19540 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.173642 19540 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.174080 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.174685 19372 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:26.180799 19425 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.181588 19425 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.181728 19540 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.182154 19425 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.185525 19540 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.109113 19507 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.186738 19425 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.187709 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:26.187764 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.188701 19372 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.185415 19339 leader_election.cc:343] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.191143 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.192334 19450 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.196338 19223 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.112577 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.216770 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:26.221256 19339 leader_election.cc:343] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.221709 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.213205 19373 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:26.228018 19505 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.229395 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.224556 19450 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.242723 19464 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.248112 19122 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.254978 19505 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.268383 19225 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.269578 19505 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.271535 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.272297 19370 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:26.273620 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:26.278362 19507 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.278826 19507 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.279112 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.279270 19507 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.265544 19371 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:26.280843 19540 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.282011 19191 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:26.283386 19464 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.289227 19441 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.304008 19441 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.307291 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.307626 19441 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:08:26.309410 19339 leader_election.cc:343] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.309689 19507 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:26.314313 19191 leader_election.cc:343] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.312218 19507 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.321969 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:26.326756 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.336618 19368 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.262491 19372 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
W20260709 13:08:26.365972 19191 leader_election.cc:343] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.374754 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.387578 19505 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.381397 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:26.395967 19225 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.392920 19540 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.396518 19418 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:26.398715 19418 ts_tablet_manager.cc:1403] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.379s	user 0.113s	sys 0.184s
W20260709 13:08:26.393741 19340 leader_election.cc:343] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.399451 19340 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.400178 19484 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.400662 19540 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:26.400569 19482 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.401572 19540 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.403321 19223 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
W20260709 13:08:26.398170 19191 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.410195 19418 raft_consensus.cc:359] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.410913 19418 raft_consensus.cc:385] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.411180 19418 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
W20260709 13:08:26.407202 19539 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:26.413169 19418 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.428968 19420 tablet_bootstrap.cc:492] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:26.429597 19420 ts_tablet_manager.cc:1403] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.333s	user 0.061s	sys 0.043s
I20260709 13:08:26.434206 19420 raft_consensus.cc:359] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.434945 19420 raft_consensus.cc:385] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.435328 19420 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.436043 19420 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.438860 19420 ts_tablet_manager.cc:1434] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:26.440567 19418 ts_tablet_manager.cc:1434] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:08:26.441630 19418 tablet_bootstrap.cc:492] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:26.442700 19420 tablet_bootstrap.cc:492] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:26.447809 19368 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:26.453800 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:26.454986 19425 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.455555 19425 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:26.456851 19425 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.458420 19414 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.458824 19414 ts_tablet_manager.cc:1403] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.449s	user 0.110s	sys 0.149s
I20260709 13:08:26.461398 19418 tablet_bootstrap.cc:654] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.489471 19122 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.503429 19464 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.507893 19414 raft_consensus.cc:359] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.508706 19414 raft_consensus.cc:385] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.508978 19414 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.509706 19414 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.512519 19414 ts_tablet_manager.cc:1434] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.054s	user 0.013s	sys 0.026s
I20260709 13:08:26.508035 19464 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.515105 19464 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.517359 19414 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:26.534809 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.535485 19370 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:26.536612 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.537195 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:26.537947 19464 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.538348 19464 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.538697 19464 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.541761 19191 leader_election.cc:343] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.549338 19122 catalog_manager.cc:5697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.559268 19464 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.560788 19420 tablet_bootstrap.cc:654] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.563274 19418 tablet_bootstrap.cc:492] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:26.563778 19418 ts_tablet_manager.cc:1403] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.004s
I20260709 13:08:26.564684 19464 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.565282 19414 tablet_bootstrap.cc:654] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.565938 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.566501 19374 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.566797 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:26.566565 19418 raft_consensus.cc:359] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.567466 19418 raft_consensus.cc:385] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.567791 19418 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.568837 19524 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:26.569424 19191 leader_election.cc:343] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.570264 19418 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.576045 19374 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:26.577391 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:26.578159 19464 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.579525 19464 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:26.580478 19420 tablet_bootstrap.cc:492] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:26.580871 19414 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.580996 19420 ts_tablet_manager.cc:1403] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.000s
I20260709 13:08:26.581312 19414 ts_tablet_manager.cc:1403] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.003s
I20260709 13:08:26.580345 19464 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.584201 19418 ts_tablet_manager.cc:1434] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:08:26.583995 19414 raft_consensus.cc:359] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.586494 19414 raft_consensus.cc:385] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.589231 19414 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.590023 19414 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.592002 19414 ts_tablet_manager.cc:1434] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:26.585351 19420 raft_consensus.cc:359] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.592371 19420 raft_consensus.cc:385] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.592646 19420 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.588914 19418 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:26.598541 19418 tablet_bootstrap.cc:654] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.600411 19420 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.602447 19420 ts_tablet_manager.cc:1434] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.001s
I20260709 13:08:26.602945 19414 tablet_bootstrap.cc:492] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:26.608558 19414 tablet_bootstrap.cc:654] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.609730 19420 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:26.617405 19420 tablet_bootstrap.cc:654] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.622737 19225 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.622746 19475 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:26.628947 19122 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.638936 19464 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.639446 19464 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.645802 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.646505 19298 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:26.647852 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:26.648694 19425 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:26.649046 19425 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.649369 19425 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.649586 19414 tablet_bootstrap.cc:492] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.650141 19414 ts_tablet_manager.cc:1403] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 13:08:26.652743 19414 raft_consensus.cc:359] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.653527 19414 raft_consensus.cc:385] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.653849 19414 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.655011 19414 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.657516 19464 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.657722 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.658583 19425 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.659232 19484 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.659910 19414 ts_tablet_manager.cc:1434] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:26.661084 19414 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:26.670780 19414 tablet_bootstrap.cc:654] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.676373 19420 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:26.676945 19420 ts_tablet_manager.cc:1403] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.005s
I20260709 13:08:26.681761 19441 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.682557 19414 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.683053 19414 ts_tablet_manager.cc:1403] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:08:26.684657 19224 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:26.686172 19450 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.686885 19450 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.687196 19450 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:26.687984 19450 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.689157 19450 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.692910 19425 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.693925 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.695142 19420 raft_consensus.cc:359] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.695807 19420 raft_consensus.cc:385] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.696105 19420 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.696278 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:26.696775 19420 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.699064 19420 ts_tablet_manager.cc:1434] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:08:26.699918 19420 tablet_bootstrap.cc:492] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:26.701706 19414 raft_consensus.cc:359] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.704502 19370 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:08:26.705250 19420 tablet_bootstrap.cc:654] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.708335 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:26.709862 19414 raft_consensus.cc:385] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.710304 19414 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.711082 19414 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.712311 19425 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.713524 19414 ts_tablet_manager.cc:1434] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:08:26.714654 19414 tablet_bootstrap.cc:492] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
W20260709 13:08:26.719641 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:26.720077 19418 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:26.721347 19414 tablet_bootstrap.cc:654] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.724632 19418 ts_tablet_manager.cc:1403] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.136s	user 0.035s	sys 0.052s
I20260709 13:08:26.721818 19420 tablet_bootstrap.cc:492] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:26.726329 19420 ts_tablet_manager.cc:1403] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.001s
I20260709 13:08:26.727221 19418 raft_consensus.cc:359] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.727885 19418 raft_consensus.cc:385] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.728183 19418 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.728809 19418 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.729806 19298 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.730845 19418 ts_tablet_manager.cc:1434] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:26.731740 19418 tablet_bootstrap.cc:492] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:26.737403 19418 tablet_bootstrap.cc:654] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.740607 19420 raft_consensus.cc:359] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.741511 19420 raft_consensus.cc:385] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.742259 19475 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.742836 19475 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.741884 19420 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.744977 19420 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.748138 19420 ts_tablet_manager.cc:1434] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:08:26.751588 19420 tablet_bootstrap.cc:492] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:26.752048 19414 tablet_bootstrap.cc:492] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.752102 19475 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.752645 19414 ts_tablet_manager.cc:1403] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.010s
I20260709 13:08:26.754601 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.755165 19414 raft_consensus.cc:359] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.755828 19414 raft_consensus.cc:385] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.756117 19414 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.756757 19425 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.756841 19414 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.757592 19425 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.760428 19414 ts_tablet_manager.cc:1434] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:26.761119 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.762573 19370 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:26.763873 19425 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.764200 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:26.765781 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.766112 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.766374 19370 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:26.766801 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:26.768087 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:26.768565 19540 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.771775 19420 tablet_bootstrap.cc:654] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.774052 19464 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.772583 19418 tablet_bootstrap.cc:492] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:26.774435 19464 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.768730 19414 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:26.774823 19464 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.776230 19418 ts_tablet_manager.cc:1403] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.004s
I20260709 13:08:26.776567 19540 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.781016 19425 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.781503 19425 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.786063 19418 raft_consensus.cc:359] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.786439 19540 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.789552 19418 raft_consensus.cc:385] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.789605 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:26.789904 19418 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.790267 19370 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:26.788522 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:26.790714 19418 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.789230 19414 tablet_bootstrap.cc:654] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.792874 19418 ts_tablet_manager.cc:1434] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:08:26.793851 19418 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:26.793638 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:26.788542 19425 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.794540 19505 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:26.794754 19191 leader_election.cc:343] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.794932 19505 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.795555 19505 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.802907 19418 tablet_bootstrap.cc:654] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.810432 19464 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.813254 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:26.813802 19298 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.822837 19298 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:26.823794 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:26.824633 19425 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.825075 19425 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:26.825877 19425 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.807300 19505 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.846184 19505 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.847121 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:26.848340 19191 leader_election.cc:343] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.851415 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.852078 19370 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.852262 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:26.852842 19374 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.859057 19370 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:26.859181 19374 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:26.861388 19464 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:26.881074 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:26.882454 19507 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.882970 19507 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:26.883845 19507 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.890978 19450 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.891494 19450 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.896628 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.897796 19450 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:08:26.898461 19339 leader_election.cc:343] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.907572 19123 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.938805 19123 catalog_manager.cc:5697] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.941169 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:26.942729 19340 leader_election.cc:343] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.943212 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.944389 19450 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.945366 19414 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.948571 19420 tablet_bootstrap.cc:492] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:26.949141 19420 ts_tablet_manager.cc:1403] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.200s	user 0.030s	sys 0.048s
I20260709 13:08:26.951179 19482 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.952939 19420 raft_consensus.cc:359] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.953858 19420 raft_consensus.cc:385] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.945992 19414 ts_tablet_manager.cc:1403] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.184s	user 0.024s	sys 0.053s
I20260709 13:08:26.954192 19420 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.955082 19420 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.956410 19418 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:26.956845 19418 ts_tablet_manager.cc:1403] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.163s	user 0.054s	sys 0.091s
I20260709 13:08:26.957335 19414 raft_consensus.cc:359] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.958061 19414 raft_consensus.cc:385] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.958382 19414 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.959190 19414 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.959576 19418 raft_consensus.cc:359] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.960304 19418 raft_consensus.cc:385] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.960696 19418 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.961701 19414 ts_tablet_manager.cc:1434] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:26.962658 19414 tablet_bootstrap.cc:492] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:26.963040 19420 ts_tablet_manager.cc:1434] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:26.961318 19418 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.963317 19450 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.963786 19450 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:26.964915 19418 ts_tablet_manager.cc:1434] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:26.965447 19420 tablet_bootstrap.cc:492] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:26.965849 19450 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:26.970644 19414 tablet_bootstrap.cc:654] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.971737 19420 tablet_bootstrap.cc:654] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.972524 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:26.972636 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:26.973805 19339 leader_election.cc:343] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:26.974345 19340 leader_election.cc:343] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.974768 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:26.975790 19450 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.979112 19418 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:26.982270 19414 tablet_bootstrap.cc:492] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:26.985172 19418 tablet_bootstrap.cc:654] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.984936 19464 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.989012 19414 ts_tablet_manager.cc:1403] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.005s
I20260709 13:08:26.988445 19420 tablet_bootstrap.cc:492] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.001155 19414 raft_consensus.cc:359] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.002111 19414 raft_consensus.cc:385] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.002449 19414 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.002640 19450 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:27.003144 19450 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.003307 19414 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.027691 19418 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.028203 19418 ts_tablet_manager.cc:1403] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.017s
I20260709 13:08:27.028306 19414 ts_tablet_manager.cc:1434] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:08:27.029212 19414 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.030930 19418 raft_consensus.cc:359] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.005867 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.017272 19464 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.004412 19420 ts_tablet_manager.cc:1403] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.005s
I20260709 13:08:27.005195 19450 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.006801 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.032717 19298 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:27.034585 19420 raft_consensus.cc:359] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.031751 19418 raft_consensus.cc:385] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.035283 19420 raft_consensus.cc:385] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.035429 19418 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.035617 19420 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.035969 19225 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:27.036469 19420 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.036428 19418 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.037467 19339 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:27.042961 19450 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.043357 19450 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:27.043493 19418 ts_tablet_manager.cc:1434] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:27.043758 19450 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.044638 19418 tablet_bootstrap.cc:492] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.046013 19420 ts_tablet_manager.cc:1434] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:27.046988 19420 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.053045 19450 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.054220 19441 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.054710 19441 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.061928 19464 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.056492 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:27.069218 19298 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:27.068078 19464 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.075949 19418 tablet_bootstrap.cc:654] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.079325 19298 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.079401 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:27.055150 19450 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.081357 19414 tablet_bootstrap.cc:654] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.081820 19441 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.083997 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.084601 19300 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:27.088299 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.089133 19450 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.089524 19450 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.089917 19450 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.093498 19464 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.094811 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.095438 19300 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.096737 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:27.103582 19425 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.103423 19464 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.103962 19425 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.104346 19425 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.104118 19450 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.110010 19420 tablet_bootstrap.cc:654] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.116041 19450 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.117235 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:27.117878 19299 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.118413 19418 tablet_bootstrap.cc:492] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.118881 19418 ts_tablet_manager.cc:1403] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.011s
I20260709 13:08:27.113634 19425 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.121743 19418 raft_consensus.cc:359] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.122359 19418 raft_consensus.cc:385] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.122591 19418 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.124032 19418 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.119163 19225 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:27.126914 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:27.127811 19300 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.127947 19418 ts_tablet_manager.cc:1434] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:27.129001 19418 tablet_bootstrap.cc:492] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.130869 19475 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.131312 19475 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.133644 19475 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.134220 19425 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.136739 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.136842 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.141434 19374 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.141459 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.142154 19223 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:08:27.142336 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.142961 19370 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:08:27.144088 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.144348 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.144794 19505 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.145067 19450 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.145495 19475 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:27.145869 19475 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.145612 19450 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.146206 19475 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.146663 19418 tablet_bootstrap.cc:654] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.149953 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.150985 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:08:27.151674 19340 leader_election.cc:343] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.151980 19414 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.152859 19414 ts_tablet_manager.cc:1403] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.006s
I20260709 13:08:27.135289 19300 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:27.150646 19450 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.156510 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:27.157270 19425 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.158349 19425 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:27.159170 19425 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.160252 19414 raft_consensus.cc:359] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.160933 19414 raft_consensus.cc:385] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.161217 19414 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.161859 19414 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.162731 19299 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:27.167917 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.168751 19450 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.169364 19450 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:27.170257 19450 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.186710 19482 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.187320 19482 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:27.189402 19339 leader_election.cc:343] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.190493 19339 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:08:27.191543 19339 leader_election.cc:343] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.189458 19482 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.186882 19414 ts_tablet_manager.cc:1434] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:08:27.194180 19414 tablet_bootstrap.cc:492] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.196143 19441 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.196422 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.164013 19475 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.206867 19420 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.207430 19420 ts_tablet_manager.cc:1403] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.007s
I20260709 13:08:27.207516 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.206012 19371 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:27.224190 19122 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.229790 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.229604 19420 raft_consensus.cc:359] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.230468 19420 raft_consensus.cc:385] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.230733 19420 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.231312 19420 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.232954 19420 ts_tablet_manager.cc:1434] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:08:27.233507 19225 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:27.233820 19475 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.235258 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.237879 19482 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.238263 19482 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.238597 19482 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.240963 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.241576 19225 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:27.242208 19414 tablet_bootstrap.cc:654] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.247360 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:27.248203 19420 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.239204 19123 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.240907 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:27.250903 19441 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:27.251248 19223 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.257997 19482 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.271204 19418 tablet_bootstrap.cc:492] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.252650 19441 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.271695 19418 ts_tablet_manager.cc:1403] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.143s	user 0.006s	sys 0.048s
I20260709 13:08:27.271860 19587 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.274116 19420 tablet_bootstrap.cc:654] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.277217 19223 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:08:27.278064 19418 raft_consensus.cc:359] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.278666 19418 raft_consensus.cc:385] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.278913 19418 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.279120 19265 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:27.280184 19475 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:27.280992 19482 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.281267 19475 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:27.279579 19418 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.282208 19475 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.290223 19418 ts_tablet_manager.cc:1434] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:27.291191 19418 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.291509 19425 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.290267 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.283385 19587 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.293900 19374 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.301433 19299 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.304003 19414 tablet_bootstrap.cc:492] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.306928 19418 tablet_bootstrap.cc:654] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.294854 19587 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.321789 19414 ts_tablet_manager.cc:1403] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.128s	user 0.020s	sys 0.031s
I20260709 13:08:27.328246 19590 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.328805 19590 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.346189 19590 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.349351 19507 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.351758 19374 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:27.352775 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.353181 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.354351 19482 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:08:27.354403 19339 leader_election.cc:343] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.354535 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.354916 19482 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:08:27.355999 19340 leader_election.cc:343] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.356242 19420 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.355774 19482 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.356788 19420 ts_tablet_manager.cc:1403] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.003s
I20260709 13:08:27.356488 19340 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:27.357368 19450 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.351821 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:27.358426 19223 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.359519 19587 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.354588 19414 raft_consensus.cc:359] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.360621 19414 raft_consensus.cc:385] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.360817 19414 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.364935 19414 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.372776 19123 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 2 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.377077 19441 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.377602 19441 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.380306 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:27.384881 19339 leader_election.cc:343] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.376641 19414 ts_tablet_manager.cc:1434] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.006s
I20260709 13:08:27.393003 19414 tablet_bootstrap.cc:492] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.393880 19420 raft_consensus.cc:359] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.397181 19441 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.397070 19122 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 3, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.398080 19587 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.394589 19420 raft_consensus.cc:385] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.399567 19420 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.400281 19420 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.402384 19420 ts_tablet_manager.cc:1434] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:08:27.403803 19420 tablet_bootstrap.cc:492] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.407774 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:27.408610 19224 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.410872 19223 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:27.417088 19418 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.417490 19418 ts_tablet_manager.cc:1403] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.003s
I20260709 13:08:27.420030 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:27.425644 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:27.426335 19340 leader_election.cc:343] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:27.427644 19340 leader_election.cc:343] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.428046 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:27.429044 19507 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.430557 19420 tablet_bootstrap.cc:654] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.431640 19587 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.431980 19418 raft_consensus.cc:359] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.432798 19418 raft_consensus.cc:385] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.433077 19418 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.439152 19418 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.444552 19418 ts_tablet_manager.cc:1434] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:08:27.445900 19418 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.447427 19122 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.450446 19587 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.453198 19587 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.446344 19507 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:27.464601 19414 tablet_bootstrap.cc:654] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.484915 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.484138 19587 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:08:27.486426 19339 leader_election.cc:343] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.485491 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:27.491860 19340 leader_election.cc:343] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.492472 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:27.493264 19587 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.496912 19418 tablet_bootstrap.cc:654] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.491860 19224 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:27.504343 19420 tablet_bootstrap.cc:492] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.504061 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:27.504798 19420 ts_tablet_manager.cc:1403] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.101s	user 0.027s	sys 0.006s
I20260709 13:08:27.508837 19420 raft_consensus.cc:359] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.509493 19420 raft_consensus.cc:385] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.509776 19420 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.510424 19420 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.511904 19420 ts_tablet_manager.cc:1434] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:08:27.513290 19420 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.506340 19587 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.517642 19587 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:27.518453 19587 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.521291 19414 tablet_bootstrap.cc:492] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.521968 19414 ts_tablet_manager.cc:1403] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.005s
I20260709 13:08:27.525244 19414 raft_consensus.cc:359] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.527176 19414 raft_consensus.cc:385] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.529095 19420 tablet_bootstrap.cc:654] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.529524 19414 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.529096 19418 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.530473 19418 ts_tablet_manager.cc:1403] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.013s
I20260709 13:08:27.530354 19414 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.532806 19414 ts_tablet_manager.cc:1434] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:08:27.533753 19414 tablet_bootstrap.cc:492] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.534948 19418 raft_consensus.cc:359] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.535604 19418 raft_consensus.cc:385] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.535861 19418 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.536613 19418 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.538625 19418 ts_tablet_manager.cc:1434] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:27.539774 19418 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.545580 19418 tablet_bootstrap.cc:654] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.553622 19414 tablet_bootstrap.cc:654] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.561002 19420 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.561450 19420 ts_tablet_manager.cc:1403] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 13:08:27.563881 19418 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.564350 19418 ts_tablet_manager.cc:1403] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:08:27.564134 19420 raft_consensus.cc:359] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.564889 19420 raft_consensus.cc:385] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.565148 19420 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.565254 19120 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.565809 19420 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.566897 19418 raft_consensus.cc:359] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.567499 19418 raft_consensus.cc:385] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.567739 19418 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.567857 19420 ts_tablet_manager.cc:1434] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:27.568342 19418 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.570206 19418 ts_tablet_manager.cc:1434] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:27.572154 19420 tablet_bootstrap.cc:492] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.572235 19418 tablet_bootstrap.cc:492] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.573321 19414 tablet_bootstrap.cc:492] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.573791 19414 ts_tablet_manager.cc:1403] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.003s
I20260709 13:08:27.578277 19420 tablet_bootstrap.cc:654] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.578447 19418 tablet_bootstrap.cc:654] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:27.582103 19339 consensus_peers.cc:597] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.589258 19420 tablet_bootstrap.cc:492] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.589723 19420 ts_tablet_manager.cc:1403] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:08:27.592206 19420 raft_consensus.cc:359] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.593145 19420 raft_consensus.cc:385] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.593434 19420 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.594161 19420 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.596451 19420 ts_tablet_manager.cc:1434] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:27.597501 19420 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.598461 19414 raft_consensus.cc:359] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.599162 19414 raft_consensus.cc:385] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.605032 19414 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.603645 19420 tablet_bootstrap.cc:654] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.605937 19414 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.609619 19414 ts_tablet_manager.cc:1434] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 13:08:27.610788 19414 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.622000 19414 tablet_bootstrap.cc:654] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.623229 19418 tablet_bootstrap.cc:492] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.623672 19418 ts_tablet_manager.cc:1403] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.019s
I20260709 13:08:27.627017 19418 raft_consensus.cc:359] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.627727 19418 raft_consensus.cc:385] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.628073 19482 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.628086 19418 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.628870 19482 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.629446 19418 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.631433 19482 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.632292 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.632933 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:27.634228 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.634794 19368 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:27.636328 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:27.636726 19414 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.637140 19482 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.637354 19414 ts_tablet_manager.cc:1403] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:08:27.637521 19482 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.637912 19482 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.645816 19418 ts_tablet_manager.cc:1434] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:08:27.646615 19425 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.646984 19414 raft_consensus.cc:359] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.647094 19425 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.647790 19414 raft_consensus.cc:385] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.648128 19414 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.648572 19418 tablet_bootstrap.cc:492] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.648898 19414 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.644631 19482 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.651659 19414 ts_tablet_manager.cc:1434] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:08:27.651593 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.649276 19425 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.652076 19482 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.644820 19420 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.652339 19368 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.652937 19420 ts_tablet_manager.cc:1403] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.015s
I20260709 13:08:27.653136 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:27.653705 19224 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.653858 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.655609 19464 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.656013 19464 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.656468 19464 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.655784 19420 raft_consensus.cc:359] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.656906 19420 raft_consensus.cc:385] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.657320 19420 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.658399 19420 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.660326 19420 ts_tablet_manager.cc:1434] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:27.661372 19414 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.661309 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.663211 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.663731 19370 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.656966 19418 tablet_bootstrap.cc:654] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.667433 19414 tablet_bootstrap.cc:654] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.668326 19420 tablet_bootstrap.cc:492] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.660372 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:27.685581 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:27.686729 19475 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.687405 19475 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:27.693936 19475 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.682157 19425 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 13:08:27.693390 19191 leader_election.cc:343] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.682149 19370 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:27.708372 19587 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.699745 19464 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.709712 19587 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.713312 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:27.714964 19191 leader_election.cc:343] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.715929 19464 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.717068 19450 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.718158 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.718742 19420 tablet_bootstrap.cc:654] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:27.719569 19339 leader_election.cc:343] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.721498 19587 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.722703 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.723445 19370 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.725726 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:27.729319 19340 leader_election.cc:343] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.729887 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:27.731631 19224 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:27.732546 19441 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.734406 19441 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:27.735410 19441 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:27.735783 19441 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:27.742473 19441 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.748835 19441 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.740737 19368 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.740064 19370 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:27.753891 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:27.754853 19464 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.755393 19464 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:27.756409 19464 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:27.765894 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:27.770166 19418 tablet_bootstrap.cc:492] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.770666 19418 ts_tablet_manager.cc:1403] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.122s	user 0.026s	sys 0.020s
I20260709 13:08:27.771842 19414 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.772276 19414 ts_tablet_manager.cc:1403] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.024s
I20260709 13:08:27.775207 19414 raft_consensus.cc:359] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.775852 19414 raft_consensus.cc:385] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.776141 19414 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.776777 19414 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.776631 19123 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.773213 19418 raft_consensus.cc:359] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.779402 19418 raft_consensus.cc:385] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.779690 19418 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.780623 19418 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.783484 19418 ts_tablet_manager.cc:1434] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:08:27.784351 19418 tablet_bootstrap.cc:492] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.789992 19418 tablet_bootstrap.cc:654] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.793627 19450 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.794178 19450 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.796082 19450 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.796353 19414 ts_tablet_manager.cc:1434] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:08:27.798552 19507 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.799019 19507 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.800828 19507 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.801352 19414 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.802778 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:27.807543 19191 leader_election.cc:343] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.797852 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.809767 19420 tablet_bootstrap.cc:492] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:27.810271 19420 ts_tablet_manager.cc:1403] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.001s
W20260709 13:08:27.810424 19339 leader_election.cc:343] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.811071 19464 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.813264 19224 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:27.816087 19475 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:27.816465 19507 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.816900 19507 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.819947 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.820083 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.820283 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.820647 19374 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.821084 19299 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.822029 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.823094 19464 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.823633 19464 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.823347 19482 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.824062 19464 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.826946 19507 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.829396 19450 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.829998 19450 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:27.830116 19340 leader_election.cc:343] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.831404 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:27.834161 19590 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.843062 19540 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.846449 19450 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:27.849864 19414 tablet_bootstrap.cc:654] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.851804 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:27.853201 19339 leader_election.cc:343] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.861508 19482 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.861865 19373 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:27.862289 19373 pending_rounds.cc:85] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 1
I20260709 13:08:27.861970 19482 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.862618 19373 pending_rounds.cc:107] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:27.862944 19373 raft_consensus.cc:2889] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.865746 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.865808 19524 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:27.866446 19374 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:27.822891 19420 raft_consensus.cc:359] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.865790 19482 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.867533 19420 raft_consensus.cc:385] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.867852 19420 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.868515 19420 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.869166 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.870020 19507 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.870628 19420 ts_tablet_manager.cc:1434] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 13:08:27.870450 19507 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.871479 19420 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:27.871958 19414 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:27.872913 19414 ts_tablet_manager.cc:1403] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.003s
I20260709 13:08:27.873039 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.873659 19300 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.875519 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:27.876317 19505 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.876665 19505 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.877027 19505 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.876762 19414 raft_consensus.cc:359] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.877940 19414 raft_consensus.cc:385] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.878376 19414 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.879143 19414 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.879992 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.880826 19414 ts_tablet_manager.cc:1434] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:27.880815 19482 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.881799 19482 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.882155 19482 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.886735 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.891553 19507 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.888859 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:27.893551 19505 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.895574 19507 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.895706 19223 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:27.896071 19507 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.898130 19420 tablet_bootstrap.cc:654] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.891736 19374 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.901772 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.902365 19372 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.902796 19482 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.904731 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:27.905056 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:27.905395 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:27.905810 19300 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:27.906112 19223 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:27.847302 19418 tablet_bootstrap.cc:492] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:27.907856 19418 ts_tablet_manager.cc:1403] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.004s
I20260709 13:08:27.911450 19372 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:27.912595 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:27.913363 19425 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.910398 19418 raft_consensus.cc:359] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.915222 19418 raft_consensus.cc:385] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.915599 19418 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.922133 19464 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.924916 19464 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.924950 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:27.926062 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.926951 19374 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.926071 19300 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:27.929445 19340 leader_election.cc:343] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.929944 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:27.901801 19122 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.930627 19450 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.932108 19482 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.932673 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:27.933262 19414 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:27.933264 19368 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:27.934767 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:27.938805 19418 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.941387 19425 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:27.974685 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:27.975067 19414 tablet_bootstrap.cc:654] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.953084 19505 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.978718 19505 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.979090 19505 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.979410 19505 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.977826 19507 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.981191 19418 ts_tablet_manager.cc:1434] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.004s
I20260709 13:08:27.984575 19418 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:27.984061 19372 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:27.990960 19540 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.993541 19540 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:27.995044 19300 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:27.995630 19540 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.995826 19623 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.988998 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51502.1us
I20260709 13:08:28.001626 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.002353 19225 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:08:27.996332 19623 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.017513 19623 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:27.996984 19425 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.018934 19418 tablet_bootstrap.cc:654] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.023526 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:08:28.036355 19622 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:28.039637 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.044853 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.045396 19370 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:28.046196 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:28.046968 19623 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.047725 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:28.048527 19623 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.048723 19266 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.049228 19450 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.049520 19540 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.049670 19450 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.050050 19540 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.052968 19450 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.054143 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.061944 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.056887 19540 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.089443 19414 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.090076 19414 ts_tablet_manager.cc:1403] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.012s
W20260709 13:08:28.090873 19340 leader_election.cc:343] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.063362 19374 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:28.098297 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.100294 19414 raft_consensus.cc:359] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.100989 19414 raft_consensus.cc:385] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.101241 19414 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.102818 19587 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.105770 19587 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.107264 19587 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.107507 19418 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.107970 19418 ts_tablet_manager.cc:1403] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.018s
I20260709 13:08:28.108368 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.104432 19414 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.109622 19540 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.113420 19540 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.112632 19418 raft_consensus.cc:359] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.113832 19418 raft_consensus.cc:385] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.114123 19418 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
W20260709 13:08:28.104800 19265 leader_election.cc:343] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.115950 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:28.116496 19368 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.116997 19623 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:28.119012 19339 leader_election.cc:343] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.118824 19505 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.119329 19414 ts_tablet_manager.cc:1434] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:08:28.119412 19339 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:28.120368 19414 tablet_bootstrap.cc:492] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.121569 19420 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.121759 19589 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.121985 19420 ts_tablet_manager.cc:1403] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.251s	user 0.016s	sys 0.012s
I20260709 13:08:28.124890 19505 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.125916 19589 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.128536 19418 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.128371 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.136498 19418 ts_tablet_manager.cc:1434] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.001s
I20260709 13:08:28.137341 19418 tablet_bootstrap.cc:492] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.137358 19420 raft_consensus.cc:359] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.137233 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.140250 19420 raft_consensus.cc:385] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.140969 19420 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.141566 19420 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.143080 19420 ts_tablet_manager.cc:1434] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:08:28.142963 19225 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:28.147337 19589 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.148105 19225 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.150144 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:28.150874 19590 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.151228 19590 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.151540 19590 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.156275 19368 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:28.157429 19266 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.158586 19475 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.159192 19475 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:28.160246 19475 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.163025 19224 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:28.170964 19455 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.130s	user 0.006s	sys 0.000s
I20260709 13:08:28.175771 19224 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:28.180999 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:28.181646 19299 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.183868 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:28.184522 19368 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.190678 19590 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.185245 19524 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:28.191896 19418 tablet_bootstrap.cc:654] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.205477 19524 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.194229 19414 tablet_bootstrap.cc:654] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.194283 19299 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:28.204507 19191 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:28.207928 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.209611 19524 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.204845 19368 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:28.216015 19628 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.216866 19420 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.217897 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.217938 19628 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:28.218744 19222 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:28.219354 19628 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.235785 19475 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.226645 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.234306 19505 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.239069 19123 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.242906 19418 tablet_bootstrap.cc:492] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.245431 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:28.246958 19418 ts_tablet_manager.cc:1403] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.031s
I20260709 13:08:28.236855 19374 raft_consensus.cc:2368] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3.
I20260709 13:08:28.252645 19420 tablet_bootstrap.cc:654] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.253515 19266 leader_election.cc:400] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3.
I20260709 13:08:28.253878 19266 leader_election.cc:403] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.255834 19524 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.249725 19507 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.257928 19507 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:28.258818 19507 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.261224 19590 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.267041 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.267920 19223 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.274834 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:28.277681 19121 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.281646 19414 tablet_bootstrap.cc:492] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.282210 19414 ts_tablet_manager.cc:1403] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.162s	user 0.027s	sys 0.003s
I20260709 13:08:28.284495 19524 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3.
I20260709 13:08:28.292608 19414 raft_consensus.cc:359] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.293390 19414 raft_consensus.cc:385] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.293678 19414 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.294376 19414 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.294550 19418 raft_consensus.cc:359] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.295689 19418 raft_consensus.cc:385] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.296027 19418 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.302174 19414 ts_tablet_manager.cc:1434] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:08:28.304522 19418 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.310125 19420 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.310632 19420 ts_tablet_manager.cc:1403] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.016s
I20260709 13:08:28.313169 19420 raft_consensus.cc:359] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.313856 19420 raft_consensus.cc:385] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.314188 19420 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.314992 19420 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.317263 19420 ts_tablet_manager.cc:1434] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:28.317901 19590 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.318171 19420 tablet_bootstrap.cc:492] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.318361 19590 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.320331 19590 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.321381 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.321907 19300 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:08:28.322022 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.321727 19123 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:28.322855 19339 leader_election.cc:343] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:28.323396 19340 leader_election.cc:343] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.323858 19340 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:28.323647 19123 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.325568 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.326333 19450 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.326385 19590 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.327026 19590 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:28.327481 19420 tablet_bootstrap.cc:654] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.328928 19482 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.329423 19482 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.331437 19482 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.332751 19441 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.333366 19441 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.336992 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.337735 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.338341 19222 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:28.339190 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.339818 19224 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:28.341163 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:28.341964 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.342679 19368 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:28.342064 19540 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.335918 19441 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.343487 19540 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.327883 19590 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:28.338546 19340 leader_election.cc:343] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.343948 19540 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.345890 19339 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:28.348004 19223 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:08:28.348345 19441 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.348704 19441 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.349207 19507 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.349797 19441 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.351923 19418 ts_tablet_manager.cc:1434] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.001s
I20260709 13:08:28.352882 19418 tablet_bootstrap.cc:492] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.354524 19540 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.357033 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.357578 19223 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.357573 19540 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.358286 19524 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:28.360320 19191 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.357887 19414 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.363097 19441 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.365546 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:28.366132 19374 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.366041 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.366849 19225 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.372809 19225 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:28.373849 19374 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:28.373957 19339 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.375063 19450 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.375715 19450 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:28.376701 19450 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.379151 19414 tablet_bootstrap.cc:654] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.383471 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:28.384764 19340 leader_election.cc:343] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.385439 19441 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.397444 19418 tablet_bootstrap.cc:654] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.394248 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.400923 19540 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.401450 19540 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:28.402280 19540 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.406896 19121 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.407963 19223 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:28.417609 19414 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.418089 19414 ts_tablet_manager.cc:1403] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.003s
I20260709 13:08:28.420851 19414 raft_consensus.cc:359] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.421577 19414 raft_consensus.cc:385] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.421885 19414 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.422592 19414 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.428841 19414 ts_tablet_manager.cc:1434] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:28.429867 19414 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.438143 19420 tablet_bootstrap.cc:492] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.437556 19122 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.438602 19420 ts_tablet_manager.cc:1403] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.025s
I20260709 13:08:28.441181 19420 raft_consensus.cc:359] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.441810 19420 raft_consensus.cc:385] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.442546 19450 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.445660 19414 tablet_bootstrap.cc:654] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.452045 19420 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.452710 19450 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.453824 19121 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.454840 19450 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.457589 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.458930 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:28.460706 19340 leader_election.cc:343] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:28.461676 19339 leader_election.cc:343] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.462113 19339 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:28.462802 19450 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.464624 19420 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.466715 19420 ts_tablet_manager.cc:1434] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:08:28.468393 19420 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.469281 19418 tablet_bootstrap.cc:492] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.469887 19418 ts_tablet_manager.cc:1403] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.014s
I20260709 13:08:28.473359 19418 raft_consensus.cc:359] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.474550 19418 raft_consensus.cc:385] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.474892 19418 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.475100 19420 tablet_bootstrap.cc:654] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.475760 19418 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.490710 19420 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.491302 19420 ts_tablet_manager.cc:1403] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:08:28.494136 19420 raft_consensus.cc:359] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.495018 19420 raft_consensus.cc:385] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.495344 19420 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.496135 19420 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.497006 19418 ts_tablet_manager.cc:1434] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:08:28.497398 19414 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.497807 19414 ts_tablet_manager.cc:1403] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.023s
I20260709 13:08:28.498627 19420 ts_tablet_manager.cc:1434] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:08:28.500275 19420 tablet_bootstrap.cc:492] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.501071 19414 raft_consensus.cc:359] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.501714 19414 raft_consensus.cc:385] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.502300 19414 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.502964 19414 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.505111 19414 ts_tablet_manager.cc:1434] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:08:28.506385 19414 tablet_bootstrap.cc:492] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.510361 19418 tablet_bootstrap.cc:492] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.511751 19414 tablet_bootstrap.cc:654] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.519927 19418 tablet_bootstrap.cc:654] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.521553 19420 tablet_bootstrap.cc:654] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.522872 19505 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.523331 19505 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.525303 19505 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.526678 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.526875 19420 tablet_bootstrap.cc:492] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.527271 19414 tablet_bootstrap.cc:492] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.527848 19414 ts_tablet_manager.cc:1403] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:08:28.527913 19420 ts_tablet_manager.cc:1403] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:08:28.528187 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.528939 19374 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:28.529951 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.527323 19300 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:28.530616 19505 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.531028 19505 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.531370 19505 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.530385 19414 raft_consensus.cc:359] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.532371 19420 raft_consensus.cc:359] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.538395 19505 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.534526 19418 tablet_bootstrap.cc:492] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.538707 19414 raft_consensus.cc:385] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.538856 19425 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.539824 19418 ts_tablet_manager.cc:1403] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.009s
I20260709 13:08:28.539805 19414 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.539513 19420 raft_consensus.cc:385] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.541239 19420 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.540866 19414 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.541471 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:28.542048 19300 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.542076 19420 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.542655 19418 raft_consensus.cc:359] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.543313 19418 raft_consensus.cc:385] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.543568 19418 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.544183 19418 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.546394 19418 ts_tablet_manager.cc:1434] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:08:28.547587 19418 tablet_bootstrap.cc:492] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.551401 19300 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:28.553586 19418 tablet_bootstrap.cc:654] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.554805 19414 ts_tablet_manager.cc:1434] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.004s
I20260709 13:08:28.557176 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:28.558241 19425 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.558797 19420 ts_tablet_manager.cc:1434] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:08:28.558851 19425 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:28.560643 19414 tablet_bootstrap.cc:492] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.560518 19425 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.567337 19414 tablet_bootstrap.cc:654] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.567821 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:28.570669 19374 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.573616 19420 tablet_bootstrap.cc:492] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.581823 19374 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:28.584857 19420 tablet_bootstrap.cc:654] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.585466 19505 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.589856 19414 tablet_bootstrap.cc:492] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.590353 19414 ts_tablet_manager.cc:1403] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260709 13:08:28.590155 19505 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.593108 19414 raft_consensus.cc:359] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.594102 19414 raft_consensus.cc:385] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.594529 19414 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.595443 19414 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.604106 19420 tablet_bootstrap.cc:492] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.604977 19420 ts_tablet_manager.cc:1403] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.008s
I20260709 13:08:28.604285 19121 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.607345 19420 raft_consensus.cc:359] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.607973 19420 raft_consensus.cc:385] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.608280 19420 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.608949 19420 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.610886 19420 ts_tablet_manager.cc:1434] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:08:28.611708 19420 tablet_bootstrap.cc:492] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.618912 19418 tablet_bootstrap.cc:492] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.619393 19418 ts_tablet_manager.cc:1403] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.036s
I20260709 13:08:28.622392 19420 tablet_bootstrap.cc:654] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.622105 19418 raft_consensus.cc:359] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.622750 19418 raft_consensus.cc:385] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.623044 19418 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.623876 19418 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.625916 19414 ts_tablet_manager.cc:1434] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:08:28.626322 19418 ts_tablet_manager.cc:1434] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:28.627375 19418 tablet_bootstrap.cc:492] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.634703 19418 tablet_bootstrap.cc:654] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.633394 19414 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.649252 19420 tablet_bootstrap.cc:492] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:28.651062 19418 tablet_bootstrap.cc:492] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.649717 19420 ts_tablet_manager.cc:1403] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.015s
I20260709 13:08:28.651484 19418 ts_tablet_manager.cc:1403] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:08:28.654024 19418 raft_consensus.cc:359] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.654657 19418 raft_consensus.cc:385] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.654922 19418 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.654945 19420 raft_consensus.cc:359] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.655625 19420 raft_consensus.cc:385] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.656034 19420 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.655611 19418 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.656739 19420 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.657747 19418 ts_tablet_manager.cc:1434] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:08:28.658779 19418 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.663125 19441 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.663585 19441 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.664127 19418 tablet_bootstrap.cc:654] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.666060 19441 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.666200 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.666842 19223 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:28.667958 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.668716 19441 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.669051 19441 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.669448 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.669373 19441 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:28.670804 19340 leader_election.cc:343] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.673424 19420 ts_tablet_manager.cc:1434] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:08:28.677022 19414 tablet_bootstrap.cc:654] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.681980 19450 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.682679 19450 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.705452 19450 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.711469 19420 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:28.718200 19441 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.726487 19524 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.727012 19524 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.729463 19524 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.729756 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.730393 19300 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:28.730599 19299 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.731405 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.732003 19373 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:28.732738 19441 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.733547 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.734144 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:28.734375 19540 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.735504 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.736246 19225 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:28.735482 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.735714 19540 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.737821 19540 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.738184 19540 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.742053 19414 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.742622 19414 ts_tablet_manager.cc:1403] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.109s	user 0.006s	sys 0.004s
I20260709 13:08:28.745235 19414 raft_consensus.cc:359] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.745875 19414 raft_consensus.cc:385] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.746124 19414 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.748116 19441 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.748521 19441 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.748879 19441 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.744824 19540 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.751065 19418 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.751493 19418 ts_tablet_manager.cc:1403] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.043s
W20260709 13:08:28.748301 19340 leader_election.cc:343] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.754527 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:28.755111 19373 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.755685 19441 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.747414 19414 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.762509 19373 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:28.763664 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.764068 19450 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.764423 19524 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.764582 19450 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.764923 19524 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:28.765973 19524 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.766492 19450 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.766793 19414 ts_tablet_manager.cc:1434] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:08:28.767088 19418 raft_consensus.cc:359] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.767793 19418 raft_consensus.cc:385] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.768051 19418 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.768855 19441 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.767808 19414 tablet_bootstrap.cc:492] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.768642 19418 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.771757 19418 ts_tablet_manager.cc:1434] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:08:28.773288 19418 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.778995 19418 tablet_bootstrap.cc:654] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.789116 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:28.789752 19299 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:28.791261 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:28.791766 19299 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.794068 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.801257 19450 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.801577 19450 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.802048 19450 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.796706 19418 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:28.806104 19418 ts_tablet_manager.cc:1403] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.010s
I20260709 13:08:28.808554 19418 raft_consensus.cc:359] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.809188 19418 raft_consensus.cc:385] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.809453 19418 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.798861 19299 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:28.799823 19414 tablet_bootstrap.cc:654] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.811483 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:28.801527 19340 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.811832 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.812105 19223 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:28.812454 19221 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.798720 19540 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.814579 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.815186 19219 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.817230 19450 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.819527 19450 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.819878 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.820261 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.819445 19221 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:28.820485 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:28.821242 19300 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.821221 19123 catalog_manager.cc:5697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.820758 19225 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.823925 19219 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:28.826124 19590 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.826670 19590 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.828768 19590 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:28.828806 19418 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.831190 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:28.832697 19340 leader_election.cc:343] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:28.835158 19339 leader_election.cc:343] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.836041 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:28.836086 19425 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.837154 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:28.838937 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:28.839697 19590 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.840340 19587 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.841109 19590 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:28.842937 19590 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.843808 19425 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.841485 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:28.841776 19339 leader_election.cc:343] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:28.850154 19339 leader_election.cc:343] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.850546 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:28.852416 19482 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.853096 19441 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.853634 19482 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.854075 19482 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.855242 19420 tablet_bootstrap.cc:654] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.855772 19418 ts_tablet_manager.cc:1434] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.001s
I20260709 13:08:28.857999 19475 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.879834 19418 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:28.856019 19482 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:28.863415 19414 tablet_bootstrap.cc:492] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:28.864466 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:28.865940 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:28.881590 19414 ts_tablet_manager.cc:1403] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.114s	user 0.030s	sys 0.016s
I20260709 13:08:28.872440 19225 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:28.883126 19219 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:08:28.884109 19414 raft_consensus.cc:359] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.884799 19414 raft_consensus.cc:385] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.885071 19414 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.885689 19414 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.886701 19505 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.887809 19414 ts_tablet_manager.cc:1434] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:08:28.887990 19482 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.888797 19414 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:28.889282 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:28.890184 19475 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:28.873373 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:28.873500 19587 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:28.897001 19414 tablet_bootstrap.cc:654] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.899370 19587 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.906069 19475 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.906541 19418 tablet_bootstrap.cc:654] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.908025 19450 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.912556 19425 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.921659 19300 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:28.947191 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:28.948953 19590 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.949608 19590 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:28.949903 19224 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:28.950608 19590 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:28.953208 19441 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.962620 19296 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:28.964618 19450 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:28.993888 19524 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.994519 19524 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.003206 19425 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.005373 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:29.006249 19368 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:29.008785 19524 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.010308 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.014217 19266 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:29.015820 19482 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:29.016706 19265 leader_election.cc:343] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.022148 19482 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.022626 19482 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.032538 19628 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.045610 19628 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.066114 19420 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:29.066736 19420 ts_tablet_manager.cc:1403] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.356s	user 0.013s	sys 0.000s
I20260709 13:08:29.077116 19628 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.086817 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:29.089015 19191 leader_election.cc:343] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.091636 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:29.092245 19374 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:29.093612 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:29.096825 19121 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.098791 19121 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.097898 19505 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.120316 19505 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.130653 19482 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.138458 19482 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.139719 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:29.128723 19505 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.142521 19418 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:29.143114 19418 ts_tablet_manager.cc:1403] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.264s	user 0.011s	sys 0.023s
I20260709 13:08:29.141390 19371 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.148288 19414 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.148800 19414 ts_tablet_manager.cc:1403] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.260s	user 0.038s	sys 0.077s
I20260709 13:08:29.148452 19420 raft_consensus.cc:359] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.149377 19420 raft_consensus.cc:385] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.149667 19420 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.152225 19420 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.156025 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:08:29.161206 19265 leader_election.cc:343] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.161654 19418 raft_consensus.cc:359] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.162177 19505 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.163295 19420 ts_tablet_manager.cc:1434] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.096s	user 0.004s	sys 0.004s
I20260709 13:08:29.164626 19505 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.162585 19418 raft_consensus.cc:385] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.166867 19418 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.167793 19418 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.170607 19418 ts_tablet_manager.cc:1434] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:08:29.171783 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:29.173496 19191 leader_election.cc:343] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.180184 19371 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:29.190045 19266 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:29.190682 19482 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.191107 19482 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:29.191561 19482 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:29.194648 19679 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:08:29.199205 19420 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:29.203466 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:29.203568 19414 raft_consensus.cc:359] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.204101 19371 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.204272 19414 raft_consensus.cc:385] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.204555 19414 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.205225 19414 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.208673 19414 ts_tablet_manager.cc:1434] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:08:29.209575 19414 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:29.211484 19627 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:08:29.218681 19420 tablet_bootstrap.cc:654] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.222574 19418 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:29.226608 19371 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:29.229029 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:29.230067 19425 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.230552 19425 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:29.231330 19425 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.230463 19414 tablet_bootstrap.cc:654] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.236948 19418 tablet_bootstrap.cc:654] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.257470 19414 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.258046 19414 ts_tablet_manager.cc:1403] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.003s
I20260709 13:08:29.261797 19123 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.268014 19414 raft_consensus.cc:359] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.268821 19414 raft_consensus.cc:385] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.269156 19414 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.271772 19414 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.273377 19414 ts_tablet_manager.cc:1434] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:29.274252 19414 tablet_bootstrap.cc:492] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:29.274291 19418 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:29.274891 19418 ts_tablet_manager.cc:1403] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.011s
I20260709 13:08:29.277411 19418 raft_consensus.cc:359] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.278030 19418 raft_consensus.cc:385] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.278264 19418 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.278816 19418 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.280632 19418 ts_tablet_manager.cc:1434] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:08:29.281440 19418 tablet_bootstrap.cc:492] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:29.287698 19414 tablet_bootstrap.cc:654] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.290832 19418 tablet_bootstrap.cc:654] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.297996 19420 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:29.298417 19420 ts_tablet_manager.cc:1403] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.099s	user 0.025s	sys 0.017s
I20260709 13:08:29.299618 19414 tablet_bootstrap.cc:492] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.300215 19414 ts_tablet_manager.cc:1403] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 13:08:29.303682 19414 raft_consensus.cc:359] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.304558 19414 raft_consensus.cc:385] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.304891 19414 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.305229 19420 raft_consensus.cc:359] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.305886 19420 raft_consensus.cc:385] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.306209 19420 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.305692 19414 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.307861 19701 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.308506 19414 ts_tablet_manager.cc:1434] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:29.308377 19701 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.309669 19414 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:29.310384 19701 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.310325 19122 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.312357 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.313799 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:29.315258 19339 leader_election.cc:343] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.316339 19340 leader_election.cc:343] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.316736 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:29.317247 19414 tablet_bootstrap.cc:654] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.317981 19701 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.306897 19420 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.322746 19700 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.324347 19418 tablet_bootstrap.cc:492] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:29.324752 19414 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.324754 19420 ts_tablet_manager.cc:1434] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:08:29.324774 19418 ts_tablet_manager.cc:1403] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.024s
I20260709 13:08:29.325493 19414 ts_tablet_manager.cc:1403] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:08:29.325929 19420 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:29.328121 19418 raft_consensus.cc:359] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.328298 19414 raft_consensus.cc:359] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.328814 19418 raft_consensus.cc:385] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.329034 19414 raft_consensus.cc:385] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.329113 19418 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.329519 19414 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.329952 19418 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.330314 19701 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.330325 19414 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.331087 19701 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.331631 19418 ts_tablet_manager.cc:1434] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:29.332454 19418 tablet_bootstrap.cc:492] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:29.333204 19701 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.333621 19414 ts_tablet_manager.cc:1434] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:29.334882 19414 tablet_bootstrap.cc:492] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:29.336439 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.337196 19219 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:29.338729 19418 tablet_bootstrap.cc:654] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.340720 19414 tablet_bootstrap.cc:654] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.340566 19339 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:29.341710 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.341939 19700 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.342285 19700 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.342624 19700 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:29.343132 19340 leader_election.cc:343] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.347646 19420 tablet_bootstrap.cc:654] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.354300 19414 tablet_bootstrap.cc:492] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.354816 19414 ts_tablet_manager.cc:1403] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:08:29.355597 19700 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.351717 19121 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.357647 19414 raft_consensus.cc:359] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.358525 19414 raft_consensus.cc:385] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.358937 19414 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.362771 19414 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.364456 19482 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.364886 19482 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.365064 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:29.366591 19482 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.367705 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:29.368319 19224 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:29.371223 19340 leader_election.cc:343] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.379312 19224 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:29.381363 19414 ts_tablet_manager.cc:1434] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:08:29.382267 19414 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:29.383812 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:29.384783 19374 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:29.388319 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.389748 19482 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.360935 19700 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.394353 19339 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:29.397914 19482 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.400538 19673 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.394430 19701 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:08:29.402675 19587 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.405596 19673 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:29.406567 19673 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.411747 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:29.414230 19299 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.415010 19418 tablet_bootstrap.cc:492] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:29.425789 19696 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:29.416707 19339 consensus_peers.cc:597] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.428414 19418 ts_tablet_manager.cc:1403] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.013s
I20260709 13:08:29.430529 19475 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.434490 19675 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.434984 19675 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.439190 19675 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.457994 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:29.461453 19368 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:29.465185 19414 tablet_bootstrap.cc:654] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.468716 19475 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.481082 19418 raft_consensus.cc:359] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.482055 19418 raft_consensus.cc:385] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.482398 19418 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.483923 19418 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.484738 19122 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.485765 19425 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.486174 19425 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.488665 19425 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.493957 19418 ts_tablet_manager.cc:1434] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:08:29.496263 19418 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:29.498757 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:29.500481 19374 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:29.502291 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:29.503636 19425 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.504032 19425 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.504493 19425 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.531600 19587 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.531715 19425 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.533631 19425 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.537189 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:29.537864 19374 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.539019 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.546190 19420 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:29.546802 19420 ts_tablet_manager.cc:1403] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.221s	user 0.037s	sys 0.047s
W20260709 13:08:29.552259 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 95020.3us
I20260709 13:08:29.557708 19420 raft_consensus.cc:359] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.558413 19420 raft_consensus.cc:385] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.558676 19420 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.559273 19420 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.560245 19590 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.560695 19590 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.563676 19590 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.563694 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:29.571087 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.572278 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:29.574443 19340 leader_election.cc:343] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.575539 19339 leader_election.cc:343] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.575991 19339 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:29.563215 19266 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:29.580602 19695 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.582033 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.583426 19540 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.583868 19540 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.584367 19540 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.597244 19420 ts_tablet_manager.cc:1434] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.002s
I20260709 13:08:29.598572 19420 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:29.602800 19418 tablet_bootstrap.cc:654] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.605165 19374 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:29.603675 19590 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.608623 19590 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:29.608973 19265 leader_election.cc:343] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.616937 19191 leader_election.cc:343] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.617534 19191 leader_election.cc:343] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.618494 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:29.619144 19425 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.619590 19425 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:29.620268 19425 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.625725 19414 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.626161 19414 ts_tablet_manager.cc:1403] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.244s	user 0.034s	sys 0.036s
I20260709 13:08:29.628208 19590 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.629170 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:29.632318 19339 leader_election.cc:343] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.628639 19540 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.666224 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.666280 19414 raft_consensus.cc:359] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.666957 19299 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:29.667124 19414 raft_consensus.cc:385] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.667436 19414 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.668558 19701 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.670378 19701 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.673099 19701 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.674811 19414 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.675954 19418 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:29.676664 19418 ts_tablet_manager.cc:1403] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.010s
I20260709 13:08:29.666431 19587 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.684834 19540 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:29.692960 19414 ts_tablet_manager.cc:1434] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.003s
I20260709 13:08:29.684937 19587 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.695501 19418 raft_consensus.cc:359] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.696022 19418 raft_consensus.cc:385] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.696333 19418 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.697167 19587 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.696946 19418 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.698319 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:29.698515 19418 ts_tablet_manager.cc:1434] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.000s
I20260709 13:08:29.698889 19371 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.699462 19418 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:29.703826 19371 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:29.705765 19418 tablet_bootstrap.cc:654] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.706103 19420 tablet_bootstrap.cc:654] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.744496 19266 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:29.755848 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:29.753676 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.760947 19540 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.782331 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:29.782615 19339 leader_election.cc:343] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.785235 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.788698 19590 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.789276 19590 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.789706 19590 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.795305 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:29.769222 19698 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.791759 19540 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:29.801149 19414 tablet_bootstrap.cc:492] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:29.801813 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.807502 19420 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:29.811759 19720 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:08:29.813620 19540 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.813977 19420 ts_tablet_manager.cc:1403] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.011s
I20260709 13:08:29.822832 19587 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.833442 19121 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:29.834846 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:29.836665 19698 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:29.840965 19339 leader_election.cc:343] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.845235 19420 raft_consensus.cc:359] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.846225 19420 raft_consensus.cc:385] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.848475 19420 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.850654 19414 tablet_bootstrap.cc:654] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.849102 19420 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:29.857918 19340 leader_election.cc:343] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.858575 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:08:29.835994 19265 leader_election.cc:343] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.862587 19695 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.849391 19698 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:08:29.874953 19340 leader_election.cc:343] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.875396 19340 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:29.876672 19695 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.879374 19418 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:29.880064 19418 ts_tablet_manager.cc:1403] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.010s
I20260709 13:08:29.852756 19587 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.883286 19590 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.883812 19420 ts_tablet_manager.cc:1434] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.002s
I20260709 13:08:29.886049 19420 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:29.886819 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:29.887537 19218 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:29.893297 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:29.895644 19673 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.896106 19673 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.901376 19673 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.895009 19587 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.903986 19590 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:29.905092 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.894621 19418 raft_consensus.cc:359] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.906800 19418 raft_consensus.cc:385] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.906991 19418 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.911815 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:29.912576 19298 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.912850 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:08:29.917707 19340 leader_election.cc:343] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:29.919188 19339 leader_election.cc:343] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.922403 19414 tablet_bootstrap.cc:492] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:29.922865 19414 ts_tablet_manager.cc:1403] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.007s
I20260709 13:08:29.923345 19418 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.933758 19414 raft_consensus.cc:359] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.934468 19414 raft_consensus.cc:385] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.934770 19414 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.934926 19420 tablet_bootstrap.cc:654] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.937678 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:29.942973 19297 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.943018 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:29.943822 19418 ts_tablet_manager.cc:1434] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 13:08:29.940701 19414 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.940689 19627 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:08:29.950212 19414 ts_tablet_manager.cc:1434] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:08:29.956295 19418 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:29.960214 19673 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.970135 19370 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:08:29.961412 19123 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.965363 19298 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:29.968204 19590 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.969187 19414 tablet_bootstrap.cc:492] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
W20260709 13:08:29.974267 19191 leader_election.cc:343] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.975018 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:29.975927 19450 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.976402 19450 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:29.977368 19627 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.977258 19450 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:29.982874 19420 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:29.983341 19420 ts_tablet_manager.cc:1403] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.098s	user 0.005s	sys 0.009s
I20260709 13:08:29.992208 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:29.995682 19218 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.996933 19418 tablet_bootstrap.cc:654] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.993992 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:29.998831 19673 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:30.001066 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:30.017400 19425 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.018061 19425 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.025897 19425 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:08:30.027681 19340 leader_election.cc:343] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.037098 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.037806 19370 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:30.051003 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:30.059993 19420 raft_consensus.cc:359] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.061158 19420 raft_consensus.cc:385] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.061596 19420 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.063603 19420 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.066684 19728 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.067127 19728 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.067575 19728 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.071429 19414 tablet_bootstrap.cc:654] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.075686 19720 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.077996 19425 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.077731 19720 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.083477 19720 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.087198 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.087901 19296 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:30.094528 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.095749 19218 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:30.097401 19420 ts_tablet_manager.cc:1434] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 13:08:30.097690 19121 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.102653 19627 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.119030 19673 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:30.149152 19191 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.153465 19420 tablet_bootstrap.cc:492] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:30.165426 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:30.166918 19450 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.167752 19450 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:30.169587 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.170336 19374 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:30.174278 19414 tablet_bootstrap.cc:492] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.175576 19414 ts_tablet_manager.cc:1403] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.207s	user 0.009s	sys 0.016s
I20260709 13:08:30.178082 19418 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:30.178088 19266 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:30.178694 19418 ts_tablet_manager.cc:1403] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.001s
I20260709 13:08:30.178416 19450 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.164744 19728 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.180358 19540 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.190001 19540 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.190378 19540 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.191718 19418 raft_consensus.cc:359] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.192790 19418 raft_consensus.cc:385] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.193154 19418 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.197214 19223 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:30.203128 19418 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.210400 19540 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.213397 19418 ts_tablet_manager.cc:1434] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:08:30.214603 19418 tablet_bootstrap.cc:492] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:30.218564 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:30.219512 19295 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:30.222886 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:30.223624 19370 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.227402 19728 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.231577 19540 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.233454 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:30.234383 19218 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 1: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:08:30.235685 19414 raft_consensus.cc:359] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.239799 19414 raft_consensus.cc:385] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.240132 19414 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.254119 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:30.257792 19420 tablet_bootstrap.cc:654] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.259685 19414 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.271723 19266 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:30.272843 19540 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.275815 19701 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.276353 19701 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.276821 19370 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:30.278306 19701 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:30.279505 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:30.281878 19340 leader_election.cc:343] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.283053 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:30.283156 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.284453 19505 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.284914 19505 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:08:30.285454 19339 leader_election.cc:343] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.286016 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.285688 19505 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.287497 19701 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.287957 19418 tablet_bootstrap.cc:654] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.291226 19540 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.297356 19414 ts_tablet_manager.cc:1434] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.121s	user 0.001s	sys 0.005s
I20260709 13:08:30.298414 19414 tablet_bootstrap.cc:492] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.304409 19418 tablet_bootstrap.cc:492] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:30.304906 19418 ts_tablet_manager.cc:1403] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.006s
W20260709 13:08:30.310132 19265 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.308849 19418 raft_consensus.cc:359] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.311432 19418 raft_consensus.cc:385] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.311721 19418 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.312346 19418 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.314522 19418 ts_tablet_manager.cc:1434] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:30.315495 19418 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:30.319813 19420 tablet_bootstrap.cc:492] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:30.319378 19123 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.320266 19420 ts_tablet_manager.cc:1403] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.000s
I20260709 13:08:30.323771 19414 tablet_bootstrap.cc:654] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.324115 19418 tablet_bootstrap.cc:654] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:30.323954 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:30.328321 19420 raft_consensus.cc:359] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.329241 19420 raft_consensus.cc:385] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.329505 19420 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.330258 19420 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.332299 19420 ts_tablet_manager.cc:1434] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:30.333232 19420 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:30.338743 19420 tablet_bootstrap.cc:654] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.340370 19505 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.340857 19505 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.342806 19505 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.344687 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.346078 19414 tablet_bootstrap.cc:492] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.346535 19414 ts_tablet_manager.cc:1403] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 13:08:30.348946 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.349125 19414 raft_consensus.cc:359] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.349896 19414 raft_consensus.cc:385] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.350191 19414 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.350852 19414 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.351215 19122 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.353089 19414 ts_tablet_manager.cc:1434] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:30.354084 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:30.355333 19505 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.354060 19414 tablet_bootstrap.cc:492] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.360299 19524 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.360844 19524 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.363333 19524 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.364969 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.365272 19414 tablet_bootstrap.cc:654] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.365698 19370 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:30.366482 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.367255 19266 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:30.368237 19524 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:30.368304 19265 leader_election.cc:343] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.368767 19524 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.369371 19524 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.377841 19414 tablet_bootstrap.cc:492] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.378527 19414 ts_tablet_manager.cc:1403] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:08:30.380223 19524 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.382375 19414 raft_consensus.cc:359] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.383180 19414 raft_consensus.cc:385] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.383605 19414 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.384531 19414 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.385779 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:30.386162 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:30.386801 19370 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.387252 19414 ts_tablet_manager.cc:1434] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:08:30.387621 19265 leader_election.cc:343] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.388440 19414 tablet_bootstrap.cc:492] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.394651 19370 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:30.395434 19414 tablet_bootstrap.cc:654] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.396075 19266 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.397332 19475 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.397930 19475 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:30.398847 19475 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.408780 19414 tablet_bootstrap.cc:492] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.409418 19414 ts_tablet_manager.cc:1403] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:08:30.412551 19418 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:30.413110 19418 ts_tablet_manager.cc:1403] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.017s
I20260709 13:08:30.415231 19414 raft_consensus.cc:359] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.416208 19414 raft_consensus.cc:385] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.417050 19414 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.417959 19524 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.415833 19418 raft_consensus.cc:359] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.421173 19418 raft_consensus.cc:385] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.421517 19418 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.418110 19414 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.425441 19414 ts_tablet_manager.cc:1434] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:30.428331 19414 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.433322 19418 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.436530 19418 ts_tablet_manager.cc:1434] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:08:30.437067 19414 tablet_bootstrap.cc:654] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.438701 19701 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.441848 19123 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.443176 19420 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:30.443598 19420 ts_tablet_manager.cc:1403] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.111s	user 0.045s	sys 0.033s
I20260709 13:08:30.447429 19418 tablet_bootstrap.cc:492] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:30.471174 19414 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.472124 19414 ts_tablet_manager.cc:1403] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.004s
I20260709 13:08:30.474740 19418 tablet_bootstrap.cc:654] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.476349 19420 raft_consensus.cc:359] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.477752 19420 raft_consensus.cc:385] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.478801 19414 raft_consensus.cc:359] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.479403 19414 raft_consensus.cc:385] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:30.479365 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.479825 19414 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.480497 19414 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.478545 19420 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.483582 19420 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.484712 19414 ts_tablet_manager.cc:1434] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:08:30.486310 19414 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.490155 19420 ts_tablet_manager.cc:1434] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.005s
I20260709 13:08:30.491061 19414 tablet_bootstrap.cc:654] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.491210 19420 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:30.499346 19418 tablet_bootstrap.cc:492] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:30.499830 19418 ts_tablet_manager.cc:1403] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.007s
I20260709 13:08:30.502039 19420 tablet_bootstrap.cc:654] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.502912 19414 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.503350 19414 ts_tablet_manager.cc:1403] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:08:30.503028 19418 raft_consensus.cc:359] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.503825 19418 raft_consensus.cc:385] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.504118 19418 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.505133 19418 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.507025 19414 raft_consensus.cc:359] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.507647 19414 raft_consensus.cc:385] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.507912 19414 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.508253 19418 ts_tablet_manager.cc:1434] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:08:30.508802 19414 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.510938 19414 ts_tablet_manager.cc:1434] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:30.511173 19420 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:30.511701 19420 ts_tablet_manager.cc:1403] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:08:30.511889 19414 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.513664 19418 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:30.521309 19418 tablet_bootstrap.cc:654] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.523154 19295 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.523355 19590 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.523869 19590 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.525879 19590 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:30.528316 19420 raft_consensus.cc:359] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.529040 19420 raft_consensus.cc:385] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.529315 19420 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.530012 19420 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.530876 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.531500 19414 tablet_bootstrap.cc:654] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.532502 19420 ts_tablet_manager.cc:1434] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:08:30.533340 19218 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.535061 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:30.542852 19340 leader_election.cc:343] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:30.545169 19339 leader_election.cc:343] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.545475 19697 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.546312 19697 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.547067 19420 tablet_bootstrap.cc:492] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:30.545600 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.550441 19695 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.569185 19420 tablet_bootstrap.cc:654] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.580600 19697 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.581481 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.587042 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.588140 19368 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:30.589375 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:30.592597 19505 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.611292 19505 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.614746 19223 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.621116 19673 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.625892 19475 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.626907 19420 tablet_bootstrap.cc:492] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:30.655345 19420 ts_tablet_manager.cc:1403] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.008s
I20260709 13:08:30.655268 19475 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.658324 19420 raft_consensus.cc:359] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.658655 19475 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.659009 19420 raft_consensus.cc:385] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.659307 19420 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.660032 19420 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.661743 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.667287 19368 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:30.670425 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:30.671631 19475 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.674808 19475 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.675386 19475 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.666311 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:30.677558 19265 leader_election.cc:343] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.662297 19420 ts_tablet_manager.cc:1434] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:30.685662 19418 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:30.686162 19418 ts_tablet_manager.cc:1403] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.046s
I20260709 13:08:30.686726 19420 tablet_bootstrap.cc:492] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:30.687347 19414 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.687799 19414 ts_tablet_manager.cc:1403] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.176s	user 0.043s	sys 0.070s
I20260709 13:08:30.688750 19418 raft_consensus.cc:359] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.689652 19418 raft_consensus.cc:385] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.689925 19418 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.690726 19414 raft_consensus.cc:359] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.692673 19414 raft_consensus.cc:385] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.692919 19414 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.691942 19418 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.694149 19414 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:30.697278 19340 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.697628 19418 ts_tablet_manager.cc:1434] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:30.698630 19418 tablet_bootstrap.cc:492] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:30.704815 19418 tablet_bootstrap.cc:654] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.707791 19414 ts_tablet_manager.cc:1434] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 13:08:30.709172 19414 tablet_bootstrap.cc:492] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Bootstrap starting.
I20260709 13:08:30.713269 19420 tablet_bootstrap.cc:654] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.720145 19414 tablet_bootstrap.cc:654] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.738759 19505 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.747095 19418 tablet_bootstrap.cc:492] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:30.747733 19418 ts_tablet_manager.cc:1403] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.020s
I20260709 13:08:30.754006 19673 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.754516 19673 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.757503 19673 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:30.757807 19418 raft_consensus.cc:359] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.758428 19418 raft_consensus.cc:385] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.758692 19418 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.759347 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.759310 19418 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.761691 19418 ts_tablet_manager.cc:1434] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:08:30.742375 19475 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.765913 19225 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:30.763288 19340 leader_election.cc:343] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.764493 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.764866 19418 tablet_bootstrap.cc:492] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:30.770229 19414 tablet_bootstrap.cc:492] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: No bootstrap required, opened a new log
I20260709 13:08:30.770704 19414 ts_tablet_manager.cc:1403] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
W20260709 13:08:30.770833 19339 leader_election.cc:343] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.771256 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.773193 19505 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.773624 19673 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.776463 19505 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.778719 19505 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.782871 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.783506 19297 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:30.785161 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.785794 19368 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:30.786528 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:30.788833 19697 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.789204 19697 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.789525 19697 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.797555 19524 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.799496 19420 tablet_bootstrap.cc:492] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:30.800197 19420 ts_tablet_manager.cc:1403] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.007s
I20260709 13:08:30.800500 19697 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.803818 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:30.805390 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:08:30.806154 19265 leader_election.cc:343] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.806198 19414 raft_consensus.cc:359] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.808104 19414 raft_consensus.cc:385] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.808485 19414 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.809013 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:30.809739 19372 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.809300 19414 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.810061 19296 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.812502 19414 ts_tablet_manager.cc:1434] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:08:30.842762 19450 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.843253 19450 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.852273 19450 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:30.818477 19673 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.858006 19675 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.872864 19627 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.873389 19675 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.875730 19675 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.859227 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.864374 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.821882 19590 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.881865 19590 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.884375 19590 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:30.884735 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.885816 19296 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:30.886857 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:30.884392 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:30.887629 19627 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.887749 19373 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:30.888221 19697 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.888334 19627 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:30.888090 19372 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
W20260709 13:08:30.889211 19265 leader_election.cc:343] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.889546 19627 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.890604 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:30.891146 19369 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:30.896246 19339 leader_election.cc:343] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.920543 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:30.835155 19475 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:30.902683 19675 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.940428 19418 tablet_bootstrap.cc:700] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent opening tablet: real 0.151s	user 0.047s	sys 0.100s
I20260709 13:08:30.941022 19418 tablet_bootstrap.cc:654] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:30.945335 19770 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:08:30.948405 19420 raft_consensus.cc:359] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.949252 19420 raft_consensus.cc:385] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.949553 19420 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.950330 19420 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:30.958341 19340 leader_election.cc:343] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.958794 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.960059 19450 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.896229 19673 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.944064 19590 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.967856 19420 ts_tablet_manager.cc:1434] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.167s	user 0.008s	sys 0.000s
I20260709 13:08:30.973861 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.974900 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:30.944492 19675 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.983285 19420 tablet_bootstrap.cc:492] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:30.987926 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:30.984467 19524 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.971874 19590 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:30.984311 19773 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:08:31.016151 19340 leader_election.cc:343] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.009470 19524 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:31.036126 19339 leader_election.cc:343] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.039234 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.038671 19701 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.036942 19524 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:31.059187 19771 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:31.061715 19673 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:31.031478 19773 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:31.062477 19123 catalog_manager.cc:5697] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.063714 19773 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.064815 19695 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.073822 19418 tablet_bootstrap.cc:492] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.074342 19418 ts_tablet_manager.cc:1403] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.310s	user 0.057s	sys 0.113s
I20260709 13:08:31.065243 19701 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.081840 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:31.083076 19339 leader_election.cc:343] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.084367 19524 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.099504 19590 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:08:31.069284 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51976.4us
I20260709 13:08:31.108822 19701 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:31.108899 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.121399 19524 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.121474 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:31.124264 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:08:31.128139 19339 leader_election.cc:343] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.129657 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.135355 19675 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.133860 19369 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
W20260709 13:08:31.141872 19339 leader_election.cc:343] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.145706 19222 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.164553 19418 raft_consensus.cc:359] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.170904 19418 raft_consensus.cc:385] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.171305 19418 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.172094 19418 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.174955 19418 ts_tablet_manager.cc:1434] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.100s	user 0.003s	sys 0.003s
I20260709 13:08:31.176239 19418 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.178434 19420 tablet_bootstrap.cc:654] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:31.182623 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 71106.6us
I20260709 13:08:31.186930 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:31.210547 19475 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.204880 19368 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.221895 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:08:31.257211 19265 leader_election.cc:343] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.259677 19418 tablet_bootstrap.cc:654] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.279070 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.279531 19295 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.279986 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.281010 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:31.283565 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43556.6us
I20260709 13:08:31.287215 19774 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.289362 19774 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:31.333156 19340 leader_election.cc:343] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.333788 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.335011 19701 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:31.335130 19340 leader_election.cc:343] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.335752 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.339816 19701 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:31.339882 19340 leader_election.cc:343] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.340597 19340 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.341383 19673 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.373984 19774 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.396646 19266 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:31.421042 19793 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.436338 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.437016 19369 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.383963 19368 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.446015 19420 tablet_bootstrap.cc:492] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.446462 19420 ts_tablet_manager.cc:1403] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.463s	user 0.028s	sys 0.029s
I20260709 13:08:31.448891 19121 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:31.451994 19796 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:08:31.454144 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:31.456178 19524 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.456307 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.456653 19524 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.460568 19675 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.461113 19675 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:31.461900 19675 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.463713 19524 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:31.467052 19171 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:31.470885 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.471525 19524 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.472767 19673 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.473479 19673 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:31.477063 19265 leader_election.cc:343] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.475370 19673 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:31.483038 19793 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.479393 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.481117 19524 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.476832 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.490957 19774 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.491539 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:31.492134 19369 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:31.492614 19339 leader_election.cc:343] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.492058 19420 raft_consensus.cc:359] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.493106 19420 raft_consensus.cc:385] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.493430 19420 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.494199 19420 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:31.497848 19340 leader_election.cc:343] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.498363 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.499181 19673 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.503610 19369 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.474308 19418 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.505192 19418 ts_tablet_manager.cc:1403] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.329s	user 0.024s	sys 0.052s
I20260709 13:08:31.506397 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:31.509770 19420 ts_tablet_manager.cc:1434] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:08:31.510228 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:31.510826 19420 tablet_bootstrap.cc:492] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.511644 19790 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.512118 19790 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:31.509810 19418 raft_consensus.cc:359] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.513445 19418 raft_consensus.cc:385] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.513779 19418 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
W20260709 13:08:31.514295 19265 leader_election.cc:343] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.513775 19790 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.518026 19418 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.531026 19221 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.531456 19418 ts_tablet_manager.cc:1434] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:08:31.536592 19418 tablet_bootstrap.cc:492] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.543800 19420 tablet_bootstrap.cc:654] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.545589 19790 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.555060 19774 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.568091 19122 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.569926 19122 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.571528 19420 tablet_bootstrap.cc:492] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.571980 19420 ts_tablet_manager.cc:1403] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.002s
I20260709 13:08:31.574846 19420 raft_consensus.cc:359] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.575487 19420 raft_consensus.cc:385] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.575748 19420 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.577558 19418 tablet_bootstrap.cc:654] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.582361 19418 tablet_bootstrap.cc:492] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.582765 19418 ts_tablet_manager.cc:1403] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.046s	user 0.002s	sys 0.007s
I20260709 13:08:31.585199 19418 raft_consensus.cc:359] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.585794 19418 raft_consensus.cc:385] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.586048 19418 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.586634 19418 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.588850 19418 ts_tablet_manager.cc:1434] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:08:31.589895 19418 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.590389 19420 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.592494 19420 ts_tablet_manager.cc:1434] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:08:31.593966 19420 tablet_bootstrap.cc:492] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.600495 19420 tablet_bootstrap.cc:654] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.613888 19418 tablet_bootstrap.cc:654] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.624390 19420 tablet_bootstrap.cc:492] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.624831 19420 ts_tablet_manager.cc:1403] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 13:08:31.628055 19420 raft_consensus.cc:359] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.628959 19420 raft_consensus.cc:385] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.629303 19420 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.630102 19420 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.631986 19420 ts_tablet_manager.cc:1434] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:31.632108 19418 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.632690 19418 ts_tablet_manager.cc:1403] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.002s
I20260709 13:08:31.633508 19420 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.635299 19418 raft_consensus.cc:359] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.635985 19418 raft_consensus.cc:385] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.636322 19418 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.636996 19418 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.637627 19790 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.638093 19790 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.638765 19420 tablet_bootstrap.cc:654] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.640014 19418 ts_tablet_manager.cc:1434] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:08:31.641017 19418 tablet_bootstrap.cc:492] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.641362 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.642011 19370 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.642169 19782 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.642654 19782 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.644550 19782 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:31.646729 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:31.647121 19418 tablet_bootstrap.cc:654] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.646931 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.647588 19774 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.648000 19774 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.648449 19774 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.652036 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.652736 19420 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.653030 19295 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 0.
I20260709 13:08:31.653203 19420 ts_tablet_manager.cc:1403] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
W20260709 13:08:31.653228 19339 leader_election.cc:343] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.654142 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.654732 19790 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:08:31.655637 19265 leader_election.cc:343] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.656456 19420 raft_consensus.cc:359] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.657189 19420 raft_consensus.cc:385] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.657426 19420 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.658514 19340 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.659539 19673 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.659178 19420 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.659893 19673 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.660243 19673 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.661701 19420 ts_tablet_manager.cc:1434] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:31.662685 19420 tablet_bootstrap.cc:492] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.664121 19774 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.668761 19673 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.670601 19774 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.668316 19420 tablet_bootstrap.cc:654] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.671277 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:31.672029 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:08:31.672653 19265 leader_election.cc:343] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.672876 19370 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.677755 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:31.678409 19673 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:31.678400 19221 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.679970 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:31.680614 19295 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.686471 19221 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:31.687754 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:31.689201 19673 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.690296 19673 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:31.691228 19673 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.698535 19418 tablet_bootstrap.cc:492] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.699164 19418 ts_tablet_manager.cc:1403] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.000s
I20260709 13:08:31.699903 19784 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.700446 19784 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.701992 19418 raft_consensus.cc:359] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.702654 19418 raft_consensus.cc:385] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.702912 19418 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.703557 19370 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.703513 19418 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.705382 19295 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:31.705823 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.707412 19675 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.707867 19675 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:31.708778 19675 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.709599 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.710595 19784 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.711598 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.713362 19370 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:31.714609 19420 tablet_bootstrap.cc:492] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.715104 19420 ts_tablet_manager.cc:1403] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.000s
I20260709 13:08:31.716456 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:31.717234 19784 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.720355 19418 ts_tablet_manager.cc:1434] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:08:31.725545 19784 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.726907 19121 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 0 to 1, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.729553 19420 raft_consensus.cc:359] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.730201 19420 raft_consensus.cc:385] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.721338 19418 tablet_bootstrap.cc:492] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.730441 19420 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.732401 19420 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.732754 19120 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.738458 19418 tablet_bootstrap.cc:654] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.740101 19420 ts_tablet_manager.cc:1434] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:08:31.741004 19420 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.747632 19420 tablet_bootstrap.cc:654] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.761946 19420 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.762367 19420 ts_tablet_manager.cc:1403] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 13:08:31.764745 19420 raft_consensus.cc:359] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.765785 19420 raft_consensus.cc:385] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.766047 19420 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.766763 19420 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.769563 19420 ts_tablet_manager.cc:1434] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:31.772014 19420 tablet_bootstrap.cc:492] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.778163 19418 tablet_bootstrap.cc:492] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.778642 19418 ts_tablet_manager.cc:1403] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.004s
I20260709 13:08:31.777966 19420 tablet_bootstrap.cc:654] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.781224 19418 raft_consensus.cc:359] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.781934 19418 raft_consensus.cc:385] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.782226 19418 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.783092 19418 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.785703 19418 ts_tablet_manager.cc:1434] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:31.786733 19418 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.790310 19797 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.790925 19797 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.794399 19797 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.797396 19418 tablet_bootstrap.cc:654] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.798060 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.799517 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.800720 19420 tablet_bootstrap.cc:492] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.801102 19369 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:31.801246 19420 ts_tablet_manager.cc:1403] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260709 13:08:31.802258 19191 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:31.803290 19797 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.804265 19420 raft_consensus.cc:359] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.805014 19420 raft_consensus.cc:385] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.805316 19420 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.806671 19420 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.808283 19418 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.808694 19418 ts_tablet_manager.cc:1403] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:08:31.810421 19418 raft_consensus.cc:359] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.810477 19797 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.810911 19418 raft_consensus.cc:385] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.811211 19418 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.812119 19420 ts_tablet_manager.cc:1434] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:31.811913 19418 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.813098 19420 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.813969 19418 ts_tablet_manager.cc:1434] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:31.815539 19418 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.819111 19420 tablet_bootstrap.cc:654] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.821462 19418 tablet_bootstrap.cc:654] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.837133 19420 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:31.837695 19420 ts_tablet_manager.cc:1403] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.015s
I20260709 13:08:31.839620 19420 raft_consensus.cc:359] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.837133 19418 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.840111 19420 raft_consensus.cc:385] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.840603 19420 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.840760 19418 ts_tablet_manager.cc:1403] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:08:31.841329 19420 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.843096 19420 ts_tablet_manager.cc:1434] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:08:31.843467 19418 raft_consensus.cc:359] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.843999 19420 tablet_bootstrap.cc:492] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:31.844125 19418 raft_consensus.cc:385] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.844415 19418 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.845017 19418 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.847142 19418 ts_tablet_manager.cc:1434] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:31.848531 19418 tablet_bootstrap.cc:492] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:31.851975 19420 tablet_bootstrap.cc:654] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.852715 19797 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.853128 19797 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.853389 19675 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.853904 19675 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.855078 19797 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.856042 19675 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.856882 19418 tablet_bootstrap.cc:654] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.857882 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.858541 19221 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.860102 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.860742 19370 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.862983 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:31.863675 19675 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.864053 19675 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.864455 19675 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.868799 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.869477 19295 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:31.864279 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.870186 19369 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:31.873303 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:31.874696 19784 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.875172 19784 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.875572 19784 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.887296 19675 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.889262 19788 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.889799 19788 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.890100 19777 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.892022 19788 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.894482 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.906982 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.907874 19368 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.896543 19784 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.907505 19221 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.910893 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:31.911155 19784 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.900032 19675 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.900856 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:31.901773 19505 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.911885 19675 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.912300 19675 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.912035 19505 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.912654 19675 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.912588 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:31.913277 19368 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.914112 19505 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.915576 19225 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.919776 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.920620 19369 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 1: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:08:31.921514 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:31.922071 19369 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.925203 19777 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.925833 19777 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.930148 19225 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.931600 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:31.932770 19788 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.933269 19788 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:31.934818 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:31.935446 19295 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.935441 19777 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.942101 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:31.942560 19295 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:31.941787 19675 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.947232 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:31.951049 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:31.953166 19505 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.953125 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:08:31.954783 19265 leader_election.cc:343] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.956306 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:31.956882 19370 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:31.957059 19793 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.957654 19793 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:31.956930 19675 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:31.964897 19505 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.967190 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:31.968082 19777 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.968402 19370 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.958501 19793 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.974587 19370 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.935635 19788 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.976089 19266 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:31.978719 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:31.978780 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:31.981446 19369 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.982937 19225 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.980530 19789 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.981446 19777 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.987193 19777 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:31.987994 19418 tablet_bootstrap.cc:492] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:31.990303 19418 ts_tablet_manager.cc:1403] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.142s	user 0.027s	sys 0.028s
I20260709 13:08:31.993145 19368 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:31.987957 19777 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.990913 19789 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.996605 19225 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:31.997429 19789 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.997813 19418 raft_consensus.cc:359] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:31.998526 19418 raft_consensus.cc:385] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.998857 19418 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.999607 19418 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.001147 19418 ts_tablet_manager.cc:1434] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:32.002110 19418 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Bootstrap starting.
I20260709 13:08:32.005532 19789 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.008798 19418 tablet_bootstrap.cc:654] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.009465 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:08:32.012564 19265 leader_election.cc:343] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.017084 19420 tablet_bootstrap.cc:492] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:32.017620 19420 ts_tablet_manager.cc:1403] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.174s	user 0.033s	sys 0.051s
I20260709 13:08:32.018811 19675 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.024863 19789 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.026876 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:32.027472 19373 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.031605 19420 raft_consensus.cc:359] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.032300 19420 raft_consensus.cc:385] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.032541 19420 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.033344 19420 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.035571 19420 ts_tablet_manager.cc:1434] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:08:32.036613 19420 tablet_bootstrap.cc:492] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:32.039076 19789 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.042081 19418 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: No bootstrap required, opened a new log
I20260709 13:08:32.042529 19418 ts_tablet_manager.cc:1403] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 13:08:32.043574 19373 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:32.045500 19266 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:32.046658 19789 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.047431 19789 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:32.047077 19120 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.048345 19789 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.048518 19122 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.049968 19418 raft_consensus.cc:359] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.052814 19418 raft_consensus.cc:385] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.053146 19418 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.053799 19418 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.052523 19420 tablet_bootstrap.cc:654] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.057804 19418 ts_tablet_manager.cc:1434] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:08:32.076337 19788 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.077169 19788 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.080180 19788 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.083992 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:32.084501 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:32.084684 19373 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
W20260709 13:08:32.085875 19265 leader_election.cc:343] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:32.089725 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:32.093091 19788 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.093509 19788 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.093880 19788 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.099572 19420 tablet_bootstrap.cc:492] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:32.101094 19420 ts_tablet_manager.cc:1403] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.018s
I20260709 13:08:32.103442 19420 raft_consensus.cc:359] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.103945 19420 raft_consensus.cc:385] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.104239 19420 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.104918 19420 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.106921 19420 ts_tablet_manager.cc:1434] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:32.106823 19777 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.107410 19777 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.107936 19420 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:32.111402 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:32.112051 19218 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:32.113312 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:32.114079 19675 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.114426 19420 tablet_bootstrap.cc:654] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.114441 19675 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.114979 19675 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.127249 19420 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:32.127103 19777 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.127712 19420 ts_tablet_manager.cc:1403] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.009s
I20260709 13:08:32.130265 19420 raft_consensus.cc:359] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.130952 19420 raft_consensus.cc:385] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.131247 19420 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.132805 19420 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.134831 19420 ts_tablet_manager.cc:1434] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:08:32.134814 19675 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.137583 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:32.145002 19369 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 0.
I20260709 13:08:32.137974 19420 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Bootstrap starting.
I20260709 13:08:32.146065 19675 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.150657 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:32.151238 19369 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.151911 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:32.152783 19224 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.157850 19369 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:32.156255 19420 tablet_bootstrap.cc:654] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.163007 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:32.163702 19777 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.164193 19777 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:32.164901 19777 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.179641 19675 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:32.138674 19788 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.194036 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:32.194766 19218 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.206044 19224 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:32.215512 19788 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.217980 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:32.219446 19368 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.234189 19368 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:32.236366 19120 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.241981 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:32.237675 19777 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.243417 19790 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.218087 19218 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:08:32.243981 19790 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:32.244944 19790 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.241593 19120 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.270529 19673 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.280643 19420 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: No bootstrap required, opened a new log
I20260709 13:08:32.281143 19420 ts_tablet_manager.cc:1403] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent bootstrapping tablet: real 0.143s	user 0.033s	sys 0.048s
I20260709 13:08:32.284819 19420 raft_consensus.cc:359] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.285470 19420 raft_consensus.cc:385] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.285717 19420 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.286298 19420 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.288558 19420 ts_tablet_manager.cc:1434] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:32.291949 19793 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.292456 19793 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.294430 19793 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.294243 19701 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:32.296377 19326 tablet.cc:2406] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:32.296695 19122 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.297168 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:32.300154 19296 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:32.299829 19122 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 0 to 1, leader changed from <none> to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.301532 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:32.302402 19784 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.302776 19784 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.303099 19784 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.305495 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:32.306066 19368 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 0.
I20260709 13:08:32.311097 19784 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.322613 19784 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.323549 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:32.324265 19298 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.328140 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:32.328717 19368 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.334857 19298 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:32.335718 19368 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:32.336020 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:32.336884 19784 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.338119 19784 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:32.339545 19784 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.350878 19122 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.362502 19784 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.378470 19627 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.378705 19789 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.400418 19789 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.485011 19777 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.494959 19789 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.505589 19218 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.523818 19675 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.525985 19793 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.526444 19793 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.528525 19793 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.529021 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:32.529975 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:32.530540 19368 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:32.535375 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:32.539479 19793 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.539863 19793 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.540259 19793 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.547030 19793 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.549957 19218 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:32.550866 19793 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:32.552326 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:32.552774 19675 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.552920 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:32.553462 19368 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.553486 19675 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:32.553891 19675 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:32.554432 19675 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.555323 19675 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.558547 19368 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:08:32.559327 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:08:32.560272 19793 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:32.560696 19793 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:32.561501 19793 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:32.570302 19122 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 2 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.688186 19675 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.688869 19777 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.704331 19790 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.712723 19675 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.779256 19793 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.789099 19627 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:33.004709 19369 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:33.006904 19784 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:33.020124 19298 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:08:33.020501 19298 pending_rounds.cc:85] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 0
I20260709 13:08:33.020720 19298 pending_rounds.cc:107] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:08:33.021016 19298 raft_consensus.cc:2889] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:33.035038 19784 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:33.236145 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:33.266171 19858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:33.267284 19857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:33.269132 19860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:33.270221 18095 server_base.cc:1061] running on GCE node
I20260709 13:08:33.272069 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:33.272346 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:33.272498 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602513272484 us; error 0 us; skew 500 ppm
I20260709 13:08:33.272984 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:33.275580 18095 webserver.cc:533] Webserver started at http://127.17.171.196:42571/ using document root <none> and password file <none>
I20260709 13:08:33.276063 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:33.276322 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:33.276587 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:33.277691 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-3-root/instance:
uuid: "d50eb2dab6754df8bcbed1445f2e8430"
format_stamp: "Formatted at 2026-07-09 13:08:33 on dist-test-slave-jhlz"
I20260709 13:08:33.282100 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:08:33.285547 19865 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:33.286276 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:33.286535 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-3-root
uuid: "d50eb2dab6754df8bcbed1445f2e8430"
format_stamp: "Formatted at 2026-07-09 13:08:33 on dist-test-slave-jhlz"
I20260709 13:08:33.286775 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:33.313740 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:33.315272 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:33.316684 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:33.318838 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:33.319008 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:33.319335 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:33.319518 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:33.387081 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.196:38805
I20260709 13:08:33.387179 19927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.196:38805 every 8 connection(s)
I20260709 13:08:33.395015 18095 auto_leader_rebalancer-test.cc:384] add a tserver: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:33.417210 19928 heartbeater.cc:344] Connected to a master server at 127.17.171.254:34425
I20260709 13:08:33.417716 19928 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:33.418447 19928 heartbeater.cc:507] Master 127.17.171.254:34425 requested a full tablet report, sending...
I20260709 13:08:33.420418 19122 ts_manager.cc:194] Registered new tserver with Master: d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:33.421734 19122 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36688
I20260709 13:08:33.616039 19369 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:33.622959 19296 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.624815 19855 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.632669 19218 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.634436 19855 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.644695 19701 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.647770 19221 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.650998 19296 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.663430 19369 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:08:33.665134 19337 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52be2d3fd44446e288f920256640822f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:33.674814 19122 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.695333 19296 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.697710 19855 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:33.709249 19337 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f5150fb077a470497ba70512f18f476. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:33.709774 19221 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.712679 19940 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.725687 19855 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.727375 19296 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.737566 19221 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.762523 19121 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.766886 19296 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:33.776403 19221 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.782125 19373 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.783712 19789 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.784736 19788 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:33.794031 19263 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a94e7b00544419ab2f3f84812c9b155. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:33.801522 19789 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.802872 19373 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.809849 19224 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.817830 19368 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:33.818884 19122 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:33.831137 19337 consensus_peers.cc:597] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5f7f3521ddc43959640091aefee2a11. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:33.834703 19298 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.836195 19224 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:33.836561 19940 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.837641 19701 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.844141 19940 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.846925 19298 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.859148 19218 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:33.877475 19122 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.043375 19956 ts_tablet_manager.cc:933] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:34.045468 19956 tablet_copy_client.cc:323] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:34.060017 19384 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet 52be2d3fd44446e288f920256640822f from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:34.060698 19384 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet 52be2d3fd44446e288f920256640822f from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-52be2d3fd44446e288f920256640822f
I20260709 13:08:34.068897 19384 tablet_copy_source_session.cc:215] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:34.072315 19956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52be2d3fd44446e288f920256640822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.087518 19956 tablet_copy_client.cc:806] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.088151 19956 tablet_copy_client.cc:670] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.095650 19956 tablet_copy_client.cc:538] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.104779 19956 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:34.123198 19956 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.124101 19956 tablet_bootstrap.cc:492] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:34.124749 19956 ts_tablet_manager.cc:1403] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:08:34.127559 19956 raft_consensus.cc:359] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.128371 19956 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:34.129310 19956 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.135250 19928 heartbeater.cc:499] Master 127.17.171.254:34425 was elected leader, sending a full tablet report...
I20260709 13:08:34.137383 19956 ts_tablet_manager.cc:1434] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.009s
I20260709 13:08:34.139550 19384 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-52be2d3fd44446e288f920256640822f received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:34.140029 19384 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-52be2d3fd44446e288f920256640822f on tablet 52be2d3fd44446e288f920256640822f with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:34.249115 19956 ts_tablet_manager.cc:933] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:34.253645 19956 tablet_copy_client.cc:323] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:34.261936 19384 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet 6f5150fb077a470497ba70512f18f476 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:34.262475 19384 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet 6f5150fb077a470497ba70512f18f476 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-6f5150fb077a470497ba70512f18f476
I20260709 13:08:34.264906 19961 ts_tablet_manager.cc:933] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:34.277024 19961 tablet_copy_client.cc:323] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:34.278893 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet d5f7f3521ddc43959640091aefee2a11 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:34.279458 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet d5f7f3521ddc43959640091aefee2a11 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-d5f7f3521ddc43959640091aefee2a11
I20260709 13:08:34.280336 19384 tablet_copy_source_session.cc:215] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:34.286931 19383 tablet_copy_source_session.cc:215] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:34.291188 19961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f7f3521ddc43959640091aefee2a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.296043 19956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5150fb077a470497ba70512f18f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.311578 19961 tablet_copy_client.cc:806] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.312238 19961 tablet_copy_client.cc:670] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.315861 19961 tablet_copy_client.cc:538] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.317348 19964 ts_tablet_manager.cc:933] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:34.325685 19956 tablet_copy_client.cc:806] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.326480 19961 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:34.326592 19956 tablet_copy_client.cc:670] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.330025 19956 tablet_copy_client.cc:538] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.334268 19964 tablet_copy_client.cc:323] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:34.348865 19956 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:34.361137 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet 4a94e7b00544419ab2f3f84812c9b155 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:34.361726 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet 4a94e7b00544419ab2f3f84812c9b155 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-4a94e7b00544419ab2f3f84812c9b155
I20260709 13:08:34.370229 19310 tablet_copy_source_session.cc:215] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:34.372991 19956 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.373878 19956 tablet_bootstrap.cc:492] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:34.374518 19956 ts_tablet_manager.cc:1403] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:08:34.378063 19956 raft_consensus.cc:359] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.378875 19956 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:34.381819 19964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a94e7b00544419ab2f3f84812c9b155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.383448 19961 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.384403 19961 tablet_bootstrap.cc:492] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:34.385084 19961 ts_tablet_manager.cc:1403] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.013s
I20260709 13:08:34.385752 19956 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.388248 19961 raft_consensus.cc:359] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.389137 19961 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:34.389775 19961 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.405157 19956 ts_tablet_manager.cc:1434] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 13:08:34.408751 19964 tablet_copy_client.cc:806] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.409366 19964 tablet_copy_client.cc:670] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.413122 19964 tablet_copy_client.cc:538] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.417642 19961 ts_tablet_manager.cc:1434] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 13:08:34.420135 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-6f5150fb077a470497ba70512f18f476 received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:34.420619 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-6f5150fb077a470497ba70512f18f476 on tablet 6f5150fb077a470497ba70512f18f476 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:34.423367 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-d5f7f3521ddc43959640091aefee2a11 received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:34.423743 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-d5f7f3521ddc43959640091aefee2a11 on tablet d5f7f3521ddc43959640091aefee2a11 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:34.434077 19964 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:34.472597 19902 raft_consensus.cc:1217] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:34.476686 19964 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.492866 19964 tablet_bootstrap.cc:492] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:34.494483 19964 ts_tablet_manager.cc:1403] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.009s
I20260709 13:08:34.498659 19964 raft_consensus.cc:359] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.499650 19964 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:34.500453 19964 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:34.502755 19964 ts_tablet_manager.cc:1434] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:34.504693 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-4a94e7b00544419ab2f3f84812c9b155 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:34.505110 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-4a94e7b00544419ab2f3f84812c9b155 on tablet 4a94e7b00544419ab2f3f84812c9b155 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:34.630470 19902 raft_consensus.cc:1217] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:34.638938 19902 raft_consensus.cc:1217] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:34.811170 19902 raft_consensus.cc:1217] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:34.951618 19940 raft_consensus.cc:1064] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:34.954330 19940 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:34.961233 19902 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:34.961424 19224 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:34.962055 19296 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:34.963202 19940 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:34.964234 19955 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:34.965330 19972 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.017652 19972 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.025869 19902 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.029461 19224 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.039237 19296 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.062915 19122 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.094317 19368 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.099783 19296 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.101223 19855 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.104180 19902 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.105643 19855 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.109144 19955 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.113204 19296 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.120985 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52be2d3fd44446e288f920256640822f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:35.125005 19903 raft_consensus.cc:2955] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.133766 19120 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.136890 19972 raft_consensus.cc:1064] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:35.138731 19972 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.152639 19903 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.153059 19296 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.153468 19224 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.154655 19940 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.155618 19855 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.158222 19955 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.158365 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet 52be2d3fd44446e288f920256640822f with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:35.188329 19984 tablet_replica.cc:333] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:35.187692 19955 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.189456 19984 raft_consensus.cc:2243] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.190593 19984 raft_consensus.cc:2272] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:35.193827 19984 ts_tablet_manager.cc:1916] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.194530 19903 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.200757 19224 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.201640 19295 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.209990 19120 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.228775 19984 ts_tablet_manager.cc:1929] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:35.229300 19984 log.cc:1199] T 52be2d3fd44446e288f920256640822f P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/52be2d3fd44446e288f920256640822f
I20260709 13:08:35.238916 19940 raft_consensus.cc:1064] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:35.245746 19940 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.232110 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet 52be2d3fd44446e288f920256640822f (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:35.262162 19903 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.263857 19295 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.263666 19972 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:35.266360 19940 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.266963 19368 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.277236 19218 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.278650 19940 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.281747 19218 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.281747 19903 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.284214 19940 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.295429 19972 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.297756 19940 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.309231 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f5150fb077a470497ba70512f18f476 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:35.311309 19903 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.322077 19955 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.324290 19120 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.326753 19218 raft_consensus.cc:2955] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.344080 19295 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.349510 19218 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.349510 19902 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.362926 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f5150fb077a470497ba70512f18f476 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:35.368237 19994 tablet_replica.cc:333] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:35.369251 19994 raft_consensus.cc:2243] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.369879 19994 raft_consensus.cc:2272] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:35.374655 19994 ts_tablet_manager.cc:1916] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.379223 19120 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.389793 19789 raft_consensus.cc:1064] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:35.392069 19789 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.396754 19994 ts_tablet_manager.cc:1929] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:35.397235 19994 log.cc:1199] T 6f5150fb077a470497ba70512f18f476 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/6f5150fb077a470497ba70512f18f476
I20260709 13:08:35.400477 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet 6f5150fb077a470497ba70512f18f476 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:35.405062 19903 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.406157 19218 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.407910 19788 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:35.408741 19368 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:35.409911 19373 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.414139 19675 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.417125 19675 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.417304 19903 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.420745 19295 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.421734 19972 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:35.422875 19955 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.441011 19988 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.444845 19902 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.451802 19296 raft_consensus.cc:2955] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.491380 19121 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.493084 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5f7f3521ddc43959640091aefee2a11 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:35.511750 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet d5f7f3521ddc43959640091aefee2a11 with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:35.512717 19984 tablet_replica.cc:333] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:35.513691 19984 raft_consensus.cc:2243] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.514407 19984 raft_consensus.cc:2272] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:35.517976 19984 ts_tablet_manager.cc:1916] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.521986 19788 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.528409 19369 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.531985 19903 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.552146 19224 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.553542 19121 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.570356 19984 ts_tablet_manager.cc:1929] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:35.570838 19984 log.cc:1199] T d5f7f3521ddc43959640091aefee2a11 P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/d5f7f3521ddc43959640091aefee2a11
I20260709 13:08:35.577237 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet d5f7f3521ddc43959640091aefee2a11 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:35.586565 19298 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:35.591852 19903 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.594363 19675 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.592244 19224 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:35.600106 19675 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.602083 19996 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.609404 19224 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.610554 19903 raft_consensus.cc:2955] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.615511 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a94e7b00544419ab2f3f84812c9b155 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:35.629160 19121 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:35.640302 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a94e7b00544419ab2f3f84812c9b155 with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:35.642412 20001 tablet_replica.cc:333] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:35.657639 20001 raft_consensus.cc:2243] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.658299 20001 raft_consensus.cc:2272] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:35.661232 20001 ts_tablet_manager.cc:1916] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.673998 20001 ts_tablet_manager.cc:1929] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:35.674391 20001 log.cc:1199] T 4a94e7b00544419ab2f3f84812c9b155 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/4a94e7b00544419ab2f3f84812c9b155
I20260709 13:08:35.675900 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet 4a94e7b00544419ab2f3f84812c9b155 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:36.716447 19221 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:36.722455 19368 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.723657 19296 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.724491 20003 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:36.727092 19971 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.752601 19971 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:36.754680 19188 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e795450462624104a515893162f51e61. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.755378 19368 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.758268 19296 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.770190 19224 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:36.772370 19123 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:36.786805 19188 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f43f1e515be64813bb797fabd579621f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.787827 19368 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.788033 19296 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.789144 20011 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.790093 19784 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.807938 20011 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.809844 19298 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.812297 19368 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.823093 19221 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:36.831051 19368 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.833736 20003 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:36.836654 19188 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 994bf3418aeb467ea0f5718bd6226a66. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.840783 19298 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.842720 19971 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.842348 19784 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.843777 19370 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.844832 19121 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.853927 19298 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.854839 19224 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:36.867933 19123 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:36.877776 19188 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8639f6119a14d6bb7cd841127c14e48. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.880666 19370 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.886005 20003 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.887692 19298 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:36.891821 19971 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.897235 19784 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.900239 19370 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.917994 19298 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:36.924319 19121 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:37.203579 20025 ts_tablet_manager.cc:933] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:37.206275 20025 tablet_copy_client.cc:323] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:37.206954 20027 ts_tablet_manager.cc:933] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:37.210346 20027 tablet_copy_client.cc:323] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:37.218443 19234 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet 994bf3418aeb467ea0f5718bd6226a66 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:37.219048 19234 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet 994bf3418aeb467ea0f5718bd6226a66 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-994bf3418aeb467ea0f5718bd6226a66
I20260709 13:08:37.221148 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet e795450462624104a515893162f51e61 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:37.221719 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet e795450462624104a515893162f51e61 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-e795450462624104a515893162f51e61
I20260709 13:08:37.226415 19234 tablet_copy_source_session.cc:215] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:37.229576 19235 tablet_copy_source_session.cc:215] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:37.231760 20030 ts_tablet_manager.cc:933] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:37.232926 20027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994bf3418aeb467ea0f5718bd6226a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:37.243438 20030 tablet_copy_client.cc:323] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:37.246037 20025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e795450462624104a515893162f51e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:37.248193 20027 tablet_copy_client.cc:806] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:37.249048 20027 tablet_copy_client.cc:670] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:37.254829 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet f43f1e515be64813bb797fabd579621f from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:37.255329 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet f43f1e515be64813bb797fabd579621f from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-f43f1e515be64813bb797fabd579621f
I20260709 13:08:37.267349 19235 tablet_copy_source_session.cc:215] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:37.287108 20027 tablet_copy_client.cc:538] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:37.287127 20030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43f1e515be64813bb797fabd579621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:37.301173 20025 tablet_copy_client.cc:806] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:37.304239 20027 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:37.306193 20025 tablet_copy_client.cc:670] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:37.307415 20032 ts_tablet_manager.cc:933] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:37.318758 20025 tablet_copy_client.cc:538] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:37.331650 20025 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:37.325686 20032 tablet_copy_client.cc:323] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:37.339452 20030 tablet_copy_client.cc:806] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:37.340032 20030 tablet_copy_client.cc:670] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:37.371104 20027 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.374670 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet b8639f6119a14d6bb7cd841127c14e48 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:37.376122 20030 tablet_copy_client.cc:538] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:37.376646 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet b8639f6119a14d6bb7cd841127c14e48 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-b8639f6119a14d6bb7cd841127c14e48
I20260709 13:08:37.375576 20027 tablet_bootstrap.cc:492] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:37.380904 20027 ts_tablet_manager.cc:1403] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.021s
I20260709 13:08:37.396622 20027 raft_consensus.cc:359] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.397534 20027 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:37.398228 20027 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.406792 19235 tablet_copy_source_session.cc:215] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:37.410573 20032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8639f6119a14d6bb7cd841127c14e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:37.414480 20030 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:37.422363 20025 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.423240 20025 tablet_bootstrap.cc:492] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:37.423900 20025 ts_tablet_manager.cc:1403] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.026s
I20260709 13:08:37.426898 20025 raft_consensus.cc:359] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.427661 20025 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:37.428373 20025 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.439780 20027 ts_tablet_manager.cc:1434] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.059s	user 0.015s	sys 0.028s
I20260709 13:08:37.442215 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-994bf3418aeb467ea0f5718bd6226a66 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:37.442693 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-994bf3418aeb467ea0f5718bd6226a66 on tablet 994bf3418aeb467ea0f5718bd6226a66 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:37.470572 20030 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.474095 20030 tablet_bootstrap.cc:492] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:37.475752 20030 ts_tablet_manager.cc:1403] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.004s
I20260709 13:08:37.479342 20030 raft_consensus.cc:359] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.483394 20025 ts_tablet_manager.cc:1434] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.022s
I20260709 13:08:37.485877 20030 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:37.486500 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-e795450462624104a515893162f51e61 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:37.486727 20032 tablet_copy_client.cc:806] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:37.487015 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-e795450462624104a515893162f51e61 on tablet e795450462624104a515893162f51e61 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:37.487293 20032 tablet_copy_client.cc:670] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:37.494037 20030 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.497228 20030 ts_tablet_manager.cc:1434] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:08:37.495522 20032 tablet_copy_client.cc:538] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:37.499267 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-f43f1e515be64813bb797fabd579621f received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:37.499764 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-f43f1e515be64813bb797fabd579621f on tablet f43f1e515be64813bb797fabd579621f with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:37.517695 20032 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:37.539588 20032 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.540572 20032 tablet_bootstrap.cc:492] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:37.541237 20032 ts_tablet_manager.cc:1403] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:08:37.544382 20032 raft_consensus.cc:359] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.545259 20032 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:37.545948 20032 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:37.548525 20032 ts_tablet_manager.cc:1434] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:37.550297 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-b8639f6119a14d6bb7cd841127c14e48 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:37.550717 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-b8639f6119a14d6bb7cd841127c14e48 on tablet b8639f6119a14d6bb7cd841127c14e48 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:37.587522 19903 raft_consensus.cc:1217] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:37.607241 19903 raft_consensus.cc:1217] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:37.781270 19903 raft_consensus.cc:1217] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:37.856407 19903 raft_consensus.cc:1217] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:38.127806 19971 raft_consensus.cc:1064] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:38.129591 19971 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:38.135638 19903 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.138332 19370 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.139024 19296 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.137540 19971 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:38.140391 20003 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:38.141400 20011 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:38.150113 20003 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.159758 19370 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.164965 19903 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.166290 19121 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:38.189419 19296 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.203061 20047 raft_consensus.cc:1064] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:38.205672 20047 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:38.219384 19902 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.221987 20003 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:38.232481 19368 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.235689 19971 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:38.242259 19296 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.246554 20003 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:38.254376 19221 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:38.262997 19298 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:38.265115 19902 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:38.268844 20003 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:38.266609 20011 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.281309 19971 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.282887 19902 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.301283 20047 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:38.301641 19123 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.304260 19368 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.313777 19298 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.314003 19296 raft_consensus.cc:2955] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:08:38.410111 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 99012.9us
I20260709 13:08:38.444831 19902 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:38.449054 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f43f1e515be64813bb797fabd579621f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:38.458588 19971 raft_consensus.cc:1064] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:38.459560 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet f43f1e515be64813bb797fabd579621f with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:38.461052 19971 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:38.461860 20003 raft_consensus.cc:1064] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:38.465029 20003 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:38.472246 19120 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:08:38.513509 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48172us
I20260709 13:08:38.481695 19903 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.770640 20059 tablet_replica.cc:333] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:38.771735 20059 raft_consensus.cc:2243] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:38.772627 20059 raft_consensus.cc:2272] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:38.790513 20059 ts_tablet_manager.cc:1916] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:38.889834 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 94869.8us
I20260709 13:08:38.911134 20059 ts_tablet_manager.cc:1929] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:38.911698 20059 log.cc:1199] T f43f1e515be64813bb797fabd579621f P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/f43f1e515be64813bb797fabd579621f
I20260709 13:08:38.917022 19295 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.925846 19369 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.932126 20070 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:38.956970 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66130.1us
I20260709 13:08:38.967656 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet f43f1e515be64813bb797fabd579621f (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:38.973388 19368 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.988607 20075 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:38.990571 19364 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.039s	sys 0.047s
W20260709 13:08:38.991061 19364 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.039s	sys 0.047s
I20260709 13:08:38.998704 19903 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:08:39.007192 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65840.6us
I20260709 13:08:39.025219 20075 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:39.035773 20011 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:39.075866 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54553.1us
I20260709 13:08:39.077983 20047 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:39.085801 19299 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:39.090171 20077 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.103022 20075 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:39.106704 19299 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.114423 19223 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:39.122741 19901 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:39.124306 20067 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:39.132654 20067 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.135329 19123 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.137284 19901 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.152864 20079 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.167685 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e795450462624104a515893162f51e61 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:39.168869 19123 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.173542 19373 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:39.180968 19373 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.181243 19902 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.181041 19374 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.183940 20075 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:39.187637 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet e795450462624104a515893162f51e61 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:39.197135 19123 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.193287 19367 raft_consensus.cc:2955] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.169224 19901 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.232842 20086 tablet_replica.cc:333] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:39.234628 20086 raft_consensus.cc:2243] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.235306 20086 raft_consensus.cc:2272] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.239274 20086 ts_tablet_manager.cc:1916] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:39.240263 19299 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.253633 20086 ts_tablet_manager.cc:1929] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:39.254079 20086 log.cc:1199] T e795450462624104a515893162f51e61 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/e795450462624104a515893162f51e61
I20260709 13:08:39.255683 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet e795450462624104a515893162f51e61 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:39.262861 19223 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:39.269629 19901 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:39.271128 20011 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:39.272131 19367 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:39.274809 19971 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:39.280100 19971 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.282771 19901 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.301896 19223 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:39.310338 19902 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:39.312569 20079 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:39.319353 20011 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.321739 19902 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.323398 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8639f6119a14d6bb7cd841127c14e48 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:39.323993 19121 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.355206 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet b8639f6119a14d6bb7cd841127c14e48 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:39.355726 19299 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:39.356209 20086 tablet_replica.cc:333] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:39.393635 19123 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.400231 20086 raft_consensus.cc:2243] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.402884 20086 raft_consensus.cc:2272] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.406706 20086 ts_tablet_manager.cc:1916] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:39.401141 20077 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:08:39.433579 19373 raft_consensus.cc:2955] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.441059 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet 994bf3418aeb467ea0f5718bd6226a66 with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:39.453209 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 994bf3418aeb467ea0f5718bd6226a66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:39.468051 20086 ts_tablet_manager.cc:1929] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:39.468603 20086 log.cc:1199] T b8639f6119a14d6bb7cd841127c14e48 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/b8639f6119a14d6bb7cd841127c14e48
I20260709 13:08:39.471248 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet b8639f6119a14d6bb7cd841127c14e48 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:39.470640 19299 raft_consensus.cc:2955] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:39.478186 20087 tablet_replica.cc:333] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:39.493084 20087 raft_consensus.cc:2243] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.493904 20087 raft_consensus.cc:2272] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.501432 20087 ts_tablet_manager.cc:1916] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:39.526155 20087 ts_tablet_manager.cc:1929] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:39.526584 20087 log.cc:1199] T 994bf3418aeb467ea0f5718bd6226a66 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/994bf3418aeb467ea0f5718bd6226a66
I20260709 13:08:39.528482 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet 994bf3418aeb467ea0f5718bd6226a66 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
W20260709 13:08:39.818286 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800196160 after lost signal to thread 18098
W20260709 13:08:39.819279 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08000eede0 after lost signal to thread 19157
W20260709 13:08:39.820459 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4a80 after lost signal to thread 19249
W20260709 13:08:39.821372 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800307b80 after lost signal to thread 19324
W20260709 13:08:39.822281 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800319ac0 after lost signal to thread 19398
W20260709 13:08:39.823179 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002db3c0 after lost signal to thread 19927
W20260709 13:08:40.074260 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55122.1us
I20260709 13:08:40.538139 19373 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:40.547492 19296 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:40.548110 19337 consensus_peers.cc:597] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 443db347d2a7465e8845fc3facf2ea26. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:40.549201 20093 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.549919 19224 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.551450 20093 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.559428 19972 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.562322 19296 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.586669 19297 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:40.607914 19123 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.617986 19221 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:40.634620 19263 consensus_peers.cc:597] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 539f966b2e414ce2b1c2096d339a2147. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:40.636668 19224 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.640312 19373 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.640189 20091 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.642707 20065 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.676359 20065 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.679090 19373 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.686564 19224 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.696794 19367 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:40.714717 19297 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.716714 19972 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.717397 19221 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.719475 20097 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:40.714718 19337 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2c0dc5e5d2542c88c79527e70d218e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:40.755311 19972 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.761384 19297 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.792637 19120 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.820453 19221 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:40.825485 19224 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.837252 19121 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:40.848497 19188 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbaa5acb8ba24137bd7a86d1598250e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:40.851529 19367 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.851984 19297 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:40.853739 20011 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.856580 20011 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.895557 19297 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.897627 20011 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.898325 19374 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:40.924760 19120 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:41.032081 20113 ts_tablet_manager.cc:933] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:41.034629 20113 tablet_copy_client.cc:323] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:41.037016 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet 443db347d2a7465e8845fc3facf2ea26 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:41.037753 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet 443db347d2a7465e8845fc3facf2ea26 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-443db347d2a7465e8845fc3facf2ea26
I20260709 13:08:41.049566 19383 tablet_copy_source_session.cc:215] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:41.053880 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443db347d2a7465e8845fc3facf2ea26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.089797 20113 tablet_copy_client.cc:806] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:41.091553 20113 tablet_copy_client.cc:670] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:41.103976 20113 tablet_copy_client.cc:538] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:41.117033 20113 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:41.167482 20113 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.177630 20116 ts_tablet_manager.cc:933] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:41.187803 20116 tablet_copy_client.cc:323] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:41.189795 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet 539f966b2e414ce2b1c2096d339a2147 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:41.190389 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet 539f966b2e414ce2b1c2096d339a2147 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-539f966b2e414ce2b1c2096d339a2147
I20260709 13:08:41.195191 20113 tablet_bootstrap.cc:492] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:41.196133 20113 ts_tablet_manager.cc:1403] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.008s
I20260709 13:08:41.199633 20113 raft_consensus.cc:359] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.206952 20113 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:41.207754 20113 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.211055 19310 tablet_copy_source_session.cc:215] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:41.215586 20116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 539f966b2e414ce2b1c2096d339a2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.223814 20113 ts_tablet_manager.cc:1434] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.006s
I20260709 13:08:41.228225 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-443db347d2a7465e8845fc3facf2ea26 received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:41.228713 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-443db347d2a7465e8845fc3facf2ea26 on tablet 443db347d2a7465e8845fc3facf2ea26 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:41.242340 20116 tablet_copy_client.cc:806] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:41.243006 20116 tablet_copy_client.cc:670] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:41.246990 20116 tablet_copy_client.cc:538] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:41.257450 20116 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:41.280611 20116 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.281601 20116 tablet_bootstrap.cc:492] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:41.282287 20116 ts_tablet_manager.cc:1403] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:08:41.287496 20116 raft_consensus.cc:359] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.288647 20116 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:41.289337 20116 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.294981 20116 ts_tablet_manager.cc:1434] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:08:41.297400 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-539f966b2e414ce2b1c2096d339a2147 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:41.297865 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-539f966b2e414ce2b1c2096d339a2147 on tablet 539f966b2e414ce2b1c2096d339a2147 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:41.308881 20116 ts_tablet_manager.cc:933] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:41.311555 20116 tablet_copy_client.cc:323] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:41.313656 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet cbaa5acb8ba24137bd7a86d1598250e1 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:41.314203 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet cbaa5acb8ba24137bd7a86d1598250e1 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-cbaa5acb8ba24137bd7a86d1598250e1
I20260709 13:08:41.324878 19235 tablet_copy_source_session.cc:215] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:41.329501 20113 ts_tablet_manager.cc:933] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:41.329892 20116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbaa5acb8ba24137bd7a86d1598250e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.358819 20113 tablet_copy_client.cc:323] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:41.363690 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet f2c0dc5e5d2542c88c79527e70d218e3 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:41.364333 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet f2c0dc5e5d2542c88c79527e70d218e3 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-f2c0dc5e5d2542c88c79527e70d218e3
I20260709 13:08:41.364437 20116 tablet_copy_client.cc:806] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:41.365134 20116 tablet_copy_client.cc:670] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:41.378230 20116 tablet_copy_client.cc:538] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:41.380316 19383 tablet_copy_source_session.cc:215] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:41.389035 20113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0dc5e5d2542c88c79527e70d218e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:41.392920 20116 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:41.450093 20113 tablet_copy_client.cc:806] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:41.450719 20113 tablet_copy_client.cc:670] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:41.481731 20113 tablet_copy_client.cc:538] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:41.498867 19902 raft_consensus.cc:1217] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:41.519120 20116 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.520517 20116 tablet_bootstrap.cc:492] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:41.521347 20116 ts_tablet_manager.cc:1403] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.129s	user 0.024s	sys 0.032s
I20260709 13:08:41.531708 20113 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:41.532341 20116 raft_consensus.cc:359] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.533442 20116 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:41.534145 20116 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.537283 20116 ts_tablet_manager.cc:1434] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:08:41.539047 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-cbaa5acb8ba24137bd7a86d1598250e1 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:41.539486 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-cbaa5acb8ba24137bd7a86d1598250e1 on tablet cbaa5acb8ba24137bd7a86d1598250e1 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:41.557422 20113 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.558390 20113 tablet_bootstrap.cc:492] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:41.559101 20113 ts_tablet_manager.cc:1403] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.010s
I20260709 13:08:41.562101 20113 raft_consensus.cc:359] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.562988 20113 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:41.563681 20113 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:41.568837 20113 ts_tablet_manager.cc:1434] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:08:41.570567 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-f2c0dc5e5d2542c88c79527e70d218e3 received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:41.570971 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-f2c0dc5e5d2542c88c79527e70d218e3 on tablet f2c0dc5e5d2542c88c79527e70d218e3 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:41.701125 19902 raft_consensus.cc:1217] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:41.725615 19902 raft_consensus.cc:1217] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:41.904446 19902 raft_consensus.cc:1217] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:41.948724 20093 raft_consensus.cc:1064] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:41.951414 20093 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:41.959786 19902 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.961038 19299 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.962098 20123 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.963771 19224 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:41.965385 20123 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.972216 20093 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.050590 19218 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.052599 19901 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.048689 20093 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.075698 19120 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.097230 19299 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.140332 20123 raft_consensus.cc:1064] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:42.143122 20123 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.161222 19901 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.162909 19972 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.171172 19299 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.172837 19972 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.179940 19373 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.181290 19218 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.182708 20093 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.197600 19902 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.200662 20093 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:42.219094 19296 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.222188 20140 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:42.223766 20123 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.226162 19901 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.228708 20093 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.245779 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 443db347d2a7465e8845fc3facf2ea26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.248148 19902 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.259233 19299 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.265192 19121 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.270917 19296 raft_consensus.cc:2955] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.278703 19218 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.287130 19122 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.323668 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet 443db347d2a7465e8845fc3facf2ea26 with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:42.327611 20126 raft_consensus.cc:1064] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:42.330307 20125 raft_consensus.cc:1064] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:42.330703 20126 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.333632 20125 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.353201 19224 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.353719 19902 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.331362 20145 tablet_replica.cc:333] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:42.356324 20100 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:42.357072 20145 raft_consensus.cc:2243] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:42.357860 20145 raft_consensus.cc:2272] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:42.358084 20065 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.362929 20145 ts_tablet_manager.cc:1916] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:42.363682 19901 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.364319 19367 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.366618 19297 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.367017 19367 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:42.368343 20112 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:42.370244 20112 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.371901 20075 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:42.373334 20091 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.366226 19373 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.396426 19900 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.398114 20144 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:42.404043 19218 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.405704 20093 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.408334 20140 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:42.422971 19902 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.428910 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2c0dc5e5d2542c88c79527e70d218e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.434401 20145 ts_tablet_manager.cc:1929] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:42.434942 20145 log.cc:1199] T 443db347d2a7465e8845fc3facf2ea26 P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/443db347d2a7465e8845fc3facf2ea26
I20260709 13:08:42.436757 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet 443db347d2a7465e8845fc3facf2ea26 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:42.436466 19218 raft_consensus.cc:2955] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.444011 19120 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.457347 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c0dc5e5d2542c88c79527e70d218e3 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:42.460672 20091 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.460397 19224 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.494000 20154 tablet_replica.cc:333] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:42.495379 20154 raft_consensus.cc:2243] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:42.495009 19121 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.496366 20154 raft_consensus.cc:2272] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:42.498692 19367 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.507411 20131 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.521095 19374 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.525579 19297 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.521112 20154 ts_tablet_manager.cc:1916] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:42.559235 19902 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.569216 19121 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.572352 19901 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.607542 19218 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.627933 19297 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:42.633015 19367 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.635548 19901 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.638098 20156 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:42.642391 20091 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:42.645285 20065 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.647269 19901 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.651196 20131 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:42.653049 19296 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:42.653081 19367 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.658960 20131 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:42.672194 20125 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.673768 19901 raft_consensus.cc:2955] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.680450 19902 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.684576 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbaa5acb8ba24137bd7a86d1598250e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.692067 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 539f966b2e414ce2b1c2096d339a2147 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.691012 19123 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.700066 19121 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.700940 19297 raft_consensus.cc:2955] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:42.702721 20154 ts_tablet_manager.cc:1929] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:42.723030 20154 log.cc:1199] T f2c0dc5e5d2542c88c79527e70d218e3 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/f2c0dc5e5d2542c88c79527e70d218e3
I20260709 13:08:42.725075 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet cbaa5acb8ba24137bd7a86d1598250e1 with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:42.732728 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet f2c0dc5e5d2542c88c79527e70d218e3 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:42.748155 20157 tablet_replica.cc:333] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:42.749416 20157 raft_consensus.cc:2243] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:42.750236 20157 raft_consensus.cc:2272] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:42.773456 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet 539f966b2e414ce2b1c2096d339a2147 with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:42.774431 20145 tablet_replica.cc:333] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:42.776225 20157 ts_tablet_manager.cc:1916] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:42.787078 20145 raft_consensus.cc:2243] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:42.787788 20145 raft_consensus.cc:2272] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:42.795375 20145 ts_tablet_manager.cc:1916] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:42.798611 20157 ts_tablet_manager.cc:1929] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:42.799110 20157 log.cc:1199] T cbaa5acb8ba24137bd7a86d1598250e1 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/cbaa5acb8ba24137bd7a86d1598250e1
I20260709 13:08:42.800931 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet cbaa5acb8ba24137bd7a86d1598250e1 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:42.815030 20145 ts_tablet_manager.cc:1929] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:42.815428 20145 log.cc:1199] T 539f966b2e414ce2b1c2096d339a2147 P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/539f966b2e414ce2b1c2096d339a2147
I20260709 13:08:42.816799 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet 539f966b2e414ce2b1c2096d339a2147 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:43.894511 19297 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:08:43.903090 19263 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c79ddd82cd084684a0080d4432222b09. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.904826 19374 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.905220 19218 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.906455 20065 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.907307 20158 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.915934 20158 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:43.917230 19374 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:43.924294 19224 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:43.941018 19297 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:43.947052 19121 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:43.969187 19263 consensus_peers.cc:597] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb03123528514382bd026ba70cefa81a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.974072 19224 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.975126 19374 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:43.976461 20158 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.977589 20155 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:43.988245 20158 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:43.989907 19374 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.003404 19367 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:08:44.037144 19337 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c88904f118f462b924e48beec293ae5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.039523 19297 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:44.042574 20093 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.034657 19123 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.045074 19221 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:44.048058 20093 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.087478 20144 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.089326 19218 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.098822 19296 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.101670 19218 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.126811 19123 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.147198 19296 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:08:44.159965 19263 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03efca40b3ba4ad5b0122303a9a227a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.160418 19374 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:44.161863 20176 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.162650 19218 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:44.166797 20176 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:44.171541 20173 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.173615 19374 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.195288 19123 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.199369 19218 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:44.362864 20180 ts_tablet_manager.cc:933] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:44.368476 20180 tablet_copy_client.cc:323] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:44.370153 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet cb03123528514382bd026ba70cefa81a from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:44.370740 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet cb03123528514382bd026ba70cefa81a from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-cb03123528514382bd026ba70cefa81a
I20260709 13:08:44.387781 19310 tablet_copy_source_session.cc:215] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:44.394215 20180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb03123528514382bd026ba70cefa81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.431476 20180 tablet_copy_client.cc:806] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:44.432374 20180 tablet_copy_client.cc:670] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:44.436005 20182 ts_tablet_manager.cc:933] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:44.436380 20180 tablet_copy_client.cc:538] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:44.453083 20180 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:44.461273 20182 tablet_copy_client.cc:323] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:44.463112 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet c79ddd82cd084684a0080d4432222b09 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:44.463703 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet c79ddd82cd084684a0080d4432222b09 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-c79ddd82cd084684a0080d4432222b09
I20260709 13:08:44.502106 19310 tablet_copy_source_session.cc:215] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:44.505713 20182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79ddd82cd084684a0080d4432222b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.519308 20185 ts_tablet_manager.cc:933] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:44.519726 20180 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.549045 20180 tablet_bootstrap.cc:492] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:44.549749 20180 ts_tablet_manager.cc:1403] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.013s
I20260709 13:08:44.554427 20180 raft_consensus.cc:359] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:44.556768 20180 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:44.563611 20180 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:44.578558 20180 ts_tablet_manager.cc:1434] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:08:44.580745 20185 tablet_copy_client.cc:323] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:44.588303 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet 6c88904f118f462b924e48beec293ae5 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:44.588883 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet 6c88904f118f462b924e48beec293ae5 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-6c88904f118f462b924e48beec293ae5
I20260709 13:08:44.590449 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-cb03123528514382bd026ba70cefa81a received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:44.590968 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-cb03123528514382bd026ba70cefa81a on tablet cb03123528514382bd026ba70cefa81a with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:44.596716 19383 tablet_copy_source_session.cc:215] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:44.600008 20182 tablet_copy_client.cc:806] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:44.601073 20182 tablet_copy_client.cc:670] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:44.605718 20185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88904f118f462b924e48beec293ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.609087 20182 tablet_copy_client.cc:538] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:44.635648 20182 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:44.644310 20185 tablet_copy_client.cc:806] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:44.644989 20185 tablet_copy_client.cc:670] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:44.652613 20185 tablet_copy_client.cc:538] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:44.667871 20185 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:44.695598 20182 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.696637 20182 tablet_bootstrap.cc:492] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:44.697292 20182 ts_tablet_manager.cc:1403] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.010s
I20260709 13:08:44.701382 20182 raft_consensus.cc:359] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:44.702387 20182 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:44.704635 20182 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:44.708539 20182 ts_tablet_manager.cc:1434] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:08:44.727195 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-c79ddd82cd084684a0080d4432222b09 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:44.727802 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-c79ddd82cd084684a0080d4432222b09 on tablet c79ddd82cd084684a0080d4432222b09 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:44.803714 20182 ts_tablet_manager.cc:933] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:44.819753 20182 tablet_copy_client.cc:323] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
W20260709 13:08:45.007942 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 263077us
I20260709 13:08:45.016404 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet 03efca40b3ba4ad5b0122303a9a227a2 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:45.041831 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet 03efca40b3ba4ad5b0122303a9a227a2 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-03efca40b3ba4ad5b0122303a9a227a2
I20260709 13:08:45.050576 19310 tablet_copy_source_session.cc:215] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:45.125252 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 111314us
I20260709 13:08:45.133351 19902 raft_consensus.cc:1217] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:45.137347 20182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efca40b3ba4ad5b0122303a9a227a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:45.143477 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60415us
I20260709 13:08:45.159977 20182 tablet_copy_client.cc:806] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.168148 20182 tablet_copy_client.cc:670] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.171391 20185 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:45.178740 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 148114us
I20260709 13:08:45.178921 19902 raft_consensus.cc:1217] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:45.172148 20185 tablet_bootstrap.cc:492] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:45.195369 20185 ts_tablet_manager.cc:1403] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.528s	user 0.114s	sys 0.220s
I20260709 13:08:45.205411 20182 tablet_copy_client.cc:538] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.207959 20185 raft_consensus.cc:359] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:45.208854 20185 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:45.209501 20185 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:45.214917 20182 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:45.237074 20185 ts_tablet_manager.cc:1434] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:08:45.252586 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-6c88904f118f462b924e48beec293ae5 received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:45.253099 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-6c88904f118f462b924e48beec293ae5 on tablet 6c88904f118f462b924e48beec293ae5 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:45.261327 20182 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.272948 20182 tablet_bootstrap.cc:492] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:45.273687 20182 ts_tablet_manager.cc:1403] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.008s
I20260709 13:08:45.276820 20182 raft_consensus.cc:359] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:45.277770 20182 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:45.278479 20182 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:45.280902 20182 ts_tablet_manager.cc:1434] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:45.283229 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-03efca40b3ba4ad5b0122303a9a227a2 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:45.283631 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-03efca40b3ba4ad5b0122303a9a227a2 on tablet 03efca40b3ba4ad5b0122303a9a227a2 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:45.424620 20203 raft_consensus.cc:1064] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:45.427341 20203 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:45.472630 19901 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:45.474588 20193 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.484128 19223 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:45.488456 20155 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.486718 19374 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:45.497605 20170 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.521696 20176 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.539392 19224 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.551316 19901 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.559230 19122 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.569638 20155 raft_consensus.cc:1064] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:45.575817 20155 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:45.591077 19374 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.597178 19902 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:45.598486 20170 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.601673 19365 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:45.604234 19223 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:45.604717 20170 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.614084 20155 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.618034 19902 raft_consensus.cc:1217] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:45.651952 20155 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.663347 19224 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.691931 19901 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.722033 19901 raft_consensus.cc:1217] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:45.725313 19367 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.745410 19121 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.785449 19296 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:45.791741 19901 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.792248 19367 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.794185 20173 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:45.801070 19296 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:45.802383 20170 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.806075 19901 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.815128 19902 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.821826 19224 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:45.821681 20170 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.830597 20176 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.835065 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb03123528514382bd026ba70cefa81a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:45.836212 19122 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.838564 20155 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.855165 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet cb03123528514382bd026ba70cefa81a with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:45.861953 19374 raft_consensus.cc:2955] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.860625 19901 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.872575 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c79ddd82cd084684a0080d4432222b09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:45.875682 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46085.9us
I20260709 13:08:45.871966 20219 tablet_replica.cc:333] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:45.877467 20170 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.919670 20219 raft_consensus.cc:2243] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:45.921205 20219 raft_consensus.cc:2272] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:45.922964 19223 raft_consensus.cc:2955] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:45.933249 19122 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.938725 20219 ts_tablet_manager.cc:1916] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:45.958019 20219 ts_tablet_manager.cc:1929] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:45.958134 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet c79ddd82cd084684a0080d4432222b09 with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:45.958603 20219 log.cc:1199] T cb03123528514382bd026ba70cefa81a P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/cb03123528514382bd026ba70cefa81a
I20260709 13:08:45.960422 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet cb03123528514382bd026ba70cefa81a (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:45.973315 20221 tablet_replica.cc:333] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:45.974462 20221 raft_consensus.cc:2243] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:45.975457 20221 raft_consensus.cc:2272] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:45.978760 20221 ts_tablet_manager.cc:1916] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:45.996045 20221 ts_tablet_manager.cc:1929] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:45.996567 20221 log.cc:1199] T c79ddd82cd084684a0080d4432222b09 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/c79ddd82cd084684a0080d4432222b09
I20260709 13:08:45.998530 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet c79ddd82cd084684a0080d4432222b09 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:46.080389 20201 raft_consensus.cc:1064] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:46.082926 20201 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:46.091804 19223 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.093169 20198 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.096323 19901 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.097896 20198 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.099048 19296 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.101511 20217 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.119804 20199 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.139802 19223 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.171568 20220 raft_consensus.cc:1064] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:46.184996 19903 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.190438 19122 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.203044 20220 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:46.216061 19367 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:46.222422 19901 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:46.234753 20201 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:46.236908 19223 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:46.239056 19218 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.239205 20199 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:46.240442 20220 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.240617 19365 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.244962 20198 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.262924 19903 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.266112 20155 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.271196 19901 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.284035 20220 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:08:46.335078 20227 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:46.341279 19221 raft_consensus.cc:2955] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.342747 19123 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.371047 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c88904f118f462b924e48beec293ae5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:46.406410 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48994.8us
I20260709 13:08:46.414716 20203 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.419754 19902 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:08:46.499971 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 79596.4us
I20260709 13:08:46.501585 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c88904f118f462b924e48beec293ae5 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:46.517004 20244 tablet_replica.cc:333] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:46.519222 20244 raft_consensus.cc:2243] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.546461 19123 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.535351 20244 pending_rounds.cc:70] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Trying to abort 1 pending ops.
I20260709 13:08:46.562994 19365 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.566175 20244 pending_rounds.cc:77] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635946829676544 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6c88904f118f462b924e48beec293ae5" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } } }
I20260709 13:08:46.610452 20244 raft_consensus.cc:2917] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:08:46.611006 20244 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:46.611442 20244 raft_consensus.cc:2272] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.616487 19223 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.620554 20244 ts_tablet_manager.cc:1916] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:46.629805 20203 consensus_queue.cc:1175] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56df67425e6f45d3b2b42441e3c143ba" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
W20260709 13:08:46.630537 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 91058.7us
I20260709 13:08:46.631654 19295 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:46.642588 19901 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:46.642588 19221 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:46.646485 20243 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:46.649323 20235 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:46.680382 20244 ts_tablet_manager.cc:1929] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:46.680940 20244 log.cc:1199] T 6c88904f118f462b924e48beec293ae5 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/6c88904f118f462b924e48beec293ae5
I20260709 13:08:46.682622 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet 6c88904f118f462b924e48beec293ae5 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:46.691377 20240 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.701588 19223 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.710000 19901 raft_consensus.cc:2955] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.725787 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03efca40b3ba4ad5b0122303a9a227a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:46.722991 19123 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:46.751747 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet 03efca40b3ba4ad5b0122303a9a227a2 with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:46.767786 20251 tablet_replica.cc:333] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:46.768726 20251 raft_consensus.cc:2243] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.769531 20251 raft_consensus.cc:2272] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.774600 20251 ts_tablet_manager.cc:1916] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:46.787524 20251 ts_tablet_manager.cc:1929] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:46.787982 20251 log.cc:1199] T 03efca40b3ba4ad5b0122303a9a227a2 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/03efca40b3ba4ad5b0122303a9a227a2
I20260709 13:08:46.789479 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet 03efca40b3ba4ad5b0122303a9a227a2 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:47.838428 19365 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:08:47.845075 19337 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d425f48ed5b488e9080214e593ef6fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:47.845320 19221 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:47.848796 19298 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:47.850145 20254 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.851151 20233 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.859267 20233 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.860857 19295 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.862241 19221 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.876363 19298 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:47.880183 19123 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:47.908118 19263 consensus_peers.cc:597] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5aeada323a94b289fcf904795167d43. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:47.910912 19221 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:47.912706 20243 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.910912 19365 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:47.914841 20252 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.924032 20252 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.926538 19221 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.935115 19374 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.952314 19221 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:47.953792 19121 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:47.970819 19188 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5c7a109008641aaa9e738f35f1abf42. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:47.971670 19365 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:47.972688 19298 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:47.973183 20249 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.974121 20229 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.981602 20250 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.983321 19298 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.983935 19365 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:47.997426 19295 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:47.998085 19122 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:48.015507 19263 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c32ecd0e2df44d9eace43b19017215ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.019445 19221 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:48.020685 20243 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.024417 19365 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:48.026070 20243 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.028381 20252 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:48.031265 19221 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:48.035406 19365 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:48.045257 19122 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:48.409965 20271 ts_tablet_manager.cc:933] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:48.414415 20271 tablet_copy_client.cc:323] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:48.415907 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet f5aeada323a94b289fcf904795167d43 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:48.416450 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet f5aeada323a94b289fcf904795167d43 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-f5aeada323a94b289fcf904795167d43
I20260709 13:08:48.423655 19310 tablet_copy_source_session.cc:215] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:48.428428 20271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aeada323a94b289fcf904795167d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:48.443161 20271 tablet_copy_client.cc:806] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.443746 20271 tablet_copy_client.cc:670] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.448505 20271 tablet_copy_client.cc:538] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:48.457731 20271 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:48.477478 20273 ts_tablet_manager.cc:933] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:48.483991 20271 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.485067 20271 tablet_bootstrap.cc:492] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:48.485769 20271 ts_tablet_manager.cc:1403] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.005s
I20260709 13:08:48.488636 20271 raft_consensus.cc:359] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.489573 20271 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:48.490646 20273 tablet_copy_client.cc:323] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:48.490242 20271 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.492475 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet 5d425f48ed5b488e9080214e593ef6fc from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:48.492976 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet 5d425f48ed5b488e9080214e593ef6fc from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-5d425f48ed5b488e9080214e593ef6fc
I20260709 13:08:48.500252 19383 tablet_copy_source_session.cc:215] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:48.500996 20271 ts_tablet_manager.cc:1434] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 13:08:48.503822 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-f5aeada323a94b289fcf904795167d43 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:48.504240 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-f5aeada323a94b289fcf904795167d43 on tablet f5aeada323a94b289fcf904795167d43 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:48.505491 20273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d425f48ed5b488e9080214e593ef6fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:48.520622 20273 tablet_copy_client.cc:806] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.521142 20273 tablet_copy_client.cc:670] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.526201 20273 tablet_copy_client.cc:538] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:48.535646 20273 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:48.556588 20273 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.557575 20273 tablet_bootstrap.cc:492] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:48.557657 20271 ts_tablet_manager.cc:933] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:48.558305 20273 ts_tablet_manager.cc:1403] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.008s
I20260709 13:08:48.559345 20271 tablet_copy_client.cc:323] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:48.560920 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet d5c7a109008641aaa9e738f35f1abf42 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:48.561401 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet d5c7a109008641aaa9e738f35f1abf42 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-d5c7a109008641aaa9e738f35f1abf42
I20260709 13:08:48.561439 20273 raft_consensus.cc:359] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.562359 20273 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:48.562985 20273 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.565384 20273 ts_tablet_manager.cc:1434] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:48.569938 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-5d425f48ed5b488e9080214e593ef6fc received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:48.570427 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-5d425f48ed5b488e9080214e593ef6fc on tablet 5d425f48ed5b488e9080214e593ef6fc with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:48.584026 19235 tablet_copy_source_session.cc:215] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:48.587038 20271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c7a109008641aaa9e738f35f1abf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:48.601397 20271 tablet_copy_client.cc:806] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.602006 20271 tablet_copy_client.cc:670] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.606359 20271 tablet_copy_client.cc:538] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:48.612445 20271 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:48.619982 20273 ts_tablet_manager.cc:933] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:48.625334 20273 tablet_copy_client.cc:323] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:48.627223 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet c32ecd0e2df44d9eace43b19017215ee from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:48.627823 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet c32ecd0e2df44d9eace43b19017215ee from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-c32ecd0e2df44d9eace43b19017215ee
I20260709 13:08:48.633647 20271 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.634600 20271 tablet_bootstrap.cc:492] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:48.635334 20271 ts_tablet_manager.cc:1403] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:08:48.636361 19310 tablet_copy_source_session.cc:215] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:48.638798 20271 raft_consensus.cc:359] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.639504 20271 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:48.639863 20273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32ecd0e2df44d9eace43b19017215ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:48.640077 20271 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.642956 20271 ts_tablet_manager.cc:1434] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260709 13:08:48.645555 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-d5c7a109008641aaa9e738f35f1abf42 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:48.646018 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-d5c7a109008641aaa9e738f35f1abf42 on tablet d5c7a109008641aaa9e738f35f1abf42 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:48.664206 20273 tablet_copy_client.cc:806] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.664832 20273 tablet_copy_client.cc:670] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.668113 20273 tablet_copy_client.cc:538] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:48.676863 20273 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:48.696933 20273 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.697893 20273 tablet_bootstrap.cc:492] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:48.698562 20273 ts_tablet_manager.cc:1403] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:08:48.701462 20273 raft_consensus.cc:359] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.702354 20273 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:48.703140 20273 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:48.705678 20273 ts_tablet_manager.cc:1434] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:08:48.710233 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-c32ecd0e2df44d9eace43b19017215ee received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:48.710713 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-c32ecd0e2df44d9eace43b19017215ee on tablet c32ecd0e2df44d9eace43b19017215ee with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:48.926900 19902 raft_consensus.cc:1217] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.003531 19902 raft_consensus.cc:1217] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.141894 19902 raft_consensus.cc:1217] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.200527 19902 raft_consensus.cc:1217] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.469305 20252 raft_consensus.cc:1064] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:49.471772 20252 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.478632 19902 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.479632 19374 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.480334 20287 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.480886 19223 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.481156 20270 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.482095 20252 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.506351 20286 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.514320 19366 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.514827 19902 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.531118 19223 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.539387 19121 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.561517 20284 raft_consensus.cc:1064] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:49.565521 20284 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.580826 19295 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.582204 20233 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.600090 19902 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.601902 20233 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.630151 20283 raft_consensus.cc:1064] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:49.631554 20252 raft_consensus.cc:1064] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:49.634007 20252 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.633899 20283 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.640578 19223 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.648180 20254 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.670047 20284 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.671599 19367 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.673036 20250 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.668897 19902 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.677870 20250 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:49.693063 19295 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.693805 19221 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.694689 20250 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.707734 19295 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.713004 19297 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.717468 19122 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.722735 19218 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.725802 20287 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:49.738741 19903 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.740191 20287 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.743716 19903 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.745092 20287 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:49.753533 20286 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:08:49.757651 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 55064.6us
I20260709 13:08:49.761994 20282 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.765098 19903 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.763840 19902 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.782196 19120 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.784312 19903 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.784478 20250 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.786047 19123 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.802768 19902 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.812151 19365 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.815192 19365 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.816391 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5aeada323a94b289fcf904795167d43 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:49.815448 19121 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.792196 19366 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.826301 20252 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:08:49.825798 20287 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:08:49.845058 19223 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.824997 19221 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.826303 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet f5aeada323a94b289fcf904795167d43 with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:49.839354 19365 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.852543 19367 raft_consensus.cc:2955] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.862532 19903 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.864188 20229 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:49.864557 19903 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.866058 20304 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:49.868472 19223 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.869731 20304 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:08:49.875562 20229 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.880542 20254 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.882673 19902 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.887209 19218 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.888820 19903 raft_consensus.cc:2955] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.893986 19297 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:49.894524 20310 tablet_replica.cc:333] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:49.895711 20310 raft_consensus.cc:2243] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.902688 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5c7a109008641aaa9e738f35f1abf42 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:49.903899 19901 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.944455 20310 raft_consensus.cc:2272] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.904914 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d425f48ed5b488e9080214e593ef6fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:49.923266 19374 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.947428 20287 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:49.924139 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 106353us
I20260709 13:08:49.955827 19367 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:49.961606 20252 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.964335 20313 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:49.948720 19119 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.952399 20310 ts_tablet_manager.cc:1916] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:49.971149 19901 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:49.971165 19122 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.995803 19367 raft_consensus.cc:2955] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:08:49.997541 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 62597.2us
I20260709 13:08:50.014632 20310 ts_tablet_manager.cc:1929] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.033954 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c32ecd0e2df44d9eace43b19017215ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.040213 19120 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.048041 19221 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.015182 20310 log.cc:1199] T f5aeada323a94b289fcf904795167d43 P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/f5aeada323a94b289fcf904795167d43
I20260709 13:08:50.064132 20282 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:08:50.076776 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet f5aeada323a94b289fcf904795167d43 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:50.103794 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c7a109008641aaa9e738f35f1abf42 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:50.108676 19218 raft_consensus.cc:2955] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:50.118098 20317 tablet_replica.cc:333] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:50.119340 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d425f48ed5b488e9080214e593ef6fc with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:50.120398 20317 raft_consensus.cc:2243] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.121213 20317 pending_rounds.cc:70] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Trying to abort 1 pending ops.
I20260709 13:08:50.121553 20317 pending_rounds.cc:77] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635961371136000 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d5c7a109008641aaa9e738f35f1abf42" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } } }
I20260709 13:08:50.129221 20317 raft_consensus.cc:2917] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:08:50.129884 20317 raft_consensus.cc:2889] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:50.130388 20317 raft_consensus.cc:2272] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.135275 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet c32ecd0e2df44d9eace43b19017215ee with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:50.146405 20318 tablet_replica.cc:333] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:50.149250 20318 raft_consensus.cc:2243] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.150472 20318 raft_consensus.cc:2272] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.156978 20318 ts_tablet_manager.cc:1916] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.169909 20317 ts_tablet_manager.cc:1916] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.182953 20318 ts_tablet_manager.cc:1929] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.183674 20318 log.cc:1199] T c32ecd0e2df44d9eace43b19017215ee P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/c32ecd0e2df44d9eace43b19017215ee
I20260709 13:08:50.185971 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet c32ecd0e2df44d9eace43b19017215ee (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:50.203428 20317 ts_tablet_manager.cc:1929] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.204079 20317 log.cc:1199] T d5c7a109008641aaa9e738f35f1abf42 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/d5c7a109008641aaa9e738f35f1abf42
I20260709 13:08:50.206231 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet d5c7a109008641aaa9e738f35f1abf42 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:50.206549 20317 tablet_replica.cc:333] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:50.207721 20317 raft_consensus.cc:2243] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.208592 20317 raft_consensus.cc:2272] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.212240 20317 ts_tablet_manager.cc:1916] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.222836 20317 ts_tablet_manager.cc:1929] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.223111 20317 log.cc:1199] T 5d425f48ed5b488e9080214e593ef6fc P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/5d425f48ed5b488e9080214e593ef6fc
I20260709 13:08:50.224401 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet 5d425f48ed5b488e9080214e593ef6fc (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:51.253504 19297 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:08:51.259903 19263 consensus_peers.cc:597] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2348394564c140f3aec293661379e650. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.261008 19374 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.263165 20282 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.265311 19223 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:51.267050 20287 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.272094 20282 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.273685 19374 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.276252 19223 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.286536 19297 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.291147 19120 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 3, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:51.315562 19263 consensus_peers.cc:597] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0169774f68846529d675fe580574195. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.317389 19223 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.318667 20287 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.323447 19374 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.325062 20282 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.333375 20287 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.347216 19223 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.349951 19218 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.352774 19374 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.375897 19121 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:51.391139 19188 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03d4cdd71fcc4422813ad324c5c5f5e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.392553 19297 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.394819 19373 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.396340 20319 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:51.399040 20313 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:51.407850 20309 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.413997 19297 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.422521 19295 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.416761 19373 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.438901 19121 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:51.448962 19263 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba44c11bd3fc411ca166bf56c457490f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.449553 19373 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.450459 19218 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.451161 20252 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.452762 20252 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.460017 20332 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.462028 19373 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.462535 19218 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:51.480494 19122 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.767380 20340 ts_tablet_manager.cc:933] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:51.771312 20340 tablet_copy_client.cc:323] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:51.773842 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet 2348394564c140f3aec293661379e650 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:51.774385 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet 2348394564c140f3aec293661379e650 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-2348394564c140f3aec293661379e650
I20260709 13:08:51.786360 19310 tablet_copy_source_session.cc:215] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:51.790486 20340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2348394564c140f3aec293661379e650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:51.803956 20340 tablet_copy_client.cc:806] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:51.804629 20340 tablet_copy_client.cc:670] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:51.808519 20340 tablet_copy_client.cc:538] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:51.814431 20340 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:51.834800 20340 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.835577 20340 tablet_bootstrap.cc:492] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:51.836212 20340 ts_tablet_manager.cc:1403] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.016s
I20260709 13:08:51.838850 20340 raft_consensus.cc:359] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.839473 20340 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:51.840003 20340 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.866762 20340 ts_tablet_manager.cc:1434] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.014s
I20260709 13:08:51.868481 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-2348394564c140f3aec293661379e650 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:51.868934 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-2348394564c140f3aec293661379e650 on tablet 2348394564c140f3aec293661379e650 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:51.918839 20340 ts_tablet_manager.cc:933] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:51.920469 20340 tablet_copy_client.cc:323] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:51.921908 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet e0169774f68846529d675fe580574195 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:51.922348 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet e0169774f68846529d675fe580574195 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-e0169774f68846529d675fe580574195
I20260709 13:08:51.928930 19310 tablet_copy_source_session.cc:215] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:51.931509 20340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0169774f68846529d675fe580574195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:51.943410 20340 tablet_copy_client.cc:806] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:51.943879 20340 tablet_copy_client.cc:670] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:51.948107 20340 tablet_copy_client.cc:538] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:51.954440 20340 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:51.971225 20340 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.971899 20340 tablet_bootstrap.cc:492] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:51.972529 20340 ts_tablet_manager.cc:1403] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.018s	user 0.018s	sys 0.001s
I20260709 13:08:51.975103 20340 raft_consensus.cc:359] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.975914 20340 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:51.976603 20340 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:51.978816 20340 ts_tablet_manager.cc:1434] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:51.980723 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-e0169774f68846529d675fe580574195 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:51.981133 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-e0169774f68846529d675fe580574195 on tablet e0169774f68846529d675fe580574195 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:51.983912 20346 ts_tablet_manager.cc:933] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:51.989948 20346 tablet_copy_client.cc:323] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:51.991896 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet 03d4cdd71fcc4422813ad324c5c5f5e5 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:51.992475 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet 03d4cdd71fcc4422813ad324c5c5f5e5 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-03d4cdd71fcc4422813ad324c5c5f5e5
I20260709 13:08:51.999679 19235 tablet_copy_source_session.cc:215] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:52.002684 20346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d4cdd71fcc4422813ad324c5c5f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.014218 20346 tablet_copy_client.cc:806] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.014716 20346 tablet_copy_client.cc:670] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:52.019405 20346 tablet_copy_client.cc:538] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:52.028882 20346 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:52.034366 20340 ts_tablet_manager.cc:933] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:52.055130 20346 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.056124 20346 tablet_bootstrap.cc:492] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:52.057220 20346 ts_tablet_manager.cc:1403] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 13:08:52.059621 20340 tablet_copy_client.cc:323] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:08:52.061335 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet ba44c11bd3fc411ca166bf56c457490f from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:08:52.060902 20346 raft_consensus.cc:359] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:52.061887 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet ba44c11bd3fc411ca166bf56c457490f from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-ba44c11bd3fc411ca166bf56c457490f
I20260709 13:08:52.062100 20346 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:52.062789 20346 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:52.065179 20346 ts_tablet_manager.cc:1434] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:52.067718 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-03d4cdd71fcc4422813ad324c5c5f5e5 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:52.068120 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-03d4cdd71fcc4422813ad324c5c5f5e5 on tablet 03d4cdd71fcc4422813ad324c5c5f5e5 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:52.072561 19310 tablet_copy_source_session.cc:215] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:52.075814 20340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba44c11bd3fc411ca166bf56c457490f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.091249 20340 tablet_copy_client.cc:806] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.091799 20340 tablet_copy_client.cc:670] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:52.094938 20340 tablet_copy_client.cc:538] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:52.102664 20340 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:52.121145 20340 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.122025 20340 tablet_bootstrap.cc:492] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:52.122632 20340 ts_tablet_manager.cc:1403] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:08:52.125145 20340 raft_consensus.cc:359] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:52.125921 20340 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:52.126482 20340 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:52.128839 20340 ts_tablet_manager.cc:1434] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:08:52.130750 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-ba44c11bd3fc411ca166bf56c457490f received from {username='slave'} at 127.0.0.1:36770
I20260709 13:08:52.131152 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-ba44c11bd3fc411ca166bf56c457490f on tablet ba44c11bd3fc411ca166bf56c457490f with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:52.207934 19901 raft_consensus.cc:1217] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:08:52.388615 19903 raft_consensus.cc:1217] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:52.487638 19903 raft_consensus.cc:1217] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:52.575827 19901 raft_consensus.cc:1217] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:52.834249 20348 raft_consensus.cc:1064] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:52.836856 20348 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:52.843713 19901 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:52.845288 19223 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:52.846511 20348 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:52.846896 19373 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:52.848991 20330 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:52.852222 20348 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:52.862388 20354 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:52.863587 19373 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:52.879966 19223 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:52.889127 19901 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:52.892436 19119 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 3 to 4, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.906083 20332 raft_consensus.cc:1064] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:52.908581 20332 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:52.938627 19901 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:52.939965 19373 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:52.941231 19218 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:52.943975 20348 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:52.945816 20348 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:52.946781 20332 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:52.975124 20332 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:52.976505 19901 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:52.988745 19296 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:52.994879 19122 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.001113 19223 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.005734 19373 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.018435 19374 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:53.023465 20330 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:53.028594 19901 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:53.031517 20332 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:53.032935 20358 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.037961 19903 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.049754 19296 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.052240 19365 raft_consensus.cc:2955] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.059815 19901 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.061458 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2348394564c140f3aec293661379e650 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.061527 20348 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.067996 19374 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.070977 20330 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.072022 20354 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.077749 19902 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.081597 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0169774f68846529d675fe580574195 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.080246 19374 raft_consensus.cc:2955] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.079813 19121 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 4 to 5, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.090143 20354 raft_consensus.cc:1064] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:53.094820 20354 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.097980 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet 2348394564c140f3aec293661379e650 with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:53.106469 20368 tablet_replica.cc:333] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:53.107676 20368 raft_consensus.cc:2243] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.108528 20368 raft_consensus.cc:2272] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.113849 19122 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.120198 20368 ts_tablet_manager.cc:1916] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.122385 19373 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.125276 19223 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.125569 20330 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.126731 20332 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.127957 19901 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.129339 20330 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.142297 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet e0169774f68846529d675fe580574195 with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:08:53.155432 20354 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.159212 20368 ts_tablet_manager.cc:1929] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:08:53.160647 20368 log.cc:1199] T 2348394564c140f3aec293661379e650 P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/2348394564c140f3aec293661379e650
I20260709 13:08:53.162384 20368 tablet_replica.cc:333] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:08:53.163524 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet 2348394564c140f3aec293661379e650 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:53.164290 20368 raft_consensus.cc:2243] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.165144 20368 raft_consensus.cc:2272] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.169473 20368 ts_tablet_manager.cc:1916] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.220773 19901 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.174543 19374 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.232082 19120 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.236125 19221 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.242478 20313 raft_consensus.cc:1064] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:53.244874 20313 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.247635 20368 ts_tablet_manager.cc:1929] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:53.248082 20368 log.cc:1199] T e0169774f68846529d675fe580574195 P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/e0169774f68846529d675fe580574195
I20260709 13:08:53.254284 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet e0169774f68846529d675fe580574195 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:53.264510 19373 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.265506 19901 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.265683 19297 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.266788 20364 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.270637 19296 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.272086 19901 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.274255 20354 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.277105 20309 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.285446 20313 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.290077 20358 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.298266 19901 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.301316 20309 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.303968 19221 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.309309 20332 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.312970 19374 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.314826 19296 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.316358 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba44c11bd3fc411ca166bf56c457490f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.318703 19902 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.323388 19221 raft_consensus.cc:2955] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.332638 19121 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 3 to 4, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 1 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.346812 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet ba44c11bd3fc411ca166bf56c457490f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:53982
I20260709 13:08:53.350169 19122 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.366034 20378 tablet_replica.cc:333] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:08:53.367131 20378 raft_consensus.cc:2243] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.369048 20378 raft_consensus.cc:2272] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.370592 19221 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.373950 20378 ts_tablet_manager.cc:1916] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.377010 19374 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.377296 19902 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.378417 20313 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.379319 20364 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.385109 20313 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.390480 19374 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.394711 20378 ts_tablet_manager.cc:1929] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:53.395350 20378 log.cc:1199] T ba44c11bd3fc411ca166bf56c457490f P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/ba44c11bd3fc411ca166bf56c457490f
I20260709 13:08:53.397007 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet ba44c11bd3fc411ca166bf56c457490f (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:53.402799 19902 raft_consensus.cc:2955] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:53.412598 19109 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03d4cdd71fcc4422813ad324c5c5f5e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.417876 19120 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 1 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.429137 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.436685 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet 03d4cdd71fcc4422813ad324c5c5f5e5 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:08:53.448264 20380 tablet_replica.cc:333] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:08:53.449352 20380 raft_consensus.cc:2243] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.450161 20380 raft_consensus.cc:2272] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.453573 20380 ts_tablet_manager.cc:1916] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.468261 20380 ts_tablet_manager.cc:1929] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:53.468632 20380 log.cc:1199] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/03d4cdd71fcc4422813ad324c5c5f5e5
I20260709 13:08:53.470131 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet 03d4cdd71fcc4422813ad324c5c5f5e5 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:08:53.500417 19367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:08:53.501129 19367 raft_consensus.cc:606] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:08:53.513505 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7547528ebe74640917580adfe8092bd"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:53.513983 19296 raft_consensus.cc:606] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:53.516085 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:53.516551 19296 raft_consensus.cc:606] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:53.518570 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb03123528514382bd026ba70cefa81a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:53.518961 19296 raft_consensus.cc:606] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:53.520936 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:53.521327 19296 raft_consensus.cc:606] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:53.538163 20354 raft_consensus.cc:993] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:53.538607 20354 raft_consensus.cc:1081] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:53.540081 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb03123528514382bd026ba70cefa81a"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:08:53.540267 19223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:35524
I20260709 13:08:53.540676 19902 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.540764 19223 raft_consensus.cc:606] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:08:53.541039 19902 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.543437 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5aeada323a94b289fcf904795167d43"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:53.543926 19296 raft_consensus.cc:606] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:53.546139 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:08:53.546856 19902 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.548460 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:53.549316 19902 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:53.550428 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:53.551062 19296 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.551329 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:53.551389 19296 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:53.552042 19374 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.552625 19296 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.553591 19296 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.556380 19374 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:53.557477 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:53.558410 20343 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.558285 19296 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:53.560210 20343 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:53.561117 20343 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.570282 19120 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.626717 20358 raft_consensus.cc:993] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:53.627218 20332 raft_consensus.cc:1081] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:53.628593 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:08:53.629019 19902 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.629308 19902 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.635186 19902 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.637588 19902 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:53.637918 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:53.638216 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:53.638485 19223 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.638754 19296 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.639043 19296 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:53.639804 19296 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.641022 19296 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.644799 19223 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:53.646150 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:53.647131 20343 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.647240 19296 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:53.647826 20343 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:53.648831 20343 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:53.659960 19120 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.674118 20358 raft_consensus.cc:993] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: : Instructing follower c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:08:53.674710 20332 raft_consensus.cc:1081] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:08:53.676360 19367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7547528ebe74640917580adfe8092bd"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:53992
I20260709 13:08:53.676888 19367 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.677227 19367 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.684303 19367 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.686255 19367 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:53.686905 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:53.687278 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:53.687606 19223 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.687817 19296 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.688122 19296 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:53.688995 19296 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.690111 19296 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.694052 19223 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:53.695180 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:53.695958 20373 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.696412 20373 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:53.697224 20373 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.700778 19296 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:53.707865 19120 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 2 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.879050 20320 raft_consensus.cc:993] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:08:53.879462 20373 raft_consensus.cc:1081] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Signalling peer 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:08:53.880759 19296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41702
I20260709 13:08:53.881274 19296 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.881630 19296 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.888584 19296 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.890043 19296 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:53.890688 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:53.890990 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:53.891294 19223 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.891507 19367 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.891866 19367 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:53.892573 19367 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.893568 19367 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.896611 19223 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:08:53.897706 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:08:53.898348 20354 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.899322 20354 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:53.900236 20354 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.901113 19367 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:08:53.907130 20358 raft_consensus.cc:993] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: : Instructing follower c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:08:53.907572 20354 raft_consensus.cc:1081] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:08:53.909101 19367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:53992
I20260709 13:08:53.909615 19367 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.909947 19367 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.909431 19120 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.915412 19367 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.917191 19367 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:53.918087 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:53.918207 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:53.918681 19223 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.918759 19296 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.919130 19296 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:53.919785 19296 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.920601 19296 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.924394 19223 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:53.925287 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:53.925978 20320 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.926363 20320 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:53.926463 19296 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:53.927222 20320 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.936260 19120 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 2 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.973747 20364 raft_consensus.cc:993] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: : Instructing follower 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:08:53.974442 20313 raft_consensus.cc:1081] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Signalling peer 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:08:53.976519 19296 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41704
I20260709 13:08:53.977089 19296 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:53.977501 19296 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.983472 19296 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.985311 19296 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:53.986370 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:53.986501 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:53.987442 19374 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.988741 19223 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:53.989034 19223 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:53.989770 19223 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:53.990839 19223 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.993476 19374 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:08:53.994417 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:53.995055 20358 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:53.995297 19223 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:08:53.995438 20358 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:53.996428 20358 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:54.013320 19120 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.066339 20354 raft_consensus.cc:993] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:54.066772 20358 raft_consensus.cc:1081] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:54.067956 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5aeada323a94b289fcf904795167d43"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:08:54.068470 19902 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.068743 19902 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.072873 19902 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:54.075145 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:54.075767 19296 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.076095 19296 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:54.076509 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:54.077090 19374 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.076918 19296 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:54.077739 19902 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:54.078058 19296 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.082157 19374 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:54.082772 19296 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:54.083027 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:54.083812 20343 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.084307 20343 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:54.085140 20343 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:54.097038 19120 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.133297 19296 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.134459 20343 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.154524 19223 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.155778 20385 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.165462 19374 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.167110 20385 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.167457 19221 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.168905 20373 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.173693 19296 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.175292 20385 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.222872 19296 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.224277 20402 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.413925 19223 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.415082 20354 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.426190 19367 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.428005 20358 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.431121 19297 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.436589 19223 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.439102 20404 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.442906 20404 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:54.518244 19373 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.519966 20358 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.520524 19223 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.521868 20358 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.552595 19367 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.554344 20343 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.559345 19374 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:54.549458 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:54.605599 19337 consensus_peers.cc:597] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ed1a12d65a24a9cbdd9846e6437132d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.607295 19223 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:54.608359 19295 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:54.608624 20405 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.610734 20405 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.616448 19297 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.622159 20385 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.630208 20373 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.641796 19223 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.654171 19367 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:54.667073 19297 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.691846 19121 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.707460 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.725343 19221 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:54.726801 20405 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:54.730464 19337 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce726108fd4e452b9a0b91d535939c7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.732290 19296 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:54.734987 20404 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:54.771011 20373 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.781826 19221 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.789858 19218 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:54.792773 19296 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.806408 19120 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
W20260709 13:08:54.823958 19188 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78d1dbf9a24f4b489920281c72245ab4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.824790 19367 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.826481 20414 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.835577 19296 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.834791 20413 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.837838 19367 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.845249 20313 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.845345 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:54.848372 19296 raft_consensus.cc:606] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:54.852325 19295 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.855100 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:54.855738 19296 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:08:54.856839 19119 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 2 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.858560 19367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c88904f118f462b924e48beec293ae5"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:08:54.859124 19367 raft_consensus.cc:606] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:54.861802 19218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:35524
I20260709 13:08:54.862313 19218 raft_consensus.cc:606] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:54.865613 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:54.866200 19295 raft_consensus.cc:606] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:54.874586 19367 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:54.882037 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:08:54.882627 19295 raft_consensus.cc:606] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:54.884353 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:54.885881 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:54.889940 19218 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:54.890049 19337 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aff34caf0ca44db08f7c49f51ca52966. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.889292 19295 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:54.891988 20404 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.892838 20373 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.901538 20373 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.903595 19296 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.903358 19218 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.909687 20332 raft_consensus.cc:993] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:54.910182 20332 raft_consensus.cc:1081] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:54.913075 19901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:08:54.913555 19901 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.913858 19901 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.922580 19901 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:54.924026 19121 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: config changed from index -1 to 2, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:08:54.926700 20354 raft_consensus.cc:993] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: : Instructing follower c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:08:54.929061 20332 raft_consensus.cc:1081] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:08:54.933892 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:54.934448 19296 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.934806 19296 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:54.935416 19901 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:54.938506 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:54.939083 19218 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.941675 19367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:53992
I20260709 13:08:54.942224 19367 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.942571 19367 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.949064 19367 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:54.936038 19296 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:54.950274 19296 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.950865 19367 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:54.951829 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:54.952416 19221 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.958690 19221 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:54.963336 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:54.964529 19218 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:54.965543 19295 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.965946 19295 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:54.966249 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:54.966444 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:54.967202 20400 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.967370 20404 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.955978 19296 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:54.967715 20400 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:54.967911 20404 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:54.966821 19295 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:54.968607 20400 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:54.968819 20404 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:54.969383 19295 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.005234 19121 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.014909 19295 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:55.024649 20358 raft_consensus.cc:993] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.025195 20354 raft_consensus.cc:1081] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.029084 19901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:08:55.029678 19901 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.030079 19901 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.035760 20313 raft_consensus.cc:993] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.036231 20313 raft_consensus.cc:1081] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.037822 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37398
I20260709 13:08:55.038300 19902 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.038627 19902 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.040210 19121 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 2 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.045194 19901 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.047953 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:55.048471 19218 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.048910 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:55.049367 19297 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.049589 19297 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:55.050232 19297 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.051179 19297 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.054133 19218 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.056181 19901 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:55.056831 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:55.057747 20417 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.058239 20417 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:55.058810 19902 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.059026 20417 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.060904 19297 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.061877 19902 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:55.062139 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:55.066651 19218 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.066973 19218 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:08:55.067589 19218 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.063951 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:55.068516 19373 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.068610 19218 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.073964 19218 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.076031 19121 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.077021 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:55.077809 20417 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.078261 20417 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:55.079061 20417 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.080377 19373 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.090220 19121 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.105333 20404 raft_consensus.cc:993] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.105803 20404 raft_consensus.cc:1081] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.109005 19901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c88904f118f462b924e48beec293ae5"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37370
I20260709 13:08:55.109534 19901 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.109855 19901 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.118131 19901 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.121304 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:55.121512 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:55.122051 19221 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.122196 19901 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:55.122079 19373 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.124459 20438 ts_tablet_manager.cc:933] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:55.124692 19373 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:55.125468 19373 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.126185 20438 tablet_copy_client.cc:323] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:55.126560 19373 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.128129 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet 5ed1a12d65a24a9cbdd9846e6437132d from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:55.128715 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet 5ed1a12d65a24a9cbdd9846e6437132d from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-5ed1a12d65a24a9cbdd9846e6437132d
I20260709 13:08:55.138351 19383 tablet_copy_source_session.cc:215] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:55.139441 19221 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.140691 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:55.141463 20417 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.141904 20417 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:55.142724 20417 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.143508 20438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1a12d65a24a9cbdd9846e6437132d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:55.151917 19373 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.152653 20441 ts_tablet_manager.cc:933] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:55.159777 19121 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.167505 20441 tablet_copy_client.cc:323] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:55.169301 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet ce726108fd4e452b9a0b91d535939c7d from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:55.169835 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet ce726108fd4e452b9a0b91d535939c7d from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-ce726108fd4e452b9a0b91d535939c7d
I20260709 13:08:55.173508 20438 tablet_copy_client.cc:806] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:55.174082 20438 tablet_copy_client.cc:670] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:55.178764 19383 tablet_copy_source_session.cc:215] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:55.179804 20438 tablet_copy_client.cc:538] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:55.181559 20441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce726108fd4e452b9a0b91d535939c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:55.189357 20438 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:55.202560 20441 tablet_copy_client.cc:806] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:55.203218 20441 tablet_copy_client.cc:670] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:55.208105 20441 tablet_copy_client.cc:538] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:55.218096 20441 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:55.219606 20438 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:55.220556 20438 tablet_bootstrap.cc:492] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:55.221225 20438 ts_tablet_manager.cc:1403] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.011s
I20260709 13:08:55.224331 20438 raft_consensus.cc:359] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.225195 20438 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:55.225841 20438 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.229233 20444 ts_tablet_manager.cc:933] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875)
I20260709 13:08:55.231416 20438 ts_tablet_manager.cc:1434] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:55.233300 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-5ed1a12d65a24a9cbdd9846e6437132d received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:55.233747 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-5ed1a12d65a24a9cbdd9846e6437132d on tablet 5ed1a12d65a24a9cbdd9846e6437132d with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:55.234699 20444 tablet_copy_client.cc:323] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.193:44875
I20260709 13:08:55.236929 19235 tablet_copy_service.cc:140] P 56df67425e6f45d3b2b42441e3c143ba: Received BeginTabletCopySession request for tablet 78d1dbf9a24f4b489920281c72245ab4 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:55.237424 19235 tablet_copy_service.cc:161] P 56df67425e6f45d3b2b42441e3c143ba: Beginning new tablet copy session on tablet 78d1dbf9a24f4b489920281c72245ab4 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:46420: session id = d50eb2dab6754df8bcbed1445f2e8430-78d1dbf9a24f4b489920281c72245ab4
I20260709 13:08:55.244390 19235 tablet_copy_source_session.cc:215] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:55.245314 20441 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:55.246270 20441 tablet_bootstrap.cc:492] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:55.246934 20441 ts_tablet_manager.cc:1403] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.000s
I20260709 13:08:55.247534 20444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d1dbf9a24f4b489920281c72245ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:55.249761 20441 raft_consensus.cc:359] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.250561 20441 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:55.251166 20441 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.254019 20441 ts_tablet_manager.cc:1434] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:55.255723 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-ce726108fd4e452b9a0b91d535939c7d received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:55.256116 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-ce726108fd4e452b9a0b91d535939c7d on tablet ce726108fd4e452b9a0b91d535939c7d with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:55.269280 20444 tablet_copy_client.cc:806] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:55.270792 20444 tablet_copy_client.cc:670] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:55.281364 20444 tablet_copy_client.cc:538] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:55.289445 20444 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:55.307186 20444 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:55.308136 20444 tablet_bootstrap.cc:492] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:55.308848 20444 ts_tablet_manager.cc:1403] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 13:08:55.311745 20444 raft_consensus.cc:359] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.313796 20444 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:55.314445 20444 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.316828 20444 ts_tablet_manager.cc:1434] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:08:55.319818 19235 tablet_copy_service.cc:342] P 56df67425e6f45d3b2b42441e3c143ba: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-78d1dbf9a24f4b489920281c72245ab4 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:55.320250 19235 tablet_copy_service.cc:434] P 56df67425e6f45d3b2b42441e3c143ba: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-78d1dbf9a24f4b489920281c72245ab4 on tablet 78d1dbf9a24f4b489920281c72245ab4 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:55.380376 20354 raft_consensus.cc:993] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.380870 20354 raft_consensus.cc:1081] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:55.382254 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37382
I20260709 13:08:55.382717 19902 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.383037 19902 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.389000 19902 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.392673 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:08:55.393190 19221 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.399109 19221 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.400321 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:55.400646 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:55.400878 19295 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:55.401201 19295 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:08:55.401388 20417 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:55.401908 20417 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:55.401995 19902 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:55.403059 20417 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.401911 19295 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:55.405169 19295 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.413776 20444 ts_tablet_manager.cc:933] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:55.416028 19295 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:55.419152 20444 tablet_copy_client.cc:323] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:08:55.420861 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet aff34caf0ca44db08f7c49f51ca52966 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:08:55.421389 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet aff34caf0ca44db08f7c49f51ca52966 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-aff34caf0ca44db08f7c49f51ca52966
I20260709 13:08:55.427641 19121 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.435721 19383 tablet_copy_source_session.cc:215] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:55.444715 20444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff34caf0ca44db08f7c49f51ca52966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:55.456835 20444 tablet_copy_client.cc:806] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:55.457352 20444 tablet_copy_client.cc:670] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:55.460500 20444 tablet_copy_client.cc:538] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:55.468988 20444 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:08:55.488332 20444 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:55.489025 20444 tablet_bootstrap.cc:492] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:08:55.489585 20444 ts_tablet_manager.cc:1403] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:08:55.492729 19295 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.492488 20444 raft_consensus.cc:359] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.493283 20444 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:08:55.493932 20444 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:55.494326 20417 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.497542 20444 ts_tablet_manager.cc:1434] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:55.498762 19297 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.500787 20373 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.504969 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-aff34caf0ca44db08f7c49f51ca52966 received from {username='slave'} at 127.0.0.1:49022
I20260709 13:08:55.505352 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-aff34caf0ca44db08f7c49f51ca52966 on tablet aff34caf0ca44db08f7c49f51ca52966 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:55.506342 19221 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.507552 20417 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.737318 19223 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.751308 19901 raft_consensus.cc:1217] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:55.753410 19223 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.802227 19373 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.805614 20402 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.809749 19223 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.858539 20473 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:55.868804 20475 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:08:55.841542 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77923.1us
I20260709 13:08:55.887001 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.933589 19373 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.941442 19298 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:56.001952 19902 raft_consensus.cc:1217] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:56.016367 20481 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:56.019927 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94229.9us
I20260709 13:08:56.030479 19225 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:56.038328 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 79866.8us
I20260709 13:08:56.044200 19298 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:56.053921 19224 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:56.036275 20475 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:56.076107 19902 raft_consensus.cc:1217] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:56.078989 19902 raft_consensus.cc:1217] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:56.096233 20475 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:08:56.116485 20481 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:56.147424 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53402.6us
I20260709 13:08:56.212658 20475 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.214082 20475 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.218101 20402 raft_consensus.cc:1064] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:56.247972 20402 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:56.291448 19220 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:56.296960 20484 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.299851 19902 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:56.301674 20480 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.304134 20480 raft_consensus.cc:1064] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:56.305701 19298 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:56.308301 20484 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.283948 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.307663 20480 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:56.358923 19298 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:56.359822 19223 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:56.361320 20405 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.362462 19902 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:56.353048 20402 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:56.373068 19298 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:56.364486 19901 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:56.365872 20484 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:08:56.411194 20471 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.463755 19120 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:56.463379 19224 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:56.472581 19220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:35524
I20260709 13:08:56.495607 19220 raft_consensus.cc:606] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:08:56.511483 19365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:08:56.512102 19365 raft_consensus.cc:606] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:08:56.529930 19367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:08:56.530625 19367 raft_consensus.cc:606] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:08:56.546412 20488 raft_consensus.cc:1064] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:56.568364 20488 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:56.713375 20516 raft_consensus.cc:993] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:56.714107 20516 raft_consensus.cc:1064] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:08:56.714269 20484 raft_consensus.cc:1081] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:08:56.719576 19902 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:56.719641 20516 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:56.721283 20476 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:56.722585 19300 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:56.722981 19901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37370
I20260709 13:08:56.723484 19901 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:56.723809 19901 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.793577 19901 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:56.795085 19373 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:56.797444 19901 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:56.808568 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:08:56.809188 19298 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.814383 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:08:56.822446 19365 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:56.822737 19365 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:08:56.823410 19365 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:56.826530 19298 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:56.828989 19365 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.836480 19224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de803894748b488d81cb5c7007c78cce"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:35524
I20260709 13:08:56.837188 19224 raft_consensus.cc:606] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:08:56.844763 19365 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:08:56.805622 20488 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:08:57.184676 20522 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:08:57.233239 20523 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:08:57.310701 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 488202us
I20260709 13:08:57.451517 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:08:57.486935 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48767us
I20260709 13:08:57.795468 20525 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:57.796355 20525 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:08:57.797488 20525 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.203722 20536 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:58.239923 20535 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:58.240599 20535 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.243535 20535 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:58.204572 20536 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.354764 20535 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:58.383940 20535 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.476794 20540 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:58.477325 20530 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:58.482144 20540 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.485124 20530 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:08:58.922453 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.924381 20548 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:58.924657 20550 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.924981 20548 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.925558 20550 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.927181 20548 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.927687 20548 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:58.928020 20548 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.928952 20551 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:58.929454 20551 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.929944 20548 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:58.930598 20548 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:58.931142 20548 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:58.931516 20551 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:58.933071 20548 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.933974 20548 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.934170 20552 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.934439 20548 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.934660 20552 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.936419 20548 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.936578 20552 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.936887 20548 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.937572 20552 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.937335 20548 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.938040 20552 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.939270 20548 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:58.939764 20548 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:58.939837 20552 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.940371 20552 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:58.940956 20552 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.940424 20548 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.943192 20552 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.943279 20548 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.943603 20550 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.945007 20548 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.945508 20548 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.946405 20550 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:58.947466 20548 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.944801 20554 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.949414 20554 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.951268 20554 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:58.946921 20550 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.957420 20550 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:08:58.959702 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.471s	user 0.013s	sys 0.013s
W20260709 13:08:58.960047 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.472s	user 0.013s	sys 0.013s
W20260709 13:08:58.960325 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 1.47194e+06us
I20260709 13:08:58.961007 20550 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.961514 20550 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.963639 20550 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:08:58.969769 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.716s	user 0.028s	sys 0.093s
W20260709 13:08:58.970110 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.716s	user 0.028s	sys 0.093s
I20260709 13:08:58.974654 20546 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:58.975172 20546 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.977495 20546 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:58.979106 20547 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.979605 20547 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.981665 20547 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:58.982122 20547 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.982549 20547 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.985220 20546 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:58.985924 20555 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.985828 20546 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:58.986523 20555 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.988464 20546 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:58.988550 20555 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:58.989455 20546 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:58.992009 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:58.991412 20547 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:08:58.990466 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.108s	user 0.017s	sys 0.010s
I20260709 13:08:58.991962 20546 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:58.992820 19366 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
W20260709 13:08:58.992978 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.110s	user 0.017s	sys 0.011s
I20260709 13:08:58.994379 20546 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:58.995923 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:58.996583 19366 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:58.992098 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:58.997875 19369 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.000924 20556 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.001480 20556 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:59.003886 19190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.900s	user 0.023s	sys 0.017s
W20260709 13:08:59.004348 19190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.900s	user 0.023s	sys 0.017s
I20260709 13:08:59.004362 20556 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.015389 20459 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.016446 20559 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.016083 20459 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.017071 20559 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.019004 20459 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.019215 20559 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.019654 20459 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.020615 20560 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.021394 20546 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.021997 20546 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.023120 20547 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.023406 20459 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.023694 20547 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.024791 20546 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.026896 20547 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.027421 20547 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.028090 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.028499 20459 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.022132 20559 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.027891 20547 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:59.030305 20559 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.032065 20547 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.032338 20559 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:08:59.029578 19866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.146s	user 0.127s	sys 0.264s
W20260709 13:08:59.033890 19866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.150s	user 0.127s	sys 0.264s
I20260709 13:08:59.021755 20560 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.034729 20556 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.035432 20546 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.035323 20556 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.036132 20559 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.036067 20546 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.036692 20559 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.037501 20556 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.038662 20547 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.039176 20547 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.040695 20459 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.040901 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.041175 20459 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.041517 19368 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.042330 20546 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.042866 20546 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.043129 20459 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.043653 20459 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.043380 20546 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.039954 20479 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.045776 20546 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.046458 20561 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.046967 20561 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.044711 20547 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.044111 20459 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.049121 20561 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.050514 20459 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.053723 20479 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.054279 19120 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 258) took 2593 ms. Trace:
I20260709 13:08:59.058986 20541 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.054695 19120 rpcz_store.cc:276] 0709 13:08:56.460893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.461021 (+   128us) service_pool.cc:224] Handling call
0709 13:08:59.054199 (+2593178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:56.691274 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:56.691879 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:56.691918 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:56.691937 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:56.692452 (+   515us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:56.692537 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:56.692566 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:56.692778 (+   212us) tablet.cc:701] Row locks acquired
0709 13:08:56.692796 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:56.692927 (+   131us) write_op.cc:270] Start()
0709 13:08:56.693027 (+   100us) write_op.cc:276] Timestamp: P: 1783602536692882 usec, L: 0
0709 13:08:56.693045 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:56.693640 (+   595us) log.cc:844] Serialized 603 byte log entry
0709 13:08:56.721759 (+ 28119us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.971281 (+249522us) write_op.cc:301] APPLY: starting
0709 13:08:57.031857 (+ 60576us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:57.150255 (+118398us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:57.162559 (+ 12304us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:57.173523 (+ 10964us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.183259 (+  9736us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:57.207988 (+ 24729us) write_op.cc:312] APPLY: finished
0709 13:08:57.243481 (+ 35493us) log.cc:844] Serialized 23 byte log entry
0709 13:08:57.256929 (+ 13448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.259702 (+  2773us) write_op.cc:454] Released schema lock
0709 13:08:57.261228 (+  1526us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:57.261562 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.261589 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":136079,"apply.run_cpu_time_us":2356,"apply.run_wall_time_us":384105,"num_ops":1,"prepare.queue_time_us":220804,"prepare.run_cpu_time_us":5339,"prepare.run_wall_time_us":10889,"raft.queue_time_us":19492,"raft.run_cpu_time_us":16518,"raft.run_wall_time_us":115122,"replication_time_us":28568,"thread_start_us":469699,"threads_started":4,"wal-append.queue_time_us":7099,"wal-append.run_cpu_time_us":7206,"wal-append.run_wall_time_us":1645035}]]}
I20260709 13:08:59.059509 20541 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.060304 20556 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.060803 20556 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.061695 20541 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.062781 20556 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.063114 20486 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.055994 20479 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.063617 20486 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.064605 20479 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.065090 20479 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.065809 20486 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.066902 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.067557 19366 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.069223 19119 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 245) took 2603 ms. Trace:
I20260709 13:08:59.069639 19119 rpcz_store.cc:276] 0709 13:08:56.476952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.480929 (+  3977us) service_pool.cc:224] Handling call
0709 13:08:59.069145 (+2588216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128802,"reported_tablets":1}
I20260709 13:08:59.072129 20556 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.072628 20556 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.077253 20479 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.077280 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.077914 20479 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.078018 19223 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:08:59.078402 20479 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.079774 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.080422 19223 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:08:59.081619 20515 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.082052 20556 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.082134 20515 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.084522 20486 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.084851 20515 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.085060 20486 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.086660 20557 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.087466 20486 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.087818 20557 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.090131 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.093119 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.095788 20480 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.096113 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.096367 20480 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.096787 19219 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:08:59.098419 20480 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.098814 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.099898 20482 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.103051 20479 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.103541 20479 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.103960 20479 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.113852 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.082621 20556 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.114621 19223 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:08:59.125654 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.127956 20564 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.128763 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.127976 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.128348 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.132812 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.133291 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.133905 19374 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:08:59.135267 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.135581 20561 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.136091 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.136381 20547 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.135396 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.136759 19366 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:08:59.136982 20459 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.136847 20547 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.137502 20459 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.138967 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.139408 20459 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.139537 19901 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.141719 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.142292 19901 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.130053 20548 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.150172 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:08:59.151189 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.856s	user 0.043s	sys 0.104s
W20260709 13:08:59.151556 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.896s	user 0.043s	sys 0.104s
I20260709 13:08:59.152871 20546 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.153018 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.153630 19365 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.153491 20546 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.155550 20546 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.155715 20547 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.155021 19218 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:59.150045 20548 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.129558 20555 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.160563 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:59.165588 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:08:59.168339 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.134925 20479 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.174391 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.196666 19901 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.100451 20482 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.130569 20556 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.176815 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.136097 20561 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.129413 20564 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.162851 20547 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:08:59.319128 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.327898 20559 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.326399 20553 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:08:59.315701 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.287356 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.218586 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:08:59.274870 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.341009 20568 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.341713 20568 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.342253 20573 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.342953 20573 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.344063 20568 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.344640 20568 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.345304 20573 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.341140 20564 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.345095 20568 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.348645 20572 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.349161 20572 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:08:59.349438 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.576s (SENT) [suppressed 1 similar messages]
I20260709 13:08:59.350037 20564 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.350966 20574 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.350625 20564 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:59.211185 20486 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.252285 20480 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.353821 20486 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.354074 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:08:59.354008 20480 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.355850 20486 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.326203 19222 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:59.215837 20552 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.216797 20479 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.166546 20555 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.290488 20459 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:59.375633 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 212010us
I20260709 13:08:59.349512 20568 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.382390 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.383320 19225 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:59.345986 20573 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.326972 20485 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:59.387634 20564 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.357236 20566 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.356933 20562 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.390405 20480 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.391279 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.379596 20459 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:08:59.392407 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 226637us
I20260709 13:08:59.356630 20561 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.317408 20563 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.404592 19225 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:59.378728 20479 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.422019 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.423561 19222 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:59.393051 20568 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.423990 20565 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.425771 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:59.396353 20573 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:08:59.369102 20552 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.392771 20557 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.328681 20553 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.420444 20459 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.353114 20574 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.400844 20567 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.403878 20564 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:08:59.454633 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 49698.9us
I20260709 13:08:59.455230 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:59.437542 20563 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.457755 20580 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.458205 20580 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:08:59.458832 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 81335.5us
I20260709 13:08:59.421957 20562 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.459031 20584 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.460104 20584 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.460037 20566 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.456372 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:08:59.485144 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.424427 20568 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.450385 20557 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.489753 19298 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:59.458561 20580 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.451905 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.461544 20559 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.456821 20564 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.483104 20587 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:08:59.522058 20557 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.421172 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.490005 20479 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.461697 20563 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.461486 19366 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:08:59.562129 20583 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:08:59.548569 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.532971 20559 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.486706 20567 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:08:59.570669 19154 debug-util.cc:398] Leaking SignalData structure 0x7b0800091c40 after lost signal to thread 18098
I20260709 13:08:59.567577 19222 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:08:59.550450 20556 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.565541 20482 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.443581 20565 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.573133 20559 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.586127 20581 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.562750 20583 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.580713 20547 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.575395 20569 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:08:59.603500 20547 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:08:59.656389 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.607429 20555 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.650347 19300 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:08:59.648502 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.661556 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.664603 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.654520 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.657532 20547 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.675377 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.651655 20581 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.677280 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.572723 20587 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:08:59.668454 20552 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:08:59.667996 19219 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:08:59.650328 20569 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:08:59.675721 20564 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.707237 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:59.877120 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.635s	user 0.004s	sys 0.014s
W20260709 13:08:59.878548 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.878355 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:59.732779 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 247333us
W20260709 13:08:59.889161 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.726675 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:08:59.925601 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.932744 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.691s	user 0.005s	sys 0.015s
W20260709 13:08:59.999135 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.024s	sys 0.020s
I20260709 13:08:59.822329 20557 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.006739 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.009039 19297 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:00.018060 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.018887 19296 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
W20260709 13:08:59.999653 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.024s	sys 0.020s
I20260709 13:08:59.878504 20568 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.846625 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:08:59.814528 20552 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.037402 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.809072 20583 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.038461 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.707412 20573 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.932391 20565 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.052577 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.054139 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.933229 20581 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:08:59.824175 20567 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:08:59.681799 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.062315 19293 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:00.063488 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.837288 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.080960 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:08:59.809442 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.087347 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.045815 20552 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.098523 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.100301 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.101092 19292 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:00.102221 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.089818 19218 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:00.090191 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.104418 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.105728 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.068647 19293 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:00.109040 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.240643 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.112145 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.165009 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:00.186053 19295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.018s
W20260709 13:09:00.171998 20580 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.675s	user 0.000s	sys 0.028s
W20260709 13:09:00.254638 19295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.017s	sys 0.022s
I20260709 13:09:00.254920 20580 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.108949 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:00.224152 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 343673us
I20260709 13:09:00.229938 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.263408 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.263815 19373 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.202289 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.115916 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.268605 19365 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.268778 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.229820 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.168948 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:00.112907 18100 debug-util.cc:398] Leaking SignalData structure 0x7b080000fb00 after lost signal to thread 19869
I20260709 13:09:00.114230 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.269551 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.269536 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:00.229012 20459 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.775s	user 0.014s	sys 0.014s
I20260709 13:09:00.238857 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:00.187098 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.019s	sys 0.072s
I20260709 13:09:00.256922 20580 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.282236 19374 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.112541 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.278004 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:00.281920 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.021s	sys 0.090s
W20260709 13:09:00.284132 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 827739us
I20260709 13:09:00.285919 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.287573 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.170751 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.273135 19902 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:00.282409 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.278502 19365 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.289880 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.288586 19374 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
W20260709 13:09:00.238380 19866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.007s	sys 0.042s
I20260709 13:09:00.283565 19223 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:00.294551 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.108839 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:00.306778 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 298889us
I20260709 13:09:00.306862 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.306448 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.268672 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.297854 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.264667 19899 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:00.310422 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.312791 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:00.305724 19866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.011s	sys 0.046s
I20260709 13:09:00.310510 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.309834 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.293859 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.316485 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.316664 20589 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.317588 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.309470 19365 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.317451 20560 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.320503 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:00.311259 20559 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.000s
I20260709 13:09:00.321815 19300 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:00.293928 19294 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:00.323408 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.325629 19373 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:00.326264 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.317248 20589 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.266919 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:00.328191 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 81637us
I20260709 13:09:00.294512 20459 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.329502 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.310423 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.337106 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.337692 19367 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.325232 20559 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.340137 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.339709 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.340137 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.352890 19899 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:00.353011 20569 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.296883 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.349983 20552 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.356186 20559 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:00.356372 20547 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.003s
I20260709 13:09:00.356606 20552 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:00.358093 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.336827 19896 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:00.421484 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.321790 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.421592 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:00.250180 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080008a320 after lost signal to thread 19157
I20260709 13:09:00.295842 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.403867 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.280376 19219 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:00.361418 20459 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:00.370500 20485 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.847s	user 0.006s	sys 0.009s
I20260709 13:09:00.370504 20487 raft_consensus.cc:993] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: : Instructing follower 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:09:00.356796 20547 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.450035 19222 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:00.374154 20562 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:00.365832 20563 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.798s	user 0.001s	sys 0.008s
I20260709 13:09:00.362012 20589 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.341281 19369 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.458498 20487 raft_consensus.cc:1081] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Signalling peer 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:09:00.435256 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:00.445500 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 149612us
I20260709 13:09:00.452415 20563 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.460028 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.463043 19122 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 154) took 3958 ms. Trace:
I20260709 13:09:00.463595 19122 rpcz_store.cc:276] 0709 13:08:56.484177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.484322 (+   145us) service_pool.cc:224] Handling call
0709 13:09:00.442006 (+3957684us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":323456}
I20260709 13:09:00.464187 19221 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:00.466411 20459 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.467016 20459 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.467568 20459 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.466346 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.473951 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.477792 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.479141 20555 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.479708 20559 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:00.480991 20559 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.481520 20559 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.482847 20555 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.495177 19217 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.494961 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.505157 20572 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.505761 20587 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.525666 19218 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.533331 20563 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.503213 20555 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.539682 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35524 (request call id 3) took 3710 ms. Trace:
I20260709 13:09:00.540920 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 952) took 1387 ms. Trace:
I20260709 13:09:00.492467 20547 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.540594 19224 rpcz_store.cc:276] 0709 13:08:56.829163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.829314 (+   151us) service_pool.cc:224] Handling call
0709 13:09:00.538758 (+3709444us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54002c86a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e32520 00007fe8d7eaf652 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:00.539387 (+   629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47581952}
I20260709 13:09:00.541571 19220 rpcz_store.cc:276] 0709 13:08:59.153280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.156110 (+  2830us) service_pool.cc:224] Handling call
0709 13:08:59.164625 (+  8515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.404470 (+239845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.420619 (+ 16149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.424456 (+  3837us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:59.437323 (+ 12867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.540309 (+1102986us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003d1b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:00.540411 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.540674 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526015104}
I20260709 13:09:00.546558 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:00.548769 19154 debug-util.cc:398] Leaking SignalData structure 0x7b0800370fe0 after lost signal to thread 19249
I20260709 13:09:00.548755 19299 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:00.551244 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1197) took 1578 ms. Trace:
I20260709 13:09:00.551837 19372 rpcz_store.cc:276] 0709 13:08:58.972777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.549527 (+1576750us) service_pool.cc:224] Handling call
0709 13:09:00.550157 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.550595 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.550643 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.550745 (+   102us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:00.550785 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.550879 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.551034 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.562970 20540 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.566370 20548 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.569844 20553 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:00.581593 19366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1216) took 1438 ms (client timeout 1882 ms). Trace:
W20260709 13:09:00.582273 19366 rpcz_store.cc:269] 0709 13:08:59.142846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.149168 (+  6322us) service_pool.cc:224] Handling call
0709 13:09:00.581111 (+1431943us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:00.581351 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268071168}
I20260709 13:09:00.586448 20536 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:00.587239 19154 debug-util.cc:398] Leaking SignalData structure 0x7b0800370560 after lost signal to thread 19324
W20260709 13:09:00.587688 19154 debug-util.cc:398] Leaking SignalData structure 0x7b0800370540 after lost signal to thread 19325
W20260709 13:09:00.589265 19154 debug-util.cc:398] Leaking SignalData structure 0x7b08003462c0 after lost signal to thread 19398
W20260709 13:09:00.590822 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080036dac0 after lost signal to thread 19927
I20260709 13:09:00.592912 20559 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.598393 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1223) took 1135 ms. Trace:
I20260709 13:09:00.612088 19368 rpcz_store.cc:276] 0709 13:08:59.462561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.462692 (+   131us) service_pool.cc:224] Handling call
0709 13:09:00.581464 (+1118772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.582090 (+   626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.582119 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.582182 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:00.582214 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.582296 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.597978 (+ 15682us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400198050. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:00.598178 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427528960}
I20260709 13:09:00.603693 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.602322 19218 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.615021 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.615995 19221 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.616530 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.616957 20559 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.617184 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.604851 20574 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.609680 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 273) took 1113 ms. Trace:
I20260709 13:09:00.602294 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.617794 19225 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:00.606488 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 968) took 1057 ms. Trace:
I20260709 13:09:00.620143 20584 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.629205 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.630530 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.621783 19901 rpcz_store.cc:276] 0709 13:08:59.496422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.496568 (+   146us) service_pool.cc:224] Handling call
0709 13:08:59.496818 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.709028 (+212210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.709069 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.709113 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:59.709155 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.609014 (+899859us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54006a68d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:00.609096 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.609408 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487441792}
I20260709 13:09:00.604106 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:00.631752 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 139596us
I20260709 13:09:00.640915 20546 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:00.641831 20546 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:00.642299 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 93308.5us
I20260709 13:09:00.644345 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.645567 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.651841 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.652391 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.652535 19225 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.653748 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.653767 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.654910 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.655138 19225 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:00.655619 19218 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.658126 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.657513 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.665737 19219 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.667337 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.668246 20553 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:00.668586 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.669104 20553 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.671836 20553 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.644268 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.673233 19217 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
W20260709 13:09:00.673789 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080036da60 after lost signal to thread 20414
W20260709 13:09:00.674331 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080036d8a0 after lost signal to thread 20474
W20260709 13:09:00.674841 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080036d780 after lost signal to thread 20488
I20260709 13:09:00.674916 19221 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:00.676045 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.680392 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.683465 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.680011 19903 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.629763 19222 rpcz_store.cc:276] 0709 13:08:59.616254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.616933 (+   679us) service_pool.cc:224] Handling call
0709 13:09:00.606156 (+989223us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54000776d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:00.606388 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795903872}
I20260709 13:09:00.685268 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.691742 19221 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:00.691851 19371 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.684002 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:00.674340 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.701246 20481 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.681602 19219 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:00.702219 20481 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.689683 20527 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:09:00.683657 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:00.678895 20556 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:09:00.705973 20556 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.706554 20556 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:00.706672 20481 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.698349 20535 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.707350 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:00.708375 20556 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.710533 20556 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.684572 20546 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.715117 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:00.715619 20332 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:00.716830 20332 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.716593 20557 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:00.717243 20332 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:00.687058 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79780.8us
I20260709 13:09:00.717937 20567 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.718417 20567 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:00.720379 20514 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:00.720834 20514 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.721232 20514 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.720647 20567 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.718410 20332 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.724952 20597 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.725674 20597 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.725837 20567 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.726225 20597 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.730361 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.731287 19901 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:00.732583 20332 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.719522 20536 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.739441 20566 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.751452 19366 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.751266 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.752244 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.746372 20530 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.760421 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:00.802996 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 104125us
I20260709 13:09:00.806414 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:00.807456 19901 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.806269 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:00.816793 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.819329 20606 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.822758 20606 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.819410 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:00.825408 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 168500us
I20260709 13:09:00.826436 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:00.824784 20585 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:00.834372 20585 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.838898 20582 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:00.839378 20582 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:00.839748 20582 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.842082 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:00.842125 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 113152us
I20260709 13:09:00.835806 20555 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.845575 20527 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:00.846036 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:00.849047 20607 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.849510 20607 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.849923 20607 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.850226 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.847131 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:00.851512 20527 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:00.816044 20536 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.858942 20557 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.859400 20557 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.859802 20557 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.861439 19224 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.864307 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:00.867256 20577 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.867162 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.867781 20577 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.868230 20577 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.882362 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.883214 19901 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:00.885092 19897 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.892575 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.893406 20561 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:00.893893 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.869257 20591 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:00.898887 20606 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.899156 20536 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.904860 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:00.899756 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.900068 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.901160 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.901595 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:00.903510 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:00.889045 20585 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.906371 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.912575 20459 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.919273 19216 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.919855 20400 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.920272 20400 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:00.920622 20400 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.921644 20459 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.922672 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:00.923612 20584 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:00.909202 20610 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:09:00.912081 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.913492 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.904800 20591 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:00.928721 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75225.3us
I20260709 13:09:00.930508 20514 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.934796 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.935487 19370 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:00.936866 20597 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.938644 20577 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.939098 20597 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.940506 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:00.940606 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.945662 19297 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:00.948096 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 131895us
I20260709 13:09:00.934103 20591 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.923870 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:00.950861 20459 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.956370 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:00.952304 20567 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.953100 20459 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.962119 20332 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.962512 20332 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.962880 20332 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.961434 20536 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.966514 20536 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.966966 20536 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.962949 20459 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.960376 20567 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.961149 20555 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:00.977039 20332 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:00.955312 20582 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:00.978291 20577 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:00.986069 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:00.986805 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:00.986944 20593 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.983963 20514 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:00.988045 20593 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:00.982957 20567 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.988525 20593 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.991205 20433 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.991614 20433 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.991990 20433 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.997911 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:00.999271 20574 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:00.999652 20574 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:00.999990 20574 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.001253 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.002141 20569 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.002499 20569 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.002810 20569 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.004383 20593 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.000403 20400 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.013751 20332 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:01.019469 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.049s	sys 0.091s
W20260709 13:09:01.019876 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.049s	sys 0.091s
W20260709 13:09:01.020403 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 691413us
I20260709 13:09:01.021762 20584 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:01.023945 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 127188us
I20260709 13:09:01.026898 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:01.027930 20557 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.030288 20557 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.032938 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:01.033736 20561 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.034183 20561 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:01.035132 20561 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.035702 20593 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.036510 20574 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.038605 20574 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.032956 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.049074 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.026429 20433 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:01.054947 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 184001us
I20260709 13:09:01.055624 19902 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.018507 20567 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.057816 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.034017 20607 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:01.068221 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47016.2us
I20260709 13:09:01.071825 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.060387 19122 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.074276 20567 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.057770 20574 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.032949 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.077271 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.072712 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.077205 20609 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.061530 20556 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.071462 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:01.082079 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.068044 20527 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:09:01.085054 20548 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.086958 20548 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.087349 20548 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.089380 19265 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.090173 20332 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.090029 20591 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.090539 20332 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:01.085762 20603 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:01.086151 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.081362 20609 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.083350 19340 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.090900 20332 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.091765 20557 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.092818 20591 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.094395 20400 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.076653 20574 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.080551 19122 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:01.095109 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.096949 20603 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.105273 20603 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.105633 20603 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.084034 20567 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.097476 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.095566 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.099848 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.107082 20400 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.096707 20527 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.107537 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.111116 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.107170 20567 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:01.099457 20557 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.100425 20574 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:01.167057 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59608.7us
I20260709 13:09:01.162267 20433 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.157755 20528 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.131855 20459 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.137645 20582 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.101260 20569 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.176139 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.124358 20514 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.111007 20332 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.177042 20597 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.098894 20609 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.099416 20577 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.177907 20597 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:01.124967 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 92095.2us
I20260709 13:09:01.178602 20597 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.178901 20557 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.179051 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.180335 20400 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.107717 20548 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.119789 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.180975 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.126943 20536 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.182188 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.182439 20548 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.180397 20582 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.117167 20527 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:01.183110 20582 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.184024 20536 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.183969 20527 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.177840 20514 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.185065 20514 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.185279 20527 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.110719 20614 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.185838 20332 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.129436 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.189484 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.121795 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.177064 20459 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.109901 20607 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.111550 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.194919 20332 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.122165 20556 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:01.196745 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 105896us
I20260709 13:09:01.160679 20555 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:01.198137 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 76443.3us
I20260709 13:09:01.149421 20483 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.190593 20569 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.193006 20528 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.195719 20548 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.201097 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.196444 20609 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:01.202200 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 72876.6us
I20260709 13:09:01.196626 20556 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.206874 19266 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.201087 20555 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.211189 20597 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.212090 20555 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.198354 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.194157 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:01.202032 20528 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.215085 20332 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.216144 20332 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.209197 20556 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.216579 20332 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.215260 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.220229 20400 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.216866 20528 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.218472 20569 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.226092 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.226890 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.228190 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.221169 20555 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.229944 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.231468 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.222295 20400 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.224951 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:01.233393 20597 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.227686 20569 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.230177 20555 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.240456 20609 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.240536 20614 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.234820 20400 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.232780 20459 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.242102 20483 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.242290 20609 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.247412 20459 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.242628 20614 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:01.248672 20459 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.249161 20609 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.247700 20483 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.252210 19897 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.242713 20555 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.248736 20614 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.238788 20567 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.254024 20332 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.241163 20569 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.251848 20483 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.254237 20546 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:01.273988 20546 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.266615 20574 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.274375 20546 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:01.275285 20546 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.275910 20574 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.268517 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.256888 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.286273 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.290926 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.291420 20613 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.291751 20433 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.291847 20613 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.292418 20613 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.293795 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.290273 20567 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.293874 20609 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.294605 20567 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.295159 20567 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.272045 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.270907 20332 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.236850 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.257668 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.277146 20546 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.277889 20514 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.279670 20603 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:01.303690 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47080.1us
I20260709 13:09:01.303313 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.273468 20555 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.295099 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.292503 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.298388 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.302049 20566 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:01.302184 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70424.4us
I20260709 13:09:01.241477 20582 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.297374 20561 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.314311 20548 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.309836 20574 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.315320 20574 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.315706 20574 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.317921 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.318681 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.319324 19297 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.321018 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.321559 19368 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.322877 20556 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.324641 20561 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.325074 20561 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:01.325420 20561 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.328225 19297 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:01.301018 20607 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.329161 20607 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.307255 20514 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.329541 20607 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.326231 20582 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.339053 20567 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.339509 20613 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.305424 20603 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.347285 19368 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:01.346890 20332 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.296123 20609 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:01.351436 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53144.2us
W20260709 13:09:01.352219 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48942.5us
I20260709 13:09:01.346063 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.342509 19371 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:09:01.343401 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.340294 20433 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.363350 20603 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.290226 20557 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:09:01.367274 20556 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.368372 20613 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.345213 20459 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.345856 20561 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.369656 20603 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:01.395864 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.365639 20536 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.382771 20483 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.402191 20557 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.384668 20459 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.403398 20483 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.404054 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.404791 19371 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.388831 20527 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:01.407490 20527 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.407876 20527 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:01.408840 20527 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.410336 20527 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.390370 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.412892 19374 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.413436 20614 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.390544 19366 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.391181 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.391599 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.417654 19369 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.419130 20607 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.392051 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.392372 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.374727 20400 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.393429 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.424808 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.425175 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.394057 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.353191 20569 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.430223 19368 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:01.430317 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 135321us
I20260709 13:09:01.430734 19365 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.401212 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.401069 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.436447 20563 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.436571 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.437232 20563 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.437417 20585 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.437687 20563 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.437841 19367 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.399542 20603 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.437412 19373 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.440481 19374 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:01.375864 20584 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:09:01.443641 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.444140 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.446509 19369 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:01.442592 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.448318 19298 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:01.455854 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.456557 19297 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:01.458804 20332 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.459389 20332 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.459821 20332 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:01.461941 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 69644us
I20260709 13:09:01.463678 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.466693 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.458288 20577 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.443087 20546 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.472568 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.482815 19294 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.484268 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.484548 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.457121 20597 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.485900 19296 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:09:01.496604 19373 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:01.486999 20607 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.487761 19297 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.498872 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.484614 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.490870 19367 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:01.447677 20614 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.484300 19292 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.498864 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.499033 20400 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.499773 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.506875 19299 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:01.464540 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.533324 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.533635 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.509928 19365 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:01.509459 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.512477 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.512646 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.512915 20459 raft_consensus.cc:993] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: : Instructing follower 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:09:01.513031 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.513242 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.515537 19291 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:01.516106 19294 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:01.516597 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.491364 20567 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.518266 20561 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.543357 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.519543 20528 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.522315 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:01.525790 20569 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.526317 20555 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:01.463508 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94205us
I20260709 13:09:01.517086 19293 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:01.537765 19373 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.539181 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.540771 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.546984 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:01.547236 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.542440 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.549353 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.549480 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.554086 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.542254 20614 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:01.554404 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.556200 19369 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:01.570300 19216 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:01.570935 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.571184 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.571560 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.572364 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.572536 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.572707 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.573248 19217 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:01.573762 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.574056 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.574360 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.575450 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:01.575683 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.554850 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.576982 19219 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:01.580313 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.580106 20574 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.548954 20613 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.581595 19300 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.582417 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:01.581466 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.583338 19223 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:01.583623 19220 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.581569 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.588479 19223 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.589699 20574 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.590910 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.592258 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.593474 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.593849 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.594719 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.595091 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.596108 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.596279 20619 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:09:01.597373 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.551398 20557 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:09:01.598726 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.608533 20569 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.609148 20556 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.609593 20556 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.610674 20556 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.613116 20619 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.613662 20619 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.614787 20619 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.616917 19901 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.602023 19298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41704
I20260709 13:09:01.619297 19298 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:01.551069 20591 raft_consensus.cc:1081] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Signalling peer 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:09:01.625504 19295 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:01.604925 19292 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:01.600879 20618 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:01.619760 19298 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.620335 19299 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:01.574162 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:01.634169 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.572396 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.541741 19371 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
W20260709 13:09:01.637353 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 112569us
I20260709 13:09:01.638343 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.640740 20332 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.639734 20574 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.644692 20619 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.642650 20582 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.644532 20574 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.641357 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.646373 19223 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:01.649055 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.648677 20332 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:01.654603 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 105292us
I20260709 13:09:01.659096 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.632251 20556 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.666857 19223 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:01.666923 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94611.4us
I20260709 13:09:01.636662 19222 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.669193 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:01.671792 19367 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:01.636009 20433 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.625144 20613 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.675467 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.636075 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:01.676638 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.678598 19368 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.678550 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.644554 20614 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:01.677132 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.664635 20591 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.667788 20561 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:01.645447 20582 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.677708 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.679345 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.679477 20569 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.681224 20591 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.703461 19219 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:01.766317 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:01.766494 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.764377 20628 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.766760 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.740548 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:01.767823 20566 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.768409 20566 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:01.690882 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:01.725091 19296 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:01.690491 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:01.765245 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 88185.5us
I20260709 13:09:01.764532 20569 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.746713 19220 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:01.767150 19372 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:01.764796 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 85522us
I20260709 13:09:01.682425 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.721381 19298 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.719342 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:01.779932 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.775730 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.718072 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:01.682536 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70804.2us
I20260709 13:09:01.673903 20597 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.765700 20591 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.784921 19373 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.3-2.3]
W20260709 13:09:01.780617 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 89843.2us
I20260709 13:09:01.781056 19223 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:01.781452 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 63470.4us
I20260709 13:09:01.780728 19296 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:01.786237 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:01.786499 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.787352 20577 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.788723 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.792775 19298 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.751433 20528 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:01.688573 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.729349 20614 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.796018 20574 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.769358 20566 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.796658 20574 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.796852 20614 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.797477 20614 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.797945 20614 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.798730 19291 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:01.693832 20555 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.674772 20483 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.111s
I20260709 13:09:01.811018 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.750149 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:01.809629 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:01.812937 19225 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.771878 20626 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.763769 20627 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.782577 20606 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.818959 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:01.750622 20609 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:09:01.822434 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:01.786089 20628 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.730895 20613 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.681530 20548 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:09:01.828676 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.694561 20603 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.695384 20433 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.831727 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:01.808650 20597 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.808976 20555 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.812242 20546 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.799748 20593 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.691169 20563 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:09:01.865029 19367 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.836496 20577 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.834718 20607 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.798928 20614 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.813741 20574 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:09:01.838414 20626 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.868518 20546 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:01.867983 20555 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.883127 19367 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.841868 19294 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:09:01.884783 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 109173us
W20260709 13:09:01.879920 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48271.9us
I20260709 13:09:01.886487 19221 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:01.845041 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:01.879436 20593 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.895455 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:01.895859 20332 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.896297 20332 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:01.887096 20546 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.892031 20585 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.910640 20332 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:01.912640 20620 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:01.893988 20577 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.940440 19373 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.944178 19224 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:09:01.942135 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:01.954350 19868 leader_election.cc:336] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.576s (SENT)
I20260709 13:09:01.941670 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:01.945667 20563 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.931428 20607 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:09:01.983176 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.983600 20607 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:01.979116 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 193484us
I20260709 13:09:01.942986 20536 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:01.980865 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:01.983960 20607 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:01.985157 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:01.953315 20582 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:01.987378 19369 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.926434 20628 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.934571 20626 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:01.987170 20536 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.000504 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:01.995543 19222 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:02.001973 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.007376 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.009763 20641 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.010341 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.010468 20641 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.010954 19367 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:02.009850 19369 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:01.998824 20603 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:02.023295 19365 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:02.003153 20613 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.029767 19292 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.036037 19372 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:02.037711 20555 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.005120 20634 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:02.058530 20634 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:02.058914 20634 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.997886 20629 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.056344 19365 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.058130 20555 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.026553 20607 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:02.054916 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 268781us
W20260709 13:09:02.054908 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54472us
I20260709 13:09:02.066184 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.071565 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.073065 19365 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.078320 19369 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.062291 20593 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:01.902701 20625 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:02.078986 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:02.066310 20629 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.073889 20555 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:02.090348 20649 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.099361 19372 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.100860 19292 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.103156 20630 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.103541 20630 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.064042 20536 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.079663 20582 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:09:02.091145 19365 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:02.173445 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.129076 20528 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.320578 20528 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:02.104374 20630 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.321488 20528 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.321980 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:02.322989 19221 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:02.237628 19900 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.324087 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:02.324862 19224 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.326221 19291 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.129603 20629 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.327293 20585 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:02.311261 20607 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.328297 20585 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.315941 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:02.328492 20648 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:02.328788 20585 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:02.329284 20591 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.002s
I20260709 13:09:02.329088 20648 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.329663 20591 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.126884 20483 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.331106 20483 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:02.344244 19224 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:02.152760 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.340526 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:02.348376 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 276864us
I20260709 13:09:02.361805 19298 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:02.357431 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 245170us
W20260709 13:09:02.361126 19868 leader_election.cc:336] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.825s (SENT)
I20260709 13:09:02.459266 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.363243 19221 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:02.185925 20619 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:09:02.128669 20433 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.366503 19122 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 155) took 1403 ms. Trace:
I20260709 13:09:02.117018 20555 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.463567 20555 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.463212 20483 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.464434 20555 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.465869 20591 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.467056 20636 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:02.467337 19370 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.237270 20635 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.366519 20561 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.324127 20528 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:02.460819 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 120359us
W20260709 13:09:02.360667 20400 consensus_queue.cc:1175] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:09:02.235257 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:02.462268 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:02.235597 20634 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.293390 19897 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:02.472191 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.476131 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.499644 19370 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:02.477905 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.230762 20584 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.231s
I20260709 13:09:02.461690 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.462342 20628 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.463091 20606 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.469201 20514 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.490712 20603 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:02.493013 20557 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:02.495000 20546 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
W20260709 13:09:02.531127 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53303.5us
I20260709 13:09:02.532037 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.500614 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.504254 20332 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:02.504961 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.473371 20635 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.512408 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.509855 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.329625 20585 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.537636 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.541695 19373 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.509773 20561 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.514046 19372 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:02.473762 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:02.497999 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 136904us
I20260709 13:09:02.536021 19369 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.513335 20627 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.512328 20593 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.542704 19265 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.542652 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.544876 19365 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:02.530059 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.559873 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.512290 20606 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:02.561411 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.561121 20606 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.562907 19371 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:02.568313 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.569464 19222 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:02.569519 19121 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 257) took 1509 ms. Trace:
I20260709 13:09:02.570060 19121 rpcz_store.cc:276] 0709 13:09:01.060040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.064058 (+  4018us) service_pool.cc:224] Handling call
0709 13:09:02.569362 (+1505304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459729,"reported_tablets":2,"spinlock_wait_cycles":73600}
I20260709 13:09:02.571295 20561 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.572356 19372 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.572638 19119 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 259) took 1030 ms. Trace:
I20260709 13:09:02.547861 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.572819 20483 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.573040 20638 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:02.532305 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 297134us
I20260709 13:09:02.573002 19119 rpcz_store.cc:276] 0709 13:09:01.546642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.552959 (+  6317us) service_pool.cc:224] Handling call
0709 13:09:01.746704 (+193745us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:02.572460 (+825756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104147,"reported_tablets":1,"spinlock_wait_cycles":198753152}
W20260709 13:09:02.574772 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.535059 20514 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.528918 20557 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.576517 20557 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.577482 20557 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.577567 19372 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.551129 20620 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:02.579802 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.540879 19219 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.572073 19366 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.532112 20603 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.541184 20628 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.584256 19367 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:02.587025 20603 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:02.588289 20620 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.581375 19223 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
W20260709 13:09:02.590322 19868 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.877s (SENT)
I20260709 13:09:02.588416 20593 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.590755 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:02.592188 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49541.6us
W20260709 13:09:02.591503 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58321.6us
I20260709 13:09:02.593117 19373 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:02.594431 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.595925 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.596935 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.599112 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:02.602243 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52495.7us
I20260709 13:09:02.538857 20546 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.605798 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.597448 20614 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.613404 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.604660 20628 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.616489 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.619877 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.623426 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.605434 20603 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.463251 19122 rpcz_store.cc:276] 0709 13:09:00.959056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.959280 (+   224us) service_pool.cc:224] Handling call
0709 13:09:02.362135 (+1402855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:01.254652 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:01.268725 (+ 14073us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:01.268782 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:09:01.268814 (+    32us) tablet.cc:662] Decoding operations
0709 13:09:01.269479 (+   665us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:01.269562 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:01.269593 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:01.269973 (+   380us) tablet.cc:701] Row locks acquired
0709 13:09:01.270019 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:09:01.270164 (+   145us) write_op.cc:270] Start()
0709 13:09:01.270312 (+   148us) write_op.cc:276] Timestamp: P: 1783602541270111 usec, L: 0
0709 13:09:01.270348 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:09:01.284857 (+ 14509us) log.cc:844] Serialized 989 byte log entry
0709 13:09:01.522859 (+238002us) op_driver.cc:464] REPLICATION: finished
0709 13:09:01.694676 (+171817us) write_op.cc:301] APPLY: starting
0709 13:09:01.694796 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:01.694983 (+   187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:01.716296 (+ 21313us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:01.742487 (+ 26191us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb232a 00007fe8d7e37f14 00007fe8d7e37ec3 00007fe8d7e37e38 00007fe8d7e37df3 00007fe8d7e370dc 00007fe8d7e60e16 00007fe8d7e48cbb 00007fe8d7e3339d 00007fe8d7e36d75
0709 13:09:01.881660 (+139173us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:01.881996 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:01.882108 (+   112us) write_op.cc:312] APPLY: finished
0709 13:09:01.882445 (+   337us) log.cc:844] Serialized 29 byte log entry
0709 13:09:01.882655 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:01.882748 (+    93us) write_op.cc:454] Released schema lock
0709 13:09:01.882806 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:01.883202 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:01.883238 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":152116,"apply.run_cpu_time_us":3710,"apply.run_wall_time_us":188500,"num_ops":2,"prepare.queue_time_us":120100,"prepare.run_cpu_time_us":12905,"prepare.run_wall_time_us":135786,"raft.queue_time_us":20918,"raft.run_cpu_time_us":38843,"raft.run_wall_time_us":235820,"replication_time_us":252353,"spinlock_wait_cycles":24479104,"thread_start_us":266253,"threads_started":4,"wal-append.queue_time_us":137294}]]}
I20260709 13:09:02.624529 20593 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.632988 19225 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.614477 20548 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:02.615509 20644 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.615772 20627 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.618475 20653 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.620088 20649 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.655438 19225 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.656193 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:02.656724 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.657044 20514 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.657477 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.658221 20514 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.622227 20658 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:02.660135 19868 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.925s (SENT)
I20260709 13:09:02.650389 19217 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:02.660319 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74729.2us
I20260709 13:09:02.595750 20620 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.619745 20635 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.676017 20635 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.660219 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.680876 19225 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.680826 20627 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.681483 20483 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.682248 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.684226 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:02.666425 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.670310 20546 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.672428 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.685868 20660 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.686357 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:02.686511 20625 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.001s
I20260709 13:09:02.686621 20660 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:02.687757 20653 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.673393 19220 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:02.693449 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.651721 20613 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:02.651429 20659 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.661803 20597 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.688081 20653 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.713084 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.714084 19373 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:02.660001 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:02.688100 19294 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:09:02.730131 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:02.699751 20584 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:09:02.715631 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.688782 20649 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.709520 20483 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.738627 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:02.739214 19223 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.739001 20649 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.742517 19368 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.743469 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.745976 20648 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:02.667042 20644 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:09:02.719045 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.719610 20634 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:02.753907 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.720394 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.722803 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.724473 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.725484 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.710964 20628 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.726056 20536 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.710777 20613 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:02.736312 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.736195 19218 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:02.737057 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.746201 19901 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.748440 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:02.776417 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:02.776822 19368 raft_consensus.cc:1813] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Handling vote request from an unknown peer 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.777153 19903 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:02.777401 19368 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:09:02.748703 19374 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:02.756471 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.747437 20585 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.761543 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.768637 19299 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.772754 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.786692 19296 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:02.787662 19297 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.788836 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.790066 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.749375 20483 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:02.776515 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.778316 19295 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:02.779021 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:02.804126 19218 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.804468 19218 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.789008 19297 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:02.774084 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.785368 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.779677 20528 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:02.793883 20653 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.795626 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.832954 19299 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:02.799306 19366 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:02.799923 19372 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:02.835906 19219 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.836616 19366 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.836891 19372 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.837054 19219 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.800459 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.837864 19366 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:02.838680 20584 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:02.839036 19219 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.773068 19369 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:02.810261 20514 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.807907 20400 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:02.839534 19221 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.839860 20514 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:02.807080 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56657.9us
I20260709 13:09:02.841378 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.810822 20528 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.841662 20636 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:02.841985 20514 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:02.843286 20528 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:02.756313 19223 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:02.845096 20546 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:02.845352 20620 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.811419 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.845546 20636 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:02.811583 20666 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:02.813392 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:02.813396 20662 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:02.814927 19294 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 3. Ops: []
I20260709 13:09:02.815578 20566 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:02.852983 20528 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:02.858103 20566 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.858511 20566 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.859423 20566 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.860646 20566 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.860852 20633 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:02.817340 20651 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.861850 20651 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.818310 20606 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.818138 20483 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.820477 20613 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.820945 19297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de803894748b488d81cb5c7007c78cce"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41704
I20260709 13:09:02.876292 19297 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.876648 19297 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.823077 20630 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.824378 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.809770 19218 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.882705 19218 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.791114 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.827013 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.828207 19291 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.828819 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:02.830785 19222 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.833009 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.810699 20634 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:02.812520 20664 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:02.895951 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.896440 20613 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:02.897521 20649 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.848187 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:02.897931 20649 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.897831 20607 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:02.898646 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.899358 20607 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.899665 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.900382 20638 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.897161 19266 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.900730 20638 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:02.846650 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.901825 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.851212 19295 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.845754 20620 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.850243 20644 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:02.848744 19292 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:02.848922 20400 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:02.856156 20653 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.856472 19225 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:02.846050 20636 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.866631 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.867187 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:02.872829 19298 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.870055 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.891884 19218 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:02.892810 19217 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:02.893411 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:02.897429 20613 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:02.844455 19223 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.936847 19223 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:02.899709 20607 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:02.868337 20633 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.848201 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:02.941350 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:02.941953 19296 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:02.905229 19300 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:02.905588 20638 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.906463 20567 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.906957 20639 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:02.907274 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.909638 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:02.943115 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:02.946360 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 256653us
I20260709 13:09:02.940577 19297 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.883404 20635 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:09:02.950316 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83749.2us
W20260709 13:09:02.951280 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.951894 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:02.910765 20629 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:02.910614 20400 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:02.934314 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:02.957823 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50658.3us
I20260709 13:09:02.937578 20613 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:02.955104 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 85143.1us
I20260709 13:09:02.959829 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:02.956617 19297 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:02.898846 20649 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.948556 20614 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.882426 20627 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:09:02.953063 19223 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:02.962087 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:02.963173 20433 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:02.963567 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.984104 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.941218 20651 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:02.984786 20651 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.955868 20528 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:02.966090 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:02.941715 20633 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:02.961277 20332 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.949770 19294 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:02.974918 19218 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:02.965960 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:02.960641 20603 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:02.960793 20597 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:02.956532 20648 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:02.946959 20569 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:09:02.953816 20629 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:02.986735 19370 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:09:03.044894 19295 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:09:03.045192 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71650.8us
I20260709 13:09:03.046085 19365 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:03.051450 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.953969 20582 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:09:02.953321 20620 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.040375 20584 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:09:03.153586 19218 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:03.158595 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 202880us
W20260709 13:09:03.162124 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 196232us
I20260709 13:09:02.970997 20557 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.151s
I20260709 13:09:02.967118 20613 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.968704 19900 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
W20260709 13:09:03.117553 20668 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:03.033584 20561 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 13:09:03.049288 20638 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.968144 20607 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.048965 20614 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.049081 20649 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:03.233837 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.254456 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.254885 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.235049 20332 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.118149 20591 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:09:03.220705 20597 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.219832 20629 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.246750 19368 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:03.248572 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.152606 20628 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:09:03.121970 20636 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.249565 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:03.255669 20332 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.232460 20635 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:03.238788 20620 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.252027 20585 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.281872 19369 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.261511 20569 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:03.262809 20597 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.262980 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:03.266268 20433 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.290805 20332 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.236279 20400 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.294705 20433 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:03.289420 20663 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:09:03.285616 20569 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:03.302778 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.308422 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.286367 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50982.1us
I20260709 13:09:03.296204 19371 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.309846 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:03.311937 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:03.326176 20648 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.283676 20585 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.289240 20635 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.332700 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:03.333590 20459 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.334091 20459 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.334553 20555 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:03.335021 20459 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.335944 20555 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:03.336452 20555 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.337419 20555 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.339053 20555 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.339972 20591 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:03.341437 20676 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:03.341955 20676 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.343003 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:03.342856 20676 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.342900 20591 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:03.344393 20676 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.344384 20591 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:03.345113 20591 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.355548 20569 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.346166 20591 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:03.331029 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.365291 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 83343.3us
I20260709 13:09:03.378175 20681 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:03.381357 19368 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:03.384387 20483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.022s
I20260709 13:09:03.356953 20569 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.399066 20678 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 13:09:03.384821 20483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.002s	sys 0.022s
I20260709 13:09:03.385522 20557 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.382483 20644 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.392036 20566 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.001s
I20260709 13:09:03.382403 20591 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.411216 19374 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.308449 20674 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:09:03.330116 20614 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.414059 20644 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.421671 20683 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:03.422266 20669 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:03.411691 20557 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:03.431430 20634 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.001s
I20260709 13:09:03.450906 20635 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.451141 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:03.434455 19374 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:03.451259 20670 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:09:03.451268 19219 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:03.474776 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:03.475574 19370 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:03.442025 20557 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.447748 20648 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.463896 20634 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:03.472831 20433 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.487848 20597 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.463889 20603 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.472841 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.471077 19366 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:03.508904 19221 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:03.497491 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:03.470306 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.499042 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 156096us
I20260709 13:09:03.512871 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:03.516902 20634 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:03.500560 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 98546.9us
I20260709 13:09:03.504917 20644 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:03.505493 20685 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:09:03.518246 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:03.521649 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 163076us
I20260709 13:09:03.520550 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:03.523701 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:03.525029 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.509200 20585 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:03.526633 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:03.529997 19225 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:03.527956 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:03.528446 20593 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:03.537904 19191 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:03.538219 20685 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.538836 20685 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.539459 20685 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.502429 20557 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:03.533293 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:03.528218 19219 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:03.537400 20690 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:03.513451 20433 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.546988 19220 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:03.496565 20648 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.511186 20603 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.544688 20644 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.548382 20433 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.547060 20694 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:03.569041 20433 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.590853 20689 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.569293 20644 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.595510 20626 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:03.620781 20626 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.608103 20648 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:03.611311 20651 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 13:09:03.621740 20626 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.623052 20626 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:03.596390 20653 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.003s
I20260709 13:09:03.598984 20557 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.626086 20630 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 13:09:03.616443 20597 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.618122 20603 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:03.617944 20644 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.600698 19371 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:03.642015 20557 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.593158 20694 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.655680 20557 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.600108 20613 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.659063 20694 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:03.656278 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:03.659276 20698 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:09:03.606927 20629 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.660312 19900 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.662434 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:03.668884 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:03.662606 20613 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.669601 19367 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:03.670158 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:03.666067 20630 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.678103 20698 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.678666 20698 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.680913 20630 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.684140 20698 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.684877 20630 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.685817 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:03.686982 20620 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.687448 20620 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.690830 20629 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.693769 20620 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.690465 20614 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:03.693975 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.697754 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:03.695920 20614 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.701939 20614 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.703179 20685 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.705806 20685 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.706892 20433 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.708984 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:03.709522 19367 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.571893 19216 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.720288 19367 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:03.721894 19900 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:03.723548 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1280) took 1554 ms. Trace:
I20260709 13:09:03.723860 19365 rpcz_store.cc:276] 0709 13:09:02.168753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.559602 (+390849us) service_pool.cc:224] Handling call
0709 13:09:03.723436 (+1163834us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400197b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:03.723508 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974398336}
I20260709 13:09:03.725176 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:03.726178 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:03.728708 20626 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:03.729231 20626 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.730044 20626 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.733072 20433 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.734229 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:03.734858 20630 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:03.734866 19365 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.736474 20630 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.737339 20630 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.743098 19365 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:03.744553 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:03.745476 20626 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:03.746021 20626 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:03.746896 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:03.746829 20626 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.757602 20548 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:03.758494 19222 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.758360 20548 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.762300 20548 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.763358 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:03.764029 19900 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:03.773656 19223 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.777475 20625 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:03.777880 20625 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.778635 20625 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.780184 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:03.790231 20548 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:03.790373 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:03.791450 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.783389 20683 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:03.783200 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 245388us
I20260709 13:09:03.795120 20682 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:03.796175 20682 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.791085 20698 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.797827 20698 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:03.798199 20698 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.800053 20682 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:03.801399 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:03.780134 20625 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.802194 19900 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:03.784533 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:03.790748 20548 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:03.807024 19223 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.807518 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1316) took 1047 ms. Trace:
I20260709 13:09:03.808472 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:03.809839 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:03.805002 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:03.812299 20593 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.812947 20593 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.807755 19223 rpcz_store.cc:276] 0709 13:09:02.759686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.844055 (+ 84369us) service_pool.cc:224] Handling call
0709 13:09:02.844305 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.773257 (+928952us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b58002702d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:09:03.807273 (+ 34016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.807454 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136845056}
I20260709 13:09:03.814121 20648 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:03.843477 20648 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.811867 20634 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:03.823846 19222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:35524
I20260709 13:09:03.820387 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:03.966574 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 149605us
I20260709 13:09:03.967693 20682 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:03.813779 20593 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.803719 20548 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.845677 20698 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.208979 20698 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:03.856478 20636 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:03.859678 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:04.212899 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 353278us
I20260709 13:09:03.869500 19218 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.214021 19218 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:03.888043 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.217062 19372 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:04.217456 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.219188 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:03.889145 20639 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:03.900321 20633 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:03.929744 19224 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:03.843943 20648 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.221166 20676 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.221686 20676 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:03.964457 20634 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:03.964471 19222 raft_consensus.cc:606] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:09:04.011183 20685 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.224385 20546 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:04.224193 20685 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.224792 20546 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:04.011211 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.050354 20630 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.225849 20546 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.226649 20630 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.227033 20546 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.055058 19374 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.055586 19369 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.048449 20675 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.077662 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.228233 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.228456 20675 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.081513 19119 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 2 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:04.089236 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.219862 20639 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:04.080070 20694 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:04.232550 20639 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.233230 20694 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.234365 19295 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.223730 20689 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:04.235311 20689 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:04.235590 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.236341 19222 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.104571 20597 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:04.237157 20634 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.237501 20597 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.114604 20660 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:04.239027 20660 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.239424 19224 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:04.116324 20682 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.240433 20584 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:04.241050 20682 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.120172 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:04.242081 19895 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.242872 19900 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:04.245447 20720 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:04.129400 19897 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:04.246052 20694 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.246626 20720 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.247156 20630 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.247756 20597 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.130185 20400 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.248812 20720 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.249167 20660 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.056329 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:04.155424 20658 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:04.251187 20658 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:04.151870 20433 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.252173 20658 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.252432 20433 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.164465 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.253805 20720 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.254305 20720 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.254582 20433 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.166100 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.254889 20682 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.255515 19373 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:04.127081 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.189906 20606 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:04.167143 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.255892 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.256152 20720 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.184669 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.256560 19294 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:04.224880 20659 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.256907 19903 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.257298 20659 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.259469 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.228947 19374 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:04.233620 20639 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.260744 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.236593 19119 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.245538 20685 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.123658 19122 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.262290 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.261976 19119 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.262249 19122 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.256273 20606 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.265061 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.189906 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.266222 20606 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.263876 19122 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.266644 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.267360 19122 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.268050 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.269315 20675 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.268887 19122 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.269497 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.270277 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.270648 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.270944 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:04.267508 20689 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.271552 19292 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.273469 19222 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:04.273921 20720 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:04.274207 20626 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:04.274452 20720 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.274798 20626 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.276057 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.276404 20630 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.276520 20720 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.276937 20630 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.277070 20720 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:04.277736 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.278383 20720 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:04.278849 20630 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.279345 20630 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:04.270396 19122 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 3, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.280283 20659 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.246637 20694 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:04.090206 20674 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.280756 19122 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 3, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.281432 20694 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.281729 20674 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.283707 20694 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.112892 20607 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.266235 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:04.283926 20674 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.306828 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:04.270992 19224 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.193177 20514 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.061715 20528 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:04.195433 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.296532 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.314718 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.288733 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:04.260298 19294 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:04.317916 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.319109 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.327788 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:04.310837 20459 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.329710 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.330356 19901 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:04.330571 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.325678 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.333961 19373 raft_consensus.cc:2368] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:04.306068 20635 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.219871 19372 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:04.318028 20658 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.335369 19218 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.310868 20698 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.311195 20675 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.354126 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1321) took 1385 ms (client timeout 1794 ms). Trace:
I20260709 13:09:04.305614 20682 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.281435 20626 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.342299 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.378616 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.317292 20593 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.321836 20625 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.330446 20555 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.345707 20690 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:04.354575 19218 rpcz_store.cc:269] 0709 13:09:02.960534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.961843 (+  1309us) service_pool.cc:224] Handling call
0709 13:09:03.869104 (+907261us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002c86a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e3306f 00007fe8d7eabf60 00007fe8d7ead7de 00007fe8d7eb927c 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2
0709 13:09:04.346302 (+477198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676104576}
I20260709 13:09:04.311427 20591 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:09:04.373112 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.373556 19292 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:04.374990 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.375771 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:04.333256 20713 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.375860 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.376552 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.379982 19903 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:04.379244 19299 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.380683 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.331657 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.382315 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.430373 19223 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:04.383023 19224 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:04.381410 20635 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:04.433086 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44731.8us
I20260709 13:09:04.384207 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.389716 19297 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:04.389796 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.326196 20597 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:09:04.391629 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.322652 20528 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.317940 20514 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.352021 20698 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.393486 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.428478 19869 leader_election.cc:400] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:04.445001 19869 leader_election.cc:403] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:04.429184 19300 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:04.341110 20459 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:04.432751 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 159078us
I20260709 13:09:04.433792 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:04.434269 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 131046us
I20260709 13:09:04.443713 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:04.430548 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47356.1us
I20260709 13:09:04.447474 19370 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.437326 19218 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:04.439631 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.391242 20628 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:04.429806 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.469256 19294 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:04.469151 20628 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.470171 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.471235 20628 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.472113 20674 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.472581 20674 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.474395 20674 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.474835 20674 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:04.380403 20648 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:04.449472 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70871.9us
I20260709 13:09:04.452754 20644 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.477483 20648 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.477365 20644 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.478132 20459 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.479492 20644 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.453504 20609 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.453718 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.454465 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.480468 19372 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.481114 19371 raft_consensus.cc:2410] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:04.482055 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.482678 19371 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.482746 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.483428 19372 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.483601 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.455008 20685 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:04.484079 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.484670 19372 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.434710 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.485769 19219 raft_consensus.cc:2376] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2. Re-sending same reply.
I20260709 13:09:04.486773 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.487501 19219 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:04.457001 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.488811 19369 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.457753 20701 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:04.489126 20659 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.489711 20701 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.490195 20659 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.491055 20528 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.491873 20701 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.428777 20433 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:04.386759 20650 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:09:04.462313 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.498242 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:04.448089 20698 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.462985 20582 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:04.464815 19895 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:04.467290 19868 leader_election.cc:336] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.591s (SENT)
I20260709 13:09:04.452881 20483 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.448536 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.439402 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.448009 20625 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:04.439065 19898 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:04.448760 19901 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:04.505885 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 57962.1us
I20260709 13:09:04.459465 20514 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.492179 19897 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:04.484707 19220 raft_consensus.cc:2376] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2. Re-sending same reply.
I20260709 13:09:04.380923 20675 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.494263 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.477367 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.481309 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.393693 20555 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.504256 20400 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:04.499325 19221 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:04.383984 20593 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.501021 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:04.480294 20459 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.496094 20633 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.444586 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.498061 20609 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.509583 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:04.568646 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 59116us
I20260709 13:09:04.570106 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:04.503726 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.387787 20682 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.536362 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.475265 20674 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.520103 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.504815 20701 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.563819 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.565411 19903 raft_consensus.cc:2410] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:09:04.565779 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64822.1us
I20260709 13:09:04.515184 20585 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.505422 20483 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.506387 20625 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.568094 20514 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:04.566660 20718 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.558451 20722 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:04.568130 20639 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.560354 20659 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:04.570801 20702 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:04.561694 20713 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.580075 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.604288 20634 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:09:04.653623 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.655232 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.582617 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:04.591823 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.595052 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:04.656805 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 61844.6us
I20260709 13:09:04.597972 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:04.574865 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.599489 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.604103 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:04.657963 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75482.4us
I20260709 13:09:04.588944 20674 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.586908 19224 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:04.638388 20701 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.639010 20606 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.660490 20658 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.605407 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.662474 20644 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.590305 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.604789 19296 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:04.646171 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:04.663028 20644 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.663748 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:04.662528 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.665149 20644 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.665369 19224 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.665755 20722 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.666159 20722 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.666519 20722 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.670898 20483 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.671295 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:04.604957 20400 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:09:04.574561 19899 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:04.673259 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.674933 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.651813 20514 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:04.675981 19217 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:04.677379 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.677186 20514 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.678129 19217 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.679323 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.643031 20726 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.680507 20726 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.682819 20726 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.682340 20713 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.643185 20636 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.592103 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.574632 20459 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:09:04.574746 20720 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.577735 20593 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.577831 20676 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.585574 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.576225 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.587201 20682 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.580153 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:04.593173 19894 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:04.591388 19897 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.592439 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.598126 20660 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:04.657850 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59954.3us
I20260709 13:09:04.680016 19217 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:04.590629 20555 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.659502 19223 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:04.659504 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:04.736953 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77531.4us
I20260709 13:09:04.639050 20633 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.584249 19371 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:04.604418 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.604724 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:04.745698 19298 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.579878 20649 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.688618 20636 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.686415 19221 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.645920 20685 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:04.586617 20698 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.688767 19300 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 2: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:04.594148 20433 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:09:04.574416 20609 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.640599 20585 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.685501 20659 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.710616 20682 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.650708 20639 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.686800 20674 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.711083 19895 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.690434 20720 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.695611 20584 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.693992 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.724853 20606 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:04.726434 20713 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.770161 20606 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.726665 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.767830 20720 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.727725 20625 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.687034 20701 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.712836 20730 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.778486 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:04.762310 20729 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.784832 20729 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.787180 20729 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.768097 20584 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.761463 20659 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.768132 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.736069 19367 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:04.747999 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.818013 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.734416 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:04.781665 20730 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.749485 19368 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.751121 19224 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:04.729218 20718 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:04.820045 20718 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.753572 19373 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:04.820465 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.755492 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:04.758478 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:04.731763 19294 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.749863 20483 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.749435 20727 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:04.750435 20649 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:04.788686 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.769922 20728 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:09:04.769383 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:04.779884 19216 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:04.787909 20584 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.761205 20685 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.732901 19374 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:04.792575 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.731961 20660 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:04.800086 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48227.2us
I20260709 13:09:04.750588 20633 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.818434 20729 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.809676 19895 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:04.809186 20433 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.818624 19223 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.582165 20675 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.574039 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:04.821750 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66362.7us
I20260709 13:09:04.782258 20698 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.785789 20636 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.825657 20735 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.827252 20730 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.832865 20649 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.840368 20644 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.810618 20609 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:04.812863 20659 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.831789 19224 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:04.917320 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 313254us
W20260709 13:09:04.829797 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 95447.5us
W20260709 13:09:04.848374 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 190864us
I20260709 13:09:04.856978 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:04.867014 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.921049 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64213us
I20260709 13:09:04.921706 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:04.869448 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:04.922816 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53450.2us
I20260709 13:09:04.923182 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.923480 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:04.830348 20727 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.924680 20727 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:04.870468 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 296593us
I20260709 13:09:04.925536 19224 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.925702 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.921968 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:04.926211 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:04.827822 20606 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.827739 20701 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:04.856009 19246 debug-util.cc:398] Leaking SignalData structure 0x7b080010c9e0 after lost signal to thread 18098
I20260709 13:09:04.878257 20555 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.877224 20433 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.909490 19221 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.928972 20738 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.929013 20735 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.912320 20591 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:04.937497 20591 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:04.940249 20614 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.938656 20591 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.942765 20606 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.929474 20628 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.943620 20591 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.930433 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.944653 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:04.945560 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:04.946127 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:04.946920 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:04.933380 19246 debug-util.cc:398] Leaking SignalData structure 0x7b0800136ca0 after lost signal to thread 19157
I20260709 13:09:04.931608 19217 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:04.949376 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:04.949535 19246 debug-util.cc:398] Leaking SignalData structure 0x7b08003b33e0 after lost signal to thread 19249
W20260709 13:09:04.949975 19246 debug-util.cc:398] Leaking SignalData structure 0x7b08003b33c0 after lost signal to thread 19250
I20260709 13:09:04.947777 20636 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:04.950878 20636 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:04.951517 19246 debug-util.cc:398] Leaking SignalData structure 0x7b08003759a0 after lost signal to thread 19324
I20260709 13:09:04.951794 20636 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:04.957778 19216 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.958889 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:04.959467 19216 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:04.951934 19246 debug-util.cc:398] Leaking SignalData structure 0x7b08003759c0 after lost signal to thread 19325
I20260709 13:09:04.960230 20698 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:04.960693 20698 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:04.961068 20698 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:04.961556 19246 debug-util.cc:398] Leaking SignalData structure 0x7b08002b68c0 after lost signal to thread 19398
W20260709 13:09:04.963145 19246 debug-util.cc:398] Leaking SignalData structure 0x7b080010d220 after lost signal to thread 19927
W20260709 13:09:04.963514 19246 debug-util.cc:398] Leaking SignalData structure 0x7b08001974c0 after lost signal to thread 19928
I20260709 13:09:04.955874 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:04.964326 19898 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:04.968252 19219 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:04.968436 20728 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:04.970620 20728 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:04.971323 20585 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:04.972597 20639 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.973069 20728 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:04.833384 20483 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.927306 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:04.834142 20722 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.935799 20433 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.915032 20660 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.913503 20685 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:04.868599 20729 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:04.982798 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:05.096881 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 114322us
W20260709 13:09:04.994652 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67404.8us
I20260709 13:09:05.097544 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:04.927980 19868 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:05.097822 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:05.098599 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 180281us
W20260709 13:09:04.981851 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57470us
I20260709 13:09:04.890012 20644 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.084046 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.074539 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:05.121263 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:05.121747 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47333.7us
I20260709 13:09:05.121896 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.123342 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.123989 19225 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:05.124841 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.125195 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.125778 19225 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
W20260709 13:09:05.088088 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 424394us
W20260709 13:09:05.089039 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 105487us
I20260709 13:09:04.950062 19217 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:04.980370 19221 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:05.129173 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.122180 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:05.129904 19221 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:05.130664 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:05.094482 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 103875us
I20260709 13:09:04.977825 20609 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.130962 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.089147 20585 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.133525 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.131230 19221 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:05.138511 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.139118 19295 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:05.127940 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:05.134080 19298 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:05.140507 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.143316 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:05.141060 19300 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:05.144703 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:05.146463 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:05.095070 20633 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.153885 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:05.154181 19297 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:05.122843 20606 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.127360 20528 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.125639 20644 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.156402 20685 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:05.167148 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.170490 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.171285 19217 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:05.172350 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.172689 20694 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.172909 19217 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:05.173115 20694 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:05.173557 20694 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.140107 20585 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.174391 20585 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.176635 19223 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:05.182679 20718 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.185099 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.186547 19218 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:05.188293 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.188933 19294 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:05.188995 20694 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.157310 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.157691 20433 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.123142 20625 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.089087 20713 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:09:05.089151 20676 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:05.155138 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.161067 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.160012 20606 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.127240 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 290) took 1005 ms. Trace:
I20260709 13:09:05.125507 20660 raft_consensus.cc:2764] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:09:05.132752 20597 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.135903 20690 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.132427 20675 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.139829 20607 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.098906 20639 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:09:05.202320 19218 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:05.205233 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61979.2us
I20260709 13:09:05.094040 20630 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:05.213007 20628 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:05.216012 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60948.3us
I20260709 13:09:05.159075 20626 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.158844 20674 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:05.168124 19371 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:05.165262 20528 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.164734 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:05.254336 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 129551us
I20260709 13:09:05.213102 20433 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.221786 20606 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.260928 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:05.266207 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.269652 19291 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:05.261857 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:05.262784 20528 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.273551 19220 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:05.276544 20745 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:05.277043 20732 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.553s	user 0.005s	sys 0.007s
I20260709 13:09:05.221561 20735 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.225478 20597 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:05.257776 20628 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.257645 20626 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.258924 20607 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.224452 20694 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:05.290982 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 168858us
I20260709 13:09:05.291864 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:05.265237 20658 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.272275 20548 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.272789 20433 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.283931 20736 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:05.282802 20639 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.277055 20745 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.268915 20633 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:05.289067 20628 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.259907 20674 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.271961 20514 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.305905 20658 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.310938 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:05.314528 20483 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:05.313493 20718 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:05.280408 20735 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.282711 20734 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.287773 20597 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.271773 20685 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:09:05.288828 20626 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.288486 20607 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.315358 20694 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.313047 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.220419 19900 rpcz_store.cc:276] 0709 13:09:04.117539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.121081 (+  3542us) service_pool.cc:224] Handling call
0709 13:09:04.121395 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.243276 (+121881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.091474 (+848198us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54006dced4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:05.122532 (+ 31058us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278511360}
I20260709 13:09:05.318676 20633 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:05.309631 20584 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.314049 20548 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.324967 20483 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.348628 20734 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.358908 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.368558 19374 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:05.360422 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:05.365609 20743 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:05.349018 20735 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.392925 19373 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:05.367547 20483 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.370406 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.370635 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.355329 20694 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.370409 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.357880 20639 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:05.403373 19374 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:05.366324 20718 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.429196 19868 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.877s (SENT)
I20260709 13:09:05.429680 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.369374 20734 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.352968 20585 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.431967 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.449297 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.405304 20483 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.470052 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.447724 20701 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.495028 19368 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:05.408790 20694 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:05.446360 20744 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:09:05.408766 20639 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:05.496510 19369 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:05.401477 20698 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.512728 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.446012 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.517139 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:05.523931 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.405017 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.524972 19370 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:05.446012 20718 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:05.525103 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94837.9us
I20260709 13:09:05.532930 19370 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:05.535256 20755 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:05.533612 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.402716 20633 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.529217 20400 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.505061 20639 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.544704 19368 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:05.553922 20528 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:05.554818 20720 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.000s
I20260709 13:09:05.555217 20720 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.557870 20658 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:05.561244 20585 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:05.604425 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52703.8us
I20260709 13:09:05.530252 20676 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.606969 19294 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:05.538069 20728 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:09:05.539958 20749 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.500553 20701 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.547722 20730 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.560149 19372 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:05.625099 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:05.636193 19297 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.538290 20606 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:05.656256 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 227085us
I20260709 13:09:05.657655 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:05.561930 20636 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:09:05.551626 20648 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:09:05.632302 20730 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.632907 20749 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.659832 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:05.618160 20459 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:09:05.635746 20752 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.638531 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.638626 20400 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:05.645025 20676 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.655573 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1343) took 1191 ms. Trace:
I20260709 13:09:05.666613 19373 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:05.655786 20584 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.691931 19297 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:05.690784 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:05.689136 19300 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:05.664561 20749 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.699150 19298 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.699981 20548 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:05.703366 20675 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.663636 20674 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:05.706550 19297 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:05.696996 20433 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.665086 20730 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.710856 19300 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:05.711807 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:05.708566 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.715849 20720 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:05.716143 19372 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:05.718030 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.719094 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.717968 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.720803 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.721709 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.717229 19896 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:09:05.716869 20609 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.005s
I20260709 13:09:05.737980 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:05.739982 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:05.741876 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:05.698978 20400 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.720157 20584 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:05.698752 20676 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.690624 20752 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:05.740542 20727 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.815s	user 0.000s	sys 0.021s
W20260709 13:09:05.737012 20649 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.809s	user 0.009s	sys 0.005s
I20260709 13:09:05.713328 20734 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.748052 20609 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.748219 20561 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:09:05.689347 19219 rpcz_store.cc:276] 0709 13:09:04.461568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.969211 (+507643us) service_pool.cc:224] Handling call
0709 13:09:04.969571 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.969959 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.969998 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.970500 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.222301 (+251801us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.254492 (+ 32191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.258111 (+  3619us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.607823 (+349712us) raft_consensus.cc:1685] finished
0709 13:09:05.608296 (+   473us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4800080058. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:09:05.607854 (+  -442us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.652506 (+ 44652us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25502,"raft.run_cpu_time_us":3326,"raft.run_wall_time_us":540430,"spinlock_wait_cycles":7689216,"thread_start_us":234108,"threads_started":1,"wal-append.queue_time_us":299652}
W20260709 13:09:05.749210 20738 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.813s	user 0.016s	sys 0.000s
I20260709 13:09:05.743507 20728 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:09:05.741813 20674 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.746989 20636 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:05.728185 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:05.762972 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:05.763149 20548 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:05.779215 20483 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.780514 20606 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:05.782021 20597 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.814904 20548 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.822461 20597 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:05.761621 20584 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.822878 20548 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:05.824239 20514 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.824944 20514 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.771721 20459 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:05.761495 20768 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.826413 20745 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:05.778676 20591 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:05.827378 20591 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.792531 19370 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:05.830093 20591 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:05.789970 19299 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:05.776022 19897 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.062s	user 0.004s	sys 0.007s
I20260709 13:09:05.775836 19300 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:05.761655 20713 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:05.769429 20607 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.816046 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:05.824433 20584 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.798426 20766 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:05.800010 20738 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.832794 20713 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:05.830591 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:05.872704 19370 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.836582 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.853668 19373 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:05.772975 20727 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:05.850183 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100534us
I20260709 13:09:05.852334 19218 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:05.875425 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:05.861698 19365 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:05.852815 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:05.830582 20591 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:05.851845 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:05.773434 20649 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:05.832048 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:05.880770 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:05.881567 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:05.830590 19216 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.871s	user 0.016s	sys 0.022s
I20260709 13:09:05.824186 20728 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:05.836122 19371 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:05.856552 20548 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.842669 20483 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:05.833469 20734 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.847951 20433 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.831557 19897 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:05.845659 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:05.841274 20676 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.882010 20597 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:05.843820 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:05.876077 19218 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:05.914108 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.917212 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:05.919478 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:05.872553 20713 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:05.894698 20606 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:05.881428 20591 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:05.926425 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:05.913967 20626 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.556s	user 0.003s	sys 0.006s
I20260709 13:09:05.896271 20771 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.860234 20745 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:09:05.875223 20766 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.904345 19216 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:05.914018 20728 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:05.920416 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:05.939059 20659 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.023s	user 0.007s	sys 0.004s
I20260709 13:09:05.968865 19218 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:05.899389 20690 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:09:05.847290 20735 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.913223 20674 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 13:09:05.974483 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57331.2us
I20260709 13:09:05.944872 19894 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:05.980010 19224 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:06.001329 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.002764 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:05.982501 19868 leader_election.cc:336] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.725s (SENT)
W20260709 13:09:06.004923 19868 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.079s (SENT)
I20260709 13:09:06.005455 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:05.919749 20614 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:05.945801 20676 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.985579 20483 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.971832 20626 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.985726 20720 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:05.932300 20772 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:05.964638 20771 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.923727 20548 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:05.965390 20606 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:05.979614 19895 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.970185 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 319) took 1376 ms. Trace:
I20260709 13:09:06.016573 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.020408 20781 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.015715 20400 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:05.947223 20433 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:09:05.944923 20597 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.032917 19896 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.036201 19297 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.994361 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1048) took 1069 ms. Trace:
I20260709 13:09:06.037657 19295 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.920126 20768 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:09:06.021679 20727 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.017907 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:06.036029 20628 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.711s	user 0.025s	sys 0.011s
I20260709 13:09:06.030972 20782 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.036516 20771 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.040832 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:06.019116 20483 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.000092 20659 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.049247 20752 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.083412 19370 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:05.999902 20713 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.102499 20649 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:06.103051 20773 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:09:06.102878 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.104715 19894 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:06.105897 20483 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.030119 20720 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.074060 20648 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.102581 20713 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.054252 20768 consensus_queue.cc:1243] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:06.037603 20591 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.113793 20548 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.045823 19897 rpcz_store.cc:276] 0709 13:09:04.589777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.590990 (+  1213us) service_pool.cc:224] Handling call
0709 13:09:04.591270 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.930764 (+1339494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.965909 (+ 35145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.092336 20728 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.120805 20728 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.054342 19216 rpcz_store.cc:276] 0709 13:09:04.920008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.958624 (+ 38616us) service_pool.cc:224] Handling call
0709 13:09:05.989108 (+1030484us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:06.124518 20770 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:09:06.125324 20597 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.125114 20606 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.126204 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 305) took 1149 ms. Trace:
I20260709 13:09:06.108891 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.097709 20628 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.099432 20639 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.128331 20659 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.136082 20591 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.126772 19898 rpcz_store.cc:276] 0709 13:09:04.977140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.085353 (+108213us) service_pool.cc:224] Handling call
0709 13:09:05.155177 (+ 69824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.640149 (+484972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.646018 (+  5869us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.704424 (+ 58406us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.747448 (+ 43024us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:05.747507 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.747599 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.125907 (+378308us) raft_consensus.cc:1685] finished
0709 13:09:06.125934 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.126129 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232713,"raft.queue_time_us":314662,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":188553,"threads_started":2,"wal-append.queue_time_us":86052}
I20260709 13:09:06.142653 20689 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:06.184824 19294 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:06.177928 20626 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.180856 20735 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.182861 20766 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.185210 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.195825 20720 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.204754 20639 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.205408 20718 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:06.207367 20644 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.000s	user 0.019s	sys 0.020s
I20260709 13:09:06.207967 20514 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.213433 20514 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.216274 20730 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.217185 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:06.218060 20786 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.218164 20591 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.218614 20591 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.219105 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.220319 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.220685 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.221123 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.221704 19218 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:06.223776 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.224104 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.225085 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.225665 19223 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:06.207731 20644 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.230496 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:06.230597 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 225696us
I20260709 13:09:06.226723 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.231662 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:06.224330 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.222532 20718 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.222849 19366 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.245985 19369 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.246598 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.186501 20749 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:06.246515 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.605s (SENT) [suppressed 11 similar messages]
I20260709 13:09:06.254192 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:06.221249 20591 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.241997 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:06.243372 19220 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.243791 20628 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.244199 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.240723 19218 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.249161 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:06.258574 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.003s	sys 0.003s
I20260709 13:09:06.231987 20738 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.266255 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:06.218575 20786 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.256403 20718 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:06.232473 20758 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:06.234555 20597 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.242743 20759 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:06.274816 19372 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.272710 19293 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.268965 20675 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.257153 20644 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:06.269050 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.004s	sys 0.003s
I20260709 13:09:06.270987 20745 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:06.275306 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.287879 19221 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:06.276687 20483 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.268365 20584 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:09:06.281047 20772 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:06.296345 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.289526 20758 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.285849 20675 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:06.304931 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 375778us
I20260709 13:09:06.286718 20745 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.292497 20738 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.292441 20759 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.308663 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.320860 20759 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.321671 20639 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.293465 19895 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:06.292717 20400 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.305761 20483 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:06.331178 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.332449 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.334976 19218 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.335289 20786 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:06.313802 20694 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.003s
I20260709 13:09:06.309026 20745 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.337899 20749 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.340261 20676 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:06.343252 19218 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:06.350262 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.350957 19218 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:06.325273 20738 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:06.352699 19225 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:06.326282 20639 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:06.335578 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.325888 20628 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:06.355741 19223 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:06.327968 19216 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:06.332398 20730 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.358069 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.362361 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.360816 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.355731 20738 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.352989 20676 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:06.387538 20676 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.388188 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.368947 19220 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:06.348863 20694 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.392025 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.388957 20698 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.393819 19374 raft_consensus.cc:2368] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:06.394738 19894 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:06.394809 20701 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.390034 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1361) took 1315 ms. Trace:
I20260709 13:09:06.358871 20639 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.398361 19217 rpcz_store.cc:276] 0709 13:09:05.074216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.253796 (+179580us) service_pool.cc:224] Handling call
0709 13:09:05.299000 (+ 45204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.320725 (+ 21725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.321354 (+   629us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.382150 (+ 60796us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.251903 (+869753us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d4dab0ac 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b
0709 13:09:06.292329 (+ 40426us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:06.315501 (+ 23172us) log.cc:844] Serialized 14 byte log entry
0709 13:09:06.329952 (+ 14451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.336072 (+  6120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.341649 (+  5577us) raft_consensus.cc:1685] finished
0709 13:09:06.363810 (+ 22161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.389170 (+ 25360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":703,"prepare.queue_time_us":10972,"prepare.run_wall_time_us":35,"raft.queue_time_us":5277,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7864,"spinlock_wait_cycles":16486784,"thread_start_us":801116,"threads_started":1,"wal-append.queue_time_us":850448}
I20260709 13:09:06.325397 20718 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.410023 20561 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:06.410535 20561 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:06.411532 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.412253 19217 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.413383 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.414832 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.421303 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:06.381235 20758 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.381917 20483 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.356391 20759 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:06.391127 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.393128 20694 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:06.400259 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.401070 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.401475 20639 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.361093 20628 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.435153 20791 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.402403 20722 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.393174 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.388662 20676 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:06.379873 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 133371us
W20260709 13:09:06.379338 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 125185us
I20260709 13:09:06.447129 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.432634 20701 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:06.443395 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1328) took 1083 ms. Trace:
I20260709 13:09:06.337175 20400 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.380885 20675 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.423874 19297 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:06.416076 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.433594 20759 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.377542 20771 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.447957 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.431711 20713 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.403891 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1345) took 1941 ms. Trace:
I20260709 13:09:06.449399 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.449596 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.406635 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.467367 19224 rpcz_store.cc:276] 0709 13:09:04.462168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.980388 (+518220us) service_pool.cc:224] Handling call
0709 13:09:05.979791 (+999403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.001266 (+ 21475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.403730 (+402464us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54003c7dd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:06.403840 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297686912}
I20260709 13:09:06.468487 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.468609 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.469146 19224 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.469153 19370 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.445870 19220 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.411567 20561 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.472958 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.473892 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.474462 19370 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:06.475371 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.464524 19297 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:06.466432 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1278) took 1104 ms. Trace:
I20260709 13:09:06.476339 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.455876 20758 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:06.457754 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.470705 19869 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.479647 19869 leader_election.cc:403] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:06.469264 19266 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:06.481623 20625 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.482064 20639 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:06.482592 20639 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:06.476761 19368 rpcz_store.cc:276] 0709 13:09:05.362397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.506198 (+143801us) service_pool.cc:224] Handling call
0709 13:09:05.512692 (+  6494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.547923 (+ 35231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.466139 (+918216us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5400297f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:06.466361 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61854464}
I20260709 13:09:06.484866 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.485394 19368 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.487427 19297 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:06.477066 19370 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5.
I20260709 13:09:06.465377 20694 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.462329 20701 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:06.499655 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.499864 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.471474 20722 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.490458 19869 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5.
I20260709 13:09:06.451440 20786 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:06.435704 20791 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.510054 19368 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:06.498800 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:06.498956 19291 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:06.502516 20759 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.502905 19294 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:06.503273 19292 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:06.506464 19869 leader_election.cc:403] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:06.507611 19337 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.484565 20561 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.489112 20718 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.515017 20771 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.517001 20701 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.517599 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.483543 20639 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.518280 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:06.546607 19895 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.546655 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.489625 20625 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:09:06.547794 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.530830 20628 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.548314 20745 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.549640 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:06.550344 20689 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.550473 20745 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.550848 20689 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.542625 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.553578 19216 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.554430 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.525064 20648 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:09:06.555657 20648 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.555953 20648 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:06.556725 20648 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.557180 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.557813 20648 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.560511 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.491130 20584 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.485666 20758 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:06.473455 20713 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.528527 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:06.491029 20720 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.535326 20799 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.591737 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:06.536022 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.593210 19225 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:06.593096 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:06.538268 20729 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.539058 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1285) took 1089 ms. Trace:
I20260709 13:09:06.541267 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.594628 19373 rpcz_store.cc:276] 0709 13:09:05.449205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.834715 (+385510us) service_pool.cc:224] Handling call
0709 13:09:05.835019 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.874355 (+ 39336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.538831 (+664476us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000b3bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:06.539002 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42310016}
I20260709 13:09:06.542583 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:06.607571 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65054.8us
I20260709 13:09:06.611897 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:06.612654 19218 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:06.543259 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.527866 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.561902 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.505779 20694 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.562363 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:06.528095 20675 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.563355 19366 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:06.563828 20633 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.624755 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.625046 20400 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.625339 19366 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:06.626237 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.626312 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.529897 20718 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.566948 19220 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.573311 19293 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:05.899338 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:06.574749 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:06.616773 20698 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.575839 20791 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:06.576314 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46256.8us
I20260709 13:09:06.576886 20459 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:06.630414 20745 raft_consensus.cc:2764] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:06.651592 20528 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.661487 20782 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:09:06.676843 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.677517 19894 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:06.678467 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.679576 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.667320 20752 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.578719 20607 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.580145 20689 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.581722 19122 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 260) took 3618 ms. Trace:
I20260709 13:09:06.571789 19121 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 2 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.545646 20606 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:06.558023 19216 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:06.583951 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:06.666692 20791 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:09:06.587857 20720 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:09:06.588239 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.536476 20764 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.616616 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.638309 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:06.617844 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.520455 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.620833 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.621682 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:06.622545 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 60267.8us
I20260709 13:09:06.631346 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.632826 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.617322 20771 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.637529 19296 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:09:06.574898 20758 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:06.683554 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 99675us
I20260709 13:09:06.688480 19300 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.703491 19902 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.703941 19373 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.680567 20752 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.709295 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.709622 19895 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.710881 20752 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.706054 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.583815 20738 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.711819 19225 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.671510 20698 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:06.713246 20738 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.713007 20698 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:06.633236 20777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.003s	sys 0.012s
W20260709 13:09:06.713868 20777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.003s	sys 0.012s
I20260709 13:09:06.715058 20698 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.688134 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.715869 19220 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.718956 19225 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.719820 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:06.562454 20783 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.377s	user 0.003s	sys 0.000s
I20260709 13:09:06.634338 20701 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.715095 19897 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:06.724548 20701 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:06.724730 20713 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.680156 19894 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:06.692464 20694 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.720520 19298 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:06.682482 20628 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.704861 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.684590 19222 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.721246 20718 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.721905 19370 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:06.618391 20483 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:06.672209 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.725613 19225 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.720538 19903 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:06.704769 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.619547 20729 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:06.769268 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64578.5us
I20260709 13:09:06.769882 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:06.706238 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:06.730275 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 99004.8us
I20260709 13:09:06.740916 20738 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.776283 19188 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.681816 19122 rpcz_store.cc:276] 0709 13:09:02.963550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.963705 (+   155us) service_pool.cc:224] Handling call
0709 13:09:06.581662 (+3617957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:04.465352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:04.465942 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:04.465977 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:09:04.465994 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:04.466857 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:04.466929 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:04.466961 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:09:04.467495 (+   534us) tablet.cc:701] Row locks acquired
0709 13:09:04.467513 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:04.467641 (+   128us) write_op.cc:270] Start()
0709 13:09:04.467774 (+   133us) write_op.cc:276] Timestamp: P: 1783602544467597 usec, L: 0
0709 13:09:04.467812 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:09:04.565973 (+ 98161us) log.cc:844] Serialized 2881 byte log entry
0709 13:09:05.220543 (+654570us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:05.306296 (+ 85753us) op_driver.cc:464] REPLICATION: finished
0709 13:09:05.542716 (+236420us) write_op.cc:301] APPLY: starting
0709 13:09:05.542802 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:05.543002 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:05.543028 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:05.654653 (+111625us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:05.690257 (+ 35604us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:09:05.697530 (+  7273us) write_op.cc:312] APPLY: finished
0709 13:09:05.708662 (+ 11132us) log.cc:844] Serialized 59 byte log entry
0709 13:09:05.717349 (+  8687us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.722418 (+  5069us) write_op.cc:454] Released schema lock
0709 13:09:05.727552 (+  5134us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:05.768580 (+ 41028us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.770368 (+  1788us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":236188,"apply.run_cpu_time_us":3706,"apply.run_wall_time_us":208912,"num_ops":7,"prepare.queue_time_us":178526,"prepare.run_cpu_time_us":25060,"prepare.run_wall_time_us":239911,"raft.queue_time_us":212643,"raft.run_cpu_time_us":82266,"raft.run_wall_time_us":347298,"replication_time_us":838315,"spinlock_wait_cycles":16474368,"thread_start_us":486391,"threads_started":4,"wal-append.queue_time_us":144816}]]}
I20260709 13:09:06.750687 20771 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:06.683234 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.685601 20720 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.643142 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.783214 19224 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.771713 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.686064 20607 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:06.772794 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 122034us
I20260709 13:09:06.742374 20786 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:06.742575 20676 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:06.742501 20730 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:06.804754 20730 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.804687 20676 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.807144 20730 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.807279 20591 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:06.777794 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 71630.2us
I20260709 13:09:06.807709 20676 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.779876 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.769687 20729 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.787467 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.822820 20729 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.822997 19222 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:06.788146 19225 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:06.823858 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.792483 20690 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.775979 20514 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.792569 20781 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:06.796497 20782 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:06.798846 19300 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.802582 20771 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.803861 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.756548 20614 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.808611 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:06.762764 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.831868 19368 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:06.823401 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.808921 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.809684 20636 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.810321 20607 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:06.810976 20738 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:06.782161 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.777877 20694 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:06.763872 20628 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.813514 19899 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:06.813891 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1332) took 1447 ms (client timeout 1775 ms). Trace:
I20260709 13:09:06.814853 19216 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:06.815444 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.816454 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.785857 20811 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:06.865960 20607 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.816849 20584 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.781847 20698 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.820933 20758 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.816892 20786 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.868706 20555 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:06.868971 20758 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.824958 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.869253 20555 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.869845 20786 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.764041 20483 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.870496 20483 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.871470 20555 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.824859 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.872988 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.873970 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.874876 19220 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.450286 19367 rpcz_store.cc:276] 0709 13:09:05.359703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.360875 (+  1172us) service_pool.cc:224] Handling call
0709 13:09:06.353268 (+992393us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:06.353444 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.353635 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:06.360582 (+  6947us) log.cc:844] Serialized 14 byte log entry
0709 13:09:06.442934 (+ 82352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.443004 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:06.443091 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.443173 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.443324 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7105,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":108,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4716,"spinlock_wait_cycles":6207232,"thread_start_us":81837,"threads_started":1}
I20260709 13:09:06.838589 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1334) took 1294 ms. Trace:
I20260709 13:09:06.839109 20644 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.826330 20730 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.881274 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1275) took 1519 ms. Trace:
I20260709 13:09:06.881665 19365 rpcz_store.cc:276] 0709 13:09:05.361449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.470618 (+109169us) service_pool.cc:224] Handling call
0709 13:09:05.861497 (+390879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.879145 (+ 17648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.881088 (+1001943us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000942d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:06.881221 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872611712}
I20260709 13:09:06.858626 20689 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.826854 20690 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:06.827375 20749 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.827225 20528 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:09:06.865200 19224 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.865172 19299 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:06.865823 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.866410 20811 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.740656 20701 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.834506 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:06.862233 19374 rpcz_store.cc:269] 0709 13:09:05.366569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.409321 (+ 42752us) service_pool.cc:224] Handling call
0709 13:09:06.813697 (+1404376us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54000d34d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:06.813831 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023763328}
I20260709 13:09:06.895661 19374 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:06.896135 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1338) took 1228 ms. Trace:
I20260709 13:09:06.896416 19374 rpcz_store.cc:276] 0709 13:09:05.667340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.895221 (+1227881us) service_pool.cc:224] Handling call
0709 13:09:06.895476 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.895984 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.896099 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.875991 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:06.876061 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 99842.9us
I20260709 13:09:06.878726 19225 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:06.878342 19368 rpcz_store.cc:276] 0709 13:09:05.543875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.837757 (+1293882us) service_pool.cc:224] Handling call
0709 13:09:06.838063 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.838255 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.838285 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.838331 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:06.838366 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.838423 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.838533 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.897693 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:06.844134 20636 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:06.900908 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.884438 20648 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:06.861040 20772 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.862723 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.888604 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:06.908697 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83800us
I20260709 13:09:06.908948 19299 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:06.889966 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.864362 20738 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:06.875594 20764 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5.
I20260709 13:09:06.879976 19900 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.885102 19293 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.886650 20689 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.898736 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.899165 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:06.899317 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:06.884227 19294 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.883262 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:06.900092 19374 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:06.902074 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.858158 20597 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:06.917266 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.904232 19368 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:06.917870 19300 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.918140 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1340) took 1204 ms. Trace:
I20260709 13:09:06.918347 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.918502 19368 rpcz_store.cc:276] 0709 13:09:05.714151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.898195 (+1184044us) service_pool.cc:224] Handling call
0709 13:09:06.903932 (+  5737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.917915 (+ 13983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.918094 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.905263 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:06.887336 20644 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:06.906101 20772 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:06.910322 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.922181 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.893996 20811 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.852197 20614 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.925426 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.925771 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.926370 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.902794 20555 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.932399 19216 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.932794 20555 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.933236 20555 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.933311 20644 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.933748 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:06.912250 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.934952 19299 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.936602 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1347) took 1084 ms. Trace:
I20260709 13:09:06.936961 19369 rpcz_store.cc:276] 0709 13:09:05.852585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.894889 (+ 42304us) service_pool.cc:224] Handling call
0709 13:09:06.936422 (+1041533us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54000ea454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:06.936548 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720145664}
I20260709 13:09:06.937925 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.938730 20591 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.938941 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:06.932453 19220 raft_consensus.cc:2368] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.940361 20752 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.940897 20752 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:06.941599 20689 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.941768 20752 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:06.943207 19298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1278) took 1237 ms (client timeout 1605 ms). Trace:
W20260709 13:09:06.943575 19298 rpcz_store.cc:269] 0709 13:09:05.706038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.710385 (+  4347us) service_pool.cc:224] Handling call
0709 13:09:06.942988 (+1232603us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002b84d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:06.943125 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315520896}
I20260709 13:09:06.944046 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:06.944646 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.944856 20628 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:06.902323 19868 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.945475 19217 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:06.945880 19297 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:06.946251 19297 pending_rounds.cc:85] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 5
W20260709 13:09:06.945631 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44813.1us
I20260709 13:09:06.919982 20690 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.948465 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.949008 20690 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.949645 19868 leader_election.cc:400] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.949954 19868 leader_election.cc:403] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:06.949976 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:06.916836 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1339) took 1219 ms. Trace:
I20260709 13:09:06.925043 20764 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.952642 20799 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.953749 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.954823 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.954977 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.955524 19371 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.957926 20728 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:06.926909 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.925037 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.958680 20433 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:06.959038 20433 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:06.959177 20729 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.959841 20433 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.960992 20433 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.962098 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.932262 20636 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.962805 20636 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.963124 20720 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.963266 19300 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:06.963626 20720 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:06.928149 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.945199 19298 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:06.964506 20720 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.946467 19297 pending_rounds.cc:107] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:06.965518 19297 raft_consensus.cc:2889] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.951797 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:06.925295 20808 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.968499 19366 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:06.969257 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1337) took 1313 ms. Trace:
I20260709 13:09:06.969661 19366 rpcz_store.cc:276] 0709 13:09:05.656362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.895258 (+1238896us) service_pool.cc:224] Handling call
0709 13:09:06.923900 (+ 28642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.968955 (+ 45055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.969194 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.970671 20729 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:06.917567 20633 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:06.972256 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:06.952299 19374 rpcz_store.cc:276] 0709 13:09:05.697343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.896870 (+1199527us) service_pool.cc:224] Handling call
0709 13:09:06.897053 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.916599 (+ 19546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.916778 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.904976 20694 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.977388 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:06.979281 19869 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:06.903674 20736 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.931620 20483 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.981348 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.982275 19188 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.985153 19369 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:06.987618 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.985436 19374 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:06.980083 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.907707 20648 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:06.988485 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1343) took 1248 ms. Trace:
I20260709 13:09:06.993898 19374 rpcz_store.cc:276] 0709 13:09:05.739748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.974176 (+1234428us) service_pool.cc:224] Handling call
0709 13:09:06.974479 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.988251 (+ 13772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.988435 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.989773 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:06.991603 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.985296 19299 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:06.971441 20738 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:06.924826 20584 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.913192 19222 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:07.013042 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:07.072096 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 59149.6us
I20260709 13:09:07.072918 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:06.984699 20639 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.076452 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:07.076936 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.081225 19266 leader_election.cc:400] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:07.081579 19266 leader_election.cc:403] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:06.923430 20597 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.010218 20628 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.083009 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.984961 20633 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.083518 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:06.993942 20659 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.994050 20728 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.081642 19223 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.068605 20584 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.090909 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1344) took 1350 ms. Trace:
I20260709 13:09:07.069499 20814 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:07.011248 20459 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:07.080752 20815 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:09:07.010130 20528 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:07.082352 20788 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:07.109416 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.085048 20734 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
W20260709 13:09:07.096478 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 119197us
I20260709 13:09:07.097465 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.070612 20758 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.068759 20736 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:07.070883 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.072129 20777 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.070995 20698 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.010636 20483 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:06.995182 20689 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.987152 20433 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:09:07.080578 20808 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.158083 20808 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.103565 19369 rpcz_store.cc:276] 0709 13:09:05.740027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.073973 (+1333946us) service_pool.cc:224] Handling call
0709 13:09:07.090427 (+ 16454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.090591 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.090614 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.090651 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:07.090677 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.090730 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.090852 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.095880 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:07.113706 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 120687us
I20260709 13:09:07.111446 19894 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:09:07.162393 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.116604 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:07.093816 20628 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:07.095286 20633 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.119706 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.164604 19295 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:07.165405 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.108057 19900 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:07.107146 20584 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.167341 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.167729 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:07.168274 19295 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:07.169749 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53238.7us
I20260709 13:09:07.170526 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:07.120332 20728 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:09:07.009960 20772 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:07.153959 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70500.5us
I20260709 13:09:07.114573 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1362) took 1278 ms. Trace:
I20260709 13:09:07.117570 20528 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.178551 19300 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:07.182472 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.186601 19369 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:07.113086 20788 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:07.103545 20694 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.123199 20758 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.113773 20814 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.181303 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:07.132750 19223 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:07.198256 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.183825 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.167012 20628 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.180706 19371 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:07.184418 20745 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.158520 20808 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.169924 20764 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:07.198277 19295 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:07.182049 20818 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.190748 20660 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.198190 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.204504 19371 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.201757 20820 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.206641 20648 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.108656 20730 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.193022 20788 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.210260 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:07.202123 20772 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.207839 19217 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:07.207965 20483 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.214144 20636 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:07.214108 20729 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:09:07.218003 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 98) took 1305 ms. Trace:
W20260709 13:09:07.221784 20822 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:07.214587 20720 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.232518 20483 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.229178 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.231259 20597 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:07.222641 20827 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.210932 20644 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:07.212862 20745 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.223642 19295 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:07.241961 19374 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.243129 19903 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.211220 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.259440 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.281759 19903 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:07.239936 19896 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:07.233381 20636 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.264415 20729 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:07.266098 19294 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:07.260880 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 102) took 1322 ms. Trace:
I20260709 13:09:07.202080 20698 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.288800 19373 rpcz_store.cc:276] 0709 13:09:05.938865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.260224 (+1321359us) service_pool.cc:224] Handling call
0709 13:09:07.260513 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.260664 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.260689 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.260717 (+    28us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.260734 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.260770 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.260841 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.241485 20814 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:07.290086 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.270831 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.269613 20827 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:07.199043 20736 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.293304 20728 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.184417 19219 rpcz_store.cc:276] 0709 13:09:05.833734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.856411 (+ 22677us) service_pool.cc:224] Handling call
0709 13:09:05.901471 (+ 45060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.939176 (+ 37705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.941884 (+  2708us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.996869 (+ 54985us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.079486 (+ 82617us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:06.091305 (+ 11819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.100119 (+  8814us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.073042 (+972923us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b54002c86a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2adbe 00007fe8d7e35930 00007fe8d7e358d8 00007fe8d7e35858 00007fe8d7e35813 00007fe8d7e34a9c 00007fe8ddd20626 00007fe8ddd1add8 00007fe8d7e717cb 00007fe8d7e742c0
0709 13:09:07.083340 (+ 10298us) raft_consensus.cc:1685] finished
0709 13:09:07.085640 (+  2300us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.111798 (+ 26158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3996,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":15185,"spinlock_wait_cycles":20493184,"thread_start_us":54981,"threads_started":1,"wal-append.queue_time_us":85421}
I20260709 13:09:07.293960 20648 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.294431 20648 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:07.282049 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 71540us
I20260709 13:09:07.282078 19218 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:07.282729 19903 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.283180 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.285699 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 100) took 1372 ms. Trace:
I20260709 13:09:07.291774 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.285462 20514 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.320574 20514 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.321532 20514 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.323359 20628 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.249604 19371 rpcz_store.cc:276] 0709 13:09:05.912490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.204021 (+1291531us) service_pool.cc:224] Handling call
0709 13:09:07.204327 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.217775 (+ 13448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.217956 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.287606 20808 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.272969 20758 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.233505 20826 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:09:07.299892 19374 rpcz_store.cc:276] 0709 13:09:05.913040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.241489 (+1328449us) service_pool.cc:224] Handling call
0709 13:09:07.241799 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.281509 (+ 39710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.285634 (+  4125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.326097 19119 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 156) took 4077 ms. Trace:
I20260709 13:09:07.327168 20788 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.267764 20584 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.278903 20606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53982 (request call id 74) took 7856 ms. Trace:
I20260709 13:09:07.271576 20483 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.316047 19903 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.276298 20720 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.330459 19374 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:07.331416 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.335670 19121 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 2 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.344477 20799 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.345522 20799 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.287868 20636 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.345868 20799 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:07.295589 20729 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.346726 20799 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.272707 20766 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:09:07.347996 20729 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.293334 20827 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.349418 20827 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.349881 20718 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:07.350309 20718 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.351094 20718 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.277381 20811 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.234470 20694 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.355597 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.357151 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:07.358567 19299 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:07.347942 20799 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.360785 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.364728 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.271523 20828 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:09:07.367466 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:07.328439 20606 rpcz_store.cc:276] 0709 13:08:59.461497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.489545 (+ 28048us) service_pool.cc:224] Handling call
0709 13:09:00.590657 (+1101112us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b58000fdad0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eb070a 00007fe8d7eb176a 00007fe8d7eb091b 00007fe8d7ebc03c 00007fe8d7ebb6b3 00007fe8d7eb39fa 00007fe8dce7b4c9 00007fe8d63f7c54
0709 13:09:00.733131 (+142474us) log.cc:844] Serialized 508 byte log entry
0709 13:09:00.907676 (+174545us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4c000bea40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d6181a20 00007fe8d6192a29 00007fe8d619313f 00007fe8d61572ab 00007fe8d6184f3c 00007fe8d61853fe 00007fe8d641250b 00007fe8d7e11381 00007fe8d7e0f26b 00007fe8d7e15d53 00007fe8d7e15cd9
0709 13:09:01.041933 (+134257us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18002df700. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7e0eb0b 00007fe8d7e93b63 00007fe8d7ebb752 00007fe8d7eb39fa
0709 13:09:07.258403 (+6216470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172777,"raft.queue_time_us":196804,"raft.run_cpu_time_us":2787,"raft.run_wall_time_us":39446,"spinlock_wait_cycles":1835861120,"thread_start_us":75087,"threads_started":1,"wal-append.queue_time_us":119594,"wal-append.run_cpu_time_us":2311,"wal-append.run_wall_time_us":1078322}
I20260709 13:09:07.288554 20555 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.335888 20826 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:07.369040 20826 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:07.370067 20555 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:07.369921 20826 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.370450 20690 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.366160 20730 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.371371 20772 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.366349 20814 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:09:07.375191 20807 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.663s	user 0.002s	sys 0.000s
I20260709 13:09:07.363509 20791 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.272802 20644 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.377055 20720 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.377452 20720 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:07.377758 20811 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:07.378073 20644 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:07.378258 20720 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.337903 20597 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:07.352075 20718 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.335520 20584 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:07.389667 20829 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:07.389866 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ed1a12d65a24a9cbdd9846e6437132d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:07.392180 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 308) took 1536 ms. Trace:
I20260709 13:09:07.392558 19901 rpcz_store.cc:276] 0709 13:09:05.855293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.872666 (+ 17373us) service_pool.cc:224] Handling call
0709 13:09:05.872973 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.876057 (+  3084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.876086 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.876514 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:09:06.221538 (+345024us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18003d0a80. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8dbd8958f 00007fe8d4dc8571 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd
0709 13:09:07.108878 (+887340us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18003d0a80. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:09:07.188739 (+ 79861us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.188789 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.188925 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.391940 (+203015us) raft_consensus.cc:1685] finished
0709 13:09:07.391961 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.392102 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1254,"raft.queue_time_us":3430,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13939,"spinlock_wait_cycles":29608448,"thread_start_us":79642,"threads_started":1,"wal-append.queue_time_us":1308156}
I20260709 13:09:07.393929 19373 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:07.376610 20791 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.394048 20636 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.394599 20791 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.388386 20811 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.385543 19903 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:07.274628 20745 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.379546 20720 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.400250 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:07.407275 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.366446 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:07.386234 20777 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:07.326654 19119 rpcz_store.cc:276] 0709 13:09:03.248584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.248705 (+   121us) service_pool.cc:224] Handling call
0709 13:09:07.326022 (+4077317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:04.732409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:04.782501 (+ 50092us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:04.782546 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:09:04.782566 (+    20us) tablet.cc:662] Decoding operations
0709 13:09:04.783074 (+   508us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:04.783115 (+    41us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:04.783139 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:04.783443 (+   304us) tablet.cc:701] Row locks acquired
0709 13:09:04.783459 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:09:04.783582 (+   123us) write_op.cc:270] Start()
0709 13:09:04.783717 (+   135us) write_op.cc:276] Timestamp: P: 1783602544783541 usec, L: 0
0709 13:09:04.783739 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:04.867685 (+ 83946us) log.cc:844] Serialized 1311 byte log entry
0709 13:09:05.542781 (+675096us) op_driver.cc:464] REPLICATION: finished
0709 13:09:05.724286 (+181505us) write_op.cc:301] APPLY: starting
0709 13:09:05.726167 (+  1881us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:05.749148 (+ 22981us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:05.767942 (+ 18794us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:05.821338 (+ 53396us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:05.821570 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:09:05.821638 (+    68us) write_op.cc:312] APPLY: finished
0709 13:09:05.821897 (+   259us) log.cc:844] Serialized 35 byte log entry
0709 13:09:05.822104 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.822224 (+   120us) write_op.cc:454] Released schema lock
0709 13:09:05.822275 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:05.822705 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:05.822743 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36559,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":169074,"apply.run_cpu_time_us":3204,"apply.run_wall_time_us":107402,"num_ops":3,"prepare.queue_time_us":382767,"prepare.run_cpu_time_us":3746,"prepare.run_wall_time_us":179531,"replication_time_us":758930,"thread_start_us":94572,"threads_started":1}]]}
I20260709 13:09:07.419638 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.430653 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:07.431717 19300 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:07.451684 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.471451 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 53349.9us
W20260709 13:09:07.474502 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.410800 20730 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.477391 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.480489 19221 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:07.481758 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:07.482105 19221 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:07.482435 19218 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:07.491523 19300 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
W20260709 13:09:07.498425 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.508430 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.417898 20777 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:07.515220 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.467258 19222 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.396409 20597 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.517306 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1375) took 1194 ms. Trace:
I20260709 13:09:07.521911 19903 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:07.518074 20644 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.521682 19225 rpcz_store.cc:276] 0709 13:09:06.322636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.874737 (+552101us) service_pool.cc:224] Handling call
0709 13:09:06.878507 (+  3770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.897668 (+ 19161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.517141 (+619473us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b5400136850. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:07.517255 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7992064}
I20260709 13:09:07.482323 20607 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:09:07.523551 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.538604 20483 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.547513 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.544502 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1287) took 1938 ms. Trace:
I20260709 13:09:07.562999 19365 rpcz_store.cc:276] 0709 13:09:05.606036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.882539 (+1276503us) service_pool.cc:224] Handling call
0709 13:09:06.883364 (+   825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.106909 (+223545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.106937 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.106977 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.107002 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.544210 (+437208us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400298454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:07.544268 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.544433 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513690880}
I20260709 13:09:07.554092 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.536916 20777 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.565557 20777 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.566376 19374 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:07.566918 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:07.569716 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.572067 19903 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:07.572739 20597 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:07.573099 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:07.573911 19365 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:07.576340 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.569697 20648 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:07.575554 19898 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.001s
I20260709 13:09:07.577915 19898 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:07.578598 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 373) took 1093 ms. Trace:
I20260709 13:09:07.580106 19374 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:07.545442 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 375) took 1059 ms. Trace:
I20260709 13:09:07.582103 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.586602 19295 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:07.569763 20811 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.588039 19372 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:07.588805 20830 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.588573 20811 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.561709 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1292) took 1517 ms. Trace:
I20260709 13:09:07.534197 20644 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.560420 20614 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:07.576148 20633 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.591741 19371 rpcz_store.cc:276] 0709 13:09:06.044563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.324477 (+1279914us) service_pool.cc:224] Handling call
0709 13:09:07.324807 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.389250 (+ 64443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.389296 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.389352 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.389388 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.561476 (+172088us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:07.561528 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.561652 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128373632}
I20260709 13:09:07.597054 20483 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:07.570046 20730 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.598440 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.603463 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:07.592458 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.612155 19374 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:07.621831 19296 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3.
I20260709 13:09:07.613194 19295 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:07.623816 20636 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.616036 20791 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.624265 19292 raft_consensus.cc:2376] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3. Re-sending same reply.
I20260709 13:09:07.635119 19292 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:07.635459 20791 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.637182 19292 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:07.638602 19292 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:07.581902 19900 rpcz_store.cc:276] 0709 13:09:06.485507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.486912 (+  1405us) service_pool.cc:224] Handling call
0709 13:09:07.545242 (+1058330us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54004f0954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:07.545359 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825873280}
I20260709 13:09:07.639853 19220 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:07.640545 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:07.644297 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.644874 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.621558 20633 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.642746 19292 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.648041 19298 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:07.648569 19298 pending_rounds.cc:85] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 1
I20260709 13:09:07.648871 19298 pending_rounds.cc:107] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:07.649159 19298 raft_consensus.cc:2889] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:07.579013 19898 rpcz_store.cc:276] 0709 13:09:06.484918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.487067 (+  2149us) service_pool.cc:224] Handling call
0709 13:09:06.933593 (+446526us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:07.578527 (+644934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8617216}
I20260709 13:09:07.622985 20811 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.656597 20830 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:07.659708 20819 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.617760 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:07.618153 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:07.668033 20633 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.670038 19298 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:07.668800 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:07.672078 19292 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:07.676260 19292 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:07.671900 20633 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.678715 20633 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.678814 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1088) took 1061 ms. Trace:
I20260709 13:09:07.679231 19299 rpcz_store.cc:276] 0709 13:09:06.617284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.082477 (+465193us) service_pool.cc:224] Handling call
0709 13:09:07.678668 (+596191us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54003f20d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:07.678763 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605973376}
W20260709 13:09:07.682492 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.684267 20675 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:07.686887 20607 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:07.687392 20607 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:07.688292 20607 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.676566 19219 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:07.691892 19219 pending_rounds.cc:85] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 1
I20260709 13:09:07.692157 19219 pending_rounds.cc:107] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:07.692449 19219 raft_consensus.cc:2889] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:07.694133 20764 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.697359 20644 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:07.699082 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.700052 20597 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:07.701776 20597 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:07.702127 20597 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.702461 20597 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:07.676157 20803 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.951s	user 0.001s	sys 0.001s
I20260709 13:09:07.670176 20584 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:09:07.727100 19895 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:07.725099 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1091) took 1104 ms. Trace:
I20260709 13:09:07.747685 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.748627 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1086) took 1132 ms. Trace:
I20260709 13:09:07.753692 19368 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:07.758414 20633 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.758936 20633 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.759213 19374 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:07.748981 19291 rpcz_store.cc:276] 0709 13:09:06.615939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.619649 (+  3710us) service_pool.cc:224] Handling call
0709 13:09:07.747539 (+1127890us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:07.748565 (+  1026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10633984}
I20260709 13:09:07.752509 20690 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.753520 19222 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:07.761798 19898 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:07.772708 19369 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:07.743132 19293 rpcz_store.cc:276] 0709 13:09:06.618006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.617453 (+999447us) service_pool.cc:224] Handling call
0709 13:09:07.722688 (+105235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.777199 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:07.779567 20584 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:07.780090 20584 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:07.780766 20528 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:07.780939 20584 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.782953 20633 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.785542 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1289) took 1742 ms. Trace:
I20260709 13:09:07.785914 19373 rpcz_store.cc:276] 0709 13:09:06.043605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.290759 (+1247154us) service_pool.cc:224] Handling call
0709 13:09:07.290971 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.394379 (+103408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.785320 (+390941us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000947d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:07.785489 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236169472}
I20260709 13:09:07.786936 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:07.793567 20597 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.777824 19371 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:07.794849 19373 raft_consensus.cc:2368] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:07.795581 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:07.796762 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:07.797299 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:07.569413 20433 consensus_queue.cc:1175] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d50eb2dab6754df8bcbed1445f2e8430" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:07.785164 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:07.799770 20690 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.800276 20690 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 3 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:07.800695 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1085) took 1093 ms. Trace:
I20260709 13:09:07.801081 19216 rpcz_store.cc:276] 0709 13:09:06.706834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.865570 (+158736us) service_pool.cc:224] Handling call
0709 13:09:07.800521 (+934951us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54000771d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:07.800644 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93220224}
I20260709 13:09:07.801162 20690 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.803674 20648 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.806445 20648 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.806785 20648 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:07.807508 20648 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.808424 20788 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:07.808589 20648 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.809254 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.804325 20625 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:07.812630 20625 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.812887 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:07.813371 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:07.813556 19900 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:09:07.805336 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.814929 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 106) took 1017 ms. Trace:
I20260709 13:09:07.815284 19223 rpcz_store.cc:276] 0709 13:09:06.797994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.199009 (+401015us) service_pool.cc:224] Handling call
0709 13:09:07.199278 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.212068 (+ 12790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.212111 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.212178 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.212221 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.814733 (+602512us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5400437e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:07.814777 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.814879 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29009152}
I20260709 13:09:07.805256 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.816135 20636 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.816501 19291 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:07.810585 19224 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:07.809980 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1094) took 1177 ms. Trace:
I20260709 13:09:07.818163 19297 rpcz_store.cc:276] 0709 13:09:06.632090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.808980 (+1176890us) service_pool.cc:224] Handling call
0709 13:09:07.809929 (+   949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.813033 20625 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:07.818815 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1376) took 1496 ms. Trace:
I20260709 13:09:07.819326 20625 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:07.820495 20625 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.819182 19224 rpcz_store.cc:276] 0709 13:09:06.322880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.900250 (+577370us) service_pool.cc:224] Handling call
0709 13:09:07.810378 (+910128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.817869 (+  7491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.818625 (+   756us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b54000771d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:07.818761 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066888960}
I20260709 13:09:07.816674 20636 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:07.824985 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1083) took 1210 ms. Trace:
I20260709 13:09:07.826289 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:07.826999 19300 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:07.827783 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:07.829347 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:07.830049 19225 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:07.811694 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:07.831791 19221 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.835495 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.838194 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.839898 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.840526 19225 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:07.840991 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:07.841279 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:07.841790 19225 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.842046 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.844560 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.845043 19218 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:07.845096 19340 leader_election.cc:400] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3.
I20260709 13:09:07.845575 19340 leader_election.cc:403] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.812991 20628 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:07.809849 20799 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.853477 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:07.854375 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:07.856094 19266 leader_election.cc:400] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:07.856612 19266 leader_election.cc:403] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.857463 19225 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:07.858299 20734 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.825392 19294 rpcz_store.cc:276] 0709 13:09:06.614652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.619083 (+  4431us) service_pool.cc:224] Handling call
0709 13:09:07.824827 (+1205744us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540028ad54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:07.824929 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410297216}
I20260709 13:09:07.873587 19221 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:07.837790 19900 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:07.852959 20675 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.891930 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.853299 20799 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:07.900738 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44763us
I20260709 13:09:07.861220 20636 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:07.898353 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.916395 19218 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:07.856760 20749 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.859022 20528 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.859256 20483 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.892593 19225 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:07.892266 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:07.858835 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:07.859238 20718 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.913638 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:07.879036 20628 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.068601 20628 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.069128 20628 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.887863 20676 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:07.878769 20614 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.912191 20830 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.910355 20729 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.918783 20791 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:08.078922 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:07.887773 20827 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:09:07.897737 19221 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:07.917086 20766 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:09:08.085124 19218 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:08.003547 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:08.003388 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:08.055150 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 152707us
I20260709 13:09:08.087309 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:07.912182 20818 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.071782 19898 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:08.058930 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 144590us
I20260709 13:09:08.060386 20597 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.064349 20483 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3.
I20260709 13:09:08.059571 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:08.117028 19225 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:08.118333 19225 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:09:08.118680 19225 pending_rounds.cc:85] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 4
I20260709 13:09:08.118575 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:08.069741 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 108) took 1197 ms. Trace:
W20260709 13:09:08.073017 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 159421us
I20260709 13:09:07.858925 20659 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:08.085047 20607 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.124208 20607 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:08.125115 20607 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.089838 20830 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.091637 20766 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:08.094002 19220 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:08.056541 19222 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.104688 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:08.137459 20830 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.133180 20766 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:08.137831 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:08.139194 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:08.112980 20614 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:08.140082 20856 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.222s	user 0.008s	sys 0.010s
I20260709 13:09:08.141363 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.142052 19373 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:08.067011 20718 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.118958 19225 pending_rounds.cc:107] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:08.147746 19225 raft_consensus.cc:2889] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.120966 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:08.121217 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:08.077153 20676 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:08.121346 20772 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:08.121476 19367 rpcz_store.cc:276] 0709 13:09:06.872276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.878265 (+  5989us) service_pool.cc:224] Handling call
0709 13:09:08.069569 (+1191304us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002d0354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:08.069682 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424250240}
I20260709 13:09:08.122893 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:08.138893 20766 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.146579 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:08.108045 19218 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:08.145851 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:08.165134 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43991.9us
W20260709 13:09:08.216945 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71195.6us
I20260709 13:09:08.170420 19221 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:08.218278 19221 pending_rounds.cc:85] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 1
I20260709 13:09:08.218550 19221 pending_rounds.cc:107] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:09:08.218588 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.218814 19221 raft_consensus.cc:2889] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:08.222347 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 99553.2us
I20260709 13:09:08.113571 20818 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.226640 19373 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:08.139242 20729 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:08.140458 20614 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.164408 20718 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.250516 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:08.257040 19367 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:08.221517 20606 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:08.261539 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:08.225308 20734 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.269158 20777 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:08.269188 20817 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:08.274843 20676 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.275846 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:08.276765 19217 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3.
I20260709 13:09:08.278642 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:08.282487 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 56534us
I20260709 13:09:08.285324 19365 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:08.249993 20736 consensus_queue.cc:1175] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 3 index: 2 } }
I20260709 13:09:08.225921 20772 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.288646 19225 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:08.265702 20730 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.265295 20734 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:08.290795 20857 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:08.281172 20827 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.296973 20777 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:09:08.291538 20819 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.294471 20728 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:08.223333 19894 raft_consensus.cc:2955] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:08.278812 20644 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:08.306314 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:08.317612 20772 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.321671 20728 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:08.302680 20734 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.329368 20818 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.303809 20625 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:08.334499 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.336344 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:08.342998 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:08.345363 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.356297 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 209792us
I20260709 13:09:08.359249 20880 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.359505 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:08.377581 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:08.309005 20483 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:08.341712 20844 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:08.381548 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.380288 20819 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.383576 20819 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:08.384052 20819 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.329432 20628 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.361119 19217 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:08.392347 19898 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:08.383064 20844 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:08.392576 20749 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:08.393136 19895 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:08.393280 20844 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.386384 19896 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.378991 20871 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.397259 20644 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.399392 20827 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:08.399884 20827 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.400550 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:08.401371 20625 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.401862 20625 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:08.401976 20844 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.402750 20625 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.406875 19297 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:08.338544 20808 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:09:08.399631 20483 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:08.421685 20808 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:08.422215 20808 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:08.423213 20808 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.339886 20777 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:08.385309 20607 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:09:08.477581 20852 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.408s	user 0.000s	sys 0.004s
I20260709 13:09:08.413406 20728 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.425882 20799 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.404011 20844 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.424877 20718 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.507516 20682 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.429327 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:08.429724 20819 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:08.508801 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 110945us
I20260709 13:09:08.509527 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:08.436590 20827 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.511138 19339 leader_election.cc:400] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 2. Current term is 3.
I20260709 13:09:08.512126 20799 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.512310 20817 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:08.513234 20817 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.513541 20817 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:08.440272 19224 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:08.441828 19223 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:08.442840 19372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1357) took 1935 ms (client timeout 1933 ms). Trace:
W20260709 13:09:08.444087 20851 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.687s	user 0.001s	sys 0.001s
I20260709 13:09:08.448457 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 99) took 2535 ms. Trace:
I20260709 13:09:08.449429 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1341) took 2713 ms. Trace:
I20260709 13:09:08.453577 20766 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:08.457958 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.466702 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:08.537179 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70606.8us
I20260709 13:09:08.359848 20880 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.520700 19296 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.546504 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:08.522305 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:08.546590 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:08.526700 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.530315 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:08.547399 19224 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:08.547760 19299 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:08.532294 19368 rpcz_store.cc:276] 0709 13:09:05.735669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.964596 (+1228927us) service_pool.cc:224] Handling call
0709 13:09:06.964886 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.754109 (+789223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.449130 (+695021us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b5400355f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:08.449364 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804419328}
I20260709 13:09:08.510315 20819 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.531121 19370 rpcz_store.cc:276] 0709 13:09:05.912766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.217907 (+1305141us) service_pool.cc:224] Handling call
0709 13:09:08.443288 (+1225381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.443504 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.443539 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.443604 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:08.443656 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.443730 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.448283 (+  4553us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400424ad0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:08.448402 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817449728}
I20260709 13:09:08.548641 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.512142 20827 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.534291 20483 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:08.535092 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51372.5us
I20260709 13:09:08.525835 20818 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:08.543143 20718 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.548763 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:08.556879 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.534365 20730 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:09:08.549794 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.527393 20817 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.550537 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:08.528805 20808 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.541602 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.544697 19294 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:08.557776 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:08.563910 19365 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:08.564699 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:08.546808 20826 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.566272 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:08.399659 20734 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.573165 19300 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:08.574395 20734 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.549067 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:08.552543 20483 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:08.584944 19219 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.581436 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.583990 19368 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:08.560134 19900 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.587881 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:08.555986 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1342) took 2816 ms. Trace:
I20260709 13:09:08.597633 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:08.548588 20788 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 13:09:08.528079 19372 rpcz_store.cc:269] 0709 13:09:06.507088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.541011 (+ 33923us) service_pool.cc:224] Handling call
0709 13:09:08.442587 (+1901576us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400424ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:08.442757 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233307392}
I20260709 13:09:08.607719 20659 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.651085 20880 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:08.612520 19217 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:08.656119 20628 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.611646 20771 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:09:08.659133 19224 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:08.661463 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:08.647277 20659 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.665700 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:08.666615 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:08.675580 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.676151 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:08.672685 20606 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:08.654626 20729 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:08.669559 20659 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.712116 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:08.712877 19224 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.667256 20880 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.612847 20483 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:08.703140 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.715426 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:08.719744 20880 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:08.675029 20730 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:08.721303 19299 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:08.674944 20882 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.725929 19299 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:08.730815 20880 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.737545 19299 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:08.720266 20729 consensus_queue.cc:1243] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:08.737006 20614 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.774276 19224 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:08.775180 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:08.775733 19224 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.738353 20483 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.781921 20606 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.782493 20639 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:08.783275 20875 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:08.785722 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:08.601756 19366 rpcz_store.cc:276] 0709 13:09:05.739511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.970623 (+1231112us) service_pool.cc:224] Handling call
0709 13:09:06.970976 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.101654 (+130678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.105083 (+  3429us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.615653 (+510570us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b2c001323f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:09:07.616179 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.746725 (+130546us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.746766 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.746839 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.059972 (+313133us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b1800430240. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:08.443453 (+383481us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:08.544975 (+101522us) raft_consensus.cc:1685] finished
0709 13:09:08.546417 (+  1442us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.553558 (+  7141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114014,"raft.queue_time_us":128704,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":14455,"spinlock_wait_cycles":18427392,"thread_start_us":127861,"threads_started":1,"wal-append.queue_time_us":140390}
I20260709 13:09:08.727710 20730 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:08.737898 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:08.765532 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46122us
I20260709 13:09:08.769078 20880 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.821498 20730 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.794725 20720 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.837761 19121 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 258) took 4628 ms. Trace:
W20260709 13:09:08.848840 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 172752us
I20260709 13:09:08.808393 20890 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.819403 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 381) took 1830 ms. Trace:
I20260709 13:09:08.853403 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:08.857992 19224 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:08.858922 19223 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:08.862159 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:08.856813 19896 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:08.862358 20882 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:08.864634 20882 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.862417 20607 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:08.866963 20607 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.869311 20607 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:08.869500 20659 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.871589 20659 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:08.842351 20720 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.873977 20720 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.874655 20690 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.781358 20614 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.875962 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:08.876138 20690 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.876865 20614 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:08.875998 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:08.879894 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.884483 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:08.884781 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:08.885932 20887 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.889883 20887 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.857296 19217 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:08.895015 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:08.838209 19121 rpcz_store.cc:276] 0709 13:09:04.196158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.196327 (+   169us) service_pool.cc:224] Handling call
0709 13:09:08.824584 (+4628257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:07.551296 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:07.552049 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:07.552097 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:09:07.552123 (+    26us) tablet.cc:662] Decoding operations
0709 13:09:07.552651 (+   528us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:07.552770 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:07.552815 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:07.553244 (+   429us) tablet.cc:701] Row locks acquired
0709 13:09:07.553268 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:09:07.553439 (+   171us) write_op.cc:270] Start()
0709 13:09:07.553576 (+   137us) write_op.cc:276] Timestamp: P: 1783602547553393 usec, L: 0
0709 13:09:07.553605 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:09:07.554402 (+   797us) log.cc:844] Serialized 935 byte log entry
0709 13:09:08.078265 (+523863us) op_driver.cc:464] REPLICATION: finished
0709 13:09:08.382041 (+303776us) write_op.cc:301] APPLY: starting
0709 13:09:08.383318 (+  1277us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:08.383441 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:08.383575 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:08.383984 (+   409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:08.384203 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:08.384256 (+    53us) write_op.cc:312] APPLY: finished
0709 13:09:08.384451 (+   195us) log.cc:844] Serialized 29 byte log entry
0709 13:09:08.384628 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:08.384715 (+    87us) write_op.cc:454] Released schema lock
0709 13:09:08.407737 (+ 23022us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:08.412664 (+  4927us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:08.412705 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":651994,"reported_tablets":3,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":287831,"apply.run_cpu_time_us":2018,"apply.run_wall_time_us":33135,"num_ops":2,"prepare.queue_time_us":186632,"prepare.run_cpu_time_us":173307,"prepare.run_wall_time_us":205185,"raft.queue_time_us":96556,"raft.run_cpu_time_us":66027,"raft.run_wall_time_us":388599,"replication_time_us":503740,"thread_start_us":613346,"threads_started":4,"wal-append.queue_time_us":217162}]]}
W20260709 13:09:08.892125 20881 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:09:08.876897 19216 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:08.902833 20772 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.908056 20890 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:08.915601 20728 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.915266 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:08.919539 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1396) took 1090 ms. Trace:
I20260709 13:09:08.919770 20895 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.947407 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:08.934890 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:08.957703 19296 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:08.959542 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 110566us
I20260709 13:09:08.963085 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:08.986699 20897 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:08.987321 20897 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:08.988127 20644 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:08.990280 20897 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:08.991496 20894 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:08.991690 20772 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.946974 20887 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:08.992463 20772 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.996467 20606 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:08.996796 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.944471 19219 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:08.992960 20729 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.946868 20728 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:08.959390 19217 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:08.985742 20819 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:09.006599 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:08.997850 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.021459 19299 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:09.006701 20882 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.016716 19373 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:09.031216 19373 pending_rounds.cc:85] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 5
I20260709 13:09:09.031478 19373 pending_rounds.cc:107] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:09.031738 19373 raft_consensus.cc:2889] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.994261 19898 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:09.021875 19365 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:09.017408 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1315) took 1612 ms. Trace:
I20260709 13:09:09.040086 19295 rpcz_store.cc:276] 0709 13:09:07.387760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.652813 (+265053us) service_pool.cc:224] Handling call
0709 13:09:07.655120 (+  2307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.655570 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.655614 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.656198 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.649631 (+993433us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b18003a0960. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:09:08.768545 (+118914us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.781820 (+ 13275us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.782030 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.782112 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.973835 (+191723us) raft_consensus.cc:1685] finished
0709 13:09:08.999788 (+ 25953us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.999942 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3328,"prepare.queue_time_us":21452,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":3382,"raft.queue_time_us":353,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":3263,"spinlock_wait_cycles":8175488,"thread_start_us":118712,"threads_started":1,"wal-append.queue_time_us":1234560}
I20260709 13:09:08.972481 20889 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:09:09.046759 20879 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.688s	user 0.002s	sys 0.000s
I20260709 13:09:09.049613 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:08.857657 19894 rpcz_store.cc:276] 0709 13:09:06.986454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.199895 (+213441us) service_pool.cc:224] Handling call
0709 13:09:07.205601 (+  5706us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:07.269054 (+ 63453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.271858 (+  2804us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:08.074623 (+802765us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b2c000474b8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:09:08.075425 (+   802us) log.cc:844] Serialized 534 byte log entry
0709 13:09:08.223171 (+147746us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:08.390887 (+167716us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.506028 (+115141us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.507304 (+  1276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.781080 (+273776us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b54004b19d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:08.795302 (+ 14222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.805653 (+ 10351us) raft_consensus.cc:1685] finished
0709 13:09:08.805666 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.817112 (+ 11446us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":79260,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":30485,"spinlock_wait_cycles":25045632,"thread_start_us":141300,"threads_started":1,"wal-append.queue_time_us":225065}
I20260709 13:09:08.961369 20701 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:09:09.053563 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:09.053910 19291 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:09.054467 19217 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:08.972644 19899 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:09.010632 20896 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:09:08.945185 19216 rpcz_store.cc:276] 0709 13:09:07.827509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.836628 (+  9119us) service_pool.cc:224] Handling call
0709 13:09:08.875821 (+1039193us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90e9c 00007fe8d4d90a5b 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:08.917568 (+ 41747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10054400}
I20260709 13:09:09.017231 20887 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.958847 20817 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.063556 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:09.070664 20898 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:09:09.030275 20682 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.068532 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:09.078212 19299 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.057328 19219 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.057051 20826 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.940199 20890 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.032541 20729 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:08.953099 20895 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.128351 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:09.134974 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50616.5us
I20260709 13:09:09.144691 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.089802 20730 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.146623 19225 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:09.148630 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:09.089576 20701 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.079154 20887 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.081943 20682 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:09.153723 19266 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.012s	sys 0.011s
I20260709 13:09:09.153690 19295 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:09.156833 19299 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:09.157133 19299 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:09.138139 20889 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.158006 19266 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.013s	sys 0.011s
I20260709 13:09:09.137040 20882 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:09.158380 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 699612us
I20260709 13:09:09.163494 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:09.170823 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:09.171624 19372 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.153932 20729 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.230016 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:09.149995 20764 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:09:09.128656 20728 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.216929 20904 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:09.225291 20910 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.161087 20701 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.216199 20882 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.246206 20902 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.253474 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1288) took 3510 ms. Trace:
I20260709 13:09:09.264364 19369 rpcz_store.cc:276] 0709 13:09:05.743131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.201684 (+1458553us) service_pool.cc:224] Handling call
0709 13:09:07.214686 (+ 13002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.773177 (+558491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.253182 (+1480005us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b5400357854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:09.253407 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282593664}
I20260709 13:09:09.176476 20889 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.246603 20555 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.247098 20883 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.269784 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:09.270828 19299 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.283335 19368 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:09.280977 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 217489us
I20260709 13:09:09.263698 20905 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.290697 19369 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:09.284984 20682 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.262441 20910 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.258895 20904 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.306923 20910 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:09.291445 20788 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.290175 20826 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.293677 20734 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.293879 20433 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:09.311770 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.321085 20873 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:09.307996 20895 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.279004 20902 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.298946 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.325515 19372 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:09.325843 20701 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.325634 20902 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.312606 20817 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:09.315168 20890 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.292348 20883 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.365842 19371 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
W20260709 13:09:09.366122 20906 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:09:09.368867 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1102) took 1470 ms. Trace:
I20260709 13:09:09.331554 20913 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:09.297940 20905 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:09:09.318262 20788 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.369412 19221 rpcz_store.cc:276] 0709 13:09:07.898764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.080626 (+181862us) service_pool.cc:224] Handling call
0709 13:09:08.080981 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.219293 (+138312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.368563 (+1149270us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b540039a8d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:09.368792 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204630272}
I20260709 13:09:09.376029 20889 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.381212 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.388809 19223 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:09.329303 20855 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.410s	user 0.013s	sys 0.003s
I20260709 13:09:09.386508 20910 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:09.387030 20883 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:09.371718 20887 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.363766 20902 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:09.326231 20433 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.400298 19221 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:09.319527 20826 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:09.397437 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1319) took 1295 ms (client timeout 1509 ms). Trace:
W20260709 13:09:09.406379 19297 rpcz_store.cc:269] 0709 13:09:08.102427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.105271 (+  2844us) service_pool.cc:224] Handling call
0709 13:09:09.397241 (+1291970us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002b75d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:09.397380 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660925312}
I20260709 13:09:09.407191 19221 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:09.407728 19221 pending_rounds.cc:85] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 1
I20260709 13:09:09.408003 19221 pending_rounds.cc:107] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:09.408319 19221 raft_consensus.cc:2889] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.319741 20734 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.371444 20913 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.413335 19221 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:09.415444 20826 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.415956 20913 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:09.413251 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:09.418390 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.421190 20433 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.419253 19297 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:09.418009 20913 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:09.423804 20913 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.424134 20913 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.434990 20788 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.418527 20882 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.436321 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.437057 19297 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:09.448024 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 116) took 1751 ms. Trace:
I20260709 13:09:09.448621 19298 rpcz_store.cc:276] 0709 13:09:07.696132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.704920 (+  8788us) service_pool.cc:224] Handling call
0709 13:09:07.718938 (+ 14018us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:07.724077 (+  5139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.724122 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:07.729838 (+  5716us) log.cc:844] Serialized 52 byte log entry
0709 13:09:07.762609 (+ 32771us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.766917 (+  4308us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.767108 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.767173 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.330286 (+563113us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b1800382d20. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:09.252305 (+922019us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:09.447783 (+195478us) raft_consensus.cc:1685] finished
0709 13:09:09.447812 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.447953 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1954,"prepare.queue_time_us":4647,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":260,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":7032,"spinlock_wait_cycles":11628288,"thread_start_us":26555,"threads_started":1,"wal-append.queue_time_us":122245}
I20260709 13:09:09.469097 20905 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.471177 19219 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:09.397828 20910 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.409778 20902 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.501631 20676 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.506031 20910 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.507212 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.507995 20902 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:09.499261 19899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 326) took 1670 ms (client timeout 1731 ms). Trace:
W20260709 13:09:09.509419 19899 rpcz_store.cc:269] 0709 13:09:07.829136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.836181 (+  7045us) service_pool.cc:224] Handling call
0709 13:09:08.429194 (+593013us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:09.499034 (+1069840us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540056d454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:09.499180 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357402112}
I20260709 13:09:09.521108 20913 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.524577 20730 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.525795 19366 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:09.540526 20736 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:09.541265 20736 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.545603 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1409) took 1258 ms. Trace:
I20260709 13:09:09.546126 19218 rpcz_store.cc:276] 0709 13:09:08.287521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.287639 (+   118us) service_pool.cc:224] Handling call
0709 13:09:08.287860 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.306249 (+ 18389us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:08.661467 (+355218us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.810469 (+149002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.810537 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:08.810593 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.545329 (+734736us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b54000e3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:09.545393 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.545536 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412936,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":46959,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":22806,"spinlock_wait_cycles":41838464,"thread_start_us":470778,"threads_started":2,"wal-append.queue_time_us":248742}
I20260709 13:09:09.553423 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1306) took 1040 ms. Trace:
I20260709 13:09:09.553973 19365 rpcz_store.cc:276] 0709 13:09:08.512712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.582279 (+ 69567us) service_pool.cc:224] Handling call
0709 13:09:09.553197 (+970918us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54000956d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:09.553358 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988562304}
W20260709 13:09:09.558802 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.615224 20758 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.615911 20758 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.618233 20758 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:09.620594 20878 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.264s	user 0.002s	sys 0.002s
I20260709 13:09:09.625243 19299 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.631412 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1130) took 1112 ms. Trace:
I20260709 13:09:09.634527 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.631923 19300 rpcz_store.cc:276] 0709 13:09:08.519469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.522102 (+  2633us) service_pool.cc:224] Handling call
0709 13:09:09.631129 (+1109027us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54002e7a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:09.631328 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58970496}
W20260709 13:09:09.644026 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 135254us
W20260709 13:09:09.644507 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 352572us
I20260709 13:09:09.651098 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:09.647547 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.619091 20808 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.652247 19220 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:09.652787 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1107) took 1137 ms. Trace:
I20260709 13:09:09.652534 20808 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.653445 20788 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:09.653901 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 350944us
I20260709 13:09:09.643970 20902 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.655422 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:09.663033 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:09.673552 20758 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:09.674304 20614 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:09.674842 20614 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.679338 19299 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:09.657883 20788 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.653175 19220 rpcz_store.cc:276] 0709 13:09:08.515541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.526273 (+ 10732us) service_pool.cc:224] Handling call
0709 13:09:09.633308 (+1107035us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:09.652725 (+ 19417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9543040}
I20260709 13:09:09.683496 19299 pending_rounds.cc:85] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 5
I20260709 13:09:09.667848 20639 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:09.667757 20826 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:09.667532 20811 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.667327 20902 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.692487 20811 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.693801 20902 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.686653 20913 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.694890 20811 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.692082 20826 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:09.697924 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.698163 20826 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.699393 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.702971 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.703747 19224 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:09.705510 20904 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.712507 20625 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.713191 20625 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.676530 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:09.716187 20885 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.835s	user 0.005s	sys 0.000s
I20260709 13:09:09.716454 19900 raft_consensus.cc:2368] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 3. Current term is 4.
I20260709 13:09:09.688382 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:09.717268 19367 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.717717 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.718034 20734 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.719421 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:09.720858 19220 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.721832 19896 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:09.723855 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1414) took 1019 ms. Trace:
W20260709 13:09:09.686388 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.724269 19219 rpcz_store.cc:276] 0709 13:09:08.704939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.472148 (+767209us) service_pool.cc:224] Handling call
0709 13:09:09.518786 (+ 46638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.563573 (+ 44787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.563613 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.563666 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:09.563702 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.723638 (+159936us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b5400136354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:09.723685 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.723803 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102449024}
I20260709 13:09:09.725045 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:09.725677 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.726491 19219 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:09.726943 20734 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:09.727290 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.727458 20648 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.727924 20648 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.730283 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.732542 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.733042 19367 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:09.684950 20736 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.691437 20639 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.734790 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:09.685511 20788 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.690828 19299 pending_rounds.cc:107] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:09.749130 19299 raft_consensus.cc:2889] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.745702 19188 leader_election.cc:400] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 3. Current term is 4.
I20260709 13:09:09.746260 20639 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.746399 20910 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:09.746626 20758 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:09.753736 19188 leader_election.cc:403] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:09.752703 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.755298 19224 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:09.757339 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.758827 19224 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:09.727321 20734 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.727896 19219 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:09.781188 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:09.792485 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.770881 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.794690 19298 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:09.794694 19224 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:09.788218 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:09.752065 20628 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:09.797745 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.798810 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.800313 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:09.801240 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.804443 19224 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:09.805524 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1419) took 1024 ms. Trace:
I20260709 13:09:09.806820 19224 rpcz_store.cc:276] 0709 13:09:08.781471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.803773 (+1022302us) service_pool.cc:224] Handling call
0709 13:09:09.804235 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.805243 (+  1008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.805463 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:09.811355 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.816360 20614 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:09.816535 20648 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:09.817430 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.818107 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:09.820706 20876 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.958s	user 0.003s	sys 0.000s
I20260709 13:09:09.823757 20905 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:09.824100 20676 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:09.824154 20905 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.825600 20905 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.832793 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.833406 20905 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:09:09.835783 20720 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:09.839509 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.843401 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1111) took 1326 ms. Trace:
I20260709 13:09:09.765656 20910 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:09.801194 20902 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:09.836158 20905 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:09.854700 19369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.108s
I20260709 13:09:09.858109 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:09.765641 20734 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.870172 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 350) took 1331 ms. Trace:
I20260709 13:09:09.891271 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:09.891311 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.005s	sys 0.108s
I20260709 13:09:09.878021 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:09.890527 19903 rpcz_store.cc:276] 0709 13:09:08.538465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.538603 (+   138us) service_pool.cc:224] Handling call
0709 13:09:09.869277 (+1330674us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:09.869539 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.869770 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.869808 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.869863 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:09.869904 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.869974 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.870106 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24295680}
I20260709 13:09:09.864118 20606 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.907079 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.908923 20910 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.871547 19217 rpcz_store.cc:276] 0709 13:09:08.516763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.076235 (+559472us) service_pool.cc:224] Handling call
0709 13:09:09.129831 (+ 53596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.156028 (+ 26197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.160033 (+  4005us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.252088 (+ 92055us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.416019 (+163931us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:09.416067 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.416138 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.843134 (+426996us) raft_consensus.cc:1685] finished
0709 13:09:09.843168 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.843331 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100200,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":7791,"thread_start_us":147164,"threads_started":1,"wal-append.queue_time_us":584667}
I20260709 13:09:09.914474 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.914706 19220 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:09.915925 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:09.917495 19220 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:09.923226 19220 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:09.924407 20811 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 3. Current term is 4.
I20260709 13:09:09.928916 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.932402 20606 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:09.934921 20606 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:09.888237 20902 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:09.935829 20902 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.941862 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:09.943703 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.947809 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:09.949677 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:09.960366 19903 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:09.972568 19374 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:09.975049 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.976531 19224 pending_rounds.cc:85] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 1
I20260709 13:09:09.976990 19224 pending_rounds.cc:107] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:09.887398 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:09.759291 20758 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:09.894860 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:09.991984 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 97220.6us
I20260709 13:09:09.993813 19224 raft_consensus.cc:2889] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:09.945377 19897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.013s	sys 0.060s
I20260709 13:09:09.898768 20870 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.898551 20745 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:09.898366 19292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.018s	sys 0.029s
I20260709 13:09:09.898850 20889 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:09.993408 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:10.021853 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:09.945169 20483 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:09.996477 20648 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.030328 20904 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.021739 19216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.010s	sys 0.053s
I20260709 13:09:10.001835 20606 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:10.021859 19897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.013s	sys 0.060s
I20260709 13:09:10.019878 20676 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:10.021458 20905 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:10.030675 20690 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.023459 20718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.034s	sys 0.057s
W20260709 13:09:10.075788 19216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.011s	sys 0.054s
I20260709 13:09:10.062641 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:10.066259 19217 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:10.096920 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:10.036698 19292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.019s	sys 0.030s
W20260709 13:09:10.100215 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.100275 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 405) took 1137 ms. Trace:
I20260709 13:09:10.100821 20758 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:10.146763 19897 rpcz_store.cc:276] 0709 13:09:08.962624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.964436 (+  1812us) service_pool.cc:224] Handling call
0709 13:09:08.964746 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.964971 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:08.965296 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:09:10.085287 (+1119991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.094338 (+  9051us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:10.099944 (+  5606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.100040 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.100210 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":664,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":156557,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":1102877,"threads_started":2,"wal-append.queue_time_us":175621}
W20260709 13:09:10.090831 19221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.009s	sys 0.002s
I20260709 13:09:10.102555 20772 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.103384 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:10.070736 20904 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.089315 20676 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.105123 20808 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.106405 20922 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.106910 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:10.107259 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:10.111600 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 118277us
I20260709 13:09:10.108417 20729 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:10.094419 20718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.035s	sys 0.057s
I20260709 13:09:10.118191 19367 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:10.146153 20872 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:10.156201 19221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.002s
I20260709 13:09:10.072494 20483 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.181529 20872 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:10.182505 20483 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:10.085142 20920 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:09:10.070945 20745 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.160552 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:10.061422 20889 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.132221 20870 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:10.162858 20528 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.165125 20818 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:09:10.176506 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:10.089150 20606 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:10.133409 20880 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:10.094489 20905 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.182731 20872 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.203589 20745 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:10.158877 20844 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.105180 20690 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.213316 19374 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:10.224539 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64087.2us
I20260709 13:09:10.189267 19899 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:10.162271 20915 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:10.189447 20729 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.236431 20729 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.236565 20676 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:10.225448 20880 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.232374 20844 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.239020 20880 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.205247 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 111) took 1179 ms. Trace:
I20260709 13:09:10.188436 20614 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:10.240293 20844 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:10.165241 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1423) took 1125 ms. Trace:
I20260709 13:09:10.240319 19366 rpcz_store.cc:276] 0709 13:09:09.009216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.015697 (+  6481us) service_pool.cc:224] Handling call
0709 13:09:09.084823 (+ 69126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.526238 (+441415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.159980 (+633742us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003471d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:10.188738 (+ 28758us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009646976}
I20260709 13:09:10.246424 20898 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:10.246500 20483 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.235247 20690 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:10.249936 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:10.251026 20818 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:10.251423 20729 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.204628 20870 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.218390 20528 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.235074 20904 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.235005 20639 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.241976 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:10.243062 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:10.243820 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 56551.3us
I20260709 13:09:10.240554 20614 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.247498 20597 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.222344 20734 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:10.249503 20788 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
W20260709 13:09:10.286870 19300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.041s	sys 0.078s
W20260709 13:09:10.287458 19300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.041s	sys 0.078s
I20260709 13:09:10.255630 20483 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:10.255771 20818 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:10.291500 19296 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:10.261910 20690 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:10.263447 20904 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.245543 19217 rpcz_store.cc:276] 0709 13:09:09.037673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.915746 (+878073us) service_pool.cc:224] Handling call
0709 13:09:09.916103 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.132728 (+216625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.162953 (+ 30225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:10.249450 20915 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.292622 20728 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:10.295145 20690 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.294996 20889 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:10.216809 20607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.006s	sys 0.012s
W20260709 13:09:10.321951 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.010s
W20260709 13:09:10.322304 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.009s	sys 0.010s
I20260709 13:09:10.296693 20925 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:10.262549 20606 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.318598 20690 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:10.320955 20607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.006s	sys 0.012s
I20260709 13:09:10.325021 20555 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:10.327565 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:10.331154 20555 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.336249 20528 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:10.295495 20902 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.293643 20788 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.300760 20904 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:10.323635 20799 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.018s
I20260709 13:09:10.308056 20898 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:09:10.467151 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.018s	sys 0.013s
W20260709 13:09:10.481591 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.019s	sys 0.013s
W20260709 13:09:10.481913 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 584909us
I20260709 13:09:10.483168 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:10.459051 19264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.013s	sys 0.008s
W20260709 13:09:10.484583 19264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.014s	sys 0.008s
W20260709 13:09:10.460685 19223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.035s	sys 0.039s
W20260709 13:09:10.486013 19223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.035s	sys 0.040s
W20260709 13:09:10.323987 19222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.003s	sys 0.016s
W20260709 13:09:10.376658 20926 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:09:10.461309 20919 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.167s	user 0.003s	sys 0.000s
W20260709 13:09:10.455919 20433 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.014s	sys 0.009s
I20260709 13:09:10.340355 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1122) took 1674 ms. Trace:
W20260709 13:09:10.493251 19222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.008s	sys 0.016s
I20260709 13:09:10.487383 20628 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.391969 20915 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:10.389009 20639 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.393100 20729 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.371867 20734 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:10.484256 20799 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.000s	sys 0.024s
I20260709 13:09:10.391819 20614 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.338236 20905 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.378305 20625 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.510273 19221 rpcz_store.cc:276] 0709 13:09:08.666108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.419497 (+753389us) service_pool.cc:224] Handling call
0709 13:09:09.422798 (+  3301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.423495 (+   697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.424687 (+  1192us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.430975 (+  6288us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.183636 (+752661us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:10.183677 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.183737 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.340064 (+156327us) raft_consensus.cc:1685] finished
0709 13:09:10.340089 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.340284 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":399,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":711044,"threads_started":1,"wal-append.queue_time_us":814313}
I20260709 13:09:10.545261 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:10.385084 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:10.362663 20913 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:10.488984 20682 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:10.503479 19220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.010s	sys 0.034s
I20260709 13:09:10.502197 20870 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:10.510070 20433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.015s	sys 0.010s
W20260709 13:09:10.370795 19898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.027s	sys 0.043s
I20260709 13:09:10.563261 19221 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:09:10.564890 19263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.006s	sys 0.028s
W20260709 13:09:10.592494 19263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.008s	sys 0.029s
W20260709 13:09:10.565282 19224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.004s	sys 0.014s
W20260709 13:09:10.593397 19224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.014s
I20260709 13:09:10.333920 20925 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.390421 20483 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.457525 20818 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.541040 20758 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:10.567728 19220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.011s	sys 0.034s
I20260709 13:09:10.588289 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:10.656598 19221 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
W20260709 13:09:10.571352 19898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.028s	sys 0.048s
I20260709 13:09:10.543563 20766 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:09:10.658042 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:10.589087 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51315.2us
I20260709 13:09:10.651095 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1146) took 1599 ms. Trace:
I20260709 13:09:10.662439 19295 rpcz_store.cc:276] 0709 13:09:09.051638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.262684 (+211046us) service_pool.cc:224] Handling call
0709 13:09:09.263009 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.263324 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.263355 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.263787 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.657224 (+393437us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:09.657260 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.658268 (+  1008us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.251819 (+593551us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:10.577966 (+326147us) raft_consensus.cc:1685] finished
0709 13:09:10.577993 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.651020 (+ 73027us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5865,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4028,"spinlock_wait_cycles":45293440,"thread_start_us":363951,"threads_started":1,"wal-append.queue_time_us":733392}
I20260709 13:09:10.662161 19221 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:10.660415 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:10.712458 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:10.713124 19221 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.651645 20628 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.567625 20913 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.569468 20682 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.662099 20734 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.712839 20870 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.661545 20758 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.661660 20880 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:10.752628 20934 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.099s	user 0.004s	sys 0.001s
W20260709 13:09:10.762182 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.005s	sys 0.034s
W20260709 13:09:10.769433 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.005s	sys 0.034s
I20260709 13:09:10.730758 20811 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.740841 20925 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.713963 20639 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:10.734862 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 74518.4us
W20260709 13:09:10.770154 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 820485us
I20260709 13:09:10.766943 20788 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.737713 20682 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.734652 20628 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:10.778399 20720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.020s
W20260709 13:09:10.814183 20720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.000s	sys 0.020s
I20260709 13:09:10.798871 20788 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:10.731158 20924 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260709 13:09:10.738899 20729 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.767944 20870 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.771327 20880 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.780694 20811 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:10.809724 20614 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.803705 20682 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.798774 20639 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:10.823057 20935 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:10.778098 20734 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.808897 20902 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:10.884616 20758 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:10.883523 20826 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:09:10.896150 20728 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:10.896836 20728 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.898648 20913 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.833387 20941 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:10.822856 20788 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:10.901324 20938 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:09:10.902534 20788 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.904003 20870 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:10.905247 20939 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:09:10.884869 20929 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:10.900003 20941 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:10.908731 20928 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.588s	user 0.000s	sys 0.002s
I20260709 13:09:10.910176 20941 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.912391 20880 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.914734 20811 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:10.915995 20932 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.380s	user 0.001s	sys 0.001s
W20260709 13:09:10.887830 20930 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:10.882982 20925 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:10.939730 20940 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.199s	user 0.003s	sys 0.000s
W20260709 13:09:10.940100 20942 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:09:10.932736 20925 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.945086 20925 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.947566 20904 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:10.991973 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1418) took 2273 ms. Trace:
I20260709 13:09:10.993965 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1147) took 1267 ms. Trace:
I20260709 13:09:10.995163 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1427) took 1329 ms. Trace:
I20260709 13:09:10.993073 19218 rpcz_store.cc:276] 0709 13:09:08.717942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.548749 (+830807us) service_pool.cc:224] Handling call
0709 13:09:09.549120 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.656829 (+107709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.656879 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.665805 (+  8926us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.322693 (+656888us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:10.323387 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.323464 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.991161 (+667697us) raft_consensus.cc:1685] finished
0709 13:09:10.991239 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.991700 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107249,"raft.queue_time_us":107930,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9351,"thread_start_us":635174,"threads_started":1,"wal-append.queue_time_us":860059}
I20260709 13:09:10.995419 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1112) took 2478 ms. Trace:
I20260709 13:09:10.997396 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1115) took 2470 ms. Trace:
W20260709 13:09:10.998122 19366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.017s	sys 0.006s
I20260709 13:09:10.997189 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:10.998927 19366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.017s	sys 0.006s
I20260709 13:09:10.999729 19218 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:11.001157 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1428) took 1335 ms. Trace:
I20260709 13:09:11.001324 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1117) took 3336 ms. Trace:
I20260709 13:09:10.770363 19221 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:11.002420 19374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.010s	sys 0.029s
W20260709 13:09:11.003067 19374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.011s	sys 0.029s
I20260709 13:09:11.001693 19219 rpcz_store.cc:276] 0709 13:09:09.665914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.680888 (+1014974us) service_pool.cc:224] Handling call
0709 13:09:10.763103 (+ 82215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.771380 (+  8277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.000275 (+228895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.000415 (+   140us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:11.000534 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.000679 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.000901 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.000074 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1422) took 1962 ms. Trace:
I20260709 13:09:11.009603 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 407) took 1955 ms. Trace:
I20260709 13:09:11.010250 20614 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:10.775270 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.012s
W20260709 13:09:10.770982 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.012s
W20260709 13:09:11.013329 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.008s	sys 0.012s
I20260709 13:09:11.013090 20682 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.014991 20528 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:11.015288 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 838786us
I20260709 13:09:11.015964 20528 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.018203 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 366) took 1185 ms. Trace:
I20260709 13:09:11.009209 19224 rpcz_store.cc:276] 0709 13:09:09.037359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.810044 (+772685us) service_pool.cc:224] Handling call
0709 13:09:09.810392 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.994620 (+184228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.994659 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.995153 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.593842 (+598689us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:10.593898 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.593991 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.999395 (+405404us) raft_consensus.cc:1685] finished
0709 13:09:10.999450 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.999825 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":598338,"threads_started":1,"wal-append.queue_time_us":838815}
I20260709 13:09:11.010201 19898 rpcz_store.cc:276] 0709 13:09:09.053796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.053955 (+   159us) service_pool.cc:224] Handling call
0709 13:09:09.054314 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.279488 (+225174us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:09.282156 (+  2668us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.313784 (+ 31628us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.680482 (+1366698us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:10.775530 (+ 95048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.804652 (+ 29122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.008978 (+204326us) raft_consensus.cc:1685] finished
0709 13:09:11.009028 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.009332 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31306,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":43007,"thread_start_us":1547538,"threads_started":2,"wal-append.queue_time_us":1415758}
I20260709 13:09:11.021008 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 365) took 1194 ms. Trace:
W20260709 13:09:11.022071 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.009s	sys 0.012s
I20260709 13:09:10.869153 20729 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:11.026633 20729 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.011982 20628 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.027451 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1431) took 1360 ms. Trace:
W20260709 13:09:11.037751 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 811254us
I20260709 13:09:11.094774 19218 rpcz_store.cc:276] 0709 13:09:09.666789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.001180 (+1334391us) service_pool.cc:224] Handling call
0709 13:09:11.001767 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.026825 (+ 25058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.026882 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.026995 (+   113us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:11.027054 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.027156 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.027342 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.021462 19901 rpcz_store.cc:276] 0709 13:09:09.826409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.826549 (+   140us) service_pool.cc:224] Handling call
0709 13:09:09.826871 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.827172 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.827198 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.827627 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.327536 (+499909us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:10.327591 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.327684 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.020416 (+692732us) raft_consensus.cc:1685] finished
0709 13:09:11.020473 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.020742 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1003,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":8064,"thread_start_us":499523,"threads_started":1,"wal-append.queue_time_us":838241}
I20260709 13:09:10.994549 19300 rpcz_store.cc:276] 0709 13:09:09.725896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.728329 (+  2433us) service_pool.cc:224] Handling call
0709 13:09:09.728717 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.729067 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.729105 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.729623 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.289491 (+559868us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:10.289547 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.289650 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.993127 (+703477us) raft_consensus.cc:1685] finished
0709 13:09:10.993179 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.993603 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17758,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":559446,"threads_started":1,"wal-append.queue_time_us":840074}
I20260709 13:09:11.079144 20734 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:10.997993 19223 rpcz_store.cc:276] 0709 13:09:08.526402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.393119 (+866717us) service_pool.cc:224] Handling call
0709 13:09:09.393515 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.393891 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.393928 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.410866 (+ 16938us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.486379 (+1075513us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:10.486418 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.486483 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.996827 (+510344us) raft_consensus.cc:1685] finished
0709 13:09:10.996863 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.997195 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":530,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14712,"thread_start_us":1064128,"threads_started":1,"wal-append.queue_time_us":1379957}
I20260709 13:09:11.154000 20897 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.155076 20897 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:11.153983 20910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.034s	sys 0.024s
I20260709 13:09:11.156153 20528 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:11.163646 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:11.156936 20910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.034s	sys 0.024s
I20260709 13:09:11.018934 19896 rpcz_store.cc:276] 0709 13:09:09.832811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.832945 (+   134us) service_pool.cc:224] Handling call
0709 13:09:09.833255 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.833461 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.833489 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.833945 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.335742 (+501797us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:10.335815 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.335930 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.938245 (+602315us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:11.017054 (+ 78809us) raft_consensus.cc:1685] finished
0709 13:09:11.017120 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.017885 (+   765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47980288,"thread_start_us":491129,"threads_started":1,"wal-append.queue_time_us":818967}
I20260709 13:09:11.156356 20880 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.176517 20880 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.156147 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1402) took 1050 ms. Trace:
I20260709 13:09:11.177016 19223 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:11.179172 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.008s	sys 0.008s
I20260709 13:09:11.188740 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1436) took 1296 ms. Trace:
I20260709 13:09:11.189450 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1438) took 1302 ms. Trace:
I20260709 13:09:11.189272 19218 rpcz_store.cc:276] 0709 13:09:09.886620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.133651 (+1247031us) service_pool.cc:224] Handling call
0709 13:09:11.180007 (+ 46356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.181138 (+  1131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.181554 (+   416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.181976 (+   422us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:11.182189 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.182604 (+   415us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.183158 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.190199 19223 rpcz_store.cc:276] 0709 13:09:09.887182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.150593 (+1263411us) service_pool.cc:224] Handling call
0709 13:09:11.176388 (+ 25795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.184895 (+  8507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.189379 (+  4484us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.179996 20880 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:11.196950 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.009s	sys 0.008s
I20260709 13:09:10.996068 19216 rpcz_store.cc:276] 0709 13:09:08.516995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.082852 (+565857us) service_pool.cc:224] Handling call
0709 13:09:09.141591 (+ 58739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.284356 (+142765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.284391 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.316735 (+ 32344us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.144185 (+827450us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:10.156360 (+ 12175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.162988 (+  6628us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.908028 (+745040us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:10.994770 (+ 86742us) raft_consensus.cc:1685] finished
0709 13:09:10.994814 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.995232 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67916,"raft.queue_time_us":103526,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":23732,"spinlock_wait_cycles":13514496,"thread_start_us":792040,"threads_started":2,"wal-append.queue_time_us":961604}
I20260709 13:09:11.157244 20871 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.181318 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.205025 20682 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.207705 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1124) took 1094 ms. Trace:
W20260709 13:09:11.203015 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 411179us
I20260709 13:09:11.208202 19218 rpcz_store.cc:276] 0709 13:09:10.112887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.206144 (+1093257us) service_pool.cc:224] Handling call
0709 13:09:11.206703 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.207186 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.207231 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.207316 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:11.207367 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.207437 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.207609 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.209260 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:11.210291 20943 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:11.210620 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1125) took 1058 ms. Trace:
I20260709 13:09:11.211102 20943 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:10.995723 19220 rpcz_store.cc:276] 0709 13:09:09.665681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.924097 (+258416us) service_pool.cc:224] Handling call
0709 13:09:09.924464 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.924879 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.924923 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.925443 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.680681 (+755238us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:10.712750 (+ 32069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.730978 (+ 18228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.939400 (+208422us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:10.994471 (+ 55071us) raft_consensus.cc:1685] finished
0709 13:09:10.994514 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.994971 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":3395328,"thread_start_us":720498,"threads_started":1,"wal-append.queue_time_us":865046}
I20260709 13:09:11.212987 20871 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.215294 19216 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:11.216157 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1130) took 1063 ms. Trace:
I20260709 13:09:11.216908 20734 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.211093 19218 rpcz_store.cc:276] 0709 13:09:10.151752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.209366 (+1057614us) service_pool.cc:224] Handling call
0709 13:09:11.209881 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.210234 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.210255 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.210322 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:11.210397 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.210450 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.210550 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.001878 19292 rpcz_store.cc:276] 0709 13:09:07.664848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.677353 (+ 12505us) service_pool.cc:224] Handling call
0709 13:09:07.677752 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.678156 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.678185 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.083025 (+1404840us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b2c0000e678. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:09:09.149785 (+ 66760us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.160716 (+1010931us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:10.165875 (+  5159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.184938 (+ 19063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.000587 (+815649us) raft_consensus.cc:1685] finished
0709 13:09:11.000623 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.001109 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":98,"spinlock_wait_cycles":73443712,"thread_start_us":989525,"threads_started":1,"wal-append.queue_time_us":1108256}
W20260709 13:09:11.220806 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 388782us
I20260709 13:09:11.221619 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 114) took 1521 ms. Trace:
I20260709 13:09:11.216636 19216 rpcz_store.cc:276] 0709 13:09:10.152897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.214270 (+1061373us) service_pool.cc:224] Handling call
0709 13:09:11.214782 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.215858 (+  1076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.216085 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:11.181005 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 167020us
I20260709 13:09:11.204452 20639 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.216053 20871 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:11.233222 20690 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.012s
W20260709 13:09:11.224128 20950 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
W20260709 13:09:11.273669 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 980106us
I20260709 13:09:11.254532 20614 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.229763 20897 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.184690 19372 rpcz_store.cc:276] 0709 13:09:10.105450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.105573 (+   123us) service_pool.cc:224] Handling call
0709 13:09:10.105853 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.208806 (+102953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.214039 (+  5233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.218612 (+  4573us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:10.220754 (+  2142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.155451 (+934697us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b5400197b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:11.155561 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.155928 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178331904}
I20260709 13:09:11.222281 19221 rpcz_store.cc:276] 0709 13:09:09.667693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.003637 (+1335944us) service_pool.cc:224] Handling call
0709 13:09:11.114769 (+111132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.171176 (+ 56407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.171208 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.175087 (+  3879us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:11.184632 (+  9545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.184698 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.188890 (+  4192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.236109 20718 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:11.302019 20943 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.223520 20818 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:09:11.303229 20718 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:11.307709 20957 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 13:09:11.335183 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.223886 20948 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:09:11.338088 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.340674 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.223995 20771 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 13:09:11.341320 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.341773 19221 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:11.342060 19366 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:11.339013 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:11.342667 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.343402 19898 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:09:11.344605 19266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.576s (SENT) [suppressed 4 similar messages]
I20260709 13:09:11.345942 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.241279 20736 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:09:11.376516 20728 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.303221 20690 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.385175 20718 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.387076 20718 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.387990 20690 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.379837 20728 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.388841 19220 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:11.392590 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 116) took 1715 ms. Trace:
I20260709 13:09:11.393249 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.394464 20871 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.396704 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 357) took 1747 ms. Trace:
W20260709 13:09:11.402415 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 117850us
I20260709 13:09:11.404126 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.404587 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.405097 19296 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:11.405452 19297 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:11.405767 20555 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.403301 19894 rpcz_store.cc:276] 0709 13:09:09.649307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.654043 (+  4736us) service_pool.cc:224] Handling call
0709 13:09:11.395243 (+1741200us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:11.395638 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.396074 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.396107 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.396229 (+   122us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:11.396308 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.396390 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.396530 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16873728}
I20260709 13:09:11.407820 20959 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:11.408515 20959 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.411013 20959 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:11.411598 20959 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.411446 20962 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:11.412482 20766 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:11.413422 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:11.416213 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64164.2us
I20260709 13:09:11.401207 20682 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:11.416350 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:11.416867 20902 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:11.422875 19292 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:11.424535 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.425770 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.426901 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.427456 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.451553 20766 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.452247 19898 raft_consensus.cc:2410] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:11.452706 19296 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:11.428455 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.429354 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.429490 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.454113 20766 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.430632 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.455456 20964 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.431387 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1395) took 1460 ms. Trace:
I20260709 13:09:11.456278 19365 rpcz_store.cc:276] 0709 13:09:09.970892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.971020 (+   128us) service_pool.cc:224] Handling call
0709 13:09:09.989619 (+ 18599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.321569 (+331950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.321598 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:10.321637 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:10.321666 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.430961 (+1109295us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400314a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:11.431024 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.431225 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762909952}
I20260709 13:09:11.432024 20871 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.457924 20736 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.458356 20682 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.458602 20736 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.459296 20871 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.399333 19224 rpcz_store.cc:276] 0709 13:09:09.676978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.021100 (+1344122us) service_pool.cc:224] Handling call
0709 13:09:11.021676 (+   576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.022307 (+   631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.022347 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.133486 (+111139us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.203986 (+ 70500us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:11.204232 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.204320 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.392375 (+188055us) raft_consensus.cc:1685] finished
0709 13:09:11.392392 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.392523 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8591,"raft.queue_time_us":70132,"raft.run_cpu_time_us":540,"raft.run_wall_time_us":38178,"spinlock_wait_cycles":3297664,"thread_start_us":33671,"threads_started":1,"wal-append.queue_time_us":203935}
I20260709 13:09:11.435322 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1405) took 1327 ms. Trace:
I20260709 13:09:11.418658 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:11.460670 20682 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:11.461175 19217 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.130s	user 0.018s	sys 0.004s
W20260709 13:09:11.461410 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 238373us
I20260709 13:09:11.461565 20880 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.461935 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1108) took 2946 ms. Trace:
I20260709 13:09:11.462402 20880 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.462610 20902 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.448266 20962 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.419447 20897 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:11.465636 20897 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.462419 19222 rpcz_store.cc:276] 0709 13:09:08.515837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.526327 (+ 10490us) service_pool.cc:224] Handling call
0709 13:09:09.674664 (+1148337us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:09.674874 (+   210us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:09.675247 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.675279 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:09.675924 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 13:09:10.537060 (+861136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:10.900619 (+363559us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:11.352039 (+451420us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800086a40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf 00007fe8d7ecf038
0709 13:09:11.371710 (+ 19671us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.448092 (+ 76382us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.461380 (+ 13288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.461525 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.461579 (+    54us) raft_consensus.cc:1685] finished
0709 13:09:11.461593 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.461760 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71354,"prepare.queue_time_us":631449,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":83,"raft.queue_time_us":50723,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"spinlock_wait_cycles":93869184,"thread_start_us":853737,"threads_started":2,"wal-append.queue_time_us":895739}
I20260709 13:09:11.467015 20844 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.467521 20962 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.467653 20897 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.420058 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1434) took 1746 ms. Trace:
I20260709 13:09:11.468484 19219 rpcz_store.cc:276] 0709 13:09:09.677013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.006387 (+1329374us) service_pool.cc:224] Handling call
0709 13:09:11.006914 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.007488 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:11.137603 (+130115us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.419622 (+282019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.419674 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:11.419712 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.419831 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.419992 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93801,"prepare.queue_time_us":166450,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":94802,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":267236,"threads_started":2,"wal-append.queue_time_us":230235}
W20260709 13:09:11.420353 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 80461.9us
I20260709 13:09:11.470880 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:11.472536 19300 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:11.473289 20764 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:11.430472 19218 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:11.473889 20764 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.474149 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1131) took 1321 ms. Trace:
I20260709 13:09:11.474378 20764 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.474586 19218 rpcz_store.cc:276] 0709 13:09:10.153123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.274359 (+1121236us) service_pool.cc:224] Handling call
0709 13:09:11.429870 (+155511us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:11.430072 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.473917 (+ 43845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.474099 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11821312}
I20260709 13:09:11.439855 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1128) took 1287 ms. Trace:
I20260709 13:09:11.454041 19294 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:11.475822 19220 rpcz_store.cc:276] 0709 13:09:10.152468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.213077 (+1060609us) service_pool.cc:224] Handling call
0709 13:09:11.213644 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.401065 (+187421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.439462 (+ 38397us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001b1f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:11.439756 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402120576}
I20260709 13:09:11.455859 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:11.439141 20555 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:11.463299 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:11.509703 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.445164 20959 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.513135 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:11.514122 19224 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.461663 19217 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:11.460153 19374 rpcz_store.cc:276] 0709 13:09:10.107619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.133238 (+ 25619us) service_pool.cc:224] Handling call
0709 13:09:10.133507 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.213188 (+ 79681us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:10.265121 (+ 51933us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.144332 (+879211us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.156870 (+ 12538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.156961 (+    91us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:11.157121 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.434998 (+277877us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b5400299354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:11.435054 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.435236 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12038,"prepare.queue_time_us":227557,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":79,"raft.queue_time_us":77081,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":34666,"spinlock_wait_cycles":182748032,"thread_start_us":872656,"threads_started":2,"wal-append.queue_time_us":813002}
I20260709 13:09:11.528326 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.536345 19368 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:11.536329 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:11.538457 19899 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.524698 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:11.541400 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 85680.7us
I20260709 13:09:11.515923 20964 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.536485 20873 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.517741 20871 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.545671 20951 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:11.545830 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.546465 20764 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:11.546890 20976 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:11.532024 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:11.530165 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:11.547024 19292 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:11.587780 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 108503us
I20260709 13:09:11.589926 20948 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:11.593488 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45156.4us
I20260709 13:09:11.593616 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:11.533073 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1126) took 1375 ms (client timeout 1823 ms). Trace:
I20260709 13:09:11.518970 20555 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.581445 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.568781 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.531119 20897 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.590802 20948 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.602411 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:11.536329 20872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.012s	sys 0.017s
I20260709 13:09:11.604811 19218 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:11.603585 19292 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:11.612123 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:11.612504 20948 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:11.612818 20961 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.612975 19300 raft_consensus.cc:606] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:11.613409 19300 raft_consensus.cc:614] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:11.613493 20961 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.614336 19222 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.614480 20764 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:11.606758 20872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.016s	sys 0.031s
I20260709 13:09:11.606779 20682 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:11.616730 20682 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.618656 20682 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:11.620560 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.621052 20555 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.621209 19896 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:11.627486 19294 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:11.629976 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.628626 19119 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194), VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:11.568758 20880 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:11.569001 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.634609 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:11.601341 19220 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.615867 20961 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.606710 19219 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.646817 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.632035 19119 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 5, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.611888 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:11.650813 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.647338 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.604259 20902 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:11.654386 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 191205us
I20260709 13:09:11.649420 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:11.652570 19225 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:11.633407 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:11.597273 19217 rpcz_store.cc:269] 0709 13:09:10.152004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.311729 (+159725us) service_pool.cc:224] Handling call
0709 13:09:11.524338 (+1212609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.632858 20736 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:11.669488 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 70777.3us
I20260709 13:09:11.659209 20880 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:11.677788 19374 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:11.679492 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.678807 19366 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:11.612545 20962 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:09:11.673267 19119 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, term changed from 1 to 3, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.677251 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:11.688066 19221 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:11.687750 19368 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:11.675379 20910 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:11.677289 20880 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.706158 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.706367 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:11.677906 19216 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:11.664348 20897 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.681608 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.714084 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:11.714727 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:11.661787 20951 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.707386 20880 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.659574 20873 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.702016 20910 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:11.728735 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50322.5us
I20260709 13:09:11.715332 20764 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.715390 20682 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.710309 20961 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:11.739462 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:11.757897 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 162145us
I20260709 13:09:11.736286 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.732157 19119 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 3, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.713539 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:11.723913 20959 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.732182 20811 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.731132 20910 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.772382 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:11.775172 20951 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:11.776330 20925 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:11.796931 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57697.7us
I20260709 13:09:11.778210 20904 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.784102 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.783793 20682 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.787434 20873 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:11.787658 20961 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.732527 20764 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:11.790283 19222 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:11.773337 19295 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:11.796416 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:11.792526 20844 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.826673 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.876855 19299 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:12.047456 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 251088us
I20260709 13:09:11.857543 20811 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:11.795753 19292 raft_consensus.cc:606] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:11.838286 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 110647us
W20260709 13:09:12.033596 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56776.8us
I20260709 13:09:11.968078 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.892083 19224 raft_consensus.cc:2410] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:11.945729 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.847919 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.957144 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.043182 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:11.925876 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:12.074318 19218 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.796973 20925 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:11.880914 20953 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.268s	user 0.003s	sys 0.000s
I20260709 13:09:12.043176 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:12.015552 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 90701.3us
I20260709 13:09:11.944482 20844 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.861591 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:12.076350 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:12.086890 19369 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.867523 19119 catalog_manager.cc:5697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 2 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:11.834751 20959 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.090735 20959 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.091804 20959 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.878072 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:12.092612 19365 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.092976 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:12.093914 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 254094us
I20260709 13:09:12.094283 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.094481 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.095345 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:12.095489 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.099684 19299 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.100829 20844 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.824852 20736 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.824314 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:11.871328 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:11.946158 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.088829 20764 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.092286 19119 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:09:12.100939 20934 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:09:11.860858 20734 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.971015 20961 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.105605 19369 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:12.081456 19296 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:12.067036 20962 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:12.112880 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.860638 20729 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.140097 20729 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.143102 20729 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:12.119751 19365 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:12.102380 20736 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.133385 20764 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.134028 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.134249 19119 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.085903 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.136416 19294 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:12.135769 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.138195 20811 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.086768 20925 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.139099 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.127769 20962 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:12.156574 20962 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:12.156862 20992 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:09:12.156066 19119 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 3, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.157960 19119 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 3, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.128437 19221 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:12.082046 20897 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.145680 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:11.847404 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:12.144459 19297 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:12.138111 20844 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.164502 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.165138 20844 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:12.150617 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.165840 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.167022 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.166889 19119 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.147900 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.152093 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:11.861310 20904 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.213156 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.214891 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.217674 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.218765 19295 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:12.143224 19899 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.604s	user 0.003s	sys 0.005s
I20260709 13:09:12.163203 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.144344 20764 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.178213 19224 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
W20260709 13:09:12.172819 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 96519.1us
I20260709 13:09:12.173027 20729 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.168491 19119 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 3, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.172624 20682 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.176574 19894 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:12.144827 20734 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.182642 20736 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:12.188289 19219 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.002s
I20260709 13:09:12.190013 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.190761 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.168144 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:12.197952 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45980us
I20260709 13:09:12.201229 20959 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:12.203696 19220 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.004s
I20260709 13:09:12.203610 20897 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.222175 19218 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:12.265618 19371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7547528ebe74640917580adfe8092bd"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:12.265815 20734 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.266314 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.267028 20962 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.243005 20961 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:12.219558 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 98952.7us
I20260709 13:09:12.223131 20764 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.225765 20729 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.193857 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.240303 19219 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:12.240340 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.241328 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.259434 19220 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:12.255712 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:12.258451 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.247069 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.246908 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.221776 19899 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:12.258409 19296 raft_consensus.cc:2410] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:12.289713 19295 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:12.235875 19119 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.289181 20729 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:12.298520 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 72869.1us
W20260709 13:09:12.300045 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 179580us
I20260709 13:09:12.300392 19119 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 4, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 4 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.290146 19298 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:12.302014 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.308429 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.311925 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:12.313270 19295 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:12.309242 19119 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.315423 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.304091 20734 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.318028 19298 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:12.314504 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.299185 20997 raft_consensus.cc:2764] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:12.317134 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.347728 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.310323 20951 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.294389 20897 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:12.357391 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46970.6us
I20260709 13:09:12.320423 20736 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.363866 20736 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.364409 20736 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.315266 19292 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:12.369078 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.370476 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.371028 20897 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:12.371645 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:12.374732 20844 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:12.380475 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:12.382921 20880 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.008s
I20260709 13:09:12.384719 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:12.319531 20986 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:12.401714 19895 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:12.402207 20986 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:12.403247 20986 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.390503 20959 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:12.406181 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.356149 19119 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 3, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.391077 20614 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.346765 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.315948 20910 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.393422 19299 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.394235 20962 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:12.395227 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 299951us
I20260709 13:09:12.394421 20951 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:12.371783 20897 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.317813 20734 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.400027 19297 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:12.429194 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.429847 19901 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.430346 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.431231 19297 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:12.401316 19292 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:12.404580 19300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.014s
W20260709 13:09:12.432003 19300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.009s	sys 0.014s
I20260709 13:09:12.428097 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.434707 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.419288 19119 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:12.465672 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45016.6us
I20260709 13:09:12.467646 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.468477 19297 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:12.404114 20764 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.482125 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.482764 19292 raft_consensus.cc:1813] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Handling vote request from an unknown peer 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:12.483206 20764 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.484087 20844 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.484748 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:12.483215 19371 raft_consensus.cc:606] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:09:12.485885 19293 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:12.487217 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:12.438242 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:12.489194 19372 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.441339 20871 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:12.492867 20871 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.497031 21001 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.497526 21001 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.497884 21001 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.432693 20951 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.458284 20925 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.500559 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.501360 19367 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:12.502302 20925 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:12.507114 19365 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:12.428599 20614 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.508348 20614 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:12.509621 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46650.7us
I20260709 13:09:12.510361 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:12.511466 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:12.512075 20925 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.512288 20997 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.513803 20729 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.433732 20734 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.516598 19298 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:12.519038 20897 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:12.520506 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57735.8us
I20260709 13:09:12.521238 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:12.484874 20844 consensus_queue.cc:1243] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:12.483381 19292 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:09:12.428432 20910 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:12.426244 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.515947 20729 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.530504 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:12.531229 19297 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.532899 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.535918 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:12.409106 20880 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.540408 19298 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.541836 19119 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:12.544792 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 185438us
I20260709 13:09:12.521238 20897 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.541917 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:12.558892 19299 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:12.562455 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:12.564953 19298 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:12.538640 20904 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.575204 19297 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
W20260709 13:09:12.576258 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55131.2us
I20260709 13:09:12.558651 20871 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:12.567783 20690 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:12.607812 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.613981 20880 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:12.557629 20961 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:12.664886 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48779.1us
I20260709 13:09:12.615991 20947 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:12.667305 20947 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:12.600660 20844 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:09:12.616425 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:12.623908 20870 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.625118 20736 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.628741 20729 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.637319 20734 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.681958 20734 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.683542 19299 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:12.685397 19295 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.687672 20904 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.688230 20904 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.688659 20904 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.689790 20818 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:12.692109 20947 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.692935 20870 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:12.693840 20947 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.693574 20870 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:12.671944 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73221.6us
I20260709 13:09:12.695674 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:12.599206 20910 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.676743 20961 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.677471 20736 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.678212 20729 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.679010 20483 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:12.714362 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:12.666229 20871 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:09:12.748517 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 351854us
I20260709 13:09:12.674602 20614 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.762775 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:12.712494 20811 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.740345 20483 consensus_queue.cc:1243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:12.762672 20997 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.777520 19903 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.781733 20729 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.782251 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:12.783034 20729 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:12.784318 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.785102 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.785264 20614 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.785846 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.791162 20734 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.791664 20734 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.793459 21001 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.797060 21015 raft_consensus.cc:2764] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:12.797879 21015 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:12.798388 21015 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:12.801987 19340 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:12.803314 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:12.804414 19291 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.805044 21011 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.805203 19372 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:12.805439 21011 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:12.806447 19370 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.806365 21011 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.807476 21011 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.807801 21010 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.808147 21010 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:12.809033 20811 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.809425 20811 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:12.809927 20811 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.809379 21010 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.810786 21010 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.812240 20871 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.812633 20871 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:12.813028 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.813443 20871 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.814769 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:12.792105 20734 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.769939 20951 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.827795 20951 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:12.831668 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.833155 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.834009 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.785837 20614 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:12.837108 20614 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:12.838174 20614 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.839040 19901 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.845706 20483 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.846648 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:12.847231 19299 raft_consensus.cc:606] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:12.836519 20951 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.853353 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:12.855448 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:12.837138 20870 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:12.858582 20870 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.858950 20870 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:12.859290 20870 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.799461 21015 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.796027 21001 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:12.877826 20811 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:12.880031 20811 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:12.880653 20811 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.867561 20904 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.879344 20734 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:12.887157 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.889463 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:12.890877 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 277195us
W20260709 13:09:12.892145 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 279021us
I20260709 13:09:12.897650 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.890029 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.913151 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:12.889205 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:12.932878 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:12.951042 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 285290us
W20260709 13:09:12.930933 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 478100us
I20260709 13:09:12.971374 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:12.994971 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:13.001448 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:13.005460 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 78241.1us
I20260709 13:09:13.006086 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.006328 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.006700 19298 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:13.005568 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.010017 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:12.880975 20811 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.014504 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:13.017673 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:13.017786 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 104759us
W20260709 13:09:13.021986 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 240706us
I20260709 13:09:13.022547 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:13.023772 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 52511.8us
I20260709 13:09:13.025024 19295 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:13.028102 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:13.032595 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 245798us
I20260709 13:09:13.027246 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.013957 20811 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.014029 21010 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.051409 20871 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.053375 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1154) took 1371 ms. Trace:
I20260709 13:09:13.053669 20736 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:13.064327 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.055333 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.065356 21041 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.066020 21041 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.057052 21031 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.063656 19300 rpcz_store.cc:276] 0709 13:09:11.681918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.693614 (+ 11696us) service_pool.cc:224] Handling call
0709 13:09:11.711969 (+ 18355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.795294 (+ 83325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.795323 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.845799 (+ 50476us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.432469 (+586670us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:12.771693 (+339224us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.053076 (+281383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.053156 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.053192 (+    36us) raft_consensus.cc:1685] finished
0709 13:09:13.053204 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.053320 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51,"prepare.queue_time_us":465809,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":9372,"raft.queue_time_us":20377,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":250,"thread_start_us":1091473,"threads_started":3,"wal-append.queue_time_us":681082}
I20260709 13:09:13.017542 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:13.066265 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 182566us
I20260709 13:09:13.071382 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.072094 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:13.072890 19299 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:13.073302 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.071262 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:13.076499 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.034559 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.025022 19899 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.084669 20734 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:13.085000 20897 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.085389 20897 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:13.027519 20951 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.080662 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.029204 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.027453 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.029452 21025 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.086709 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.027722 21024 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:13.127243 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.127935 19216 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:13.129814 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.131011 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.133599 19371 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:13.134063 19371 pending_rounds.cc:85] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 5
I20260709 13:09:13.140605 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:13.141402 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 60821.9us
I20260709 13:09:13.135736 20764 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:13.142776 20956 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:13.135739 20682 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.142874 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.143303 20956 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:13.143837 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.144302 20956 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:13.145329 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.145684 21030 raft_consensus.cc:993] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: : Instructing follower c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:09:13.146139 21030 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.146220 19895 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:13.146449 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.146680 20606 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:09:13.147440 20729 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:13.146149 20959 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:13.148551 20959 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:13.149013 20959 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.142942 20764 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.153110 19266 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:13.154822 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 121127us
I20260709 13:09:13.155448 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.134322 19371 pending_rounds.cc:107] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:13.156575 19371 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:13.123992 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 93989.7us
I20260709 13:09:13.152079 20897 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:13.125032 21010 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.123276 20734 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.136902 21017 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.184937 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.185635 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.190083 19371 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:13.107595 20951 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.154311 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.152335 20729 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:13.146256 21014 raft_consensus.cc:1081] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Signalling peer c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:09:13.146344 20826 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.154680 20904 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:13.236955 20897 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.236745 20904 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:13.154547 21025 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:13.238473 21025 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.180019 21015 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:13.240965 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:13.228809 21001 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.243055 20870 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:13.245702 21021 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:09:13.247334 20870 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:13.248945 21017 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:13.249964 21017 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.252462 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.253424 20764 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:13.254010 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83256.7us
I20260709 13:09:13.146445 21026 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:13.180873 20483 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:13.258679 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:13.258841 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 70369.3us
I20260709 13:09:13.235069 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.262333 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.263206 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.189047 21030 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.188867 21031 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.262545 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.267450 19225 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:13.235169 20818 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:13.282215 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:13.278321 19191 leader_election.cc:336] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.567s (SENT)
W20260709 13:09:13.281034 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 50012.1us
I20260709 13:09:13.288374 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.253842 20764 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:13.290907 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.263672 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.275386 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:13.302258 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.254420 21041 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:09:13.279045 20818 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:13.264122 21010 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:09:13.166424 21024 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:13.302805 19297 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:13.305193 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:13.267432 20483 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.296404 20764 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.293392 20925 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:13.311152 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 78256.3us
I20260709 13:09:13.293985 21031 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:13.314401 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.303887 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:13.328481 21032 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:09:13.328542 21039 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:13.330533 20818 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:13.331737 20818 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.331954 19221 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:13.332190 21024 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:13.332571 19217 raft_consensus.cc:2376] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:09:13.333137 19894 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.332683 21031 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.304107 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.317422 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:13.320677 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.300107 20844 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:09:13.341400 20483 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:13.341564 19191 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.342408 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.342469 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:13.342698 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.343495 19371 raft_consensus.cc:2410] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:13.343668 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.345022 19365 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.344902 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:13.345546 19297 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.344292 19299 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:13.358505 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:13.359409 19295 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:13.279280 21030 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.374046 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.374969 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.283269 21026 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:13.347373 20961 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.358388 21046 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.357478 21024 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.362496 20682 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.360949 20897 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.386961 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.387023 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.401302 19224 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:13.396020 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.398110 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.409732 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.410661 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.361277 20826 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:09:13.418469 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 264821us
I20260709 13:09:13.376431 21016 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:13.415728 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.398056 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.421663 19297 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:13.558056 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.559284 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:09:13.466215 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 117273us
I20260709 13:09:13.465505 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.573817 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:13.436612 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.576705 19370 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:13.476065 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.476608 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:13.547056 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 127015us
I20260709 13:09:13.487619 19225 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:13.531914 19223 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:13.560014 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.597745 19221 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:13.598130 19191 leader_election.cc:336] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.640s (SENT)
I20260709 13:09:13.499507 19365 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:09:13.598587 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 122055us
I20260709 13:09:13.422225 19371 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
W20260709 13:09:13.442771 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 132566us
I20260709 13:09:13.400755 21046 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:13.602100 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.430986 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.731391 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.430089 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.681623 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.871048 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.474928 20951 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:13.606423 21016 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:13.415051 21027 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.405s
I20260709 13:09:13.602772 21058 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:13.528071 21045 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:09:13.700680 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 417223us
I20260709 13:09:13.841002 21041 consensus_queue.cc:1243] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:13.517139 20826 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.521245 20811 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:13.693306 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.893177 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.428856 21023 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:13.406508 19222 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:13.500330 20764 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:13.843603 19223 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.602097 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:13.894745 19224 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:13.848702 21056 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:13.850931 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.851342 21026 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:13.884297 19374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.005s	sys 0.008s
W20260709 13:09:13.954519 19374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.005s	sys 0.009s
W20260709 13:09:13.888679 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 290551us
I20260709 13:09:13.893028 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:13.891543 21027 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:13.897570 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 299095us
I20260709 13:09:13.955643 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.884477 19217 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:13.985040 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.987957 19223 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:13.989704 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:13.991372 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:13.993364 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:13.997630 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.887709 20826 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:13.897507 20871 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:09:13.896389 21016 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:14.000216 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.954543 20682 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.928963 21023 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.024919 19223 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.897658 21047 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:14.026691 19224 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.028996 21065 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.964834 21027 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:13.997097 19366 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.033339 21026 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:14.044674 21026 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.046685 21026 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.051859 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.054862 19373 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.056532 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:13.997118 21058 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.063059 21046 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.069407 20764 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.070375 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.071024 19216 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:14.071569 20734 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:14.072458 20734 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.072808 20734 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:14.073748 21053 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:09:14.073666 20734 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.074630 19297 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.074896 20734 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.074975 19297 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:14.041778 21001 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:14.032709 19191 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.750s (SENT)
W20260709 13:09:14.077515 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46578.6us
I20260709 13:09:14.077864 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:13.994755 20956 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.030615 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.075860 19297 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.091326 19297 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.090526 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:14.094007 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61356.7us
I20260709 13:09:13.897754 21056 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:14.095780 20597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.001s	sys 0.021s
W20260709 13:09:14.096513 20959 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.947s	user 0.007s	sys 0.004s
I20260709 13:09:14.096391 21067 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:14.096973 20959 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.098048 19894 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:14.099709 21056 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:14.072023 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.102361 19216 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:14.087767 21026 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:14.105149 20811 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.096481 21063 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:09:14.092761 20614 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:14.083375 21047 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.108541 20959 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.109840 19223 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:14.110420 21047 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:14.030644 21030 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.108717 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:14.110845 21048 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:14.107810 20614 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.112425 19300 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.112535 21048 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.114614 21048 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:13.994505 20951 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:09:14.120301 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:14.109242 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.123558 19296 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:14.123562 19224 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:14.121560 19371 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:14.084309 21065 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.127084 19297 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:14.129213 19297 pending_rounds.cc:85] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 5
I20260709 13:09:14.129508 19297 pending_rounds.cc:107] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:14.129814 19297 raft_consensus.cc:2889] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.134128 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.135803 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.122143 21068 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.132648 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:14.143110 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.136418 19372 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.111467 20956 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.127971 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:14.153959 20818 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.001s
I20260709 13:09:14.191542 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.201642 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:14.199564 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56560.9us
I20260709 13:09:14.133421 20614 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:14.203675 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.203794 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.103945 21027 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.198747 19300 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
W20260709 13:09:14.237833 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.241735 20959 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:14.242517 20959 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.244602 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.245524 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.245867 21047 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.246459 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.246682 21066 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.247594 21072 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:14.246479 21047 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.247548 21066 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:14.246833 21027 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:14.248770 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 355794us
I20260709 13:09:14.157891 21041 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.159077 20764 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.245491 20614 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:14.255352 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.255088 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.261601 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.252336 21047 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.264916 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.272367 19373 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:14.205049 21059 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.251685 21072 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:14.254285 21041 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.260048 21001 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:14.256146 21058 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:14.280606 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.291805 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:14.256872 20764 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:14.293133 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.283473 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.265336 20614 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.288990 19901 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:14.294209 20614 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.278738 19899 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.293355 20764 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.135681 21023 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.296995 21023 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.294358 21001 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.261054 20606 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:14.300349 19217 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:14.300418 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.300606 20606 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.301481 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.302510 20606 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.302251 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:14.308741 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.257391 20818 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:14.257678 20951 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:09:14.304500 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:14.310139 19373 raft_consensus.cc:2410] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:14.309105 19901 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:14.291002 21041 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.317862 19225 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:14.197252 21016 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.302102 19291 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.310873 20734 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:14.331852 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 237225us
I20260709 13:09:14.306241 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.276978 21065 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.333474 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:14.335981 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.337081 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.335290 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:14.333739 20614 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.339829 20764 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.346136 20764 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:14.342082 20614 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.343518 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.347271 19373 raft_consensus.cc:2410] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:14.348063 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.349287 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.350291 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.351150 19295 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:14.351542 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.352562 19373 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:14.353484 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.354166 19373 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:14.355127 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.312871 21059 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:14.357849 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:14.361290 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:14.355958 19373 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:14.303429 20606 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.362421 19901 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:14.332657 21081 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:14.376293 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.332487 21066 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:14.375622 19191 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.447s (SENT)
I20260709 13:09:14.379345 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1442) took 1040 ms. Trace:
I20260709 13:09:14.361151 19895 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:14.358747 20734 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:14.350607 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.386674 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:14.423767 19901 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:14.363869 20959 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.426954 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.393481 19372 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:14.434249 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:14.434371 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61993.6us
I20260709 13:09:14.436316 19224 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:14.437026 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.438660 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.415720 19370 rpcz_store.cc:276] 0709 13:09:13.338479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.037562 (+699083us) service_pool.cc:224] Handling call
0709 13:09:14.091460 (+ 53898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.091922 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.091972 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.116847 (+ 24875us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.276939 (+160092us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:14.276996 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.277081 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.379118 (+102037us) raft_consensus.cc:1685] finished
0709 13:09:14.379150 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.379286 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":400,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11445,"thread_start_us":141008,"threads_started":1,"wal-append.queue_time_us":214482}
I20260709 13:09:14.439519 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:14.440238 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.441365 21052 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.441774 21052 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.442108 21052 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.445438 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.391314 20925 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:14.390527 20682 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:14.435006 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:14.450628 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:14.446172 21047 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.451714 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.452991 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:14.453572 21047 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.454041 19224 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.454495 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.455614 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.455823 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.455946 19298 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:14.456933 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.459981 19367 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:14.461862 19224 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:14.433501 21031 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:14.469980 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.472149 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.387914 20614 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:09:14.444422 21068 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.446648 21025 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.436533 19217 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:14.453511 20483 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.364298 21058 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.482103 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:14.483641 19224 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:14.448421 20925 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:14.468422 21026 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.470508 20956 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.469844 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1443) took 1131 ms. Trace:
I20260709 13:09:14.474466 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:14.489845 19224 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:14.379727 21081 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.483880 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.519248 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.520336 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:14.521236 19217 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:14.523005 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 135) took 1272 ms. Trace:
I20260709 13:09:14.499886 20925 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.525236 20925 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.484647 20483 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.487164 20614 consensus_queue.cc:1243] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:14.495254 19219 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:14.517266 19216 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:14.505509 19371 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:09:14.390033 21072 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.523427 19218 rpcz_store.cc:276] 0709 13:09:13.250161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.250264 (+   103us) service_pool.cc:224] Handling call
0709 13:09:13.282785 (+ 32521us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:13.532418 (+249633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.532699 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.532738 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.557206 (+ 24468us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.116581 (+559375us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.311929 (+195348us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.313071 (+  1142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.313146 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.350307 (+ 37161us) raft_consensus.cc:1685] finished
0709 13:09:14.360051 (+  9744us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.522840 (+162789us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540039a3d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:14.522949 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":219965,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":74,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6925,"spinlock_wait_cycles":583207040,"thread_start_us":436704,"threads_started":2,"wal-append.queue_time_us":592577}
I20260709 13:09:14.501736 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.539319 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1339) took 1063 ms. Trace:
I20260709 13:09:14.539927 19374 rpcz_store.cc:276] 0709 13:09:13.475559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.025511 (+549952us) service_pool.cc:224] Handling call
0709 13:09:14.501630 (+476119us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:14.539247 (+ 37617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13138304}
W20260709 13:09:14.493000 21079 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:09:14.498888 20947 raft_consensus.cc:993] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower 0316f581086f40549fea44a772fc2dec to start an election
W20260709 13:09:14.497727 21064 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.468s	user 0.000s	sys 0.002s
I20260709 13:09:14.491472 20734 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.499480 20871 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.538422 19370 raft_consensus.cc:2410] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:14.485810 21025 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.490141 21059 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:14.555757 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 116272us
I20260709 13:09:14.491088 19366 rpcz_store.cc:276] 0709 13:09:13.338790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.046025 (+707235us) service_pool.cc:224] Handling call
0709 13:09:14.046406 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.046674 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:14.216232 (+169558us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.425574 (+209342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.434208 (+  8634us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:14.438070 (+  3862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.446909 (+  8839us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.469240 (+ 22331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13926,"prepare.queue_time_us":246837,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":34,"raft.queue_time_us":59788,"raft.run_wall_time_us":15352,"spinlock_wait_cycles":12958976,"thread_start_us":224758,"threads_started":2,"wal-append.queue_time_us":198230}
I20260709 13:09:14.547909 21081 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.550410 19223 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:14.559211 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.560580 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.544246 21027 raft_consensus.cc:1081] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Signalling peer 0316f581086f40549fea44a772fc2dec to start an election
I20260709 13:09:14.564386 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.565165 19374 raft_consensus.cc:2410] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:14.543402 20951 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.599167 19373 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.601213 20826 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.602600 20826 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.543712 20871 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.632963 21052 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.634016 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 130) took 1385 ms. Trace:
I20260709 13:09:14.634449 19222 rpcz_store.cc:276] 0709 13:09:13.248744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.266172 (+ 17428us) service_pool.cc:224] Handling call
0709 13:09:14.633840 (+1367668us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b54000762d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:14.633954 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161213184}
I20260709 13:09:14.636061 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.636363 19220 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:14.636734 19368 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:14.541745 20483 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.647107 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:14.636757 20729 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:14.655483 19291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7547528ebe74640917580adfe8092bd"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41702
I20260709 13:09:14.656239 19291 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.656358 21093 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:14.657407 21091 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.657769 21091 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.658015 19297 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.658697 21091 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.656695 19291 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.663523 21091 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.665189 21025 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:14.665740 20483 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.646683 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.668295 19291 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.670012 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.622987 20951 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.675248 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.642773 21065 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:14.679328 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 130111us
I20260709 13:09:14.646929 21052 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:14.682374 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 125639us
I20260709 13:09:14.685947 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:14.678828 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.694826 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.688679 19294 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:14.699738 19291 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.694624 20871 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.682024 21025 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:09:14.700673 21104 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:14.704734 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.713838 20951 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:14.714576 20871 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.719550 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.693682 20818 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:14.682840 21065 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.728470 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.698947 19366 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:09:14.732797 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46951.9us
W20260709 13:09:14.731197 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.734151 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:14.734990 21058 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:14.735450 21058 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:14.735860 21058 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.736203 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:14.737032 20925 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:14.737532 20925 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:14.737862 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.739382 20925 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.731177 20818 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.742091 20818 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:14.743067 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.697365 21041 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.746718 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:14.739444 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.753902 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:14.754451 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.748128 19291 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:14.767261 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.767679 19366 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:14.768976 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.769001 21011 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:14.770061 19366 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.770221 21011 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:14.770674 21011 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.771644 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 151) took 1297 ms. Trace:
I20260709 13:09:14.744724 21052 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:14.776043 19300 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:09:14.780352 19191 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.011s (SENT)
I20260709 13:09:14.772579 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.789750 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:14.795693 19191 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.018s (SENT)
I20260709 13:09:14.796193 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:14.804286 21108 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.806384 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 433) took 1208 ms. Trace:
I20260709 13:09:14.806934 19894 rpcz_store.cc:276] 0709 13:09:13.598120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.651632 (+ 53512us) service_pool.cc:224] Handling call
0709 13:09:13.853063 (+201431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.098476 (+245413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.806041 (+707565us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:14.806306 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532111616}
I20260709 13:09:14.808447 21111 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:14.774734 19292 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.809804 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.810757 19370 raft_consensus.cc:2410] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:14.811587 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.812924 21104 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:14.813295 21065 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:14.814805 21041 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:14.789249 21052 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:14.815207 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.815987 19370 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.818619 21065 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:14.820238 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:14.820712 19191 leader_election.cc:336] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.050s (SENT)
I20260709 13:09:14.821133 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:14.826320 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 130191us
I20260709 13:09:14.826459 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:14.827149 19365 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:14.771571 21011 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.829079 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:14.829871 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:14.831350 19221 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.832751 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:14.833190 19224 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.822359 21016 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.834962 19902 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.822365 21041 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:14.815981 21052 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.829632 21108 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:14.842294 19291 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:14.843290 20871 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:14.843820 21025 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:14.844233 21091 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.844617 21011 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:14.844914 21025 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:14.845404 21025 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.845144 21016 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.772089 19366 rpcz_store.cc:276] 0709 13:09:13.473976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.770756 (+1296780us) service_pool.cc:224] Handling call
0709 13:09:14.771074 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.771275 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.771313 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.771357 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:14.771409 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.771472 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.771589 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.842212 21052 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.828435 21065 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.850163 21065 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:14.832345 21104 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.850723 19370 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:53992
I20260709 13:09:14.851270 19370 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:14.851614 19370 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:14.842108 19191 leader_election.cc:336] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.115s (SENT)
I20260709 13:09:14.853454 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:14.844662 21091 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:14.843096 21108 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:14.856770 19365 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:14.857919 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 152) took 1255 ms. Trace:
I20260709 13:09:14.863688 19365 rpcz_store.cc:276] 0709 13:09:13.602702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.833566 (+1230864us) service_pool.cc:224] Handling call
0709 13:09:14.856480 (+ 22914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.857644 (+  1164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.857859 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.858240 19221 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:14.848039 21016 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:14.884212 19191 leader_election.cc:336] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.132s (SENT)
I20260709 13:09:14.884763 20483 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.885210 20483 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.885124 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:14.882265 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.893743 21091 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.898236 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:14.869717 21051 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:14.872671 21104 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.901793 20483 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:14.902478 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1450) took 1055 ms. Trace:
I20260709 13:09:14.903817 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:14.856048 21041 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.904971 19365 rpcz_store.cc:276] 0709 13:09:13.847505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.870956 (+1023451us) service_pool.cc:224] Handling call
0709 13:09:14.898545 (+ 27589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.898822 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.898858 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.898906 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:14.902121 (+  3215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.902314 (+   193us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.902426 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.903654 21051 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.916630 21051 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:14.901243 21115 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:14.897645 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:14.908001 21091 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.876293 21065 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:14.917824 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:14.920426 19370 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.926513 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:14.928902 19224 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:14.946061 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:14.930707 20606 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.924837 19222 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.921981 21104 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:14.927103 21106 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:14.961705 21056 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:14.963275 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:14.964056 19299 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:14.965222 19299 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:14.966023 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:14.966590 19295 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.960745 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:14.968797 19293 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:14.970311 20925 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:14.970863 20925 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:14.972256 21111 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:14.971943 20925 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:14.973788 21041 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:14.947949 20811 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:14.978119 19295 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
W20260709 13:09:14.980584 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.988497 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:15.003120 21107 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:09:15.007081 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:15.010133 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.012234 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.014025 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1453) took 1158 ms. Trace:
I20260709 13:09:15.014338 19369 rpcz_store.cc:276] 0709 13:09:13.855209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.013162 (+1157953us) service_pool.cc:224] Handling call
0709 13:09:15.013501 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.013705 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.013733 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.013771 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.013804 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.013856 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.013970 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.014843 20483 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.015261 20483 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.015761 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.021163 19223 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.022539 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.023065 20597 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.023620 20597 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.024682 20597 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.025393 19224 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:15.025650 20597 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.026219 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:15.026747 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.027312 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.027595 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.027886 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.027833 19216 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 13:09:15.026747 19218 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:15.030534 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.031081 19221 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.031306 19224 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.031867 19367 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:15.032642 19224 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.033954 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.039435 19370 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:15.043133 19222 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:15.045171 19221 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.046103 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.047076 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.048542 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:15.039970 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 94006.7us
I20260709 13:09:15.049131 19218 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.050151 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.051541 19224 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:15.049328 19299 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.052920 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:15.054587 19221 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.036151 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 153) took 1169 ms. Trace:
I20260709 13:09:15.057144 19218 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:15.056267 19367 rpcz_store.cc:276] 0709 13:09:13.867169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.031338 (+1164169us) service_pool.cc:224] Handling call
0709 13:09:15.031578 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.035954 (+  4376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.036111 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.058689 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53992 (request call id 1449) took 1192 ms. Trace:
I20260709 13:09:15.061672 19370 rpcz_store.cc:276] 0709 13:09:13.847275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.850591 (+1003316us) service_pool.cc:224] Handling call
0709 13:09:15.039819 (+189228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.069056 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:15.070755 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:15.071698 19299 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:15.076836 19299 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:14.985915 21058 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.044097 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:15.082320 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:15.086021 19224 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.087554 19216 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.087987 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.088642 19222 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:15.084975 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.096561 19367 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:09:15.097114 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.097760 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.097872 19221 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:15.099071 19218 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:15.097069 19367 pending_rounds.cc:85] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 4
I20260709 13:09:15.101285 19367 pending_rounds.cc:107] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:15.101531 19367 raft_consensus.cc:2889] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.082592 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1448) took 1233 ms. Trace:
I20260709 13:09:15.107693 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.090946 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.074839 20826 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:15.117805 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.121031 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.106449 19216 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.122845 19291 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:15.104277 19366 rpcz_store.cc:276] 0709 13:09:13.846980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.847050 (+1000070us) service_pool.cc:224] Handling call
0709 13:09:14.847398 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.882481 (+ 35083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.887172 (+  4691us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.918638 (+ 31466us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.978448 (+ 59810us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:14.981816 (+  3368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.039855 (+ 58039us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.059019 (+ 19164us) raft_consensus.cc:1685] finished
0709 13:09:15.059050 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.080763 (+ 21713us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4700,"raft.run_cpu_time_us":2608,"raft.run_wall_time_us":17294,"thread_start_us":21280,"threads_started":1,"wal-append.queue_time_us":83391}
I20260709 13:09:15.119369 21104 raft_consensus.cc:2764] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:15.136603 21106 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.137032 21106 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.137405 21106 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.137662 19222 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.139609 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.141396 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.142493 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.143486 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.148322 20951 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.148695 20951 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.149475 20951 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.150758 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.151029 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.160308 19219 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:15.162065 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1360) took 1043 ms. Trace:
I20260709 13:09:15.166723 21025 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.168246 19896 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.107900 19220 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.177102 19371 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:15.189093 19372 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:15.108541 21108 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.185020 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1451) took 1337 ms. Trace:
I20260709 13:09:15.182674 19373 rpcz_store.cc:276] 0709 13:09:14.118611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.456705 (+338094us) service_pool.cc:224] Handling call
0709 13:09:15.161870 (+705165us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400298e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:15.162011 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282276224}
I20260709 13:09:15.195175 19365 rpcz_store.cc:276] 0709 13:09:13.847758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.929869 (+1082111us) service_pool.cc:224] Handling call
0709 13:09:14.930142 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.930328 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:15.034695 (+104367us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.184583 (+149888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.184653 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.184721 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.184806 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.184951 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":170181,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":685,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3831,"thread_start_us":253584,"threads_started":2}
I20260709 13:09:15.190752 20986 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.184593 21016 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.190511 20734 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:15.203677 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.194666 20902 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:15.207846 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.209789 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:15.210372 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.195664 21014 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:15.230794 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.194778 21046 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:15.207409 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.233356 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.217826 21111 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:15.217661 21016 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.218915 20925 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:15.203003 21025 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:15.195106 21108 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.203634 21058 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.224962 21056 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.225701 21048 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:15.194072 19216 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:15.192409 21104 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:15.230813 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 87413.1us
I20260709 13:09:15.251080 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.251806 21046 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.252317 21016 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:15.215377 20734 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:15.253314 20734 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.234112 21014 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.254452 20734 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:15.254652 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.255937 21014 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:15.256526 21056 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.257571 19300 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:15.258491 21056 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.259156 21104 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.259564 21104 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.263226 21048 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.249500 21108 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.238358 20871 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.249322 21111 consensus_queue.cc:1243] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:15.265749 21048 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.240022 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.266911 19373 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:15.266963 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.240233 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.240582 21011 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.241367 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.268458 19374 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:15.252241 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.239346 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.269977 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.274503 21046 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.274351 21011 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.274773 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.275545 21046 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.277100 21111 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.278468 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.279349 21111 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.279707 21111 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.280043 21111 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.276614 21011 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:15.293210 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:15.293525 21104 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.294569 21052 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.294955 21052 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.295388 21052 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.295743 21104 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.296869 20483 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.298125 20483 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.300280 19366 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:15.301225 20871 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.301674 20871 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.303010 21052 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.304586 19370 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:15.305289 21052 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.298420 21106 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.306195 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.307328 21111 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:15.308454 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.309974 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.312718 19365 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:15.315156 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1197) took 1008 ms. Trace:
I20260709 13:09:15.316404 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.317711 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.314167 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:15.315531 19298 rpcz_store.cc:276] 0709 13:09:14.306468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.306588 (+   120us) service_pool.cc:224] Handling call
0709 13:09:14.314556 (+  7968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.457349 (+142793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.314927 (+857578us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002b75d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:15.315102 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324655488}
W20260709 13:09:15.308454 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 94768.5us
I20260709 13:09:15.319625 19368 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:15.307969 21106 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.322165 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:15.326809 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:15.322594 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.322495 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.331697 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:15.332551 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 94375.4us
I20260709 13:09:15.333279 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.333850 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.342345 20951 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.346170 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:15.353910 19370 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.360150 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.360378 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:15.371675 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 116442us
I20260709 13:09:15.361373 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.374264 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.377350 19370 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:15.378492 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.381474 19372 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:15.321767 21104 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.361169 19894 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:15.346607 21091 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.356719 21065 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.362188 21025 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:15.399744 21073 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:15.382104 21063 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:09:15.386984 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:15.402204 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.403311 21128 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.403746 21128 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:15.404114 21128 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.405628 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:15.406805 20811 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.408237 21097 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.408541 21015 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.387090 21093 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:09:15.409180 21015 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:15.409744 21015 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.389451 21110 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:15.383181 21052 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.412539 21052 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.412958 21052 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.416445 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.417840 20871 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:15.332307 21058 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:09:15.358053 21027 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:09:15.423249 19896 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:15.424374 20902 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.431134 20902 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:15.432498 21108 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.432225 20902 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.433928 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:15.434109 20902 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.434760 19897 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:15.434820 21108 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.424480 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:15.424801 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:15.424816 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:15.428416 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:15.439711 19291 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:15.448328 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1452) took 1600 ms. Trace:
I20260709 13:09:15.448734 19371 rpcz_store.cc:276] 0709 13:09:13.854866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.006088 (+1151222us) service_pool.cc:224] Handling call
0709 13:09:15.176792 (+170704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.192128 (+ 15336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.448125 (+255997us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400298e50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:15.448270 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391714176}
W20260709 13:09:15.452488 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.454804 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.361927 21106 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.429306 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:15.457760 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126125us
I20260709 13:09:15.459596 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.377084 21046 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.461993 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:15.463908 21127 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.428665 21111 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.468904 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.469661 19369 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:15.471496 19374 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:15.466208 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.466820 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.471839 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:15.419555 21015 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.482131 19219 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.461532 21110 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.483371 19365 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:15.465196 21014 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:09:15.485117 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:15.465481 20986 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.475945 21097 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.475627 21001 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:09:15.465405 21127 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:15.488890 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.467533 21093 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:15.492035 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.484766 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:15.493512 21016 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:15.488023 21065 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.497298 21058 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:15.502727 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.485175 21056 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.505148 19225 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:15.505484 19219 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:15.506477 21065 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.507377 21041 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:15.507746 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.508490 21056 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.508996 21056 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.486759 21091 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.486632 21027 consensus_queue.cc:1243] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:09:15.511591 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:15.530850 21015 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.486085 21028 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:15.491146 21097 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.532912 19373 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:15.533131 21097 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.534250 19373 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:15.534488 21097 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.536386 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.536849 19370 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.537290 19370 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.540661 19374 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:09:15.540967 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 138846us
I20260709 13:09:15.542053 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.541000 19374 pending_rounds.cc:85] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 2
I20260709 13:09:15.542716 19374 pending_rounds.cc:107] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:09:15.511787 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.543020 19374 raft_consensus.cc:2889] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.537986 19370 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:15.553808 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75578.4us
I20260709 13:09:15.500305 21127 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.507505 21065 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.554724 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:15.564698 19219 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:09:15.565062 19219 pending_rounds.cc:85] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:09:15.565342 19219 pending_rounds.cc:107] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:09:15.565665 19219 raft_consensus.cc:2889] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.557896 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:15.570864 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.558753 19373 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.571847 19373 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.511523 19291 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:15.561401 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.582695 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.582988 19368 raft_consensus.cc:2410] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:15.568356 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.573395 19219 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:15.575523 21015 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:15.576550 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:15.577934 21063 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:15.597078 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.577997 21051 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:15.578954 19373 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.563344 20871 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.604298 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:15.613896 19373 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.620759 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.623469 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.596216 21027 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.596350 21073 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.602748 21051 consensus_queue.cc:1243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:15.603399 21127 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.588698 21048 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:09:15.642084 21091 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.621223 21065 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.637759 20951 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.665277 21052 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.667582 21052 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.646639 21127 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.649263 20826 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.669134 20826 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:15.669520 20826 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.618772 21001 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:15.649415 21015 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:09:15.618484 21128 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.650013 19119 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 247) took 7073 ms. Trace:
I20260709 13:09:15.674546 21128 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.652632 19207 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ed1a12d65a24a9cbdd9846e6437132d with delete_type TABLET_DATA_TOMBSTONED (TS 56df67425e6f45d3b2b42441e3c143ba not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47338
I20260709 13:09:15.675556 19894 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.656605 19216 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:15.658648 20606 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:15.677234 20606 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:15.653378 21025 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:09:15.678015 20606 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.679229 20606 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:15.679370 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 198059us
I20260709 13:09:15.680721 19368 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.682404 19903 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.672859 21015 consensus_queue.cc:1243] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:09:15.686476 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 121546us
I20260709 13:09:15.691247 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.693740 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:15.702955 21041 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.704746 21059 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:15.705319 21059 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:15.706248 21059 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.672214 21001 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:15.716293 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.650098 21134 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.686391 20902 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:15.718780 20902 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.719882 21111 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:15.723120 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:15.673450 19119 rpcz_store.cc:276] 0709 13:09:08.576780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.576962 (+   182us) service_pool.cc:224] Handling call
0709 13:09:15.649946 (+7072984us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:13.086631 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:13.247574 (+160943us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:13.247651 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:09:13.247701 (+    50us) tablet.cc:662] Decoding operations
0709 13:09:13.733176 (+485475us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:13.868715 (+135539us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:13.877848 (+  9133us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:09:14.104935 (+227087us) tablet.cc:701] Row locks acquired
0709 13:09:14.104986 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:09:14.105137 (+   151us) write_op.cc:270] Start()
0709 13:09:14.105283 (+   146us) write_op.cc:276] Timestamp: P: 1783602554105085 usec, L: 0
0709 13:09:14.105320 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:09:14.106013 (+   693us) log.cc:844] Serialized 7085 byte log entry
0709 13:09:14.611976 (+505963us) op_driver.cc:464] REPLICATION: finished
0709 13:09:14.715566 (+103590us) write_op.cc:301] APPLY: starting
0709 13:09:14.715688 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:14.716061 (+   373us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:14.718483 (+  2422us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:14.734751 (+ 16268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:14.735116 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:09:14.735192 (+    76us) write_op.cc:312] APPLY: finished
0709 13:09:14.735677 (+   485us) log.cc:844] Serialized 119 byte log entry
0709 13:09:14.736545 (+   868us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:14.736710 (+   165us) write_op.cc:454] Released schema lock
0709 13:09:14.736780 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:14.737138 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:14.737165 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176088,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":103308,"apply.run_cpu_time_us":5435,"apply.run_wall_time_us":21557,"num_ops":17,"prepare.queue_time_us":446052,"prepare.run_cpu_time_us":33246,"prepare.run_wall_time_us":1170227,"raft.queue_time_us":250017,"raft.run_cpu_time_us":4806,"raft.run_wall_time_us":33016,"replication_time_us":506493,"spinlock_wait_cycles":23296,"thread_start_us":648164,"threads_started":4,"wal-append.queue_time_us":207290}]]}
I20260709 13:09:15.707962 19122 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.726447 19122 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:15.730782 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 88429us
I20260709 13:09:15.733140 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.729378 19122 catalog_manager.cc:5697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.711515 21041 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:15.734074 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 135865us
I20260709 13:09:15.692361 21048 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:09:15.720913 21046 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.724211 21051 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.689893 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:15.720876 20902 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:15.692186 21052 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:15.737255 19122 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:15.739490 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49681.8us
I20260709 13:09:15.744242 19366 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.745349 21091 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.748600 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.742853 21141 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.755040 21056 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.756218 19373 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:15.782892 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:15.764026 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 177505us
I20260709 13:09:15.783463 19374 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.767764 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.741389 21014 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:15.778695 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.784351 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.740760 21046 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:15.781157 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 198025us
I20260709 13:09:15.784981 19367 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.786228 19298 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:15.724320 21138 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:15.757083 20947 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.761286 20902 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:15.778952 21141 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.782097 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.802543 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:15.785416 21097 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.768945 19122 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 2 to 3, term changed from 2 to 4, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.836107 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:15.808151 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76436.9us
I20260709 13:09:15.816123 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.837450 19122 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.835988 20734 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.839731 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.839023 19122 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 3, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.841092 19122 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.842677 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.842880 19122 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.845458 19219 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:15.848588 21131 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:15.849031 19370 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.851402 21135 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.852180 21135 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.852593 21135 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.853489 20597 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:15.854779 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 68703.2us
I20260709 13:09:15.800143 20902 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:15.865382 19219 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:15.808835 21142 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:09:15.800239 21134 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.806996 21141 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.853029 21135 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.809341 21093 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:15.870597 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:15.776486 21001 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.809098 21097 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:15.908176 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.883626 19370 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:15.887997 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:15.918470 20483 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:09:15.888286 19122 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 4, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 4 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:15.919426 19224 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:15.871390 19897 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:15.924934 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:15.921720 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51216.2us
I20260709 13:09:15.923018 19220 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.923096 21091 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:15.923950 21140 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:09:15.808291 20925 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:09:15.835477 21058 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:15.932045 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:15.921964 19122 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:15.933216 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 154457us
I20260709 13:09:15.885847 21134 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.935663 19122 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 3, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:15.931641 21011 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:15.918938 21093 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.940855 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:15.942683 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53924.6us
I20260709 13:09:15.943897 19122 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.929983 19216 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:15.926054 21097 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.976109 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:15.977072 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:15.863425 21046 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:15.858413 21041 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:15.981278 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.929454 20871 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:09:15.948837 21093 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.973913 21011 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.993547 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.979378 21073 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.994647 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.995303 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.996232 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:15.940876 21134 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.983383 21150 tablet_replica.cc:333] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:09:15.948947 21127 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:09:15.981040 21147 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.013710 19373 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:09:16.008459 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:15.926060 21144 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:09:16.014804 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:16.027554 19224 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:16.021217 21014 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:15.994257 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 158256us
I20260709 13:09:15.978500 20902 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.026767 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:16.036224 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:16.036265 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 55034.2us
I20260709 13:09:16.032970 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:16.038228 19373 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:16.004812 21027 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.999171 21011 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:16.014636 21046 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.042448 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:16.050844 19372 raft_consensus.cc:2376] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4. Re-sending same reply.
I20260709 13:09:16.044250 19224 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:16.022421 20826 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.022665 21110 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.048359 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:16.056344 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:16.057320 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66956.7us
I20260709 13:09:16.003911 21128 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:16.036028 19222 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.058368 19372 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:16.060948 19372 pending_rounds.cc:85] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 2
I20260709 13:09:16.061255 19372 pending_rounds.cc:107] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:16.061524 19372 raft_consensus.cc:2889] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.057220 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:16.046077 21027 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:16.049811 21011 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.051527 21048 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.022343 21073 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.058719 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:16.060266 20902 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.107299 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:16.111013 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 72631.6us
I20260709 13:09:16.111725 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:16.108814 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.113704 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:15.942462 21152 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
I20260709 13:09:16.116688 19374 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:16.118669 19370 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:15.997215 21163 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:09:16.073784 21169 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:16.125109 19367 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:16.109236 21127 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.130901 19371 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:16.030694 21147 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.060426 21110 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.112865 20986 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.123696 21063 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.117815 21104 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.076150 21164 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:09:16.137006 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.176630 21155 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:09:16.177983 20826 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.181816 21147 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:16.178221 21153 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:09:16.110776 21014 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.151661 19894 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:16.182709 19368 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:16.132696 21111 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:16.179355 21161 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:16.198079 19298 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:16.201187 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:16.201946 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 138005us
I20260709 13:09:16.155016 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:16.209128 21104 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.209561 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:16.210736 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:16.211820 21149 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.269s	user 0.000s	sys 0.002s
I20260709 13:09:16.132964 21027 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.212535 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:16.138934 21127 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.215253 21127 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:16.220130 19222 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.220873 19218 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.183233 20597 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.223641 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.208362 19299 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:16.234617 19222 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:16.255051 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:16.265987 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 129054us
I20260709 13:09:16.137760 21169 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.267694 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:16.258365 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:16.259820 21174 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.280362 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.237799 20597 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.283165 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.285739 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.270073 20947 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:09:16.282676 20986 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.284484 21111 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.298640 21156 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.307137 21110 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:16.313403 21177 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:16.314495 21173 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:09:16.317034 21186 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.317626 21186 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.305442 21156 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.325356 19291 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.325937 21156 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.327236 21172 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.327122 21171 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:16.327402 21165 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:09:16.327898 21166 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:16.327797 21172 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.328644 21166 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.329967 21172 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.331048 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.331768 19293 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:16.335206 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:16.336050 21171 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.336367 20947 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.336790 20947 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.336532 21171 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.337132 20947 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.337239 21169 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.338745 21171 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.339255 21171 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.287770 21104 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:09:16.339638 21171 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:16.341995 21180 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:16.342602 21171 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.353041 21093 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.387053 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.285322 21174 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.388195 21110 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:16.388964 21093 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:16.398095 21185 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:16.400410 20597 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.402149 21184 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.403136 21184 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.405372 21184 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:16.409668 20483 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.409795 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:16.410200 20483 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:16.415552 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.417200 21186 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.421262 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:16.412110 20483 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.424980 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.425786 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:16.427291 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.430343 19370 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:16.432538 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.311946 21097 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.435681 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:16.436986 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.449915 21014 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.450150 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:16.438814 21051 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.450735 21178 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:16.450896 21150 raft_consensus.cc:2243] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:16.451331 21152 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:16.452103 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.452286 20483 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.451730 19220 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:16.385833 21111 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.455595 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:16.514832 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 59365.1us
I20260709 13:09:16.462366 19299 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:16.468379 19297 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:16.469897 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 182809us
I20260709 13:09:16.516239 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.517355 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.472731 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:16.519972 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47352.1us
W20260709 13:09:16.520711 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.394181 20947 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.511570 20483 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.331084 21166 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:16.511292 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59263.2us
I20260709 13:09:16.521567 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:16.506731 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:16.524286 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.469506 19896 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:16.532965 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 277993us
I20260709 13:09:16.508198 21104 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:16.517755 21065 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.855s	user 0.008s	sys 0.004s
I20260709 13:09:16.519019 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.511236 21046 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.426795 21134 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:16.536418 21141 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.004s
I20260709 13:09:16.468628 21041 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:09:16.540395 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.540319 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.519760 21155 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.522486 21177 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.516412 21178 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:16.536751 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:16.525722 21052 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.537111 20597 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.533420 21166 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.533370 21186 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:16.558105 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.562901 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.601909 20483 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.602625 19337 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:16.603477 20483 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.603855 20483 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.604341 20483 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.548666 20986 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:16.550549 21014 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:09:16.667762 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 131600us
I20260709 13:09:16.605592 19373 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:09:16.550751 21138 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:09:16.549017 21104 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.552238 21046 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.608074 21152 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.636629 21186 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.561990 21177 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:16.635612 21184 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:16.565837 21150 raft_consensus.cc:2272] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:16.603147 21155 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:16.718051 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46167.3us
I20260709 13:09:16.606333 21065 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:16.559818 21141 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.717199 21108 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.635507 20597 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:16.733426 21011 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.002s
I20260709 13:09:16.729077 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:16.718428 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:16.735131 21186 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.778653 21015 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.784485 21015 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:16.784750 21151 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:09:16.785399 21015 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.786897 21015 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.788239 21046 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.789580 21056 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:16.790297 21104 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.790967 21183 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:16.791472 21183 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.792436 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:16.793006 19373 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:16.793584 21183 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:16.793843 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:16.794138 21136 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:16.777035 20902 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.001s
I20260709 13:09:16.766185 21158 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.808786 20483 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.810277 19373 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:16.761423 21177 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.770366 21184 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:16.805722 21135 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.002s
I20260709 13:09:16.832638 19897 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.832764 20947 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.833395 20986 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:16.835284 21159 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.830s	user 0.002s	sys 0.000s
I20260709 13:09:16.794711 21136 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:16.794921 21187 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.844877 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 172) took 1096 ms. Trace:
I20260709 13:09:16.771301 21065 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.807472 19220 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:16.737375 21152 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.867885 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:16.868790 19295 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.737654 21181 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.294s
I20260709 13:09:16.858664 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:16.872596 19300 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:16.778532 21108 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.783099 21011 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.863051 19224 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:16.877574 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:16.877637 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 112165us
I20260709 13:09:16.804355 21162 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.299s
I20260709 13:09:16.847309 19365 rpcz_store.cc:276] 0709 13:09:15.748862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.748992 (+   130us) service_pool.cc:224] Handling call
0709 13:09:15.749334 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.776559 (+ 27225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.776587 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.779899 (+  3312us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.885654 (+105755us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:15.885729 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.886076 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.834612 (+948536us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:16.837957 (+  3345us) raft_consensus.cc:1685] finished
0709 13:09:16.837987 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.844799 (+  6812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1199,"raft.queue_time_us":1641,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5431,"spinlock_wait_cycles":39671168,"thread_start_us":27416,"threads_started":1,"wal-append.queue_time_us":144654}
I20260709 13:09:16.867682 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:16.882027 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:16.882763 19365 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:16.883709 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:16.883769 19295 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:16.826850 21014 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:09:16.847065 21187 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:16.780030 21178 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.891492 21203 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:16.877116 21001 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:16.841549 21135 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.932327 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:16.934108 21189 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.934643 21189 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:16.936892 21189 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:16.937686 21198 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:09:16.892354 21158 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:16.895148 21134 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.893515 21187 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.836525 21155 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.951210 19903 raft_consensus.cc:2368] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5.
I20260709 13:09:16.953936 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:16.954948 21204 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:16.957890 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 175) took 1177 ms. Trace:
I20260709 13:09:16.963145 19369 rpcz_store.cc:276] 0709 13:09:15.780459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.784304 (+  3845us) service_pool.cc:224] Handling call
0709 13:09:15.800890 (+ 16586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.801284 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.801313 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.358195 (+556882us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b2c001323f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:09:16.358731 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.504922 (+146191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.504965 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.505034 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.938701 (+433667us) raft_consensus.cc:1685] finished
0709 13:09:16.938723 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.957808 (+ 19085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2902,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":33144,"spinlock_wait_cycles":6212992,"thread_start_us":145753,"threads_started":1,"wal-append.queue_time_us":173922}
I20260709 13:09:16.936919 21150 ts_tablet_manager.cc:1916] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:16.943534 21158 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:16.961848 21188 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:09:16.969739 21141 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:16.970286 21111 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.973875 21192 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 13:09:16.922042 21203 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:16.940951 21001 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.006898 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:16.974004 20986 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:17.008461 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.011967 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:17.009279 19191 leader_election.cc:336] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.613s (SENT)
I20260709 13:09:17.012547 19219 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:17.012815 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:16.956569 21136 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.018498 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:17.021390 21194 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:09:17.021689 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.000300 21134 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.012357 21210 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:09:17.022315 19219 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:17.010987 21189 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:17.029943 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.033284 19219 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:17.029079 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:17.034109 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.034682 19219 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:17.035533 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.036782 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.023370 20902 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.005580 21111 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.017761 20986 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:17.046398 21195 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:09:17.047966 19374 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:09:17.068924 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.070063 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.069864 21187 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.070859 19217 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:17.049394 21203 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.049700 21135 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.048930 21172 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:17.071688 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.035600 21189 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.074410 21189 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.037650 21184 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:17.050295 21201 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:09:17.049825 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1455) took 1738 ms. Trace:
I20260709 13:09:17.076342 19366 rpcz_store.cc:276] 0709 13:09:15.311285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.313643 (+  2358us) service_pool.cc:224] Handling call
0709 13:09:15.355043 (+ 41400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.744658 (+389615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.049589 (+1304931us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400355f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:17.049769 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894567296}
I20260709 13:09:17.050604 21152 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.051254 21001 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.051698 21108 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.030051 21134 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.080109 21134 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.034997 21065 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.059727 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.038401 21011 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.063567 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.064380 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.091035 21065 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.091537 21065 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.093689 21065 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.094372 21065 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.094930 21065 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.097592 21065 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.065852 21111 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.066267 21207 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:17.072146 21187 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.076771 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 158) took 1031 ms. Trace:
I20260709 13:09:17.038220 21141 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:17.061436 21027 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.016191 21158 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:17.054735 19216 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.003s
I20260709 13:09:17.110929 19225 rpcz_store.cc:276] 0709 13:09:16.045879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.331599 (+285720us) service_pool.cc:224] Handling call
0709 13:09:16.331977 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:16.387918 (+ 55941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.387963 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:16.440863 (+ 52900us) log.cc:844] Serialized 52 byte log entry
0709 13:09:16.664827 (+223964us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.765711 (+100884us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.766556 (+   845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.766646 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.076565 (+309919us) raft_consensus.cc:1685] finished
0709 13:09:17.076585 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.076708 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55457,"prepare.queue_time_us":169727,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":58805,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":30308,"thread_start_us":199800,"threads_started":2,"wal-append.queue_time_us":296812}
I20260709 13:09:17.119279 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.120008 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.120451 19225 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:17.121148 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.115677 19219 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.115727 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1397) took 1125 ms. Trace:
I20260709 13:09:17.121590 19225 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:17.128089 19371 rpcz_store.cc:276] 0709 13:09:15.989859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.994055 (+  4196us) service_pool.cc:224] Handling call
0709 13:09:16.130655 (+136600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.131267 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.115517 (+984250us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000956d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.115673 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313484032}
I20260709 13:09:17.110430 21207 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:17.100121 19217 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:17.128518 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:17.113937 21141 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.151978 19225 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.122960 19216 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:17.154879 21111 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:17.161082 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 157) took 1116 ms. Trace:
I20260709 13:09:17.173799 19222 rpcz_store.cc:276] 0709 13:09:16.044509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.112401 (+ 67892us) service_pool.cc:224] Handling call
0709 13:09:17.160861 (+1048460us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400018bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.161007 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26511232}
I20260709 13:09:17.149897 21131 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:17.171954 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:17.149957 21158 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.295894 21065 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.304018 21011 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:17.304409 21065 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.304631 21207 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.306841 21065 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.307802 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1490) took 1186 ms. Trace:
W20260709 13:09:17.308393 21222 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:09:17.308252 19374 rpcz_store.cc:276] 0709 13:09:16.120994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.069214 (+948220us) service_pool.cc:224] Handling call
0709 13:09:17.069514 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.069848 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.069876 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.070314 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.145886 (+ 75572us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.145942 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.146030 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.307619 (+161589us) raft_consensus.cc:1685] finished
0709 13:09:17.307638 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.307748 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1018,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":75157,"threads_started":1,"wal-append.queue_time_us":235669}
I20260709 13:09:17.309983 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.294713 21111 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.313751 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.163527 21186 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.166321 20597 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:17.325001 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 153114us
I20260709 13:09:17.325860 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:17.254402 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.187124 21131 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.324748 21190 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:17.322999 21184 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.323220 21046 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.387848 19365 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:17.389364 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.391916 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.150727 21141 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.294766 21187 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:17.294649 20871 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:17.177474 21135 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:17.175096 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.304602 21011 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.324242 19374 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:17.393877 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.390177 19299 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:17.399688 19219 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:17.362006 21189 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:17.364074 21108 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.364602 21131 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.363610 21172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53982 (request call id 75) took 1674 ms. Trace:
I20260709 13:09:17.458204 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.459022 19296 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:17.451601 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.459443 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.383602 21052 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.383428 20986 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.384670 21111 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.473981 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.387917 21152 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:17.474148 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.388684 21184 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.510210 19374 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:17.496184 20597 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:17.448304 21154 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 13:09:17.396266 21046 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.457156 21189 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.505023 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.456965 20871 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:17.509490 21177 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 13:09:17.472157 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1525) took 1039 ms. Trace:
W20260709 13:09:17.518426 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.520409 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.473275 21135 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.500218 21052 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.521060 19374 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:17.453336 21187 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.408627 21190 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:17.525465 21160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.037s	sys 0.071s
I20260709 13:09:17.517217 20597 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.530752 20597 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.531663 21199 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:17.461937 21108 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.527419 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.535076 19374 raft_consensus.cc:2410] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:17.517412 21189 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.524955 21154 consensus_queue.cc:1243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:17.532099 21199 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.516456 21152 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:17.534426 21160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.037s	sys 0.071s
I20260709 13:09:17.542855 21199 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.551702 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1492) took 1349 ms. Trace:
W20260709 13:09:17.553042 21133 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.815s	user 0.011s	sys 0.000s
I20260709 13:09:17.523232 21177 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.552227 19366 rpcz_store.cc:276] 0709 13:09:16.202183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.078113 (+875930us) service_pool.cc:224] Handling call
0709 13:09:17.078377 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.081468 (+  3091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.081497 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.081915 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.116867 (+ 34952us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.116906 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.116980 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.551443 (+434463us) raft_consensus.cc:1685] finished
0709 13:09:17.551470 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.551626 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2631,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":34657,"threads_started":1,"wal-append.queue_time_us":326628}
I20260709 13:09:17.558197 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1496) took 1311 ms. Trace:
I20260709 13:09:17.558676 19366 rpcz_store.cc:276] 0709 13:09:16.246819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.557234 (+1310415us) service_pool.cc:224] Handling call
0709 13:09:17.557579 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.557783 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.557820 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.557875 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.557919 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.557987 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.558120 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.554363 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1217) took 2128 ms. Trace:
I20260709 13:09:17.562292 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:17.554812 21197 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.783s	user 0.001s	sys 0.010s
I20260709 13:09:17.572093 21046 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.573772 21135 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.576380 21150 ts_tablet_manager.cc:1929] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:17.576989 21150 log.cc:1199] T 5ed1a12d65a24a9cbdd9846e6437132d P 56df67425e6f45d3b2b42441e3c143ba: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/wals/5ed1a12d65a24a9cbdd9846e6437132d
I20260709 13:09:17.578987 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.581918 21052 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.582547 21152 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.582808 21108 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.581902 21150 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47338 (request call id 74) took 1929 ms. Trace:
I20260709 13:09:17.583545 21199 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.583629 21150 rpcz_store.cc:276] 0709 13:09:15.652087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.652341 (+   254us) service_pool.cc:224] Handling call
0709 13:09:15.930733 (+278392us) ts_tablet_manager.cc:1151] Deleting tablet 5ed1a12d65a24a9cbdd9846e6437132d
0709 13:09:15.944243 (+ 13510us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:17.148019 (+1203776us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:17.565220 (+417201us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:17.581824 (+ 16604us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415378,"tablet-delete.queue_time_us":198745,"thread_start_us":62248,"threads_started":1}
I20260709 13:09:17.564033 19292 rpcz_store.cc:276] 0709 13:09:15.425884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.426401 (+   517us) service_pool.cc:224] Handling call
0709 13:09:15.426731 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.427076 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.427111 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.427648 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.612494 (+184846us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:15.618058 (+  5564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.637827 (+ 19769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.552542 (+1914715us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:17.554060 (+  1518us) raft_consensus.cc:1685] finished
0709 13:09:17.554087 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.554300 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1530,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":3078016,"thread_start_us":165447,"threads_started":1,"wal-append.queue_time_us":281457}
I20260709 13:09:17.520959 19217 rpcz_store.cc:276] 0709 13:09:16.423311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.171458 (+748147us) service_pool.cc:224] Handling call
0709 13:09:17.325114 (+153656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.363914 (+ 38800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.368851 (+  4937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.385747 (+ 16896us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:17.387770 (+  2023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.402509 (+ 14739us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.462224 (+ 59715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.556965 21011 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.596866 21052 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.588143 21187 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.594624 21108 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:17.619517 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 179) took 1380 ms. Trace:
I20260709 13:09:17.619863 19373 rpcz_store.cc:276] 0709 13:09:16.239482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.793617 (+554135us) service_pool.cc:224] Handling call
0709 13:09:17.619372 (+825755us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5400197654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.619471 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35989376}
I20260709 13:09:17.626253 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1498) took 1212 ms. Trace:
I20260709 13:09:17.626385 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.626922 19219 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.626629 19373 rpcz_store.cc:276] 0709 13:09:16.414311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.621150 (+1206839us) service_pool.cc:224] Handling call
0709 13:09:17.625667 (+  4517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.625946 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.625980 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.626020 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.626048 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.626104 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.626206 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.631467 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:17.461447 21172 rpcz_store.cc:276] 0709 13:09:15.653969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.656241 (+  2272us) service_pool.cc:224] Handling call
0709 13:09:15.667484 (+ 11243us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b58000830d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eb070a 00007fe8d7eb176a 00007fe8d7eb091b 00007fe8d7ebc03c 00007fe8d7ebb6b3 00007fe8d7eb39fa 00007fe8dce7b4c9 00007fe8d63f7c54
0709 13:09:15.689749 (+ 22265us) log.cc:844] Serialized 508 byte log entry
0709 13:09:16.217470 (+527721us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b18001ce0c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7ef1d01 00007fe8d7e2e691 00007fe8d7e0eeaa 00007fe8d7e15d53 00007fe8d7e15cd9 00007fe8d7e15c69 00007fe8d7e15c31 00007fe8d7e14dfd 000000000038f354 000000000038f199
0709 13:09:16.386038 (+168568us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b180023f500. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:17.328709 (+942671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19852,"raft.queue_time_us":6841,"raft.run_cpu_time_us":3345,"raft.run_wall_time_us":570246,"spinlock_wait_cycles":36703104,"thread_start_us":62708,"threads_started":1,"wal-append.queue_time_us":226769}
I20260709 13:09:17.610669 21186 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.595364 21131 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.634450 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.635787 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.634305 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.637792 19292 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:09:17.641399 21027 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 13:09:17.633338 21183 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:17.642561 21183 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:17.642957 21183 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.644387 19370 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:17.611263 21052 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.646688 21052 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.629658 21046 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.634519 21184 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.648012 21046 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.648953 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.650002 21046 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.650549 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1520) took 1730 ms. Trace:
I20260709 13:09:17.632360 21187 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:17.652362 19369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.042s	sys 0.106s
W20260709 13:09:17.652801 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.042s	sys 0.106s
I20260709 13:09:17.650897 19221 rpcz_store.cc:276] 0709 13:09:15.919737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.919856 (+   119us) service_pool.cc:224] Handling call
0709 13:09:16.127195 (+207339us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:16.127385 (+   190us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:16.259566 (+132181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.259614 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:16.267245 (+  7631us) log.cc:844] Serialized 52 byte log entry
0709 13:09:16.529011 (+261766us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:16.529052 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.529126 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.540488 (+1011362us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b2400129518. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e0709d 00007fe8d7a3910e 00007fe8d7a5088c 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221
0709 13:09:17.650343 (+109855us) raft_consensus.cc:1685] finished
0709 13:09:17.650363 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.650499 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57316,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7469,"spinlock_wait_cycles":37674112,"thread_start_us":388503,"threads_started":2,"wal-append.queue_time_us":405750}
I20260709 13:09:17.658375 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.657276 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.625906 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.625219 21110 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.667673 19219 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:17.669344 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.670056 21097 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.670156 21186 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.670745 21186 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:17.672576 21200 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.739s	user 0.000s	sys 0.010s
W20260709 13:09:17.673051 21226 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:09:17.674152 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 154) took 1633 ms. Trace:
I20260709 13:09:17.675185 21177 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.670096 19221 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:17.674518 19223 rpcz_store.cc:276] 0709 13:09:16.040458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.181411 (+140953us) service_pool.cc:224] Handling call
0709 13:09:16.181805 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.251208 (+ 69403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.251261 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.251822 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.539572 (+287750us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:16.539612 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.539825 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.671990 (+1132165us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:17.673833 (+  1843us) raft_consensus.cc:1685] finished
0709 13:09:17.673869 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.674081 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27780,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":16065792,"thread_start_us":345433,"threads_started":2,"wal-append.queue_time_us":595087}
I20260709 13:09:17.681833 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.651726 21187 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.692049 19221 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:17.696547 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.697547 19223 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:17.629344 21108 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.678264 21190 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.714660 20871 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.706599 21108 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.706974 19293 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.709905 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 455) took 1289 ms. Trace:
W20260709 13:09:17.713075 19368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1395) took 1723 ms (client timeout 1613 ms). Trace:
I20260709 13:09:17.713326 19263 leader_election.cc:400] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5.
W20260709 13:09:17.732877 19368 rpcz_store.cc:269] 0709 13:09:15.989242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.995911 (+  6669us) service_pool.cc:224] Handling call
0709 13:09:17.712804 (+1716893us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400357854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.712979 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391457536}
I20260709 13:09:17.713842 19898 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.704393 21199 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.718798 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.721586 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.738449 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1177) took 1263 ms. Trace:
I20260709 13:09:17.738668 19221 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.680563 19217 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:17.730270 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.675459 21110 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.737156 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.738794 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.743764 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.744436 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.744992 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1495) took 1541 ms. Trace:
I20260709 13:09:17.745913 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.746184 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.747157 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.748576 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.749913 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.750903 19899 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:17.745349 19369 rpcz_store.cc:276] 0709 13:09:16.203869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.119827 (+915958us) service_pool.cc:224] Handling call
0709 13:09:17.120154 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.120566 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.120603 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.121093 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.653219 (+532126us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.653266 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.653582 (+   316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.744806 (+ 91224us) raft_consensus.cc:1685] finished
0709 13:09:17.744823 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.744941 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198,"raft.queue_time_us":101,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6896,"thread_start_us":502488,"threads_started":1,"wal-append.queue_time_us":605432}
I20260709 13:09:17.752398 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:17.752934 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 153) took 1715 ms (client timeout 1895 ms). Trace:
I20260709 13:09:17.753508 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1499) took 1338 ms. Trace:
W20260709 13:09:17.753312 19224 rpcz_store.cc:269] 0709 13:09:16.037914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.052405 (+ 14491us) service_pool.cc:224] Handling call
0709 13:09:17.752794 (+1700389us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54001b1f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.752886 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766262016}
I20260709 13:09:17.753841 19369 rpcz_store.cc:276] 0709 13:09:16.414596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.752803 (+1338207us) service_pool.cc:224] Handling call
0709 13:09:17.753067 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.753228 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.753250 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.753288 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.753315 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.753368 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.753460 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.755165 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.755697 19224 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.756145 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1501) took 1331 ms. Trace:
I20260709 13:09:17.756938 19368 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:17.756681 19369 rpcz_store.cc:276] 0709 13:09:16.424743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.755233 (+1330490us) service_pool.cc:224] Handling call
0709 13:09:17.755570 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.755763 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.755802 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.755854 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.755895 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.755960 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.756076 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.754592 21199 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.759200 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1412) took 1216 ms. Trace:
I20260709 13:09:17.760510 20483 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.759608 19369 rpcz_store.cc:276] 0709 13:09:16.542658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.758344 (+1215686us) service_pool.cc:224] Handling call
0709 13:09:17.758651 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.758840 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.758874 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.758925 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:17.758966 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.759030 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.759154 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.762576 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.757664 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1410) took 1215 ms. Trace:
I20260709 13:09:17.738932 19222 rpcz_store.cc:276] 0709 13:09:16.475212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.456754 (+981542us) service_pool.cc:224] Handling call
0709 13:09:17.457126 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.457352 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:17.585926 (+128574us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.738065 (+152139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.738115 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.738232 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.738297 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.738397 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":153726,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":237153,"threads_started":2}
I20260709 13:09:17.765844 19368 rpcz_store.cc:276] 0709 13:09:16.542006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.756467 (+1214461us) service_pool.cc:224] Handling call
0709 13:09:17.756737 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.757450 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.757619 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.768011 19368 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.773905 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 181) took 1172 ms. Trace:
I20260709 13:09:17.774336 19368 rpcz_store.cc:276] 0709 13:09:16.601221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.767458 (+1166237us) service_pool.cc:224] Handling call
0709 13:09:17.767792 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.773660 (+  5868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.773846 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.775218 19225 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.775825 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1526) took 1352 ms. Trace:
I20260709 13:09:17.775913 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1497) took 1528 ms. Trace:
I20260709 13:09:17.748108 19217 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:17.776124 19225 rpcz_store.cc:276] 0709 13:09:16.423562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.774740 (+1351178us) service_pool.cc:224] Handling call
0709 13:09:17.775042 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.775618 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.775773 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.811537 19365 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:17.811986 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.812453 19217 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:17.812672 19225 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:17.813081 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1179) took 1337 ms. Trace:
I20260709 13:09:17.813705 19225 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.734037 19897 rpcz_store.cc:276] 0709 13:09:16.420366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.440017 (+ 19651us) service_pool.cc:224] Handling call
0709 13:09:16.469450 (+ 29433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.833146 (+363696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.709566 (+876420us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54006a5c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:17.709823 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806627712}
I20260709 13:09:17.814291 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 160) took 1295 ms. Trace:
I20260709 13:09:17.814615 19225 rpcz_store.cc:276] 0709 13:09:16.519083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.813267 (+1294184us) service_pool.cc:224] Handling call
0709 13:09:17.813551 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.814072 (+   521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.814244 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.813422 19217 rpcz_store.cc:276] 0709 13:09:16.475833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.811827 (+1335994us) service_pool.cc:224] Handling call
0709 13:09:17.812093 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.812837 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.813032 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.816321 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.816630 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.817081 19217 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:17.818482 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.820675 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 178) took 1586 ms. Trace:
I20260709 13:09:17.821092 21131 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.821154 19371 rpcz_store.cc:276] 0709 13:09:16.233911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.130647 (+896736us) service_pool.cc:224] Handling call
0709 13:09:17.130982 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.131406 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.131444 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.147224 (+ 15780us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.618150 (+470926us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:17.618180 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.618228 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.820380 (+202152us) raft_consensus.cc:1685] finished
0709 13:09:17.820408 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.820602 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12487,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3789,"thread_start_us":288692,"threads_started":1,"wal-append.queue_time_us":577512}
I20260709 13:09:17.826057 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:17.827064 21093 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.829063 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:17.829995 21093 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:17.830448 21093 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.830897 21093 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.833583 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1500) took 1418 ms. Trace:
I20260709 13:09:17.834117 19370 rpcz_store.cc:276] 0709 13:09:16.414840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.456177 (+ 41337us) service_pool.cc:224] Handling call
0709 13:09:17.833351 (+1377174us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400425ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.833501 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2575418112}
I20260709 13:09:17.835331 21174 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.837453 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.839334 21073 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.819893 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.797561 21158 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:17.843151 21158 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:17.843573 21158 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:17.844422 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:17.844635 21158 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.847038 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.855367 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce726108fd4e452b9a0b91d535939c7d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:17.749934 21186 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.784020 19224 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:17.784310 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 152) took 1750 ms (client timeout 1799 ms). Trace:
I20260709 13:09:17.785028 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.786427 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.857780 21187 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.787343 19109 catalog_manager.cc:5028] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): tablet 5ed1a12d65a24a9cbdd9846e6437132d (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
W20260709 13:09:17.857681 19216 rpcz_store.cc:269] 0709 13:09:16.033675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.035903 (+  2228us) service_pool.cc:224] Handling call
0709 13:09:17.784100 (+1748197us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54001b2e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.784247 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705778944}
W20260709 13:09:17.858439 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 72082us
W20260709 13:09:17.858628 19109 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 120470us
I20260709 13:09:17.758672 21199 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.859181 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.859385 19216 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:17.860388 19225 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.860486 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.861179 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:17.861714 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:17.791755 21193 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.016s	user 0.014s	sys 0.032s
I20260709 13:09:17.862248 19366 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.863013 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 155) took 1821 ms. Trace:
I20260709 13:09:17.863134 21046 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.863751 21046 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.754083 21108 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.863381 19218 rpcz_store.cc:276] 0709 13:09:16.041384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.221607 (+180223us) service_pool.cc:224] Handling call
0709 13:09:16.221880 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.222076 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.222101 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.222528 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.514055 (+291527us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:16.514097 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.514158 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.791396 (+1277238us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b2400129518. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e0709d 00007fe8d7a3910e 00007fe8d7a5088c 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221
0709 13:09:17.862759 (+ 71363us) raft_consensus.cc:1685] finished
0709 13:09:17.862778 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.862958 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70762880,"thread_start_us":291196,"threads_started":1,"wal-append.queue_time_us":444090}
I20260709 13:09:17.864727 21207 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.864502 21108 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.865329 19218 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.865532 19222 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:17.866559 21108 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.794040 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.867421 19220 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:17.792481 21110 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.795276 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:17.795352 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:17.868355 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 73168.8us
I20260709 13:09:17.797535 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:17.801748 20734 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:17.803364 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:17.798559 21183 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.871122 19220 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:17.727684 21189 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.864509 21046 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.873178 21041 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:17.873656 21041 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.874078 21041 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.874343 19223 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:17.870309 20734 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:17.860494 21199 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:17.877269 20734 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:17.853238 20483 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.854287 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:17.858289 21230 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 13:09:17.777077 21169 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.862138 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 162) took 1328 ms. Trace:
I20260709 13:09:17.869906 19219 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:17.905130 19219 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:17.878518 21174 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:17.910415 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.910899 19367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:17.879509 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.852777 19221 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:17.884876 19365 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.890107 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.892405 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:17.913097 19373 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.913905 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:17.913969 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:17.777330 19374 rpcz_store.cc:276] 0709 13:09:16.247124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.606430 (+1359306us) service_pool.cc:224] Handling call
0709 13:09:17.607042 (+   612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.607475 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.607516 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.608043 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.774039 (+165996us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.774086 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.774149 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.775720 (+  1571us) raft_consensus.cc:1685] finished
0709 13:09:17.775738 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.775862 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1925,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5201,"thread_start_us":143072,"threads_started":1,"wal-append.queue_time_us":157038}
I20260709 13:09:17.915392 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:17.893898 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.901360 19371 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:17.903975 19225 rpcz_store.cc:276] 0709 13:09:16.533954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.815269 (+1281315us) service_pool.cc:224] Handling call
0709 13:09:17.860233 (+ 44964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.860759 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.861959 (+  1200us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b540039a3d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:17.862080 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102814592}
I20260709 13:09:17.805310 21141 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:17.906945 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.902401 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:17.934223 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.882603 21072 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:09:17.912298 19296 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:17.914491 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 278619us
I20260709 13:09:17.939566 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:17.940315 19365 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:17.940721 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:17.920679 19373 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:17.940846 19365 pending_rounds.cc:85] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 1
I20260709 13:09:17.942005 19365 pending_rounds.cc:107] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:17.942278 19365 raft_consensus.cc:2889] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.921306 20483 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.902220 21014 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:17.922825 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.945009 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.927937 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.871001 21131 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:17.960601 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.902798 21073 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.963065 19366 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:17.963860 19373 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.906210 21158 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.923846 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:17.937553 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58144.9us
I20260709 13:09:17.963992 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:17.941223 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:17.933332 19367 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:09:17.903231 21186 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:17.966910 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44167.4us
I20260709 13:09:17.947543 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:17.968475 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:17.969298 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:17.969578 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:17.969981 19295 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.970438 19296 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:17.970969 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.920655 21183 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:17.949877 21170 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:17.982784 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.950393 21110 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.950508 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:17.984411 19295 raft_consensus.cc:2410] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:17.951112 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:17.952050 19365 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:17.952320 21016 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:17.952906 21136 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:17.938525 21172 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.930045 21097 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.939245 20734 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.954973 21072 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:17.992916 19894 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:17.956290 21014 consensus_queue.cc:1243] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:17.952338 19216 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.890036 19293 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:17.983210 21170 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.965233 19901 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 2: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:17.966912 20483 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:17.939747 20871 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:17.966832 21178 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:17.973642 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:17.974823 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:17.974649 21063 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:17.976655 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:18.050163 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 73596.9us
I20260709 13:09:17.978302 21202 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:17.980613 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56831.1us
I20260709 13:09:17.981815 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:17.943507 21027 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.997267 19365 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 2
I20260709 13:09:17.986675 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:18.062350 19365 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:18.062747 19365 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:18.062892 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 76298us
I20260709 13:09:18.063894 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:17.955837 21174 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:17.941445 21190 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:09:17.981637 21135 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:17.967530 21186 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:17.990250 20986 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:18.022891 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.799s (SENT) [suppressed 40 similar messages]
I20260709 13:09:17.984633 19291 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.964973 19367 raft_consensus.cc:614] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:17.979907 21141 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:17.970923 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:18.107072 21155 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:18.107626 21155 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:17.999289 21166 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.971503 21131 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.036687 20871 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.038200 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:17.985525 21028 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:17.971789 21073 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.000025 21172 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.071159 21046 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.013684 21072 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:18.055435 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:18.102705 21186 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.102666 20986 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.062796 21093 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.037447 21170 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.054030 21187 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.110945 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:18.112044 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:18.027436 21041 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.065793 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 171) took 1215 ms. Trace:
I20260709 13:09:18.069265 20597 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.069571 21237 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.067905 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:18.128077 19899 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:18.065070 21174 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:18.130523 20871 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.069965 21027 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.163137 19297 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:18.108088 21155 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:18.178670 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 110830us
I20260709 13:09:18.137567 21141 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.177877 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 179535us
I20260709 13:09:18.161873 21177 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.144762 20986 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.144815 21189 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.183637 21011 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:18.129345 21166 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.189476 21108 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.185611 21016 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.147923 21046 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.171200 21187 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.281949 21187 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.236625 21141 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.285161 21073 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.285501 21141 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.285921 21073 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.289387 20483 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:18.251531 21108 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.251047 21237 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.254614 21016 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:18.296130 19300 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:18.298120 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 328701us
I20260709 13:09:18.171921 19293 rpcz_store.cc:276] 0709 13:09:16.846554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.874301 (+ 27747us) service_pool.cc:224] Handling call
0709 13:09:17.706532 (+832231us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:17.706815 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.031976 (+325161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.061959 (+ 29983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5453184}
I20260709 13:09:18.305668 20483 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.268237 21183 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.305013 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:18.317204 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 337235us
I20260709 13:09:18.294194 21108 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.300025 21189 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.342677 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:18.344281 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:18.347237 19221 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:18.348661 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:18.349195 19223 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:18.354969 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:18.286666 21073 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.344544 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:18.234764 21072 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:18.359373 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 388438us
I20260709 13:09:18.376394 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:18.377696 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:18.264879 21174 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.373029 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:18.355782 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:18.356079 21167 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.302881 21237 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.378890 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:18.453900 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75094.7us
I20260709 13:09:18.356333 21141 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:18.404145 21239 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:09:18.380299 21240 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 13:09:18.379917 21052 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:18.454016 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 98309.1us
I20260709 13:09:18.414098 21072 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.309988 19292 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:18.360241 21256 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.190188 19897 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:18.454916 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 82002.4us
I20260709 13:09:18.354336 21189 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.411623 21172 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.442834 21093 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.482301 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:18.456888 21015 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.487457 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 432073us
I20260709 13:09:18.458679 21199 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.490547 19366 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:18.485592 19365 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:18.494774 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:18.469358 21256 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.468490 21167 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:18.497905 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 446878us
I20260709 13:09:18.539937 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:18.541028 19266 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:18.473433 21041 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:18.479178 21131 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.492141 21174 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:18.643198 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 148322us
I20260709 13:09:18.442524 21016 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.493175 21172 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:18.690281 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 350520us
I20260709 13:09:18.659291 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:18.642699 19868 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.017s
I20260709 13:09:18.497985 21261 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:18.493326 21135 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:18.542543 21248 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 13:09:18.721385 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.718603 19868 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.010s	sys 0.021s
W20260709 13:09:18.722689 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 699761us
I20260709 13:09:18.496136 21027 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.543649 21093 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:18.543982 21256 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.497570 21015 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.635706 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:18.655620 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 166) took 1499 ms. Trace:
I20260709 13:09:18.497648 21141 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.233s
I20260709 13:09:18.659682 21265 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:18.709918 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:18.736534 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 78204.4us
I20260709 13:09:18.740259 21263 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.718003 21158 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:18.762988 21158 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:18.763484 21158 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:18.725646 21234 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:18.724786 21202 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:18.759570 21245 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:09:18.764371 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.726410 21167 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:18.739312 21244 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
W20260709 13:09:18.738906 21246 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.280s	user 0.000s	sys 0.000s
I20260709 13:09:18.493443 21257 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.262s
I20260709 13:09:18.772068 21158 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:18.776445 20871 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:09:18.776544 21073 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:18.778213 21253 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:18.778919 21252 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:09:18.779558 21166 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:18.779971 21052 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.781286 21177 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:18.735762 21258 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:09:18.788503 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 182) took 1961 ms. Trace:
W20260709 13:09:18.797112 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.799118 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:18.826861 19901 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
W20260709 13:09:18.799880 21255 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 13:09:18.739403 21016 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.735921 21261 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.803010 21237 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.804983 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1193) took 1214 ms. Trace:
I20260709 13:09:18.847980 19224 rpcz_store.cc:276] 0709 13:09:17.590437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.856610 (+266173us) service_pool.cc:224] Handling call
0709 13:09:17.856914 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.857243 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.857271 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.862883 (+  5612us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.145490 (+282607us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:18.145539 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.145634 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.804729 (+659095us) raft_consensus.cc:1685] finished
0709 13:09:18.804757 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.804912 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":281325,"threads_started":1,"wal-append.queue_time_us":478541}
I20260709 13:09:18.804400 21135 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.741427 21046 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.747051 21250 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:18.806313 21167 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.755288 21190 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:18.807139 21259 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:18.754444 21265 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.784096 21186 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 13:09:18.545262 21260 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.229s
I20260709 13:09:18.749205 21093 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:18.779572 21249 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 13:09:18.830755 19366 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:18.831780 19365 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:18.832341 19374 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:18.786041 21015 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.833153 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:18.825800 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 356025us
W20260709 13:09:18.886456 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 53410.4us
I20260709 13:09:18.886970 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:18.888849 21155 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.009s
I20260709 13:09:18.889236 21155 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.891191 21155 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.884658 21169 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:09:18.829937 21207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.033s
I20260709 13:09:18.749128 21027 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 13:09:18.893038 21207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.008s	sys 0.033s
I20260709 13:09:18.787237 21189 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.825729 19293 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:18.821313 20871 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.897217 21267 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:09:18.751041 19217 rpcz_store.cc:276] 0709 13:09:17.145044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.819557 (+674513us) service_pool.cc:224] Handling call
0709 13:09:17.819843 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.820029 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:18.137108 (+317079us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.487044 (+349936us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.493182 (+  6138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:18.497685 (+  4503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.537403 (+ 39718us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.644439 (+107036us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3449,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":233681,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":14866,"thread_start_us":594843,"threads_started":2,"wal-append.queue_time_us":703259}
I20260709 13:09:18.822780 21253 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.898880 20871 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.899673 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:18.900301 19223 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
W20260709 13:09:18.866595 20986 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.000s
I20260709 13:09:18.901319 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1534) took 1139 ms. Trace:
I20260709 13:09:18.901688 19218 rpcz_store.cc:276] 0709 13:09:17.761958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.866805 (+104847us) service_pool.cc:224] Handling call
0709 13:09:17.867035 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.867878 (+   843us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:17.880749 (+ 12871us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.165070 (+284321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.224290 (+ 59220us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.224475 (+   185us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:18.224528 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.224622 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.901124 (+676502us) raft_consensus.cc:1685] finished
0709 13:09:18.901142 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.901265 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21586,"prepare.queue_time_us":12425,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":19222,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":14253,"thread_start_us":265113,"threads_started":1,"wal-append.queue_time_us":436879}
I20260709 13:09:18.863627 21259 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:18.867996 19264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.013s	sys 0.037s
W20260709 13:09:18.905755 19264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.014s	sys 0.037s
I20260709 13:09:18.863777 21190 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.867727 21186 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.869676 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1540) took 1088 ms. Trace:
W20260709 13:09:18.873488 19894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 369) took 1816 ms (client timeout 2199 ms). Trace:
I20260709 13:09:18.827677 21177 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.859057 21250 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.912665 21250 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.914288 21177 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.885293 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1537) took 1116 ms. Trace:
I20260709 13:09:18.909273 19216 rpcz_store.cc:276] 0709 13:09:17.781032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.875338 (+ 94306us) service_pool.cc:224] Handling call
0709 13:09:17.937264 (+ 61926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.033493 (+ 96229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.869435 (+835942us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b5400136850. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:18.869608 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119775104}
I20260709 13:09:18.901072 21258 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:09:18.916322 19220 rpcz_store.cc:276] 0709 13:09:17.769100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.872244 (+103144us) service_pool.cc:224] Handling call
0709 13:09:17.872615 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.892374 (+ 19759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.892418 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.907032 (+ 14614us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.266462 (+359430us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:18.266516 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.266605 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.885043 (+618438us) raft_consensus.cc:1685] finished
0709 13:09:18.885070 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.885214 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19189,"raft.queue_time_us":21915,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":6571,"thread_start_us":359040,"threads_started":1,"wal-append.queue_time_us":553777}
I20260709 13:09:18.890980 21046 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.918648 21046 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.919068 21046 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:18.919512 21170 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.005s
I20260709 13:09:18.919993 21046 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.921533 21046 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.922688 21190 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:18.896518 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:18.924511 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:18.865957 21265 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.908233 21275 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.826516 19368 rpcz_store.cc:276] 0709 13:09:16.828691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.775376 (+946685us) service_pool.cc:224] Handling call
0709 13:09:17.775676 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.775996 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.776023 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.883652 (+107629us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.175489 (+291837us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:18.175542 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.175725 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.788158 (+612433us) raft_consensus.cc:1685] finished
0709 13:09:18.788333 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.788452 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":391,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":230205,"threads_started":1,"wal-append.queue_time_us":339457}
I20260709 13:09:18.910547 21186 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:18.920719 20734 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.002s
I20260709 13:09:18.906898 20986 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.930334 21028 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:18.905387 21261 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:18.944489 21028 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:18.944561 21277 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:18.950241 21264 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:18.950645 19219 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:18.950954 21264 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.953711 21264 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:18.954805 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:18.955075 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:18.957114 21028 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:18.953336 20986 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:18.958686 21028 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.960700 20734 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:18.961349 20734 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.964104 20734 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:18.937533 21166 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:18.965474 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:18.971614 21277 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:18.973531 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.021s	sys 0.029s
W20260709 13:09:18.982096 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.022s	sys 0.029s
W20260709 13:09:18.927238 19894 rpcz_store.cc:269] 0709 13:09:17.057507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.059457 (+  1950us) service_pool.cc:224] Handling call
0709 13:09:18.873176 (+1813719us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54006c5554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:18.873381 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037064960}
I20260709 13:09:18.986141 21166 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.936820 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:18.920009 21170 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:18.926151 21256 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:18.982415 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 526849us
I20260709 13:09:19.000535 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:19.005110 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:19.009408 21172 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:19.013285 19298 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:19.023730 21186 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.024330 21186 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:18.974741 21093 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.024637 20986 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:09:19.037667 21186 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.008955 19291 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:19.053479 20483 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.054908 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.055984 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.064424 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.065133 19365 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:19.066107 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:19.046415 21108 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:09:19.034544 21172 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:19.066927 19365 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:19.069286 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.060434 20483 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.052276 20871 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.071286 21270 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.078325 21270 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.071432 21259 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:19.077503 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:19.077421 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:19.081333 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.084592 20483 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.084777 19368 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:19.086328 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:19.086599 20597 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.087093 20597 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.087138 21166 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.086946 21172 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.087491 21190 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:19.087931 21190 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:19.088124 21063 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.088351 21190 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.088593 21063 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:19.090735 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:19.091374 19368 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.091693 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:19.092837 21277 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.083026 20871 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.093575 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.094188 19294 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 1.
I20260709 13:09:19.059480 21274 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.098541 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1247) took 1193 ms. Trace:
I20260709 13:09:19.098964 19294 rpcz_store.cc:276] 0709 13:09:17.905294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.907572 (+  2278us) service_pool.cc:224] Handling call
0709 13:09:19.093426 (+1185854us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:19.098456 (+  5030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12968704}
I20260709 13:09:19.099373 21270 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:19.099962 21275 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.101109 21274 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.101508 21274 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.101969 20597 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.103772 20597 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:19.105212 21178 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.105607 21178 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:19.106455 21178 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.106642 21265 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.107661 21178 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.110015 21250 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.095316 21177 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:19.089461 21063 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.112517 21177 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.112679 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 179) took 1144 ms. Trace:
I20260709 13:09:19.112958 21177 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.113031 19300 rpcz_store.cc:276] 0709 13:09:17.967790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.969267 (+  1477us) service_pool.cc:224] Handling call
0709 13:09:19.112482 (+1143215us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54001bf654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:19.112625 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748348160}
I20260709 13:09:19.114248 21011 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:19.119055 21265 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:19.119338 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.120174 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:19.120972 19898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 466) took 1236 ms (client timeout 1589 ms). Trace:
W20260709 13:09:19.121344 19898 rpcz_store.cc:269] 0709 13:09:17.892960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.904251 (+ 11291us) service_pool.cc:224] Handling call
0709 13:09:19.120019 (+1215768us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:19.120914 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51710848}
I20260709 13:09:19.123106 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1242) took 1307 ms. Trace:
I20260709 13:09:19.123497 19292 rpcz_store.cc:276] 0709 13:09:17.815843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.816053 (+   210us) service_pool.cc:224] Handling call
0709 13:09:19.122923 (+1306870us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54001d4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:19.123029 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108883200}
I20260709 13:09:19.094470 21170 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.073873 21108 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.141044 19368 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:19.114701 21011 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.112084 21250 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.152971 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:19.154062 19368 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:19.135848 19294 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 1.
I20260709 13:09:19.155025 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.155498 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:19.156757 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.158459 19368 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:19.159715 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.161093 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:19.158617 19225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.026s	sys 0.013s
W20260709 13:09:19.165134 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.018s
W20260709 13:09:19.227937 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.000s	sys 0.022s
I20260709 13:09:19.209832 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.229864 19368 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:09:19.205497 21160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.012s	sys 0.011s
I20260709 13:09:19.231355 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:19.219336 19365 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:09:19.232780 19225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.027s	sys 0.014s
I20260709 13:09:19.232642 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.233453 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1543) took 1451 ms. Trace:
I20260709 13:09:19.233862 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.234517 19365 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:09:19.227087 19373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.005s	sys 0.023s
W20260709 13:09:19.238471 19373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.006s	sys 0.023s
I20260709 13:09:19.226534 21164 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:19.220062 21256 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:19.232532 21160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.012s	sys 0.011s
I20260709 13:09:19.239152 20871 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:19.248651 21209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.022s	sys 0.012s
W20260709 13:09:19.246749 21154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.006s	sys 0.039s
I20260709 13:09:19.233789 19225 rpcz_store.cc:276] 0709 13:09:17.781773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.924339 (+142566us) service_pool.cc:224] Handling call
0709 13:09:17.924680 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.924918 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:17.946801 (+ 21883us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.488990 (+542189us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.233148 (+744158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:19.233207 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:19.233248 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.233308 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.233407 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55825,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":38210,"raft.queue_time_us":295233,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":6915,"thread_start_us":1285409,"threads_started":3,"wal-append.queue_time_us":464500}
W20260709 13:09:19.249560 20826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.003s	sys 0.020s
I20260709 13:09:19.251956 21164 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:19.255745 21256 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.280365 21164 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:19.276466 20826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.003s	sys 0.021s
W20260709 13:09:19.265925 21209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.023s	sys 0.013s
W20260709 13:09:19.286391 19367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.020s	sys 0.011s
W20260709 13:09:19.288861 19367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.020s	sys 0.011s
W20260709 13:09:19.265547 21154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.006s	sys 0.040s
I20260709 13:09:19.282507 21143 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.291870 20826 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:19.296360 21209 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:19.289413 21256 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:19.304265 19369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.016s	sys 0.020s
W20260709 13:09:19.307639 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.016s	sys 0.020s
W20260709 13:09:19.308581 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.020s
W20260709 13:09:19.308930 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.010s	sys 0.020s
W20260709 13:09:19.309701 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.014s	sys 0.016s
W20260709 13:09:19.310020 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.014s	sys 0.016s
W20260709 13:09:19.310721 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 769692us
I20260709 13:09:19.318790 21202 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:19.321656 21272 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.450s	user 0.000s	sys 0.014s
I20260709 13:09:19.325162 21015 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:19.325562 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 181) took 1357 ms. Trace:
I20260709 13:09:19.326056 19298 rpcz_store.cc:276] 0709 13:09:17.968393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.989248 (+ 20855us) service_pool.cc:224] Handling call
0709 13:09:17.989554 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.013871 (+1024317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.325240 (+311369us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002b84d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:19.325488 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353791744}
I20260709 13:09:19.326587 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 180) took 2756 ms. Trace:
I20260709 13:09:19.326947 19369 rpcz_store.cc:276] 0709 13:09:16.569896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.761377 (+1191481us) service_pool.cc:224] Handling call
0709 13:09:17.761668 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.761883 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:18.256202 (+494319us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.326284 (+1070082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:19.326333 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:19.326377 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.326441 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.326540 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18147,"prepare.queue_time_us":642560,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":5776,"thread_start_us":1443861,"threads_started":2}
I20260709 13:09:19.296458 21177 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.330053 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1507) took 1385 ms. Trace:
I20260709 13:09:19.301719 20826 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:19.295948 21143 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.319502 21202 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.330545 19370 rpcz_store.cc:276] 0709 13:09:17.944569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.946470 (+  1901us) service_pool.cc:224] Handling call
0709 13:09:17.946792 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.171806 (+225014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.171839 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.171882 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:18.171912 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.329774 (+1157862us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400426dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:19.329830 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.329989 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516994304}
I20260709 13:09:19.306027 21108 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.303125 21209 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:19.300493 21186 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:19.345793 21284 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:09:19.350153 19190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.015s
W20260709 13:09:19.353552 19190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.011s	sys 0.016s
W20260709 13:09:19.346505 21282 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:19.346699 21253 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:19.349082 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.358635 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.359488 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.321707 21281 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:19.360088 19220 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:19.326130 21154 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:19.361445 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.360113 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:19.352154 21280 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:09:19.333690 21250 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:19.367221 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.375662 19222 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:19.372689 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.376996 19298 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:19.373448 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.377847 19220 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:19.351851 21184 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.374434 19369 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:19.381107 19298 pending_rounds.cc:85] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 5
I20260709 13:09:19.381567 19298 pending_rounds.cc:107] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:19.372830 19370 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:19.378562 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.381793 19298 raft_consensus.cc:2889] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.382268 19224 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:19.383405 19370 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:19.385406 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:19.387240 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.002s	sys 0.054s
I20260709 13:09:19.361289 21237 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:19.388757 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.387180 19370 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:09:19.389158 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.003s	sys 0.054s
I20260709 13:09:19.389729 19223 raft_consensus.cc:2410] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:09:19.390339 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 900326us
I20260709 13:09:19.383690 21154 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.366727 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.366879 21285 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.365186 21287 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:19.466069 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 184) took 1497 ms. Trace:
W20260709 13:09:19.396070 19868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.005s
I20260709 13:09:19.432463 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:19.408708 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.401391 19223 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:19.421427 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.395958 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:19.467535 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.414263 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.393026 21260 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.477131 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.468518 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:19.496627 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100739us
I20260709 13:09:19.503271 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:19.505402 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:19.393288 21199 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.519351 21199 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.521826 21199 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.522419 21199 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.522944 21199 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.396698 21041 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.471273 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.528353 19223 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:19.508944 19897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.013s
I20260709 13:09:19.468506 19295 rpcz_store.cc:276] 0709 13:09:17.971420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.044195 (+ 72775us) service_pool.cc:224] Handling call
0709 13:09:18.044539 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.301806 (+257267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.301863 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.354296 (+ 52433us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.903466 (+549170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:18.903516 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.903600 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.465776 (+562176us) raft_consensus.cc:1685] finished
0709 13:09:19.465806 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.465990 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61913,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":703330,"threads_started":2,"wal-append.queue_time_us":819718}
I20260709 13:09:19.500674 21174 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.394563 21237 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.394734 21110 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.514847 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.387151 21184 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.394922 20986 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:19.394589 21046 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.507330 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.592659 19370 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:19.593808 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:19.395062 21275 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:19.469431 19868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.006s	sys 0.013s
I20260709 13:09:19.500453 21072 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.528928 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:19.469146 21293 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.531747 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.512039 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.534116 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.609916 19222 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:19.582892 21291 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.363801 21209 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.561022 21110 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.513989 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.392414 20826 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:19.531060 19897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.014s	sys 0.014s
I20260709 13:09:19.469022 21160 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:09:19.365846 21281 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.506410 21292 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:19.562016 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56573us
I20260709 13:09:19.506801 21260 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.531203 21073 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.539927 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:19.587713 21289 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:09:19.589460 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:19.518961 21268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.020s	sys 0.040s
I20260709 13:09:19.556306 21256 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:19.556092 19217 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:19.532469 21041 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.609354 21275 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.470141 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.585976 21108 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.495122 21285 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.663836 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.769451 19223 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:19.581532 21135 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:19.604935 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 76072.9us
I20260709 13:09:19.591320 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.590631 21177 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.667970 19370 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:19.661861 21293 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.601397 21143 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.661540 21186 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:19.676523 21011 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:09:19.683249 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.846627 19366 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:19.846400 21011 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.847748 19368 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:19.847934 19366 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:19.849069 19366 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:19.694283 19300 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:19.714815 21279 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:19.850569 21279 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.850946 21279 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:19.851935 21279 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:19.854353 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.679944 21291 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.855623 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:19.857182 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:19.607537 21297 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.716415 21170 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.720384 21281 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.741748 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:19.858956 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:19.859527 19295 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:19.859606 19300 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:19.601522 21046 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.601450 20986 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.707613 21209 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.743750 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.883410 19222 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:19.765910 21199 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.494083 21287 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:19.746093 21268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.020s	sys 0.046s
I20260709 13:09:19.762678 19221 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:19.737116 21154 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:19.765801 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 203310us
I20260709 13:09:19.745343 20826 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.706482 21202 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.771662 19340 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:19.774267 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.936918 19370 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:19.937839 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.938745 19370 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:19.939567 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:19.559684 21174 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:19.792624 21290 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:09:19.792850 21136 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.793218 21108 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.793207 19365 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:19.794618 21271 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.923s	user 0.003s	sys 0.000s
I20260709 13:09:19.795356 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:19.802739 21184 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.804857 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.808410 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:19.820683 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1505) took 1876 ms. Trace:
I20260709 13:09:19.826577 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 186) took 1341 ms. Trace:
I20260709 13:09:19.828207 21261 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:19.828981 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.954764 19220 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
W20260709 13:09:19.840611 21296 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 13:09:19.841323 21306 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 13:09:19.845566 21299 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.166s	user 0.000s	sys 0.003s
I20260709 13:09:19.849331 21011 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.754283 19291 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 1.
I20260709 13:09:19.608093 21172 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.609208 21072 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:19.860345 19902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 469) took 1911 ms (client timeout 2200 ms). Trace:
W20260709 13:09:19.863400 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 172) took 1519 ms (client timeout 1904 ms). Trace:
I20260709 13:09:19.945776 21136 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:19.973392 19219 rpcz_store.cc:269] 0709 13:09:18.344239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.354719 (+ 10480us) service_pool.cc:224] Handling call
0709 13:09:19.863183 (+1508464us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54000e3b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:19.863333 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367803648}
I20260709 13:09:19.864141 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.974803 19223 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:19.975829 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.976740 19223 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:19.877126 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.877143 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.706892 19294 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:19.858564 21170 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:19.978969 21170 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:19.988221 21170 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:19.989620 21046 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:19.992628 21309 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:09:19.992923 21274 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.891s	user 0.012s	sys 0.003s
I20260709 13:09:19.993440 21274 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.994738 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 188) took 1227 ms. Trace:
I20260709 13:09:19.995107 19299 rpcz_store.cc:276] 0709 13:09:18.767290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.767436 (+   146us) service_pool.cc:224] Handling call
0709 13:09:18.767720 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.768018 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.768044 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.768491 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.305323 (+536832us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:19.305363 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.305475 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.844955 (+539480us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:19.994446 (+149491us) raft_consensus.cc:1685] finished
0709 13:09:19.994468 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.994681 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16573,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"spinlock_wait_cycles":372626688,"thread_start_us":479989,"threads_started":1,"wal-append.queue_time_us":763935}
I20260709 13:09:19.998490 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:19.999131 19894 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:19.999485 21260 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:19.957991 21108 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.958348 21202 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.000116 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.004364 21174 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.005090 21291 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.885119 21279 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.888175 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:20.006074 19900 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:20.006904 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:19.889894 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1482) took 3770 ms. Trace:
W20260709 13:09:19.895861 19367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.023s	sys 0.012s
I20260709 13:09:19.902582 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:20.008009 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.008917 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.009222 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:20.010100 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.010833 19217 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:19.883705 19296 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:20.011536 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.013345 21285 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:20.008424 19367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.023s	sys 0.013s
I20260709 13:09:20.014344 21110 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:20.016326 21190 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.927s	user 0.014s	sys 0.000s
I20260709 13:09:20.016817 21190 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.018095 19895 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:20.019158 21190 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:20.020742 21307 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:09:19.887833 21237 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.920819 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.008306 19372 rpcz_store.cc:276] 0709 13:09:16.112616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.113208 (+   592us) service_pool.cc:224] Handling call
0709 13:09:17.713696 (+1600488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.714075 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.714112 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.714630 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.883938 (+169308us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:17.883991 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.885286 (+  1295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.637545 (+752259us) raft_consensus.cc:1685] finished
0709 13:09:18.637577 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.861702 (+1224125us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400357850. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:19.882577 (+ 20875us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1094,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":3679918464,"thread_start_us":168980,"threads_started":1,"wal-append.queue_time_us":338966,"wal-append.run_cpu_time_us":9283,"wal-append.run_wall_time_us":1639576}
I20260709 13:09:19.925853 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:19.914026 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:19.922569 19368 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:09:19.943202 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 171606us
W20260709 13:09:20.024720 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 110982us
I20260709 13:09:20.025295 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.026211 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.027002 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.027581 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:19.858194 21297 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:19.947316 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 343091us
W20260709 13:09:19.941095 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.888886 21177 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:19.862033 21135 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:19.959877 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:19.960357 19371 rpcz_store.cc:276] 0709 13:09:17.943990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.944253 (+   263us) service_pool.cc:224] Handling call
0709 13:09:17.948875 (+  4622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.168082 (+219207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.168121 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.168194 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:18.168237 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.820368 (+1652131us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400313154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:19.820428 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.820609 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503602432}
I20260709 13:09:19.964076 19297 rpcz_store.cc:276] 0709 13:09:18.485296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.486004 (+   708us) service_pool.cc:224] Handling call
0709 13:09:19.331742 (+845738us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:19.331976 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.717835 (+385859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.717881 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:19.717949 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:19.717992 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.826292 (+108300us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400048dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:19.826353 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.826504 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888943360}
W20260709 13:09:19.968520 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.946345 21292 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.884333 19218 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.034123 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.044687 19223 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.982059 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.045622 19295 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:19.972553 19902 rpcz_store.cc:269] 0709 13:09:17.949301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.949457 (+   156us) service_pool.cc:224] Handling call
0709 13:09:18.038015 (+ 88558us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:19.860095 (+1822080us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400780fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:19.860278 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3231456384}
I20260709 13:09:20.047106 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:19.957546 20986 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:19.983922 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:19.984970 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:19.962110 21261 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:19.986517 21199 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.987207 21178 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.000s
I20260709 13:09:20.004963 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.000838 21293 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.021955 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 193) took 1542 ms. Trace:
I20260709 13:09:19.920055 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.023666 19366 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
W20260709 13:09:19.954126 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 158849us
W20260709 13:09:20.069821 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 149837us
I20260709 13:09:20.070701 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.072023 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.072525 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:19.995965 21274 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.038205 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:19.981230 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.049242 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.043360 21187 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.068298 19373 rpcz_store.cc:276] 0709 13:09:18.479822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.479943 (+   121us) service_pool.cc:224] Handling call
0709 13:09:18.480320 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:19.239859 (+759539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.239903 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:19.240648 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:09:19.653120 (+412472us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:20.021449 (+368329us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.021670 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.021741 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.021788 (+    47us) raft_consensus.cc:1685] finished
0709 13:09:20.021800 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.021908 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7982,"prepare.queue_time_us":355412,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":283358,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":16069,"thread_start_us":1483621,"threads_started":3,"wal-append.queue_time_us":488669}
I20260709 13:09:20.092204 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:20.050791 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 315570us
I20260709 13:09:20.054023 19299 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:20.056933 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:20.002785 21063 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.002686 21041 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.063736 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.002399 21108 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.035567 21154 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.989671 21170 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.987457 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.039496 21263 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.072705 19903 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:20.038187 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.039834 21186 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 13:09:20.008334 21164 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.713s	user 0.016s	sys 0.000s
I20260709 13:09:20.083210 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.064601 19294 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:20.085781 20986 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:20.138285 21158 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.141315 21158 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:20.141705 21158 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.141798 21312 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:20.142182 21312 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:20.142987 21312 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.043802 21073 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.143955 21312 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.144130 21073 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.034638 21011 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.129835 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.133893 19368 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
W20260709 13:09:20.133941 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 95862.2us
I20260709 13:09:20.001909 21275 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.097417 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.085072 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.044210 21177 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.003437 21136 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.138403 21294 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.139411 21164 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.139326 19121 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.099570 21316 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.090401 21260 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:20.133208 21263 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.054476 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.089903 21014 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.094105 21093 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:20.198624 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.165421 19221 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:20.203030 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.203595 19221 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:20.205031 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:20.146291 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54196.2us
I20260709 13:09:20.206786 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.115100 19218 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:20.121094 19223 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:20.210954 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:20.212540 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.215425 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:20.145690 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62590.9us
I20260709 13:09:20.182399 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.184190 21287 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:20.185319 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 88010.7us
I20260709 13:09:20.218223 19372 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:20.218885 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.219079 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.189811 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.191856 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.220476 19365 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:20.144860 21073 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.199340 21011 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.224565 21011 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.165824 21169 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.131419 21250 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:20.226671 21011 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.138912 19291 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:20.145638 21292 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.227708 21292 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:20.228103 21292 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:20.229280 21256 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:20.229652 21256 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:20.230352 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.230521 21256 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.231598 21256 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.232551 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.232836 19216 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:20.095731 21187 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.233309 19368 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:20.233435 21187 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.234081 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.236459 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.167101 21253 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.164659 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:20.238933 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74369.2us
I20260709 13:09:20.240235 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:20.198067 21014 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.241755 21014 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.242213 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:20.242792 19895 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.194188 21291 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.235908 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.244341 21291 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:20.197165 21136 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.244747 21287 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.245204 21287 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:20.245571 21287 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:20.246827 21305 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.485s	user 0.000s	sys 0.002s
I20260709 13:09:20.244766 21291 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.201408 21297 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.247846 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.248515 19898 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:20.248900 21303 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.569s	user 0.001s	sys 0.001s
I20260709 13:09:20.196890 21316 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.249706 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.211925 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.251865 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.081492 21199 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.176656 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.185029 21186 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.163780 21041 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:09:20.201921 21260 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:20.187953 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:20.257540 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50817.9us
I20260709 13:09:20.221988 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.258350 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.135953 21154 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.081733 21156 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:09:20.223101 21237 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.197016 21263 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.223212 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.225422 21158 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.253209 19372 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:20.257066 21143 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.252336 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.258539 19365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:20.305382 19365 raft_consensus.cc:606] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:09:20.305778 19365 raft_consensus.cc:614] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.271543 21063 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:20.138201 21281 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:09:20.256932 21294 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.264123 21316 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.265834 21041 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:20.215335 21277 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:09:20.267170 21304 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.494s	user 0.000s	sys 0.006s
I20260709 13:09:20.270756 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.271004 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:20.271106 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.270780 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.271541 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.271974 21274 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.288341 21298 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:20.330503 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.331606 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.332095 19297 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.332262 21156 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.332893 21156 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.334151 21199 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.277000 21186 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.272852 21141 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.273546 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.339344 19296 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:20.273924 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.267033 21202 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:20.272583 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.312556 21072 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.276328 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.208667 21275 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.282496 19370 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:20.274863 21260 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.277439 21011 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.293895 21154 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.294381 21093 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.297050 19300 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:20.297338 19895 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:20.252249 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:20.304016 19372 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:20.258276 19373 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:20.281826 21237 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.329434 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.355734 21202 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:20.388917 21202 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.272281 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:20.390136 21202 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.272540 21164 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:20.391500 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 139359us
I20260709 13:09:20.304813 21135 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.368913 21275 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:09:20.341398 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:20.250288 21302 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.507s	user 0.002s	sys 0.000s
I20260709 13:09:20.342286 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.250645 20986 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:20.358412 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:20.371887 19121 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.380581 19370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:20.426004 19370 raft_consensus.cc:606] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.426469 19370 raft_consensus.cc:614] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.335726 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.427489 19901 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:20.384384 21093 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.379439 21011 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.444392 21011 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:20.419432 21311 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:09:20.445145 19370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:20.445881 19370 raft_consensus.cc:606] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:09:20.446272 19370 raft_consensus.cc:614] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.446544 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1512) took 1074 ms. Trace:
I20260709 13:09:20.446976 19367 rpcz_store.cc:276] 0709 13:09:19.372233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.372536 (+   303us) service_pool.cc:224] Handling call
0709 13:09:19.372783 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.372991 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.373015 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.374786 (+  1771us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.014713 (+639927us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:20.014754 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.014822 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.418834 (+404012us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:20.446260 (+ 27426us) raft_consensus.cc:1685] finished
0709 13:09:20.446281 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.446493 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5090048,"thread_start_us":620879,"threads_started":1,"wal-append.queue_time_us":701598}
I20260709 13:09:20.437978 21014 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.408120 19292 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:20.420822 21277 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:20.466840 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.443745 21177 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.391994 21237 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.403575 21164 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:20.483332 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 207990us
I20260709 13:09:20.498541 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:20.488920 19222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.023s
W20260709 13:09:20.483985 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 211786us
I20260709 13:09:20.502558 19298 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:20.510676 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.521060 19297 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:20.500313 19222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.011s	sys 0.023s
I20260709 13:09:20.518610 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:20.508564 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.465153 21277 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.509071 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 116394us
W20260709 13:09:20.489786 21295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.014s
I20260709 13:09:20.465299 20986 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:20.529467 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 277174us
I20260709 13:09:20.479801 21293 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.553134 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.523515 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.466023 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:20.541404 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.570529 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.576705 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:20.569689 21295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.015s
I20260709 13:09:20.500931 21177 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.536211 19219 raft_consensus.cc:2955] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:20.589179 19218 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:20.538971 21199 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:20.597335 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.597903 19296 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.592389 21277 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.595023 19366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:20.600907 19366 raft_consensus.cc:606] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.601315 19366 raft_consensus.cc:614] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:20.595883 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:20.602700 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:20.525806 21156 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.593580 21169 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.580971 21186 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:20.608227 19895 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:20.609017 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:20.609300 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.609877 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:20.610158 21274 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.610540 21274 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.610867 21274 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.602519 21295 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:20.612524 21297 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.612882 21295 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:20.612993 21297 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.613265 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.613454 21297 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.613842 21295 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.614360 19340 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.601788 21158 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.584525 21298 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.608014 21169 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:20.609915 19295 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:20.580320 21063 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:20.633975 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.573495 21146 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:20.638600 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.639689 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.522683 21141 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:09:20.594355 21177 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.646063 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.645555 21146 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:20.653684 21146 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:20.643121 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 119633us
I20260709 13:09:20.661768 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.642608 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.585041 21293 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.607000 21199 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:20.633268 21154 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.606113 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:20.634516 21169 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:20.691902 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 392876us
I20260709 13:09:20.639765 21108 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:20.637775 21174 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:20.695917 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.698581 19218 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:20.649923 21330 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.648679 21279 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:20.706912 19895 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:20.706774 21279 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:20.707509 21318 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:09:20.708489 21328 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:09:20.710091 21329 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:20.711165 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1563) took 1127 ms. Trace:
I20260709 13:09:20.711503 19222 rpcz_store.cc:276] 0709 13:09:19.583741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.926558 (+342817us) service_pool.cc:224] Handling call
0709 13:09:19.926866 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.927206 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.927234 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.927680 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.534867 (+607187us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:20.534904 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.534968 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.710962 (+175994us) raft_consensus.cc:1685] finished
0709 13:09:20.710983 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.711110 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":687,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14741,"thread_start_us":569208,"threads_started":1,"wal-append.queue_time_us":621345}
I20260709 13:09:20.712532 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1556) took 1276 ms. Trace:
I20260709 13:09:20.713496 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:20.685899 21177 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:20.697438 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 101810us
W20260709 13:09:20.697100 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 82806.2us
I20260709 13:09:20.733577 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.735157 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.689246 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.712997 19225 rpcz_store.cc:276] 0709 13:09:19.436274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.507431 (+ 71157us) service_pool.cc:224] Handling call
0709 13:09:19.507821 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:19.877882 (+370061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.877910 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:19.895716 (+ 17806us) log.cc:844] Serialized 52 byte log entry
0709 13:09:20.384296 (+488580us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:20.384335 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.384402 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.712268 (+327866us) raft_consensus.cc:1685] finished
0709 13:09:20.712290 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.712448 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30396,"raft.run_cpu_time_us":4761,"raft.run_wall_time_us":18863,"thread_start_us":792594,"threads_started":2,"wal-append.queue_time_us":591835}
I20260709 13:09:20.737035 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.738670 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.740603 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.690848 21316 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.688760 21275 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.743317 19296 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:20.691608 21154 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:20.684933 20986 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.768067 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.768882 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.771803 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.697080 21346 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.777557 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.779750 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:20.779986 21292 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.005s
I20260709 13:09:20.780339 19218 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:09:20.781203 21291 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.534s	user 0.015s	sys 0.000s
W20260709 13:09:20.780360 21187 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.546s	user 0.000s	sys 0.009s
I20260709 13:09:20.781617 21291 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.782181 21187 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.782588 21279 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.783614 21291 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.729111 21186 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.743372 21353 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:20.742441 21312 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.008s
I20260709 13:09:20.778262 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.706804 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:20.776080 21154 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:20.788815 21170 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.006s
I20260709 13:09:20.715579 21352 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.791198 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.784654 21341 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.692235 21287 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.780678 21199 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.789320 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:20.770643 19896 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:09:20.793747 21256 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.562s	user 0.017s	sys 0.014s
I20260709 13:09:20.767580 21344 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.775629 19294 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:20.715776 21174 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.810289 19218 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.741986 20826 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.784777 21187 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:20.780450 21292 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.820045 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:20.838673 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 177189us
I20260709 13:09:20.839366 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.839854 19220 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:20.840233 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.776759 21250 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:09:20.845238 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79138.3us
W20260709 13:09:20.846449 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 107893us
I20260709 13:09:20.795876 21353 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.728027 21330 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.849221 21353 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.849850 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:20.771364 21345 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:09:20.774343 21063 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.783977 21011 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.804555 21209 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.809747 21312 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.773765 21316 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:20.832422 21341 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.841213 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1570) took 1047 ms. Trace:
I20260709 13:09:20.846572 19295 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:20.848806 19368 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:20.849982 21292 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:20.787379 21014 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.787506 21186 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.797999 21346 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.811283 21349 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.852314 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.854820 19218 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:20.824687 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 464) took 2926 ms. Trace:
I20260709 13:09:20.805059 21277 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.830240 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:20.846956 19216 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.001s	sys 0.051s
I20260709 13:09:20.835126 21344 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:20.831547 21093 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.848393 20826 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.873664 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:20.938346 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:20.942761 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:20.948943 19217 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:20.850643 21275 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:20.949218 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 208704us
I20260709 13:09:20.862890 19223 rpcz_store.cc:276] 0709 13:09:19.793424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.207984 (+414560us) service_pool.cc:224] Handling call
0709 13:09:20.208252 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.208429 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:20.259189 (+ 50760us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.840933 (+581744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.840975 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:20.841009 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.841064 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.841166 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66262,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":148156,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7902,"spinlock_wait_cycles":2866048,"thread_start_us":544793,"threads_started":2,"wal-append.queue_time_us":599688}
I20260709 13:09:20.866503 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:20.948975 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 96738.1us
W20260709 13:09:20.954279 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 93882.7us
I20260709 13:09:20.954913 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.956210 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.957647 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:20.959251 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.961012 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130940us
W20260709 13:09:20.868544 21263 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
I20260709 13:09:20.973754 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:20.858560 21312 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.876238 21336 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 13:09:20.903254 21333 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:09:21.017730 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1418) took 1550 ms. Trace:
I20260709 13:09:20.987141 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:20.981302 21014 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.018718 21014 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.019227 21014 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:20.890419 21332 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:09:20.924785 21174 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.913125 21281 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:21.000409 20826 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.001001 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1430) took 1498 ms. Trace:
I20260709 13:09:21.021891 21146 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.022396 19300 rpcz_store.cc:276] 0709 13:09:19.502741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.980940 (+478199us) service_pool.cc:224] Handling call
0709 13:09:21.000807 (+1019867us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001d4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:21.000932 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495628544}
I20260709 13:09:21.001998 21093 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:20.952616 19216 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.002s	sys 0.052s
W20260709 13:09:21.002429 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 736901us
I20260709 13:09:21.004700 21294 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.024889 21294 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:21.025250 21326 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.638s	user 0.003s	sys 0.000s
I20260709 13:09:21.025877 21294 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.026923 21294 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.005623 19901 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:21.005631 19294 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.012058 19298 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:21.012841 21190 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:21.030093 21190 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:21.013742 19293 consensus_meta.cc:287] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.006s
I20260709 13:09:21.030795 21274 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.031172 19293 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:21.033010 21011 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.021942 21281 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:20.991020 21263 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.034665 21281 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.036367 21355 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:21.036785 21355 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.037101 21355 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.037631 21353 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.996721 21341 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.040083 21353 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.016358 21312 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.989914 21352 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:21.042187 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.924659 21293 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.043154 21293 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.969890 21344 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.043742 21293 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.044598 21293 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.937584 21287 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.953725 19897 rpcz_store.cc:276] 0709 13:09:17.883551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.890193 (+  6642us) service_pool.cc:224] Handling call
0709 13:09:17.953395 (+ 63202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.181763 (+228368us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:18.988538 (+806775us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.090223 (+1101685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.129285 (+ 39062us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.136018 (+  6733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.795200 (+659182us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400750154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:20.798223 (+  3023us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.810185 (+ 11962us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105201,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"spinlock_wait_cycles":443271040,"thread_start_us":1037567,"threads_started":2,"wal-append.queue_time_us":692951,"wal-append.run_cpu_time_us":14580,"wal-append.run_wall_time_us":1312438}
I20260709 13:09:20.969465 21297 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:20.996574 21365 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.004774 21143 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:21.046809 21143 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:21.047221 21297 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:20.862370 21187 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.017973 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1219) took 1055 ms. Trace:
I20260709 13:09:20.861852 21209 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.048418 19219 rpcz_store.cc:276] 0709 13:09:19.962535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.230603 (+268068us) service_pool.cc:224] Handling call
0709 13:09:20.231053 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.231346 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.231373 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.243721 (+ 12348us) log.cc:844] Serialized 508 byte log entry
0709 13:09:20.536061 (+292340us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.619211 (+ 83150us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.638887 (+ 19676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.638974 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.017774 (+378800us) raft_consensus.cc:1685] finished
0709 13:09:21.017797 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.017922 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19393,"raft.queue_time_us":159307,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10379,"thread_start_us":291961,"threads_started":1,"wal-append.queue_time_us":357520}
I20260709 13:09:21.049916 21209 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.050833 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.051754 19222 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:21.053200 21073 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.829s	user 0.004s	sys 0.006s
I20260709 13:09:21.053586 21073 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.055572 21073 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:20.936352 21261 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.039729 21341 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.056280 21261 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.057296 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:21.057529 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70704.8us
I20260709 13:09:21.016597 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1548) took 1604 ms. Trace:
I20260709 13:09:20.998019 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.062135 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:20.941541 21186 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.035928 21281 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.064389 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.083417 19219 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:21.065317 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.949910 21275 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:20.865160 21330 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.055348 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:20.926136 21316 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:20.913801 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 472) took 1318 ms. Trace:
I20260709 13:09:21.059469 19121 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 3 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 4 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:21.067313 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:21.062623 19299 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:21.077001 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:21.078210 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 120646us
I20260709 13:09:21.072748 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:21.099828 19903 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:21.099984 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.060367 19224 rpcz_store.cc:276] 0709 13:09:19.412785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.412971 (+   186us) service_pool.cc:224] Handling call
0709 13:09:19.466593 (+ 53622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.737466 (+270873us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:20.134924 (+397458us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.855781 (+720857us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.855997 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.856046 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:20.856077 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.016313 (+160236us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400077bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:21.016375 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.016527 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145396,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3658,"raft.queue_time_us":252162,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":6548,"spinlock_wait_cycles":622433536,"thread_start_us":1108237,"threads_started":3,"wal-append.queue_time_us":579612}
I20260709 13:09:21.086889 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.088430 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:21.093532 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 68904.4us
I20260709 13:09:21.101636 21352 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.101802 21319 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.102147 21352 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.102444 21319 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:21.103380 21319 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:21.104336 21156 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.104713 21156 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:21.105481 21156 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.105921 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:21.106504 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:21.106696 21156 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.107113 19902 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:21.108330 19222 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:20.989391 21292 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.118309 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:21.122512 19902 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:21.036408 21263 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.110134 19299 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:21.111789 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:21.113188 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:21.018142 19292 rpcz_store.cc:276] 0709 13:09:19.467779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.468203 (+   424us) service_pool.cc:224] Handling call
0709 13:09:19.808290 (+340087us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:21.017488 (+1209198us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54001bfb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:21.017668 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875019392}
W20260709 13:09:21.138046 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.117446 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.011710 21177 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:21.128669 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51761.1us
I20260709 13:09:21.142294 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:21.097746 19219 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
W20260709 13:09:21.090853 21237 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.003s
I20260709 13:09:21.123996 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:21.143075 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.067322 21357 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:21.092870 21275 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.142473 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:21.137012 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74929.5us
I20260709 13:09:21.090152 21172 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.047818 21143 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.153838 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.154489 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:21.140887 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.142650 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.118775 21364 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:21.152520 19370 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:21.152362 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50706.7us
I20260709 13:09:21.092680 21354 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.155694 19299 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:21.165879 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.173588 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.173972 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.062866 21312 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.187503 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:21.118956 21352 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.194802 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.192368 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.199266 19372 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:21.055466 21344 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.200131 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.215054 19372 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:21.192734 19373 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:21.215481 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.215942 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.216117 19374 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:21.216280 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.216956 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.145316 21292 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:21.201939 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.109491 19898 rpcz_store.cc:276] 0709 13:09:19.595861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.597667 (+  1806us) service_pool.cc:224] Handling call
0709 13:09:20.133016 (+535349us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:20.140463 (+  7447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.248905 (+108442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.913463 (+664558us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b5400560254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:20.913723 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177138176}
I20260709 13:09:21.201388 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.208407 19294 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:21.188671 21348 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:21.198451 21287 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.141290 21199 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:21.213579 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.254307 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.217048 19365 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.152613 21170 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:21.189633 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48815.3us
I20260709 13:09:21.197952 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:21.144799 21351 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:21.231892 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 44508.6us
I20260709 13:09:21.193879 21298 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:21.234619 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:21.234956 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:21.159945 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:21.248291 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.199883 21353 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:21.188589 21363 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:21.190198 21360 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.258738 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:21.247627 21352 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:21.153050 21237 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:21.236584 21202 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.003s
I20260709 13:09:21.191021 21172 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.290973 19219 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:21.315809 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 80916.9us
I20260709 13:09:21.334263 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:21.335141 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.298409 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:21.248123 21354 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.264814 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:21.290295 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:21.311403 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.348237 19374 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:21.350298 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:21.289007 21371 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:09:21.263972 21170 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.355029 19297 raft_consensus.cc:2410] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:21.263509 21199 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.304304 21341 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.357141 19225 raft_consensus.cc:2368] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5.
W20260709 13:09:21.314855 21367 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:21.311021 21360 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:21.358325 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 196813us
I20260709 13:09:21.262535 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.311803 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.400208 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:21.405004 21369 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:09:21.311180 21186 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.370440 21170 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.289639 21274 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.332700 21364 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.303791 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.308782 21298 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:21.374643 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:21.339468 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:21.303467 19293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1426) took 1807 ms (client timeout 2005 ms). Trace:
I20260709 13:09:21.403414 21344 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.263466 21146 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.304421 21352 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:21.432722 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.294895 21363 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.263146 21348 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.380125 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.367074 21287 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.370671 21169 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
I20260709 13:09:21.365985 21316 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.293859 21353 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.291368 21154 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.367455 21277 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.366159 21354 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:21.438508 21354 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.439092 21353 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:21.440663 21382 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:21.370877 21260 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.370155 21279 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.380040 21199 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.379395 21202 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.390964 21351 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.313056 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:21.423807 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 84452.5us
I20260709 13:09:21.445686 19298 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:21.429319 21346 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.428582 19372 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.428731 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.422756 19370 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:21.371879 21292 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.390926 21357 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:09:21.435611 19894 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:21.436612 19374 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.412075 21014 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.460444 21014 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.434412 21177 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.411621 21174 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:21.456234 21275 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.423547 21355 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:21.460588 21375 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:21.461372 21237 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.461640 21186 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.434362 21352 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.443397 21169 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.467593 21174 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.476372 21355 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.478108 21263 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:21.478513 21263 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:21.479290 21263 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.455118 21360 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.481536 21275 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.472817 21298 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.486280 21312 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.518556 19121 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:21.526209 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.357465 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 92717us
I20260709 13:09:21.529928 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:21.533131 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.542474 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.362501 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1223) took 1285 ms. Trace:
I20260709 13:09:21.545682 19216 rpcz_store.cc:276] 0709 13:09:20.072628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.233668 (+161040us) service_pool.cc:224] Handling call
0709 13:09:20.233931 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.234139 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:21.024442 (+790303us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.301005 (+276563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.309180 (+  8175us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:21.314766 (+  5586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.336535 (+ 21769us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.358042 (+ 21507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48486,"prepare.queue_time_us":80847,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2225,"raft.queue_time_us":8823,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5624,"thread_start_us":1004644,"threads_started":2,"wal-append.queue_time_us":374147}
I20260709 13:09:21.409759 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:21.561235 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.431072 19296 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:21.427671 19293 rpcz_store.cc:269] 0709 13:09:19.496391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.856880 (+360489us) service_pool.cc:224] Handling call
0709 13:09:21.303234 (+1446354us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54002e7f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:21.303389 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020640128}
W20260709 13:09:21.428225 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 78024.4us
I20260709 13:09:21.566159 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:21.567050 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.567637 19296 raft_consensus.cc:2368] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5.
I20260709 13:09:21.567440 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:21.568608 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:21.568866 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:21.446599 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:21.569885 19293 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:21.443147 19299 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:21.561295 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 151499us
I20260709 13:09:21.571727 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1263) took 1032 ms. Trace:
I20260709 13:09:21.447481 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.572237 19297 rpcz_store.cc:276] 0709 13:09:20.539196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.540590 (+  1394us) service_pool.cc:224] Handling call
0709 13:09:21.571165 (+1030575us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54003f2ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:21.571507 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761637632}
I20260709 13:09:21.408627 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:21.574769 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 127256us
I20260709 13:09:21.578174 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.580432 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.426463 19365 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:21.585633 19220 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:21.455665 19373 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.587627 19366 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:09:21.462376 21154 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.459980 21172 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:21.462530 21190 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.621445 21190 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:21.622092 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.445492 21287 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.628619 21279 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.444204 21348 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.443531 21363 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.594338 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:21.600596 21237 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.601569 21275 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.602517 21312 raft_consensus.cc:2764] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:21.606772 21174 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.608953 21073 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.608852 21011 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:21.644364 21011 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.644897 21011 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:21.609884 21093 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.608840 19295 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:21.614061 21295 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:21.614579 21263 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:21.639887 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.630302 21279 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:21.628552 21178 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.450304 21351 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.658970 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.627954 19122 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 261) took 8242 ms. Trace:
I20260709 13:09:21.660919 19221 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.652070 21073 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:21.639087 21366 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:21.639910 21156 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.006s
I20260709 13:09:21.637724 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.619273 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.625880 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.654727 21360 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:21.629774 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87575.5us
I20260709 13:09:21.665135 21349 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:21.667759 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:21.669584 21294 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.003s
I20260709 13:09:21.670506 21351 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.672044 21287 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.660852 19122 rpcz_store.cc:276] 0709 13:09:13.385766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.462604 (+ 76838us) service_pool.cc:224] Handling call
0709 13:09:21.627624 (+8165020us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:16.204694 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:16.301867 (+ 97173us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:16.303535 (+  1668us) write_op.cc:435] Acquired schema lock
0709 13:09:16.304691 (+  1156us) tablet.cc:662] Decoding operations
0709 13:09:16.339393 (+ 34702us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:16.339464 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:16.339507 (+    43us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:09:16.563550 (+224043us) tablet.cc:701] Row locks acquired
0709 13:09:16.565098 (+  1548us) write_op.cc:260] PREPARE: finished
0709 13:09:16.669512 (+104414us) write_op.cc:270] Start()
0709 13:09:16.716047 (+ 46535us) write_op.cc:276] Timestamp: P: 1783602556668912 usec, L: 0
0709 13:09:16.717633 (+  1586us) op_driver.cc:348] REPLICATION: starting
0709 13:09:16.836434 (+118801us) log.cc:844] Serialized 5268 byte log entry
0709 13:09:17.599562 (+763128us) op_driver.cc:464] REPLICATION: finished
0709 13:09:18.195589 (+596027us) write_op.cc:301] APPLY: starting
0709 13:09:18.206999 (+ 11410us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:18.294569 (+ 87570us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:18.303854 (+  9285us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:18.305437 (+  1583us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:18.305699 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:09:18.305762 (+    63us) write_op.cc:312] APPLY: finished
0709 13:09:18.306179 (+   417us) log.cc:844] Serialized 95 byte log entry
0709 13:09:18.306369 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.306518 (+   149us) write_op.cc:454] Released schema lock
0709 13:09:18.306571 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:18.307031 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.307087 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9756,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":542267,"apply.run_cpu_time_us":4295,"apply.run_wall_time_us":126227,"num_ops":13,"prepare.queue_time_us":162896,"prepare.run_cpu_time_us":20515,"prepare.run_wall_time_us":832994,"raft.queue_time_us":400838,"raft.run_cpu_time_us":31202,"raft.run_wall_time_us":478417,"replication_time_us":846223,"thread_start_us":1002378,"threads_started":4,"wal-append.queue_time_us":203999,"wal-append.run_cpu_time_us":43915,"wal-append.run_wall_time_us":2226088}]]}
I20260709 13:09:21.675964 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:21.658079 21372 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.678121 21143 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.690315 19225 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:21.700378 21381 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:21.700296 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:21.701786 21261 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.009s
I20260709 13:09:21.702068 21360 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.706039 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:21.690762 21349 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:21.707206 21353 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.709759 21170 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.712790 21177 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.655229 21169 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.700417 19374 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:21.740789 19221 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:21.753125 21187 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.756637 21108 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:21.757289 21108 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.759135 19373 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:21.759407 21108 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:21.760416 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 166412us
I20260709 13:09:21.761891 21279 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.772861 19296 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:21.752218 21156 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.713512 21073 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:21.795555 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 176618us
I20260709 13:09:21.783764 19339 leader_election.cc:400] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5.
I20260709 13:09:21.800838 19339 leader_election.cc:403] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.788961 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.789449 21363 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.794605 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:21.794366 21349 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.795364 21353 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:21.797431 21390 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:09:21.798694 19223 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.766623 21287 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:21.832911 19222 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.840569 21298 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:21.841192 21363 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.747334 21178 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.852417 21199 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.855268 21199 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.856439 21169 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:21.857154 21360 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.857733 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:21.849035 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44421us
W20260709 13:09:21.859869 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 59731.2us
W20260709 13:09:21.865742 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 210365us
W20260709 13:09:21.871450 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.779460 21011 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.873207 21187 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.800297 21156 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.799479 21177 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.806383 19898 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:21.941636 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57640.8us
I20260709 13:09:21.937678 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:21.950620 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53842.2us
I20260709 13:09:21.934604 21360 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:21.954699 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.956905 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 116915us
I20260709 13:09:21.957226 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.931069 21287 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:21.964887 21386 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:21.972306 21344 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.972990 21344 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:21.975590 21342 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:21.976142 19219 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.976022 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:21.977792 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:21.978505 19896 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.979533 21178 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:21.980686 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 87854.9us
I20260709 13:09:21.981570 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:21.982949 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:21.983852 19216 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:21.984963 21360 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:21.987227 21360 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:21.993733 21011 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.005273 21170 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:21.989424 19895 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:22.010123 19222 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:21.987830 21360 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.011410 19220 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:21.997995 21381 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:22.026405 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66171us
I20260709 13:09:21.976014 21342 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:22.019970 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:22.024797 21360 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.015719 21363 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:22.089330 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 132192us
I20260709 13:09:22.092607 19224 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:22.094172 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 110034us
I20260709 13:09:22.095587 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:22.096524 19900 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:22.084939 21360 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.108026 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:22.108798 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 158870us
I20260709 13:09:22.110309 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:22.112303 21395 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.315s	user 0.002s	sys 0.003s
I20260709 13:09:22.112728 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:22.113036 19216 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:22.114641 19221 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:22.114717 21287 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:22.092960 21381 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:22.116786 21381 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:22.117974 21352 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 13:09:22.117835 21381 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.120478 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.120911 21187 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5.
W20260709 13:09:22.122797 21190 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.501s	user 0.004s	sys 0.005s
I20260709 13:09:22.107633 21349 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.110390 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.140641 19340 leader_election.cc:400] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5.
I20260709 13:09:22.141008 19340 leader_election.cc:403] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:22.109654 19899 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:22.152726 21187 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.153146 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:22.160979 21404 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:22.118520 21352 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.168605 21344 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.124073 21146 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:22.170151 21169 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:22.172523 19217 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:22.176438 21348 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:09:22.176342 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:22.176829 21177 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:22.141904 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.177299 21287 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:22.183212 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:22.178565 21342 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.181689 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:22.202457 19219 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:22.204649 19370 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:22.108587 21174 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.208832 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:22.211910 19367 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:22.212795 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:22.213078 21143 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.215829 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 391) took 1127 ms. Trace:
I20260709 13:09:22.237442 21342 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.238356 21352 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:22.238741 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58106.6us
W20260709 13:09:22.239738 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 63608.6us
I20260709 13:09:22.242707 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:22.246482 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 63491.8us
I20260709 13:09:22.246788 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:22.247049 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.247375 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:22.247756 19296 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:22.250361 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.250821 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:22.251484 19293 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.246809 19295 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:22.215462 21256 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:09:22.228246 21348 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.257120 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.257401 19296 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:22.257445 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:22.235460 21177 raft_consensus.cc:2764] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:22.254469 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:22.257253 21292 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:22.260108 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.257831 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.253072 21156 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.259842 21349 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.256565 21344 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:22.276582 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.280838 19222 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.280061 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.277493 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.262827 21287 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:22.293464 19294 raft_consensus.cc:2368] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:22.280196 21349 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.297511 21174 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:22.277034 21143 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.299734 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:22.300432 19297 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:22.241994 19899 rpcz_store.cc:276] 0709 13:09:21.069144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.071883 (+  2739us) service_pool.cc:224] Handling call
0709 13:09:21.667495 (+595612us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:22.196145 (+528650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100364544}
I20260709 13:09:22.308329 19366 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:22.310614 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.300633 21298 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.316426 19373 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:22.309144 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:22.307992 19291 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:22.323597 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.317829 21298 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.305617 21156 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:09:22.333287 21298 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.365312 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.366338 19373 raft_consensus.cc:2368] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6.
I20260709 13:09:22.376542 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:22.377560 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 164816us
I20260709 13:09:22.354621 21381 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.354271 21292 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.353801 21268 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:22.380834 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.381451 19373 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.371943 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.372391 21202 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:22.389149 21298 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:22.390892 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 148294us
I20260709 13:09:22.393777 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:22.394543 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 114202us
I20260709 13:09:22.395846 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.403833 19366 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:22.404361 19367 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:22.391384 20826 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:22.396734 21349 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:22.400317 21202 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:22.406849 21143 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:22.408717 21406 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:09:22.419317 19373 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:22.384922 21292 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:22.422886 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 106491us
I20260709 13:09:22.384599 21381 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.411171 21348 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:22.425351 21186 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.427172 19340 leader_election.cc:400] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:22.428620 19340 leader_election.cc:403] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:22.429438 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:22.435551 21410 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:09:22.443660 21381 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:22.445039 21409 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:22.446950 21202 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.427641 21414 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:22.448297 21414 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:22.448783 21414 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.434100 21295 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.425593 21143 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.461169 21187 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5.
I20260709 13:09:22.439282 21186 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.464200 21186 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.474084 21292 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.431649 21349 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:22.492563 19299 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:22.482482 21414 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:22.531002 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 102511us
I20260709 13:09:22.530990 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.538372 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.463982 21360 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.548345 21292 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:22.548949 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.550139 21414 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:22.554144 19896 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.001s
I20260709 13:09:22.562203 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:22.567236 19868 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.799s (SENT)
I20260709 13:09:22.568312 19374 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:22.568851 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:22.569655 19899 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:22.567155 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.545954 20826 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:22.575376 19367 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:09:22.576577 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 147193us
I20260709 13:09:22.578536 19374 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:22.564060 21292 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:22.581735 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.566570 19896 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:22.586405 19903 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.586462 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.586755 19293 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:22.584236 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:22.591452 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:22.590955 21342 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.594390 19299 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:22.582930 21292 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.594937 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:22.595654 21342 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.596179 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:22.595754 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.594587 19300 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:22.598704 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:22.595655 21415 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:22.595798 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.601200 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.590569 19373 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:22.609802 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:22.610602 19372 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:22.598006 21268 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.614671 19365 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:22.612547 19368 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:22.618623 19868 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.895s (SENT)
I20260709 13:09:22.600660 21372 raft_consensus.cc:2764] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:09:22.610198 21349 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:22.624827 21349 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:22.625821 21349 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.618831 21415 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:22.628037 21415 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.638325 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 389) took 1569 ms. Trace:
I20260709 13:09:22.639469 21372 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.640074 21372 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.641345 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:22.638782 19897 rpcz_store.cc:276] 0709 13:09:21.068507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.082760 (+ 14253us) service_pool.cc:224] Handling call
0709 13:09:21.781680 (+698920us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:21.869696 (+ 88016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.940027 (+ 70331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.941698 (+  1671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.944543 (+  2845us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:21.950336 (+  5793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.637939 (+687603us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5400780354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:22.637992 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.638153 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86629504}
I20260709 13:09:22.618171 21268 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:22.650058 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49473.7us
I20260709 13:09:22.651160 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:22.651959 21187 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.652547 21187 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:22.653568 21187 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:22.656391 19898 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:22.657716 21295 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:22.666615 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1592) took 1088 ms. Trace:
I20260709 13:09:22.671239 19366 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:22.680847 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.686651 21298 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.686959 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.693080 21169 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:22.693559 21169 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:22.694505 21169 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.695240 21292 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.695856 21169 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.707561 21158 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:22.667176 19219 rpcz_store.cc:276] 0709 13:09:21.578527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.584425 (+  5898us) service_pool.cc:224] Handling call
0709 13:09:21.768916 (+184491us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90e9c 00007fe8d4d90a5b 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:22.666328 (+897412us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400136854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:22.666498 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286901888}
I20260709 13:09:22.720315 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:22.664002 21390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.025s	sys 0.046s
I20260709 13:09:22.733206 19367 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:09:22.733752 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.721601 21158 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:22.736088 19217 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:22.722992 21390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.025s	sys 0.046s
I20260709 13:09:22.727665 21178 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:22.741537 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.752229 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.753132 19219 raft_consensus.cc:2368] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:22.747989 21360 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:22.759541 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:22.759451 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 187446us
I20260709 13:09:22.722254 20826 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.765689 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.763023 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.768934 19223 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:22.769491 21268 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:22.774497 21403 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.639s	user 0.004s	sys 0.000s
I20260709 13:09:22.764344 21348 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:22.767719 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.784420 19222 raft_consensus.cc:2368] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:22.786931 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.787782 19217 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:22.785027 21292 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.795401 19219 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:22.798338 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.799212 19217 raft_consensus.cc:2376] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5. Re-sending same reply.
I20260709 13:09:22.762064 21158 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.799988 21158 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.802368 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.788832 21415 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.784325 21348 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.808343 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.810387 19217 raft_consensus.cc:2376] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5. Re-sending same reply.
I20260709 13:09:22.811199 21342 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:22.814647 19217 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:22.815861 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.829758 21348 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:22.829944 21372 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:22.840759 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.843182 19369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1548) took 1653 ms (client timeout 1723 ms). Trace:
I20260709 13:09:22.843700 19225 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:22.843606 19369 rpcz_store.cc:269] 0709 13:09:21.189412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.194531 (+  5119us) service_pool.cc:224] Handling call
0709 13:09:22.841150 (+1646619us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54000f76a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb8e18 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:22.842867 (+  1717us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:22.842996 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128010880}
I20260709 13:09:22.844762 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.845640 19225 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:22.846568 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.847401 19225 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:22.852507 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.857337 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.863685 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.864506 19218 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:22.865402 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.808533 21415 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:22.881973 19217 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:22.895479 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.901846 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.903085 19217 raft_consensus.cc:2376] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:09:22.904274 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.908088 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.909044 19219 raft_consensus.cc:2376] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:09:22.911491 19221 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.915596 19218 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.926668 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.927738 19217 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.928601 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:22.934000 21415 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:22.926373 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.936800 19223 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:22.942565 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:23.006376 19221 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.010211 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:22.940817 21372 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:09:22.940933 21256 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:09:23.019248 19223 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:23.026157 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.021620 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:23.031679 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:23.036087 19224 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.032691 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:22.940750 21186 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:09:23.036906 19223 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:23.040621 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.041234 19223 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:23.042174 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:23.042819 19223 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:23.045120 21415 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:23.045740 21415 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.046967 19221 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:23.048640 21415 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.049523 20826 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.050093 20826 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.052120 20826 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:23.052613 20826 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.053100 20826 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.055208 20826 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:23.056433 19223 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:23.056263 21417 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:23.072026 19217 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:23.086325 19218 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:23.062186 20826 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.101820 19221 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.101884 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:23.103662 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.076514 21292 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.117300 19903 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:23.119308 19903 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:23.119720 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:23.124738 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 182252us
I20260709 13:09:23.127745 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:23.132769 19368 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:23.140509 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:23.123615 19218 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.112406 21344 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.167147 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:23.168229 19366 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:23.145149 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.169356 19370 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:23.171013 19339 leader_election.cc:400] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:23.171934 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:23.091511 21417 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.174206 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:23.180140 19371 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.156459 21073 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:23.155678 21363 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:23.184257 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:23.182195 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 180464us
I20260709 13:09:23.183611 19365 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.186102 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:23.163468 21174 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.122987 20826 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.205847 19339 leader_election.cc:400] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4.
I20260709 13:09:23.169198 21011 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:23.208693 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:23.197237 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:23.213049 19365 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:23.169181 21256 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:23.172776 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.182598 19294 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:23.221208 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.618s (SENT) [suppressed 11 similar messages]
I20260709 13:09:23.221642 19218 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:23.219811 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.184850 21158 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:23.214308 21253 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.177572 21187 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:09:23.220955 21435 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:23.217900 21372 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.214733 21011 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:23.218528 19899 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:23.199604 21439 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:09:23.275405 21363 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:23.356769 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66966.8us
I20260709 13:09:23.369522 21363 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.223325 21360 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:23.280606 21158 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.372510 19191 leader_election.cc:400] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6.
I20260709 13:09:23.222491 21344 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.281682 21186 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:23.290393 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:23.290297 21174 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.371307 21169 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:23.372112 21360 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:23.337159 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.283156 21253 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.226650 19292 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:23.218377 21292 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.385504 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:23.397828 19368 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.391165 19903 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:23.393702 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.282156 21416 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.272565 21349 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.158s
I20260709 13:09:23.223323 21256 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.413451 19367 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:23.415436 21438 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 13:09:23.420756 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.420892 21442 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:23.421710 21442 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:23.400213 19216 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:23.422873 19216 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:23.423818 19216 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.424823 19216 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.432890 21360 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.434329 21417 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.437278 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.439016 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.390506 21093 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.441936 21093 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.448683 21011 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.450367 21011 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.450582 19369 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:23.453907 21348 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.454468 21348 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.454896 21348 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.457516 20826 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:23.386766 21372 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:09:23.384981 21186 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.339924 21444 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:23.465016 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.470314 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:23.466163 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:23.460070 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 84755.2us
I20260709 13:09:23.476976 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.480845 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1604) took 1379 ms. Trace:
I20260709 13:09:23.230500 21073 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.403757 19293 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:23.481257 19220 rpcz_store.cc:276] 0709 13:09:22.101742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.105488 (+  3746us) service_pool.cc:224] Handling call
0709 13:09:22.112551 (+  7063us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:22.132851 (+ 20300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.132895 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:22.141818 (+  8923us) log.cc:844] Serialized 52 byte log entry
0709 13:09:22.869447 (+727629us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b18003e11c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:09:22.923114 (+ 53667us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:23.056697 (+133583us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.160515 (+103818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.160622 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.476714 (+316092us) raft_consensus.cc:1685] finished
0709 13:09:23.480577 (+  3863us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.480751 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36860,"prepare.queue_time_us":108995,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":186733,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":64862,"spinlock_wait_cycles":13293952,"thread_start_us":200837,"threads_started":3,"wal-append.queue_time_us":948612}
I20260709 13:09:23.400610 21253 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.489511 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:23.471706 21186 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.396997 21174 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.500761 19367 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:23.504139 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:23.505960 21158 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.505734 21442 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.507045 21442 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.508180 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:23.509779 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.511169 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.512359 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:23.513687 19371 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:23.513860 19372 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:23.512939 21445 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:23.515878 21445 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.517304 21445 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.517558 21174 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.475176 20826 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:23.518018 21445 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.518601 21445 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:23.518282 20826 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.508440 21448 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.520556 20826 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.520567 21448 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.521576 21416 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.523667 21416 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:23.524647 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:23.525439 19367 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:23.526842 21437 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:09:23.529403 19292 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:23.530691 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.532049 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:23.532430 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.532325 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.532749 19292 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:23.532994 19903 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:23.533738 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.534595 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.534385 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:23.537482 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 316274us
I20260709 13:09:23.538471 19224 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:23.535156 19293 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.411028 21292 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.548671 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:23.558144 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.508242 21446 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:23.519572 21445 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.560133 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.561547 19367 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
W20260709 13:09:23.562783 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.576643 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.535151 19292 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:23.553005 21439 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:23.604270 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 115372us
I20260709 13:09:23.606408 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:23.607206 19367 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:23.546476 21093 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:23.609398 19373 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:23.611622 21452 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:23.612036 19294 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:23.489091 21444 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.613181 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.613839 19294 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:23.614787 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.615020 21444 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.615330 19294 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:23.615672 21444 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.616204 21444 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:23.617069 21444 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.620231 19296 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:23.577457 20826 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.611508 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.559979 21294 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:23.627965 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.626173 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 524938us
I20260709 13:09:23.646538 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:23.648507 19191 connection.cc:256] RPC call timeout handler was delayed by -1.094832279000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25710000000000005s for a response
I20260709 13:09:23.650982 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:23.645475 21452 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:23.646543 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 176314us
I20260709 13:09:23.656028 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:23.660468 21344 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.653604 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:23.577288 21416 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:23.609483 21439 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:23.652905 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:23.677942 19372 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:23.678066 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.678620 19372 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:09:23.652513 21417 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:09:23.671739 21446 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:23.678805 19222 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:23.628671 20826 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:23.627488 21187 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:23.624521 21454 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.639752 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.684309 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:23.687847 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:23.637698 21415 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:23.694952 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44032.8us
I20260709 13:09:23.639868 19898 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:23.629865 21178 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:09:23.710992 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:23.697221 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.715720 19368 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:23.713828 19372 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:23.680661 21439 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.687225 21158 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.721374 19902 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:23.678442 21360 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:09:23.697976 20826 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.725113 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:23.746243 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:23.705616 21470 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:23.745468 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46054.4us
I20260709 13:09:23.698113 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.700785 21342 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:23.724439 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:23.788972 19368 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:23.700656 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:23.715107 21156 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.722775 21253 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.793140 21256 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:23.792904 21446 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.798103 19372 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:23.714443 19897 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:23.798730 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.801306 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.803328 21470 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:23.803915 21349 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.809325 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126240us
W20260709 13:09:23.809697 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 85379.8us
I20260709 13:09:23.805137 19216 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:23.825414 21093 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:23.808643 21186 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.825848 21469 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:23.826031 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 138282us
I20260709 13:09:23.826371 21295 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:23.827033 21458 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:09:23.826500 21452 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.827991 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:23.828125 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 104317us
I20260709 13:09:23.829063 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.714654 21294 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:09:23.829537 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.713339 21187 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.714660 21415 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.850970 19372 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:23.855535 21416 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:23.855888 21253 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:23.856437 21471 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:09:23.862332 19903 raft_consensus.cc:2368] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:23.804046 19294 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:23.862583 19369 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:23.862576 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63924.2us
I20260709 13:09:23.865091 21186 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:23.826555 21456 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.871557 19299 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:23.890990 19295 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5.
I20260709 13:09:23.862789 21470 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.897745 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.908679 19222 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:23.909538 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.899494 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:23.871642 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:23.901108 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.862260 21414 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:23.827718 21342 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.830681 21348 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:23.902661 21416 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.919193 19219 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:23.920843 21461 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.923324 21156 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.902904 21011 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.867937 21295 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:23.867859 21256 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:23.868110 21093 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:23.928458 21471 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.928869 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.929725 21415 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.929884 21454 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:23.943780 21444 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:23.930962 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.931124 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:23.933826 21460 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:09:23.936642 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.934291 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 62717.5us
I20260709 13:09:23.940665 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.935977 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:23.890885 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.952651 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:23.984447 19298 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.953037 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:23.892560 21473 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.866070 21349 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.960740 21190 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:23.907482 21292 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:23.965250 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.072523 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:23.943969 21294 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.908082 21456 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.897192 21469 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:09:23.982846 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 271735us
I20260709 13:09:23.985320 19217 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:23.968783 21256 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.990370 19295 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:24.075094 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:23.998922 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.075718 19299 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.989745 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:24.078035 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 88355.5us
I20260709 13:09:24.072943 19219 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
W20260709 13:09:23.973323 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53136.7us
I20260709 13:09:24.078867 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:24.126127 21467 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.126205 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47441.6us
I20260709 13:09:24.127209 19219 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 2: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:09:24.161226 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 219721us
I20260709 13:09:23.968626 21011 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.075908 21294 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.965391 21414 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.169901 21294 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.169521 21467 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.978930 21444 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:24.076061 21456 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.170267 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.073493 19294 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.125473 21256 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:24.178249 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51227us
I20260709 13:09:24.182569 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:24.194451 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 258535us
I20260709 13:09:24.197288 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:24.197980 19219 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.197942 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:24.172873 21415 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.127590 21462 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:24.173556 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 91303.7us
I20260709 13:09:24.199735 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.216084 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 224) took 1116 ms. Trace:
I20260709 13:09:24.192727 19292 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:23.980335 21454 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.192634 21253 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.968823 21461 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:23.976728 21471 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.216665 19296 rpcz_store.cc:276] 0709 13:09:23.092300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.114134 (+ 21834us) service_pool.cc:224] Handling call
0709 13:09:23.609425 (+495291us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:23.609624 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.620067 (+ 10443us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:23.710039 (+ 89972us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.173874 (+463835us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.182086 (+  8212us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.182245 (+   159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.182288 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.182336 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.182398 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.208488 (+ 26090us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33498,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9465,"spinlock_wait_cycles":24810752,"thread_start_us":360856,"threads_started":2,"wal-append.queue_time_us":453888}
I20260709 13:09:24.241187 19217 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:24.196491 21360 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:24.247550 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.247970 19299 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:24.273478 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1451) took 1112 ms. Trace:
W20260709 13:09:24.238432 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.204460 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:24.182406 21292 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:09:24.208952 21415 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.265537 19300 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:09:24.271232 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 74620us
I20260709 13:09:24.276638 19217 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:24.283648 19266 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:24.273825 19299 rpcz_store.cc:276] 0709 13:09:23.161360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.980684 (+819324us) service_pool.cc:224] Handling call
0709 13:09:24.273419 (+292735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.277365 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:24.285202 19371 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.289111 21463 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:24.289660 21463 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.291780 21463 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.293386 21011 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:24.293646 21471 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.295260 21414 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.282851 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1295) took 1084 ms. Trace:
I20260709 13:09:24.296983 19300 rpcz_store.cc:276] 0709 13:09:23.198800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.240792 (+1041992us) service_pool.cc:224] Handling call
0709 13:09:24.260009 (+ 19217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.282598 (+ 22589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.282799 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.298014 21454 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.298398 19300 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:24.298827 21416 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.298954 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1297) took 1081 ms. Trace:
I20260709 13:09:24.299573 21342 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:24.300113 21342 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:24.271816 21190 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:24.300642 21342 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.302866 19298 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:24.303479 21342 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.210103 21093 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.304674 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1298) took 1083 ms. Trace:
I20260709 13:09:24.305034 19298 rpcz_store.cc:276] 0709 13:09:23.221226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.303879 (+1082653us) service_pool.cc:224] Handling call
0709 13:09:24.304196 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.304359 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.304387 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.304428 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:24.304462 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.304511 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.304623 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.306468 19298 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:24.306872 19374 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:24.306980 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1299) took 1083 ms. Trace:
I20260709 13:09:24.307325 19298 rpcz_store.cc:276] 0709 13:09:23.223160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.305911 (+1082751us) service_pool.cc:224] Handling call
0709 13:09:24.306165 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.306766 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.306934 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.324676 19219 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:24.178190 21295 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.333674 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 232) took 1103 ms. Trace:
I20260709 13:09:24.299345 19300 rpcz_store.cc:276] 0709 13:09:23.217563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.297813 (+1080250us) service_pool.cc:224] Handling call
0709 13:09:24.298119 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.298732 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.298905 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.334044 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 233) took 1103 ms. Trace:
I20260709 13:09:24.334631 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1296) took 1120 ms. Trace:
I20260709 13:09:24.335963 19371 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:09:24.277707 19293 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.003s
I20260709 13:09:24.358501 19293 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:24.335335 21190 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.278460 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1455) took 1045 ms. Trace:
I20260709 13:09:24.271948 21469 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:24.308151 21415 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.337312 19298 rpcz_store.cc:276] 0709 13:09:23.230670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.308090 (+1077420us) service_pool.cc:224] Handling call
0709 13:09:24.333095 (+ 25005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.333318 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.333347 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.333390 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:24.333440 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.333498 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.333615 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.376463 19298 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:24.342721 19296 rpcz_store.cc:276] 0709 13:09:23.214752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.308338 (+1093586us) service_pool.cc:224] Handling call
0709 13:09:24.334194 (+ 25856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.334347 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.334371 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.334410 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:24.334439 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.334488 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.334580 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.364086 19300 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:24.335639 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:24.337508 19299 rpcz_store.cc:276] 0709 13:09:23.230937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.333272 (+1102335us) service_pool.cc:224] Handling call
0709 13:09:24.333579 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.333761 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.333786 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.333826 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.333860 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.333914 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.333999 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.307415 21253 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.373795 19219 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:24.363179 21463 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.382962 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47450.5us
I20260709 13:09:24.371294 21469 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:24.397006 21363 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:24.396908 21469 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.397663 21363 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:24.398313 21469 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.398829 21363 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.400516 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 225) took 1298 ms. Trace:
I20260709 13:09:24.366803 21473 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:24.250043 21462 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.384794 21463 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.369451 19292 rpcz_store.cc:276] 0709 13:09:23.229128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.852563 (+623435us) service_pool.cc:224] Handling call
0709 13:09:24.274504 (+421941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.386443 21448 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:24.386603 21476 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:09:24.414594 21475 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:09:24.414892 21486 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.415462 21486 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.376504 19291 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:24.387387 21474 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:09:24.387719 19300 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:09:24.388760 21466 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:09:24.388406 21470 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.375789 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1453) took 1184 ms. Trace:
I20260709 13:09:24.389230 21253 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.389693 19222 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:24.427356 20826 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.001s
W20260709 13:09:24.395839 21442 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.888s	user 0.007s	sys 0.000s
I20260709 13:09:24.384919 21483 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.403883 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.402433 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:24.404870 21348 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.386155 19298 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.382437 21295 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.400962 19297 rpcz_store.cc:276] 0709 13:09:23.101663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.101962 (+   299us) service_pool.cc:224] Handling call
0709 13:09:23.129038 (+ 27076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.166784 (+ 37746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.166816 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.221407 (+ 54591us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.609768 (+388361us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.609948 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.610435 (+   487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.400247 (+789812us) raft_consensus.cc:1685] finished
0709 13:09:24.400268 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.400433 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4277,"raft.queue_time_us":31934,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":19405,"thread_start_us":318142,"threads_started":1,"wal-append.queue_time_us":977957}
I20260709 13:09:24.434244 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:24.409427 21363 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.474464 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.529670 19225 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:24.475571 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.530905 19220 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:24.477830 19299 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:24.412449 19216 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:24.368510 21479 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:24.400560 21481 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:24.516060 19222 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:24.520298 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 86175.5us
I20260709 13:09:24.336807 21444 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.533761 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.428660 21187 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:24.534318 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:24.539474 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.537204 19224 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:24.542001 19225 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:24.544580 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.412993 21473 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.428212 21416 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:09:24.429278 21414 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 13:09:24.552271 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:24.518496 21360 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:24.518675 21477 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.549840 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:24.537971 21417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.002s	sys 0.016s
I20260709 13:09:24.536440 21292 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:24.552989 19297 raft_consensus.cc:2376] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5. Re-sending same reply.
W20260709 13:09:24.535931 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1447) took 1417 ms (client timeout 1515 ms). Trace:
I20260709 13:09:24.479146 19293 rpcz_store.cc:276] 0709 13:09:23.187524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.534326 (+346802us) service_pool.cc:224] Handling call
0709 13:09:24.371779 (+837453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.562527 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:24.563858 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 161501us
I20260709 13:09:24.543154 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:24.568148 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:24.529194 20826 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.571022 19219 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
W20260709 13:09:24.561688 21417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.002s	sys 0.017s
I20260709 13:09:24.554355 21146 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:24.553928 21481 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:24.574952 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:24.580283 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:24.560318 21472 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.561342 21467 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.595320 19296 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:24.596127 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.598632 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1255) took 1369 ms. Trace:
I20260709 13:09:24.599035 19218 rpcz_store.cc:276] 0709 13:09:23.228880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.229147 (+   267us) service_pool.cc:224] Handling call
0709 13:09:23.230134 (+   987us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:23.547037 (+316903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.547083 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:23.588940 (+ 41857us) log.cc:844] Serialized 52 byte log entry
0709 13:09:23.711272 (+122332us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:23.711313 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.711377 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.598368 (+886991us) raft_consensus.cc:1685] finished
0709 13:09:24.598392 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.598541 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":189499,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":189,"thread_start_us":353001,"threads_started":2,"wal-append.queue_time_us":464363}
I20260709 13:09:24.571348 21445 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:24.564149 19291 rpcz_store.cc:269] 0709 13:09:23.104014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.113988 (+  9974us) service_pool.cc:224] Handling call
0709 13:09:24.188489 (+1074501us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:24.514915 (+326426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23583360}
I20260709 13:09:24.602777 21174 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:24.572410 21292 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:24.606230 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:24.605122 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 407252us
I20260709 13:09:24.616820 19222 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:24.611043 21495 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.610843 21174 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.601008 20826 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.612566 21256 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.529405 21483 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.572075 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:24.620368 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 54651.1us
I20260709 13:09:24.596547 21454 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:24.612846 21487 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:24.623948 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1564) took 1394 ms. Trace:
I20260709 13:09:24.647505 21454 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.647943 21454 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.647765 19366 rpcz_store.cc:276] 0709 13:09:23.224669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.224798 (+   129us) service_pool.cc:224] Handling call
0709 13:09:23.281044 (+ 56246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.544612 (+263568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.544654 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.544699 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.544734 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.618716 (+1073982us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400299354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:24.618784 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.618935 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605651712}
I20260709 13:09:24.649518 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:24.593492 21478 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:24.622103 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51843.8us
I20260709 13:09:24.604856 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:24.615629 21417 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.549517 21479 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.593211 21146 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.672103 21479 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:24.672201 21488 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:09:24.561120 21477 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.673776 21146 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.677647 21477 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.607981 21485 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:24.678442 21485 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:24.658704 21478 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.671334 21498 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:24.633867 21461 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:24.714702 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.655789 21011 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:24.668195 21417 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.679368 21485 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.628331 21445 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.690860 21478 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:24.716390 21294 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.009s
I20260709 13:09:24.690279 21487 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:24.738837 21417 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:24.740347 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 69136.8us
I20260709 13:09:24.743355 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:24.755193 21256 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:24.756081 19903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 405) took 1219 ms (client timeout 1554 ms). Trace:
I20260709 13:09:24.718926 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:24.624014 21495 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.656944 21360 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:24.764632 19903 rpcz_store.cc:269] 0709 13:09:23.536289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.542444 (+  6155us) service_pool.cc:224] Handling call
0709 13:09:24.755906 (+1213462us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:24.756029 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613583232}
W20260709 13:09:24.766397 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47589us
W20260709 13:09:24.781105 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.750029 21470 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.768851 21500 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:09:24.756844 21486 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.788344 21174 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.757090 21294 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:24.768843 21439 consensus_meta.cc:287] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.979s	user 0.004s	sys 0.008s
W20260709 13:09:24.792115 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 107391us
I20260709 13:09:24.782949 21146 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.783288 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:24.717773 21498 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.741770 21011 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:24.818437 21449 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.009s	sys 0.006s
W20260709 13:09:24.818985 21449 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.009s	sys 0.006s
I20260709 13:09:24.741417 21292 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.791703 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:24.819965 21445 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.824153 19300 raft_consensus.cc:2368] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6.
I20260709 13:09:24.798311 21473 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.717200 21481 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:24.812309 21146 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.842072 21011 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.842267 21158 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:24.842756 21158 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:24.843689 21158 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.844750 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:24.844959 21158 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.847500 21073 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.817826 21462 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:24.863143 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1568) took 1427 ms. Trace:
I20260709 13:09:24.812987 21439 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:24.832979 19898 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
W20260709 13:09:24.853513 21497 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:09:24.836012 21146 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.875272 19370 rpcz_store.cc:276] 0709 13:09:23.435637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.440221 (+  4584us) service_pool.cc:224] Handling call
0709 13:09:23.440612 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.484291 (+ 43679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.484336 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.484391 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:23.484438 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.862908 (+1378470us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:24.862957 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.863086 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99850496}
I20260709 13:09:24.931546 19223 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.939196 21253 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:24.939810 21490 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:09:24.941295 21505 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:09:24.942759 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.942890 21503 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:09:24.943215 19265 connection.cc:256] RPC call timeout handler was delayed by -1.0923883970000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:09:24.943571 19265 connection.cc:256] RPC call timeout handler was delayed by -1.0739854470000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260709 13:09:24.945096 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1257) took 1299 ms. Trace:
W20260709 13:09:24.945334 19294 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.000s
I20260709 13:09:24.945741 19294 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:24.946882 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.948052 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:24.949692 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1570) took 1513 ms. Trace:
I20260709 13:09:24.950084 19367 rpcz_store.cc:276] 0709 13:09:23.436393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.640052 (+203659us) service_pool.cc:224] Handling call
0709 13:09:23.680422 (+ 40370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.941600 (+261178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.941629 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.941669 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:23.941700 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.949459 (+1007759us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400313154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:24.949508 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.949627 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600174336}
I20260709 13:09:24.946285 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1454) took 1744 ms. Trace:
I20260709 13:09:24.956321 19294 rpcz_store.cc:276] 0709 13:09:23.201852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.930705 (+728853us) service_pool.cc:224] Handling call
0709 13:09:24.946230 (+1015525us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:24.961171 21469 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.002s
I20260709 13:09:24.962150 19217 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:24.962488 19217 pending_rounds.cc:85] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:09:24.962702 19217 pending_rounds.cc:107] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:24.962960 19217 raft_consensus.cc:2889] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:24.966125 21495 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.970237 21498 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.972276 21483 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.973592 21294 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:24.947979 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:24.948812 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1569) took 1512 ms. Trace:
I20260709 13:09:24.945508 19220 rpcz_store.cc:276] 0709 13:09:23.646065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.646218 (+   153us) service_pool.cc:224] Handling call
0709 13:09:24.944921 (+1298703us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54000e4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:24.945033 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031405440}
I20260709 13:09:24.981240 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:24.939384 21415 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.003s
I20260709 13:09:24.977921 19373 rpcz_store.cc:276] 0709 13:09:23.436018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.440866 (+  4848us) service_pool.cc:224] Handling call
0709 13:09:23.441178 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.609842 (+168664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.948569 (+1338727us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400355f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:24.948754 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355392896}
I20260709 13:09:24.988936 21439 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.116365 19219 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:24.825191 21487 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:25.124768 21363 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:09:25.007504 21415 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.127286 21415 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.128325 21253 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:25.128901 21253 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.131044 21253 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.142050 21454 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.005542 21417 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.150537 21417 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:25.135912 21478 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.155217 21478 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.158957 21169 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:25.159499 21169 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:25.160482 21169 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.161545 21169 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.162103 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 247) took 1268 ms. Trace:
I20260709 13:09:25.162482 19371 rpcz_store.cc:276] 0709 13:09:23.893440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.359087 (+465647us) service_pool.cc:224] Handling call
0709 13:09:24.363403 (+  4316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.471407 (+108004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.471438 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.471481 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.471516 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.161888 (+690372us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000d39d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:25.161932 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.162046 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247902976}
I20260709 13:09:25.163908 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1465) took 1717 ms. Trace:
I20260709 13:09:25.164300 19299 rpcz_store.cc:276] 0709 13:09:23.446844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.379167 (+932323us) service_pool.cc:224] Handling call
0709 13:09:24.477525 (+ 98358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.531690 (+ 54165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.163715 (+632025us) spinlock_profiling.cc:243] Waited 87.3 ms on lock 0x7b54000492d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:25.163851 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200827264}
I20260709 13:09:25.186618 21454 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.190065 21478 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:25.190608 21478 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.191828 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.192198 21186 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:25.192333 21363 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:25.184953 21472 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 13:09:25.193096 21478 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:25.192821 21186 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.197263 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.198704 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.199908 19370 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:25.200496 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.201047 19368 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:25.205058 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.205649 19368 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:25.207526 21186 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:25.202484 21456 consensus_meta.cc:287] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.004s	user 0.007s	sys 0.004s
I20260709 13:09:25.201805 21472 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:25.277088 21517 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:09:25.196246 21363 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.278126 21073 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.291095 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 500) took 1727 ms. Trace:
I20260709 13:09:25.303023 19896 rpcz_store.cc:276] 0709 13:09:23.563890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.577774 (+ 13884us) service_pool.cc:224] Handling call
0709 13:09:25.187247 (+1609473us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:25.196383 (+  9136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.203251 (+  6868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.204094 (+   843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.208606 (+  4512us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.209973 (+  1367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.218000 (+  8027us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.289806 (+ 71806us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8565632}
I20260709 13:09:25.301626 21073 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.211792 21456 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.314991 21146 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.318081 21349 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.319232 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:25.320389 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:25.321166 21178 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.321544 21178 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.321575 21146 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.322044 21178 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.320412 21190 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.322706 21190 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:25.323069 21190 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.327013 19374 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:09:25.327247 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:25.310619 21073 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.346001 21190 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.349362 21190 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.350626 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:25.358723 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 599582us
I20260709 13:09:25.363073 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1623) took 1464 ms. Trace:
I20260709 13:09:25.365507 19370 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:25.366268 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1263) took 1461 ms. Trace:
I20260709 13:09:25.366691 19217 rpcz_store.cc:276] 0709 13:09:23.904853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.283983 (+379130us) service_pool.cc:224] Handling call
0709 13:09:24.284271 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.963372 (+679101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.366008 (+402636us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54003610d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:25.366206 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558179200}
I20260709 13:09:25.367201 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:25.368419 21495 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:25.369073 21495 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:25.370214 21495 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:25.373556 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.373472 21363 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.363696 19223 rpcz_store.cc:276] 0709 13:09:23.898541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.898663 (+   122us) service_pool.cc:224] Handling call
0709 13:09:23.919795 (+ 21132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.933132 (+1013337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.362741 (+429609us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003d1b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:25.362989 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326336256}
W20260709 13:09:25.388108 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.365964 21456 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.332418 21146 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:25.400452 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.402328 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:25.403225 19295 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.404994 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.405730 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.406445 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:25.406913 19367 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:25.408314 19367 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.387733 21469 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.410444 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.411471 19217 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:25.410097 21471 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.416644 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.416766 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.416947 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:25.417546 19217 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.418043 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.389514 21442 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:25.421403 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:25.424948 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:25.425561 19218 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.424464 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.401470 21146 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:25.409780 21363 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.430330 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.435390 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.436376 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.436092 21442 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.437493 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.438289 21442 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:25.438875 19225 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:25.416322 21178 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.442165 21178 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.442800 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.413836 21471 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.444594 19219 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.445636 21471 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:25.445719 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.446419 19372 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:25.446233 21363 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.447662 19372 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.448644 19373 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:25.410105 21487 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:25.451315 19217 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:25.455365 19219 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:25.428663 19368 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:25.455245 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.469609 19372 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:25.467284 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.478489 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.479214 19368 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:25.486574 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.487612 19220 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:25.422107 21483 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:25.503144 21456 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.503383 21349 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.503986 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.428263 21146 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.534252 19367 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:25.549336 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:25.466889 21363 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.418969 21469 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.553874 19218 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:09:25.423988 21156 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.025s	sys 0.041s
I20260709 13:09:25.558264 19368 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:25.562098 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.564827 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.503234 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:25.503274 21453 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.568691 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:25.468029 21073 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.570043 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:25.572512 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:25.575449 19191 connection.cc:256] RPC call timeout handler was delayed by -1.4313722550000421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 13:09:25.575891 19191 connection.cc:256] RPC call timeout handler was delayed by -1.4124722550000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 13:09:25.569089 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:25.576565 19191 connection.cc:256] RPC call timeout handler was delayed by -1.3962722549999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:09:25.565479 21156 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.026s	sys 0.041s
I20260709 13:09:25.488066 21471 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:25.577363 19191 leader_election.cc:336] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.515s (SENT)
I20260709 13:09:25.559413 21448 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.556977 21349 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.583854 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.580752 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:25.570550 21442 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.545914 21483 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.589121 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:25.589073 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:25.602312 19368 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.603739 21483 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.576228 19897 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.577234 21459 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.608457 19295 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:25.608726 21459 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:25.599205 21520 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:09:25.609228 21459 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.588469 21448 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.575929 21452 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:25.590366 21186 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.612623 21186 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.613020 21448 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.576922 21453 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.614768 21186 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.615677 21453 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.617964 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.575634 21473 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.620863 19368 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:25.518669 21487 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.591351 21463 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.590332 21471 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.588438 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.598587 21363 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.598740 21469 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.582614 21295 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.642112 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52121.4us
I20260709 13:09:25.609216 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1307) took 1676 ms. Trace:
I20260709 13:09:25.635215 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 250) took 1732 ms. Trace:
W20260709 13:09:25.645153 19191 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.571s (SENT)
I20260709 13:09:25.644894 19365 rpcz_store.cc:276] 0709 13:09:23.902803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.480328 (+577525us) service_pool.cc:224] Handling call
0709 13:09:24.517656 (+ 37328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.673989 (+156333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.674025 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.674071 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.674109 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.634909 (+960800us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000956d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:25.634976 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.635143 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359005440}
I20260709 13:09:25.645692 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:25.646409 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.649485 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:25.638329 19369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1573) took 2196 ms (client timeout 1906 ms). Trace:
W20260709 13:09:25.651324 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1622722550000617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2404s for a response
I20260709 13:09:25.651716 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.563794 21456 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.639716 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.581986 21073 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:25.642915 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.644568 19295 rpcz_store.cc:276] 0709 13:09:23.932466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.128443 (+195977us) service_pool.cc:224] Handling call
0709 13:09:25.402129 (+1273686us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:25.609054 (+206925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437888}
I20260709 13:09:25.654362 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.633867 21473 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.650313 21469 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:25.655118 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1626) took 1755 ms (client timeout 2210 ms). Trace:
W20260709 13:09:25.651563 19369 rpcz_store.cc:269] 0709 13:09:23.437366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.451842 (+ 14476us) service_pool.cc:224] Handling call
0709 13:09:25.634045 (+2182203us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400297a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:25.634183 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896912256}
I20260709 13:09:25.653522 19217 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:25.656283 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:25.599781 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:25.656980 19367 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:25.654254 19365 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
W20260709 13:09:25.655480 19221 rpcz_store.cc:269] 0709 13:09:23.899324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.918618 (+ 19294us) service_pool.cc:224] Handling call
0709 13:09:25.654229 (+1735611us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:25.655053 (+   824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4037504}
I20260709 13:09:25.657968 19224 raft_consensus.cc:2410] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:25.658318 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58613.2us
I20260709 13:09:25.659817 19218 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:25.598693 21146 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:25.662092 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:25.690485 19898 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:25.691109 19897 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:25.690399 21146 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:25.693800 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.695191 21292 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:25.659690 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.652288 21295 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:25.989198 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.744989 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:25.984130 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 1.00289e+06us
I20260709 13:09:25.994107 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:25.701529 21186 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.293s
I20260709 13:09:25.702324 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:25.706298 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:25.995345 19219 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:25.995656 19218 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:25.995702 19299 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:25.996284 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.036686 19219 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:25.708779 19223 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:25.996678 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:25.997035 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.037698 19218 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:25.709996 21471 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:25.997610 19369 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:25.783429 19293 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:25.697499 21453 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.301s
I20260709 13:09:25.710731 19367 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:25.701208 21445 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:25.691905 21363 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.693176 21478 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.701570 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:25.701884 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.785334 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:25.658454 21473 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.785702 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:25.697100 21463 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.304s
I20260709 13:09:25.705386 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:25.753306 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1620) took 1855 ms. Trace:
I20260709 13:09:25.697367 21439 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:25.983502 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 287813us
I20260709 13:09:26.064990 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:25.982856 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:26.010193 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 313935us
W20260709 13:09:25.754415 19300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1468) took 1328 ms (client timeout 1732 ms). Trace:
W20260709 13:09:26.072532 19300 rpcz_store.cc:269] 0709 13:09:24.426275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.479807 (+ 53532us) service_pool.cc:224] Handling call
0709 13:09:25.754244 (+1274437us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002b75d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:25.754363 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638751488}
I20260709 13:09:25.703711 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.745546 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1464) took 2299 ms. Trace:
I20260709 13:09:26.074210 19296 rpcz_store.cc:276] 0709 13:09:23.446539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.378023 (+931484us) service_pool.cc:224] Handling call
0709 13:09:24.385233 (+  7210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.595801 (+210568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.745264 (+1149463us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003f2fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:25.745477 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482709376}
I20260709 13:09:26.074879 21453 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:26.075455 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 92719.2us
I20260709 13:09:25.712704 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.076251 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.038429 19901 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:26.077390 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.042590 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.078325 21483 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:26.074887 21454 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.081025 21454 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:26.046402 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.084021 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.049053 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.050812 21363 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.052857 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:26.053319 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58858.3us
I20260709 13:09:26.052541 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:26.088481 19218 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:25.712327 21500 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:26.055924 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.058145 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.059211 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.055434 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:25.704449 21487 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.040587 21415 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:26.025115 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.051131 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:26.098266 19366 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.074990 21452 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.099785 19902 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:26.100457 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.101110 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.101063 19372 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:26.102186 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.103263 19300 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:26.101805 19218 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:26.090055 21363 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.052480 21445 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.089354 21454 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.106285 19295 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:26.107154 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:26.107844 19902 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:26.108359 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:26.089999 21471 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.112215 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:26.108913 19372 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.113921 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.110118 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.110881 19901 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:26.118544 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.119087 19222 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:26.119784 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.113943 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.120630 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:26.120843 19366 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:26.121254 19369 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.122294 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.123222 19337 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.124549 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:26.125142 19222 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.122504 21186 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:26.096633 21500 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.062028 19216 rpcz_store.cc:276] 0709 13:09:23.897673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.903657 (+  5984us) service_pool.cc:224] Handling call
0709 13:09:23.929042 (+ 25385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.533692 (+604650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.753032 (+1219340us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:25.753232 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871511936}
I20260709 13:09:26.137177 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:26.137284 21535 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:26.098567 21439 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.105227 21452 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.121414 21536 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.163605 19219 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:26.149899 21535 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:26.168800 19369 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:26.178287 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:26.180998 19901 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.181412 21452 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.183168 21295 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.183914 21295 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.169478 19223 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:26.172904 19217 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.187352 19217 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:26.176211 19903 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.160727 21536 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.128574 21463 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:26.159992 19899 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:26.192770 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.198447 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:26.199123 19901 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:26.201870 19222 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:26.202405 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.207306 21539 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:26.211390 21539 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.212476 21539 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.208287 21483 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:26.207878 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 84730.9us
W20260709 13:09:26.211988 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 131690us
I20260709 13:09:26.170286 21535 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.200379 21445 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.223060 21473 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.192879 21536 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.224201 21444 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.217486 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.170296 21471 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:09:26.226495 21478 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.216280 19224 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:26.242326 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.273463 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.225927 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:26.269310 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51908.5us
I20260709 13:09:26.276027 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.276897 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:26.278921 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53074.9us
I20260709 13:09:26.227811 21453 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:26.276978 21507 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.291133 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.289166 21481 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.252023 21186 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:26.301254 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.304899 19371 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:26.299456 21481 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:26.278229 21495 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:26.274400 21478 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:26.288524 19216 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.312798 21186 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.287824 21454 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:26.300112 21548 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.300709 21507 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:26.290366 21546 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.342833 19370 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:26.353734 19372 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:26.353009 19868 leader_election.cc:400] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
I20260709 13:09:26.384176 19868 leader_election.cc:403] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.390054 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:26.390962 19901 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:26.358024 21478 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.358520 21295 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:26.398525 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 109253us
I20260709 13:09:26.399296 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:26.383996 21507 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.410235 21342 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:26.412117 21487 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3.
W20260709 13:09:26.415848 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63033.9us
I20260709 13:09:26.419411 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1478) took 2720 ms. Trace:
I20260709 13:09:26.395219 21495 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:26.396310 21454 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:26.417204 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.419775 19374 rpcz_store.cc:276] 0709 13:09:23.699185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.307655 (+608470us) service_pool.cc:224] Handling call
0709 13:09:24.368974 (+ 61319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.327418 (+958444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.419160 (+1091742us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b5400189f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:26.419333 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202672896}
I20260709 13:09:26.395604 21439 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.401731 21442 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.400949 21295 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.440364 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.449471 19298 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:26.450547 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.428398 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1308) took 2462 ms. Trace:
I20260709 13:09:26.452448 19297 rpcz_store.cc:276] 0709 13:09:23.965778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.576411 (+610633us) service_pool.cc:224] Handling call
0709 13:09:25.311315 (+734904us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:25.311546 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.311763 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:25.410518 (+ 98755us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.050723 (+640205us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.225353 (+174630us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18002de680. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1
0709 13:09:26.427783 (+202430us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18002de680. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:09:26.427959 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.428016 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:26.428080 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.428185 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.428329 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":909125,"prepare.queue_time_us":245869,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":526110,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3882,"spinlock_wait_cycles":53326080,"thread_start_us":196199,"threads_started":2,"wal-append.queue_time_us":193752}
W20260709 13:09:26.454357 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54195.8us
I20260709 13:09:26.447233 21190 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:26.455751 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:26.418135 21537 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:26.358795 21483 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:26.460403 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.460858 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.451850 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.460279 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.462126 19299 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.407673 21500 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.463675 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.464730 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.458350 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.467613 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.467830 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.459841 21156 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:26.469514 21156 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:26.469458 21495 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:26.469980 21459 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260709 13:09:26.470042 21533 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.470765 21533 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:26.470615 21459 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.471638 21533 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.400501 21545 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:09:26.468798 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:26.474929 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65012.7us
I20260709 13:09:26.483801 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.484076 19295 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:26.484522 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.485409 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.459854 21158 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.486123 19295 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:26.486222 21158 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.487315 19295 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:26.455420 21481 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.459152 21295 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.458710 21294 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.455231 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.499228 19221 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:26.500934 21294 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.482923 21454 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.503367 21294 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.458231 21190 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:26.504249 21190 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:26.504383 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 416076us
I20260709 13:09:26.506891 21349 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.507433 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:26.508440 21472 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.511078 21472 raft_consensus.cc:2764] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:26.529946 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.530145 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.530397 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.530807 19292 raft_consensus.cc:2368] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:26.531064 19295 raft_consensus.cc:2368] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:26.531360 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.531617 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.531980 19294 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:26.532102 19295 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:26.532050 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.533361 19297 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:26.538349 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:26.540402 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74601.5us
I20260709 13:09:26.542585 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.469985 21156 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:26.473091 21537 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:26.548105 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.547780 21439 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:26.549294 21554 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:09:26.550666 21158 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.535673 21473 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.197089 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:26.552973 19121 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 157) took 15155 ms (client timeout 15000 ms). Trace:
I20260709 13:09:26.558197 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:26.558687 19120 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 3 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 4 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.562453 19300 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:26.563266 21156 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.564297 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.564471 21156 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.565346 21492 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.565861 21492 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.567796 21492 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.565155 21535 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.550261 21537 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.544286 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:26.543324 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.515573 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:26.582691 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51192.2us
W20260709 13:09:26.553373 19121 rpcz_store.cc:269] 0709 13:09:11.400477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.400728 (+   251us) service_pool.cc:224] Handling call
0709 13:09:26.552887 (+15152159us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:21.549412 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:21.550236 (+   824us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:21.550297 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:09:21.550341 (+    44us) tablet.cc:662] Decoding operations
0709 13:09:21.551180 (+   839us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:21.551381 (+   201us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:21.551413 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:21.552006 (+   593us) tablet.cc:701] Row locks acquired
0709 13:09:21.552055 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:09:21.552239 (+   184us) write_op.cc:270] Start()
0709 13:09:21.552420 (+   181us) write_op.cc:276] Timestamp: P: 1783602561552148 usec, L: 0
0709 13:09:21.552463 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:09:21.553428 (+   965us) log.cc:844] Serialized 1698 byte log entry
0709 13:09:22.407253 (+853825us) op_driver.cc:464] REPLICATION: finished
0709 13:09:22.600555 (+193302us) write_op.cc:301] APPLY: starting
0709 13:09:22.613994 (+ 13439us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:22.624127 (+ 10133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:22.644130 (+ 20003us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:22.645014 (+   884us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:22.645378 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:09:22.645466 (+    88us) write_op.cc:312] APPLY: finished
0709 13:09:22.645843 (+   377us) log.cc:844] Serialized 41 byte log entry
0709 13:09:22.646053 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:22.646176 (+   123us) write_op.cc:454] Released schema lock
0709 13:09:22.646247 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:22.646639 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:22.646667 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1276049,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":163812,"apply.run_cpu_time_us":3177,"apply.run_wall_time_us":55237,"num_ops":4,"prepare.queue_time_us":10485,"prepare.run_cpu_time_us":24690,"prepare.run_wall_time_us":84617,"raft.queue_time_us":377065,"raft.run_cpu_time_us":38353,"raft.run_wall_time_us":159952,"replication_time_us":843881,"spinlock_wait_cycles":11520,"thread_start_us":847685,"threads_started":4,"wal-append.queue_time_us":100234,"wal-append.run_cpu_time_us":86917,"wal-append.run_wall_time_us":2137927}]]}
I20260709 13:09:26.586948 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:26.534933 21545 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.594906 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.588498 19297 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:26.527268 21342 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:26.590830 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.598232 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.592293 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.599390 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.593971 19299 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:09:26.599984 19191 leader_election.cc:336] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.883s (SENT)
W20260709 13:09:26.596910 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76602.4us
I20260709 13:09:26.600522 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.547953 21444 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.605055 19372 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:26.602361 19225 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:26.600021 19296 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:26.596786 19298 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:26.555862 21190 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.615028 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.617403 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.617776 19120 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 2 to 4, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 4 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.601670 21554 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.620632 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.626367 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.626847 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.627182 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.627665 19369 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:26.588265 21256 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.633941 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.615465 21292 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.620455 21554 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:26.401051 21548 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.637498 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.609549 21439 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.614411 21414 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.642377 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:26.632010 21363 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:09:26.608294 21545 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.632613 21415 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:09:26.615561 21533 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:09:26.667992 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:26.641839 21554 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.600623 21294 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:09:26.669533 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.719337 19297 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:26.636533 21471 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.668859 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.602752 21349 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:09:26.649398 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49425.6us
W20260709 13:09:26.724846 19191 leader_election.cc:336] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.889s (SENT)
I20260709 13:09:26.666989 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.647974 19296 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:26.677874 19300 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:26.632537 21256 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.621968 21158 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:26.685484 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.639285 21292 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:26.685782 19369 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:26.643285 21473 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.615301 21342 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.635535 21459 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:26.684624 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 237114us
I20260709 13:09:26.620252 21485 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:26.639449 21417 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.670185 21492 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:26.716418 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.666188 21416 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:26.687026 21487 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:26.672138 21539 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.705092 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.689046 21414 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.815335 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:26.769102 19371 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:26.817305 19221 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:26.817226 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64305.6us
I20260709 13:09:26.818681 19372 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:26.739893 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.772249 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:26.819995 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:26.820201 19367 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:26.753233 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.737103 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.772593 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:26.725239 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.822669 19373 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:26.826555 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 200851us
I20260709 13:09:26.826892 19297 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:26.827620 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 193727us
I20260709 13:09:26.829553 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:26.834033 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.741147 21190 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.778582 21453 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.843721 19222 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:26.778851 21456 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.850781 21459 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.778434 21548 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.859776 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:26.860528 19296 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:26.780014 21545 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:26.771308 21535 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.705601 21363 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.862115 21295 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.788641 21478 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.790096 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:26.864588 21565 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:26.865311 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 140488us
W20260709 13:09:26.866717 19191 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.977s (SENT)
I20260709 13:09:26.867192 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:26.841018 19294 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:26.856191 21453 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:26.869331 19191 leader_election.cc:336] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.109s (SENT)
I20260709 13:09:26.869509 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.869745 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.870234 21453 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.826519 21256 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.871160 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:26.852687 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.871995 19298 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:26.852980 19373 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:26.872746 19365 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.826346 21292 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.851214 21540 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.867929 21342 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.786412 21507 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.742147 19899 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:26.879062 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:26.870942 19191 leader_election.cc:336] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.207s (SENT)
I20260709 13:09:26.740763 21073 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.841033 21169 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:26.693554 21536 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:26.863953 21363 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:26.865621 21478 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.874367 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:26.919463 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45184us
I20260709 13:09:26.868590 21483 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:26.700747 21439 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.888953 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:26.891948 21416 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.877470 21295 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:26.834962 21500 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:26.893471 21169 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:26.894678 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:26.896997 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:26.959659 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 109107us
I20260709 13:09:26.841698 21415 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:09:26.897343 21554 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:26.923288 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.942003 19263 leader_election.cc:400] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:26.895087 21256 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:26.984009 19263 leader_election.cc:403] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.875337 21540 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.892855 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:26.840879 21294 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:09:26.886257 21564 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.947558 21158 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.897270 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.006731 19296 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:26.965319 19903 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.875066 21442 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.949975 21174 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:26.957700 19294 raft_consensus.cc:606] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:27.015465 19374 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:26.982148 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:27.008283 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.016381 19296 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.019425 19366 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:27.024824 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.025599 19299 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:27.028102 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.029728 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.007289 21540 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.030484 19299 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:27.035691 21158 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:27.176805 21158 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.111385 21415 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.182426 19296 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
W20260709 13:09:27.185245 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 314275us
I20260709 13:09:27.189157 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:27.015472 19294 raft_consensus.cc:614] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:27.184094 19296 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:27.032917 21492 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.163s
W20260709 13:09:27.106035 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 124020us
W20260709 13:09:27.035091 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.201846 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:27.204666 19369 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.203377 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.210052 19217 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.212991 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.214704 19369 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:27.034854 21564 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.203859 21492 consensus_queue.cc:1243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:27.192688 21539 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.226286 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.226935 19216 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.197980 21459 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.220798 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.221212 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.019049 21174 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:27.223059 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 203860us
I20260709 13:09:27.230472 19367 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.230997 19219 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:27.219250 21564 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:27.236867 21564 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.238005 21564 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.237928 19903 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:27.240418 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:27.241016 19368 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
W20260709 13:09:27.241833 21570 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:09:27.244987 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.245698 19223 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:27.246121 19217 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:27.198760 21554 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:27.247014 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.248024 19217 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.254144 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.255426 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.255916 19223 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.248208 21363 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.265278 19216 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:27.261229 19217 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
I20260709 13:09:27.257396 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:27.263474 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:27.266991 19367 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:27.250134 21536 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:27.273998 21555 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.602s	user 0.003s	sys 0.000s
I20260709 13:09:27.277442 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.285037 19367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7547528ebe74640917580adfe8092bd"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:27.286149 19367 raft_consensus.cc:606] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:09:27.286566 19367 raft_consensus.cc:614] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:27.248625 21459 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.307853 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.313591 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.314456 19216 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:27.201612 21576 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:09:27.331229 21292 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.332686 19225 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:27.316377 21582 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
W20260709 13:09:27.340420 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76978us
I20260709 13:09:27.268772 21363 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.364794 19371 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.317061 21584 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:09:27.370159 19216 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:27.370566 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.371395 19220 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.363538 19223 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:27.373361 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.374876 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:27.375458 19292 raft_consensus.cc:606] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:27.375770 21292 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.377818 19223 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:27.378538 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de803894748b488d81cb5c7007c78cce"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:27.379192 19292 raft_consensus.cc:606] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:27.382586 19217 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:27.361835 21588 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:27.381803 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:27.386400 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:27.393101 19901 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:27.388283 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:27.371347 21459 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.392906 21588 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:27.411091 19223 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:27.412750 19220 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:27.414454 19220 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:27.397486 21589 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:09:27.429600 19223 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:27.435124 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 203) took 1701 ms. Trace:
I20260709 13:09:27.435467 19223 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:27.435588 19218 rpcz_store.cc:276] 0709 13:09:25.733763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.124323 (+390560us) service_pool.cc:224] Handling call
0709 13:09:26.295141 (+170818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.295329 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:26.421542 (+126213us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.641400 (+219858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.641448 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:26.641505 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.641584 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.225324 (+583740us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b1800432700. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4
0709 13:09:27.434955 (+209631us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001b2e50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:27.435068 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":164753,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":622,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":5952,"spinlock_wait_cycles":311765120,"thread_start_us":307840,"threads_started":2,"wal-append.queue_time_us":296346}
I20260709 13:09:27.427372 21158 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:09:27.441042 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.445649 19224 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:27.447989 21487 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:27.448518 21487 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.449293 21363 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:27.451154 21540 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.447523 21588 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.457017 21540 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:27.463826 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 567600us
I20260709 13:09:27.464924 19263 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:27.468470 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:27.469138 19225 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:27.469527 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:27.459887 21487 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.471081 21417 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.489110 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.489861 19291 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:27.490150 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 569407us
I20260709 13:09:27.490350 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1482) took 1040 ms. Trace:
I20260709 13:09:27.490715 19291 rpcz_store.cc:276] 0709 13:09:26.449567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.468569 (+ 19002us) service_pool.cc:224] Handling call
0709 13:09:27.488947 (+1020378us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:27.490291 (+  1344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12653312}
I20260709 13:09:27.487219 21417 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:27.493244 21417 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.495086 21414 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:27.496002 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.496923 19224 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:27.470580 21158 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:09:27.502413 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:27.503845 21487 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:27.504706 21587 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:27.502429 19372 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:27.511763 19370 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:27.503890 19369 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:27.516635 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:27.516702 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:27.517403 19369 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:27.470698 21576 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.471243 21584 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:27.518069 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:27.530009 19365 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:27.519042 21483 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.522019 21507 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:27.537370 19370 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:27.537603 19365 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:09:27.541880 19370 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:27.542459 19365 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.543959 21483 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.544749 19373 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:27.548928 21483 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:27.550644 21483 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.564937 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.566228 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.566951 19295 raft_consensus.cc:2376] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5. Re-sending same reply.
I20260709 13:09:27.568465 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:27.569736 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 99385.5us
I20260709 13:09:27.572741 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.572794 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:27.574998 19370 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:27.576582 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.577322 19295 raft_consensus.cc:2376] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5. Re-sending same reply.
I20260709 13:09:27.579067 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:27.580605 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.583755 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.585633 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.560580 21485 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:27.608198 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 109065us
I20260709 13:09:27.551137 21483 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.612550 21507 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:09:27.608501 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.684651 21507 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.701680 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:27.703016 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 124065us
I20260709 13:09:27.703992 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:27.609126 21564 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:09:27.604635 21485 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.689278 19293 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:27.713286 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 124888us
I20260709 13:09:27.714449 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:27.689954 21507 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:27.700578 21565 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.709854 21472 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:27.728559 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 177775us
I20260709 13:09:27.689685 21584 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:09:27.732460 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:27.732725 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.738804 19225 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:09:27.723515 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.723766 21342 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:27.741775 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:27.743943 19370 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:27.746268 21471 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:27.707422 21146 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:09:27.743506 21487 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:09:27.742919 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:27.749415 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.751916 19216 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:27.751941 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1305) took 1149 ms. Trace:
I20260709 13:09:27.752496 19222 rpcz_store.cc:276] 0709 13:09:26.602610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.603311 (+   701us) service_pool.cc:224] Handling call
0709 13:09:26.603587 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.844191 (+240604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.751714 (+907523us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54003610d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:27.751875 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551756544}
I20260709 13:09:27.731428 21472 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:27.761704 19222 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.762370 19217 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:27.747180 21459 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 13:09:27.770018 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66135.2us
I20260709 13:09:27.773263 21146 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:27.833230 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:27.751628 21564 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.757486 21342 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:27.757091 21533 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:27.848489 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:27.758962 21604 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.856408 21158 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:27.856724 21483 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.857275 21584 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:27.856980 21158 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.857772 21584 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.859668 21584 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.859830 21158 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.776081 21174 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:27.852329 21591 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.093s	user 0.000s	sys 0.011s
I20260709 13:09:27.866153 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.786549 21507 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.852108 21604 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.895231 21604 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.895452 21507 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.867867 21584 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:27.868479 21609 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:09:27.862947 21540 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:27.896626 21584 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.852000 21533 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:27.897157 21584 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.897840 21533 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.898937 21533 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.871199 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:27.900463 19219 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:27.897123 21540 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:27.901852 21256 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.902062 21540 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.877892 21485 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.878696 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:27.905011 21583 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.672s	user 0.004s	sys 0.007s
I20260709 13:09:27.875448 19224 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:09:27.899030 21568 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.875s	user 0.004s	sys 0.000s
I20260709 13:09:27.908502 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1314) took 1068 ms. Trace:
I20260709 13:09:27.908879 19221 rpcz_store.cc:276] 0709 13:09:26.839712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.839881 (+   169us) service_pool.cc:224] Handling call
0709 13:09:26.841079 (+  1198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.841517 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.841555 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.886061 (+ 44506us) log.cc:844] Serialized 26 byte log entry
0709 13:09:27.149083 (+263022us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:27.149118 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.149214 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.904507 (+755293us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:27.908219 (+  3712us) raft_consensus.cc:1685] finished
0709 13:09:27.908238 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.908443 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":13162,"spinlock_wait_cycles":124806656,"thread_start_us":174282,"threads_started":1,"wal-append.queue_time_us":274541}
I20260709 13:09:27.911419 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 289) took 1020 ms. Trace:
W20260709 13:09:27.912600 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1493) took 1308 ms (client timeout 1546 ms). Trace:
I20260709 13:09:27.912779 19372 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:27.913024 19374 rpcz_store.cc:269] 0709 13:09:26.603831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.603934 (+   103us) service_pool.cc:224] Handling call
0709 13:09:27.912410 (+1308476us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54000d34d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:27.912541 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893112064}
I20260709 13:09:27.911823 19366 rpcz_store.cc:276] 0709 13:09:26.891206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.892597 (+  1391us) service_pool.cc:224] Handling call
0709 13:09:27.911231 (+1018634us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54001626d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:27.911364 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56428288}
I20260709 13:09:27.839938 21606 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:27.935731 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52373.6us
I20260709 13:09:27.925007 21342 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.857288 21483 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:27.947911 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 205251us
I20260709 13:09:27.863124 21605 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.950222 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:27.952515 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:27.951809 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 237418us
I20260709 13:09:27.947407 21483 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.952378 21473 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:27.957433 21483 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.864060 21417 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.957127 21615 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:27.959306 21615 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:27.959542 21417 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:27.959731 21615 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.867111 21472 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.950234 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1320) took 1301 ms. Trace:
I20260709 13:09:27.950771 21605 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:27.961069 19293 rpcz_store.cc:276] 0709 13:09:26.647222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.648738 (+  1516us) service_pool.cc:224] Handling call
0709 13:09:27.277177 (+628439us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:27.927381 (+650204us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54000497d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:27.948338 (+ 20957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773867008}
I20260709 13:09:27.961658 21605 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.962684 21605 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.977301 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:27.983953 19299 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:27.984076 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.985476 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.985746 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.946308 21604 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:27.990049 19299 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:27.990324 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.991211 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.991775 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.992327 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:27.845355 21564 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:27.967696 21615 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:27.996309 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 174484us
I20260709 13:09:27.944272 21610 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:09:27.970130 21472 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.998770 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.997714 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:28.001657 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.003170 19299 raft_consensus.cc:2368] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:28.004710 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:27.951200 21584 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.005527 19299 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:28.007550 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.008905 19299 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:28.010712 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.000530 21606 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:09:28.019627 21606 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:28.013262 21607 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:28.012974 21415 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:28.020030 21606 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:28.021236 21414 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:28.021879 21414 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:28.022324 21606 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.014781 21604 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.016551 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:28.024230 21613 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:28.018661 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:28.018334 19366 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:28.025303 19372 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:28.023023 21414 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.023861 21606 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.026778 21414 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.000587 21473 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.031073 21473 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.031533 21473 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.988094 21417 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:28.035837 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:28.036497 21256 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.036414 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:28.038322 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:28.038554 21613 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:28.039525 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.041602 19299 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:28.043500 21483 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.044133 21564 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:27.996961 21501 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:09:28.060701 19374 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:28.061618 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:28.062239 19372 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.004282 21471 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:09:28.045269 21616 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.053923 21256 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.061030 21611 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:09:28.072985 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 95756.3us
W20260709 13:09:28.073964 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 86115.5us
W20260709 13:09:28.079427 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 239379us
I20260709 13:09:28.084815 19372 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:28.056483 21565 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:09:28.093734 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 285) took 1257 ms. Trace:
I20260709 13:09:28.094095 19371 rpcz_store.cc:276] 0709 13:09:26.836018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.836146 (+   128us) service_pool.cc:224] Handling call
0709 13:09:26.855449 (+ 19303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.365335 (+509886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.093518 (+728183us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54000956d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:28.093680 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170834304}
I20260709 13:09:28.085975 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.057955 21613 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.097364 21473 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.097594 21507 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.097899 21613 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.098073 21473 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:28.099161 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.100207 21533 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:28.088232 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.100659 21471 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:28.100615 21533 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.101192 21495 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:28.089037 21554 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.101958 21554 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.089283 21501 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:28.100523 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:28.104794 21483 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.105908 21620 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:28.107115 21507 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.107496 21507 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:28.107877 21507 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.089435 21621 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:28.108510 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:28.084092 21616 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:28.107378 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.090013 21584 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.090906 21614 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:09:28.091259 21439 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.091601 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.091677 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.092612 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.101365 21533 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.109973 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:28.072289 21256 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.113152 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.121860 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:28.151932 19221 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:28.091954 21615 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.101208 21471 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:28.149653 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:28.151373 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64013.5us
I20260709 13:09:28.153123 19903 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:28.156970 19372 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.153522 19371 pending_rounds.cc:85] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 1
I20260709 13:09:28.157932 19371 pending_rounds.cc:107] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:28.158222 19371 raft_consensus.cc:2889] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.158711 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.103996 21554 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:28.151913 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65018.5us
I20260709 13:09:28.123801 21614 consensus_queue.cc:1243] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:28.162158 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.166183 19191 leader_election.cc:400] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:28.167373 19191 leader_election.cc:403] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:28.167982 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.169097 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.153697 21492 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.187741 19191 leader_election.cc:400] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:28.178074 19372 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:28.188736 19191 leader_election.cc:403] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.171965 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.172181 19221 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:28.152920 19294 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:28.195181 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.165239 21483 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:28.201297 21492 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:28.202776 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.203872 21492 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.207446 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.186589 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:28.194377 21573 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.211650 21625 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:28.212049 21622 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:28.267872 21622 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:28.268353 21622 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:28.268710 21622 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.166972 21554 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:28.271793 21554 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:28.212078 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.187384 21623 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.171823 21615 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:28.212226 19900 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:28.165107 21439 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:09:28.288717 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 129438us
W20260709 13:09:28.289748 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94632.2us
I20260709 13:09:28.199620 21483 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:28.309888 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:28.311913 21294 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.312526 21294 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:28.313390 21294 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.315009 19293 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:28.315685 19372 pending_rounds.cc:85] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 1
I20260709 13:09:28.315457 21256 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.331315 21459 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:28.304724 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 97345.5us
I20260709 13:09:28.316032 19372 pending_rounds.cc:107] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 4.2
W20260709 13:09:28.318114 21603 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.478s	user 0.001s	sys 0.001s
I20260709 13:09:28.318538 21485 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:28.324704 19298 raft_consensus.cc:2410] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:28.325484 21416 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:28.328560 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.276906 21573 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.332962 19372 raft_consensus.cc:2889] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.329516 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.333601 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.334074 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.315933 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.331707 21459 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:28.341361 21611 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.343734 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:28.350123 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.352429 21611 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:28.351756 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 260168us
I20260709 13:09:28.353686 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.355043 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.355631 19295 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.355577 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:28.351042 19221 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.357227 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.359264 21636 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.359768 21636 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.359545 21459 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.358026 21584 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:28.360890 21459 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.210189 21616 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.337210 21623 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.341764 21439 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:09:28.273154 21533 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.385519 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.344753 21416 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:28.360731 21584 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.360121 21636 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.361008 21573 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.344238 21576 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.400141 19300 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.332090 21483 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.356383 21615 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:28.474598 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 141087us
I20260709 13:09:28.398322 21605 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:28.476636 21605 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.478744 21539 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.478987 21605 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.478809 21576 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.479565 21539 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:28.480573 21539 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.481855 21576 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.483938 21635 raft_consensus.cc:2764] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:28.309686 21471 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.484805 21471 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.486123 21623 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:28.487294 21623 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.487704 21623 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:28.396239 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.488101 21623 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.491273 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.491842 19298 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.493053 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:28.394929 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.474116 21615 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:28.514010 21439 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:28.514124 19291 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:28.372856 21625 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:09:28.514698 21439 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.515734 19291 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:28.516858 21439 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.520268 21611 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.408501 21500 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:28.525925 21554 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:28.522290 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:28.408195 21565 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.547704 19300 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:28.554949 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.387620 21633 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.526365 21554 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:28.463091 21545 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.557147 19216 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:28.489006 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:28.548497 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 194465us
I20260709 13:09:28.408365 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:28.619786 19373 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:28.386255 19293 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:28.359215 21485 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.516119 19291 pending_rounds.cc:85] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 2
I20260709 13:09:28.514150 21615 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:28.587472 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 230303us
I20260709 13:09:28.470501 19295 raft_consensus.cc:2410] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:09:28.601969 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.557384 21611 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.613976 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.608836 19896 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:28.388665 21507 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.522359 21500 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:28.641848 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.623212 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:28.628688 19298 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:28.626345 19292 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:28.632551 19291 pending_rounds.cc:107] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:28.561868 21565 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.633749 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.633117 21576 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.648262 19291 raft_consensus.cc:2889] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.660638 21650 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:09:28.635272 21648 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:28.637545 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:28.566550 21622 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.672513 21622 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.672627 19300 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:28.673036 19300 pending_rounds.cc:85] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 2
I20260709 13:09:28.673285 19300 pending_rounds.cc:107] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:28.673547 19300 raft_consensus.cc:2889] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:28.642385 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.621917 21649 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.644903 21637 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:28.642845 19221 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:28.636893 19295 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:28.663619 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.665148 19216 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:28.679698 19216 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:28.667992 21646 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:09:28.670787 21565 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.713936 21604 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.714464 21604 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.631379 21545 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:28.685120 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 69373.4us
I20260709 13:09:28.709133 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:28.710500 21649 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.676604 21507 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:28.661558 21539 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.629527 21416 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:28.681000 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.664122 21540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.005s	sys 0.020s
I20260709 13:09:28.716634 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.673386 21256 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:28.744395 21533 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.745886 19903 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:28.771572 21623 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:28.756484 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 176921us
W20260709 13:09:28.757403 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 123728us
I20260709 13:09:28.638688 21611 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.715694 21483 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.661649 21576 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.776067 21564 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.784058 21611 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.784308 21576 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.763710 21545 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:28.752698 21584 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.769160 21615 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.772362 21604 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.772504 21648 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:28.745962 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.777971 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.780443 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.780633 19224 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:28.653524 21554 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.760696 21294 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:28.794873 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:28.761723 21540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.005s	sys 0.020s
I20260709 13:09:28.747942 21637 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.814747 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:28.815718 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 69850.5us
I20260709 13:09:28.790149 21539 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.817667 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.795554 19900 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:28.817677 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:28.818468 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.820530 21459 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.820449 21650 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.828789 21459 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:28.829713 21459 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.830312 21623 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:28.820838 19340 leader_election.cc:400] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:28.822899 21631 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.831979 19340 leader_election.cc:403] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.817075 21647 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.832616 21631 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:28.834445 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.835333 21631 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:28.835129 21648 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.835875 21631 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.826303 21622 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:28.836858 21631 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.831444 21636 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.812448 21471 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.840747 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.825608 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.841593 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.835299 21485 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:28.846068 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 742670us
I20260709 13:09:28.847236 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:28.847805 19297 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:28.861083 19297 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:28.855085 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.864008 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.865280 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:28.865501 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.868429 19295 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.866221 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:28.870286 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.870828 19299 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.861774 19297 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.873914 19297 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.842585 21554 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.896340 21439 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:28.896874 21439 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.898864 21439 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.899329 21642 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.899878 21642 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:28.899967 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.900740 21642 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.901305 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.902043 21584 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.903385 19263 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.817528 21294 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.904289 21584 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.904371 21615 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.905012 21615 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:28.905761 21294 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.905474 21615 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.858325 21650 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.876156 21655 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.888931 21633 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.889932 21649 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.916347 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:28.891350 21637 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.859642 21640 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.891440 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.893455 21483 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:28.899091 21485 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.889290 21656 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:28.876842 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:28.881387 19295 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:28.948246 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.917287 19369 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:28.884011 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:28.841473 21539 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:28.948375 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 84417us
I20260709 13:09:28.916891 21615 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:28.885897 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:28.952981 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76217.1us
I20260709 13:09:28.900761 21604 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:28.877539 21647 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:28.911650 19299 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:28.953292 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:28.881759 21501 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.845846 21471 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.949731 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.969892 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.957049 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:28.884442 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:28.956421 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.917200 21655 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:28.963030 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:28.965117 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.969987 19295 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:28.886277 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.943295 21633 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:28.954523 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:28.941565 21584 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:29.003060 21656 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.974880 21655 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.010931 21633 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:28.999081 21653 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:09:28.968869 21647 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:29.013577 21647 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.017310 21621 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.017866 21621 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:29.018939 21621 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:28.973299 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:28.996546 21485 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:29.039573 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:29.005292 21615 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.028806 21483 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:29.061205 21621 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.060598 21615 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:29.091141 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.078452 21573 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.084172 21615 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:29.107820 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 146387us
I20260709 13:09:29.088529 21492 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.112680 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.115520 19216 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.119539 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:29.120184 19225 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:29.118995 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.125712 19222 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.067597 21631 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.080965 21622 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:09:29.101658 21636 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:29.140618 19365 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:29.080756 21483 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.134380 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.135222 19216 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:29.152364 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.152936 19216 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:29.127846 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 132256us
I20260709 13:09:29.135576 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.156042 19370 raft_consensus.cc:2410] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:29.136797 19371 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:29.139174 19218 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.142699 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:29.142956 21664 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:29.143905 19222 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:09:29.158975 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 119516us
I20260709 13:09:29.159397 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.159754 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:29.160581 19222 raft_consensus.cc:2410] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:29.147750 19297 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:29.148731 21663 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:29.142956 19219 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:29.149559 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.157423 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:29.165052 19221 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:29.162966 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 261) took 1174 ms. Trace:
I20260709 13:09:29.165730 19297 rpcz_store.cc:276] 0709 13:09:27.988625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.988757 (+   132us) service_pool.cc:224] Handling call
0709 13:09:27.988999 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.847722 (+858723us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b54002f83a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb71c0 00007fe8d7eb8231 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c
0709 13:09:29.162689 (+314967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.162904 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148126592}
I20260709 13:09:29.163631 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:29.178287 19869 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.226s (SENT) [suppressed 45 similar messages]
I20260709 13:09:29.180130 19216 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:09:29.194782 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.137758 21650 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:29.251452 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.112445 21573 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.162066 21622 consensus_queue.cc:1243] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:29.288817 21677 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:29.289004 21687 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.292951 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 228074us
W20260709 13:09:29.297483 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 119217us
I20260709 13:09:29.163738 21539 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.280342 21631 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:29.318984 19216 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:29.328361 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.329087 19216 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:29.329768 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.318899 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.223580 21471 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:29.330704 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:29.282511 21665 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:29.336000 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:29.336877 19295 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:29.333823 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:29.335713 19221 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:29.340338 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:29.313129 21584 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:29.316345 21622 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.371754 19298 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:29.373122 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:29.373801 19292 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:29.374511 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:29.374676 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 225624us
W20260709 13:09:29.366103 21674 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:29.376720 19292 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:29.374207 19223 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:29.377216 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:29.375072 19298 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
I20260709 13:09:29.296063 21655 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.383724 19373 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.384925 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.386324 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:29.387699 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:29.388401 19292 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.407248 19218 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.409157 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:29.411382 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:29.411684 19371 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:29.344588 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:29.369939 21622 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:29.327651 21677 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.377077 21584 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.325671 21687 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.413420 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:29.458107 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49072.1us
I20260709 13:09:29.461860 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:29.416559 19297 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:29.477748 19292 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:29.484966 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:29.486279 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:29.430814 21564 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.002s
I20260709 13:09:29.506170 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:29.431484 21483 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.508916 19296 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:29.509050 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:29.509270 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.514724 19296 pending_rounds.cc:85] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 6
I20260709 13:09:29.515020 19298 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:29.509847 19373 raft_consensus.cc:2368] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6.
I20260709 13:09:29.515122 19296 pending_rounds.cc:107] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:29.515790 19296 raft_consensus.cc:2889] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:29.489845 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100474us
I20260709 13:09:29.531427 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.535964 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:29.477005 21688 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:29.531075 21667 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:09:29.539532 21539 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.546949 21471 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.556581 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.569060 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:29.426539 21647 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.488495 21622 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.530637 21483 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:29.580606 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.505277 21615 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.581108 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.581815 21471 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.586179 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:29.582063 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.505395 21672 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 13:09:29.720631 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:29.728861 21666 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:09:29.729365 19365 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:29.730731 21670 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:09:29.731266 21677 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:29.736812 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.737802 19221 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:29.740368 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:29.743249 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 157160us
I20260709 13:09:29.744227 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:29.740729 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.746778 19369 raft_consensus.cc:1217] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 13:09:29.602111 21655 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:29.747457 19369 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:29.772019 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.590097 21685 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:29.579555 21539 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:29.783299 19190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.020s
W20260709 13:09:29.784554 19190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.020s
W20260709 13:09:29.785351 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.747025 21682 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:09:29.788645 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:29.791278 19365 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:29.792220 21703 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.603279 21483 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.796872 21683 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.800028 21689 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.800158 21695 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:29.800661 21689 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.803480 21689 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.803684 21500 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:29.804474 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.800778 21695 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.779065 21685 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:29.814605 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:29.827610 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51282.8us
I20260709 13:09:29.822903 21685 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.823480 21628 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.837173 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100799us
I20260709 13:09:29.841974 21695 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:29.842959 21699 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:29.793001 21703 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:09:29.834352 21584 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.839186 21688 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.838673 21471 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:29.856575 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.847517 21683 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.857357 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.859051 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.863400 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:29.863617 21584 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.864302 21584 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.866843 21584 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.870906 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 263) took 1881 ms. Trace:
W20260709 13:09:29.875671 21621 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.000s
I20260709 13:09:29.846222 21628 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.877836 21628 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:29.879491 21483 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:29.861182 21683 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.871460 19296 rpcz_store.cc:276] 0709 13:09:27.990009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.990135 (+   126us) service_pool.cc:224] Handling call
0709 13:09:27.990450 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.516475 (+1526025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.870595 (+354120us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002b8ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:29.870836 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3491098112}
I20260709 13:09:29.892202 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:29.893296 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:29.900718 21707 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:29.858923 21471 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.904567 21647 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.861012 21615 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:29.893354 21416 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.855719 21688 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:29.904621 21471 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:29.909371 21471 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:29.910156 21688 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:29.913414 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:29.914250 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:29.914320 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:29.915335 21533 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:29.915624 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:29.917505 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:29.915714 21533 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.922595 19900 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:29.922765 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:29.920756 21692 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:29.925251 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1354) took 1925 ms. Trace:
I20260709 13:09:29.925343 21533 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.925691 19300 rpcz_store.cc:276] 0709 13:09:28.000110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.550824 (+550714us) service_pool.cc:224] Handling call
0709 13:09:28.551104 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.674029 (+122925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.925021 (+1250992us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000497d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:29.925194 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278592768}
I20260709 13:09:29.916895 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:29.916983 21712 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:09:29.929068 21657 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.906s	user 0.008s	sys 0.008s
I20260709 13:09:29.937502 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1621) took 1622 ms. Trace:
I20260709 13:09:29.937907 19372 rpcz_store.cc:276] 0709 13:09:28.314960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.315088 (+   128us) service_pool.cc:224] Handling call
0709 13:09:28.315443 (+   355us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:28.397221 (+ 81778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.397250 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:28.397857 (+   607us) log.cc:844] Serialized 78 byte log entry
0709 13:09:28.761193 (+363336us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:28.782531 (+ 21338us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.790340 (+  7809us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.814397 (+ 24057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.814516 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.022686 (+208170us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b18000c9fa0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:29.928383 (+905697us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:29.937305 (+  8922us) raft_consensus.cc:1685] finished
0709 13:09:29.937326 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.937454 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32345,"prepare.queue_time_us":21297,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":16661,"raft.queue_time_us":154307,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":10514,"spinlock_wait_cycles":15709184,"thread_start_us":308175,"threads_started":2,"wal-append.queue_time_us":424533}
W20260709 13:09:29.972287 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 226301us
I20260709 13:09:29.973263 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:29.974606 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:29.983073 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:29.978973 21647 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.978487 21615 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:29.989898 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 71637us
I20260709 13:09:29.984850 21693 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.991652 21688 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:29.995193 19250 heartbeater.cc:646] Failed to heartbeat to 127.17.171.254:34425 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.171.254:34425 timed out after 15.000s (SENT)
I20260709 13:09:29.997516 21622 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:30.001426 21660 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.985s	user 0.009s	sys 0.025s
I20260709 13:09:29.997464 21533 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.002375 19895 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:30.003814 21671 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.004112 21533 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:30.004352 21671 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.006505 21671 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:30.007762 21675 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.695s	user 0.004s	sys 0.020s
I20260709 13:09:30.010633 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 269) took 1098 ms. Trace:
I20260709 13:09:30.011003 19299 rpcz_store.cc:276] 0709 13:09:28.912587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.975436 (+ 62849us) service_pool.cc:224] Handling call
0709 13:09:28.975837 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:28.998451 (+ 22614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.998490 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:29.000239 (+  1749us) log.cc:844] Serialized 52 byte log entry
0709 13:09:29.077106 (+ 76867us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:29.077148 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.077220 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.007025 (+929805us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:30.010304 (+  3279us) raft_consensus.cc:1685] finished
0709 13:09:30.010328 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.010530 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39464,"raft.queue_time_us":60410,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":20928,"spinlock_wait_cycles":7841152,"thread_start_us":76452,"threads_started":1,"wal-append.queue_time_us":183898}
I20260709 13:09:30.007525 21714 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:09:30.020735 21714 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.020915 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.021284 21714 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.020717 21693 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:30.022670 21693 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:30.023471 21693 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.023957 21439 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.024334 21714 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.024595 21640 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.024850 21693 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.026006 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.026654 19900 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:30.027370 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.038123 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.038966 19218 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:30.040288 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.041097 19223 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
I20260709 13:09:30.042236 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:30.044469 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.046046 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:30.024632 21439 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:09:30.044917 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52501.2us
I20260709 13:09:30.057610 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:30.052109 21633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.001s	sys 0.023s
I20260709 13:09:30.050201 21714 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:30.051177 21628 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:30.066742 21633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.002s	sys 0.023s
W20260709 13:09:30.058957 21710 log.cc:927] Time spent T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
I20260709 13:09:30.071736 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:30.072687 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:30.074487 19365 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:30.075628 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.075934 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.076824 19366 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:30.082558 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.082955 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.077527 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:30.084313 21662 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.013s	user 0.010s	sys 0.000s
I20260709 13:09:30.085196 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.057180 19898 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:30.089396 19373 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:30.090001 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:30.090034 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.090951 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:30.081238 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.087725 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.091707 19297 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:30.087940 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:30.088431 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:30.088660 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.065136 21692 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.099669 19296 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:30.094442 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 422) took 1318 ms. Trace:
I20260709 13:09:30.092419 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.095407 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.100787 19292 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:30.066869 21714 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.070577 21628 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.089298 21487 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:30.116816 21715 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:30.102015 19266 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.117503 21715 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:30.118314 21611 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:30.118467 21687 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.092753 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.122931 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.123507 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.123989 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.125015 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.125939 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.126645 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.126885 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.129331 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.132426 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.133548 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.136674 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.066709 21688 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:30.125631 19220 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
W20260709 13:09:30.109050 21417 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:09:30.093550 21483 raft_consensus.cc:2764] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:09:30.101872 19902 rpcz_store.cc:276] 0709 13:09:28.775693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.775895 (+   202us) service_pool.cc:224] Handling call
0709 13:09:28.788807 (+ 12912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.789122 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.789151 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.820445 (+ 31294us) log.cc:844] Serialized 508 byte log entry
0709 13:09:28.949377 (+128932us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:28.949430 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.949519 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.069819 (+1120300us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:30.085590 (+ 15771us) raft_consensus.cc:1685] finished
0709 13:09:30.085624 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.094370 (+  8746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4376832,"thread_start_us":120872,"threads_started":1,"wal-append.queue_time_us":171022}
I20260709 13:09:30.145910 19223 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:30.118467 21715 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.126253 21714 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.127997 21414 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.135581 21628 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.110672 21615 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:30.146858 21573 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:30.092676 19898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 525) took 1969 ms (client timeout 1780 ms). Trace:
I20260709 13:09:30.146194 21416 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.156699 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75562.8us
I20260709 13:09:30.157869 19218 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:30.161444 19340 leader_election.cc:336] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.525s (SENT)
I20260709 13:09:30.163290 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.173518 19296 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:30.173620 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:30.171753 19340 connection.cc:256] RPC call timeout handler was delayed by -1.0334829070000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 13:09:30.174896 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:30.175909 19340 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.176757 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.179231 19295 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:30.191177 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:30.193048 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.158087 21615 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.198871 19902 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.195204 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.199949 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:30.194144 19894 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.198560 21615 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.197129 21540 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.203805 21540 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.210225 21597 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.156175 21414 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.194187 21639 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.212285 21684 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:09:30.186015 21655 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:30.214805 19297 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:30.181923 21693 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.223325 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:30.217756 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70134.3us
W20260709 13:09:30.224202 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 68551.5us
I20260709 13:09:30.215802 19902 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:30.200040 21256 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.236109 19292 pending_rounds.cc:85] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 3
I20260709 13:09:30.238865 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.218645 21540 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.182214 21416 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:30.158577 19898 rpcz_store.cc:269] 0709 13:09:28.122910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.136432 (+ 13522us) service_pool.cc:224] Handling call
0709 13:09:29.922664 (+1786232us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:30.092612 (+169948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9649920}
I20260709 13:09:30.207798 21685 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:30.309288 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70541.9us
I20260709 13:09:30.315634 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.309723 19292 pending_rounds.cc:107] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:30.329784 19292 raft_consensus.cc:2889] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:30.231648 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:30.332672 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 101164us
I20260709 13:09:30.307905 21597 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:09:30.201125 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.319883 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:30.276661 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.268419 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.336972 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.336992 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.219069 21623 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.237438 21589 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.089s
W20260709 13:09:30.320420 21722 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:30.308445 21604 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.234520 21688 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.234663 21533 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:30.318739 21716 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.319082 21507 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:30.363595 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:30.345646 21703 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.230942 21693 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.372570 19221 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:30.373250 19902 raft_consensus.cc:2376] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6. Re-sending same reply.
I20260709 13:09:30.344156 21684 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:30.318404 21256 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.225849 21169 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:09:30.213109 21294 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:30.379197 21727 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:09:30.362293 21604 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.364832 21613 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:09:30.383982 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.365665 21678 raft_consensus.cc:2764] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:30.371398 21417 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.364815 21715 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:30.371039 21688 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.374444 21533 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.441105 21533 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.443009 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.443677 19225 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:30.393311 21716 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:30.449260 21716 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.449611 21716 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:30.450565 21715 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.452728 21715 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.454494 21671 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:30.454856 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 235324us
I20260709 13:09:30.455631 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.456522 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.456670 21671 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:30.396432 21726 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:09:30.457240 21671 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.397387 21693 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.394025 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:30.386643 21507 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.382850 21703 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:30.399987 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1674) took 1723 ms (client timeout 2183 ms). Trace:
I20260709 13:09:30.400261 21683 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.401036 19217 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:30.401835 21604 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.402107 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.404183 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.405098 21539 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.480247 21695 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:30.408492 21730 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:30.385222 21256 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.410212 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.416435 19903 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:30.486644 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 99488.3us
I20260709 13:09:30.388422 21483 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:09:30.418721 21685 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:30.422183 19896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 526) took 2298 ms (client timeout 1677 ms). Trace:
I20260709 13:09:30.422358 21416 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.423861 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.421073 21615 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.425455 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 528) took 1873 ms. Trace:
I20260709 13:09:30.469560 21703 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.430545 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.440346 21169 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:30.459720 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:30.499668 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:30.462570 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70502.9us
W20260709 13:09:30.463663 19224 rpcz_store.cc:269] 0709 13:09:28.676761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.676943 (+   182us) service_pool.cc:224] Handling call
0709 13:09:30.399802 (+1722859us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b540039a8d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:30.399925 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79751424}
I20260709 13:09:30.458210 21671 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.480535 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 529) took 1181 ms. Trace:
I20260709 13:09:30.406092 21647 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:30.456921 21485 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:30.459862 21688 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.476338 21573 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:30.494844 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.429908 19223 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:30.499665 19220 raft_consensus.cc:1813] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Handling vote request from an unknown peer c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.501432 19221 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.517102 19220 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:30.480317 21634 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.503531 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:30.492475 21708 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.625s	user 0.002s	sys 0.003s
I20260709 13:09:30.484599 21623 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.485503 21633 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:09:30.498382 19898 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:30.511994 19222 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:30.494544 21620 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.514074 19292 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:30.514448 19295 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:30.515594 19224 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:30.490325 19896 rpcz_store.cc:269] 0709 13:09:28.123556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.136618 (+ 13062us) service_pool.cc:224] Handling call
0709 13:09:30.421841 (+2285223us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:30.422056 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713734016}
I20260709 13:09:30.518486 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.491818 21539 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.532908 21634 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.521176 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.510088 21169 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.537560 21634 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.539551 21169 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.489601 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.540959 21539 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.500880 21637 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.541939 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52586.3us
I20260709 13:09:30.541891 21637 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.542963 19191 leader_election.cc:400] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6.
I20260709 13:09:30.498598 21641 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.543880 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.544443 21641 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.544762 21539 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:30.546002 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.546312 21620 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.546828 21539 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.548388 21620 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.548694 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.501072 21656 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.523111 21642 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:30.493227 21683 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:09:30.495965 21636 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:30.510605 21639 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.512390 21485 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:30.551023 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.522681 21416 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.496256 19901 rpcz_store.cc:276] 0709 13:09:28.552307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.552441 (+   134us) service_pool.cc:224] Handling call
0709 13:09:28.552737 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.563663 (+ 10926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.563704 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.573022 (+  9318us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.124866 (+1551844us) spinlock_profiling.cc:243] Waited 898 us on lock 0x7b180033db40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:09:30.316485 (+191619us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:30.316547 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.316987 (+   440us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.425169 (+108182us) raft_consensus.cc:1685] finished
0709 13:09:30.425189 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.425397 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10544,"raft.queue_time_us":53856,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6362,"spinlock_wait_cycles":2065280,"thread_start_us":191368,"threads_started":1,"wal-append.queue_time_us":1800426}
I20260709 13:09:30.500355 21584 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:30.544008 21637 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.577843 19221 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:30.505681 21647 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:30.597131 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46187.2us
I20260709 13:09:30.584086 21714 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:30.528620 21616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.025s	sys 0.040s
W20260709 13:09:30.587651 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66553.8us
I20260709 13:09:30.600598 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.577256 21685 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:30.603633 21616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.934s	user 0.026s	sys 0.040s
I20260709 13:09:30.523193 21716 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.607695 21716 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.502393 19899 rpcz_store.cc:276] 0709 13:09:29.299445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.314109 (+ 14664us) service_pool.cc:224] Handling call
0709 13:09:30.401989 (+1087880us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:30.480469 (+ 78480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15525248}
I20260709 13:09:30.548787 21507 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.598069 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.593796 21620 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.576952 21576 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:30.588912 21169 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.592142 21673 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:09:30.603127 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:30.732407 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 129361us
I20260709 13:09:30.733417 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:30.595512 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 63534.8us
I20260709 13:09:30.588840 21554 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:09:30.597610 21633 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.674897 21679 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.741196 21605 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.741468 21679 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:30.741622 21605 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:30.741954 21679 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.742537 21605 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:30.689131 21725 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:09:30.656678 21642 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.585834 21656 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.646092 21735 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:30.601078 21738 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.675755 21638 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.596446 21639 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:30.693651 21628 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
W20260709 13:09:30.704144 21733 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:09:30.692076 21649 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.709760 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.718170 19225 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:30.743655 21616 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.722456 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 124517us
I20260709 13:09:30.786635 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.787391 21714 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.723677 21576 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:30.788674 21649 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.747004 19297 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:30.746915 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.802207 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:30.748847 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.802717 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:30.803212 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.657194 21623 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.752127 21747 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.808347 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 479) took 1002 ms. Trace:
I20260709 13:09:30.752473 19298 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:30.662747 21647 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:30.753793 21732 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:09:30.729709 21685 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:30.759399 19337 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.732476 21615 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.743996 21500 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.736600 21636 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:30.789455 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.791447 21637 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.791915 21417 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:30.822171 21417 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:30.823000 21417 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.824302 21417 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.825109 21683 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:30.825664 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.794723 21576 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.795403 21656 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:30.833222 21701 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.286s	user 0.000s	sys 0.003s
I20260709 13:09:30.833464 21576 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.815546 21471 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.788123 21714 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:30.616650 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 98263.7us
I20260709 13:09:30.813568 21685 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.825625 21683 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.785143 21628 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.738902 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:30.800904 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.802807 19373 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:30.802723 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:30.754748 21648 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:30.739594 21294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41698 (request call id 77) took 7292 ms. Trace:
I20260709 13:09:30.736996 21169 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.856232 21294 rpcz_store.cc:276] 0709 13:09:23.447201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.377379 (+930178us) service_pool.cc:224] Handling call
0709 13:09:24.551909 (+174530us) log.cc:844] Serialized 508 byte log entry
0709 13:09:25.702372 (+1150463us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b180023a2e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7e0eb0b 00007fe8d7e93b63 00007fe8d7ebb752 00007fe8d7eb39fa
0709 13:09:30.733052 (+5030680us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":948762,"raft.queue_time_us":1003449,"raft.run_cpu_time_us":1542,"raft.run_wall_time_us":68282,"spinlock_wait_cycles":8505216,"thread_start_us":140462,"threads_started":1,"wal-append.queue_time_us":211808,"wal-append.run_cpu_time_us":2563,"wal-append.run_wall_time_us":1175911}
I20260709 13:09:30.858072 21169 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.858668 21294 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.858775 21169 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.859179 21294 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.859395 21169 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.861291 21294 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.862401 21641 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.863631 21169 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:30.866510 19297 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:30.875178 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:30.757552 21605 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:30.815099 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 55763.1us
I20260709 13:09:30.882474 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.884932 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.886016 19373 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:30.886238 21695 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.888244 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.889678 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.891036 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:28.396601 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.756965 21735 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:30.807399 21744 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.808979 19897 rpcz_store.cc:276] 0709 13:09:29.805832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.812591 (+  6759us) service_pool.cc:224] Handling call
0709 13:09:30.709554 (+896963us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:30.808271 (+ 98717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5141376}
I20260709 13:09:30.823954 21673 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:30.794699 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.793785 21693 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.803951 21738 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:30.732766 21485 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.840404 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:30.842283 19295 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.803629 21616 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:30.852500 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 113680us
I20260709 13:09:30.852506 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.744411 21620 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.764747 21638 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:30.921515 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:31.007704 19294 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.930495 19369 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:31.011368 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.012027 19369 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:30.916117 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:31.013060 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.013247 19291 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.014285 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.015950 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:30.944373 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:30.981858 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 141547us
I20260709 13:09:31.021611 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:31.022260 19297 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:31.022480 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:31.023342 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:31.023695 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:30.962368 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78d1dbf9a24f4b489920281c72245ab4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:09:31.024468 19110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62283.7us
I20260709 13:09:30.985743 21616 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.967836 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:30.986258 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:31.025411 19895 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:31.026316 21597 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.026351 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:30.969542 19225 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:31.027671 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.974359 19221 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:30.976574 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:31.006207 21620 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:09:31.029225 21573 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.978008 19900 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:31.030673 21653 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.993693 21693 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.006709 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:31.032591 21620 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.978343 21744 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:30.941442 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:30.986917 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 134487us
I20260709 13:09:31.034751 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:31.035009 21744 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:31.035712 21620 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.035635 21744 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:31.036250 21620 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.029695 21573 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.036720 21620 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.036975 21573 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.037249 21744 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:31.037679 21744 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:31.038093 21744 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.956914 19894 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:30.932088 21704 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:31.040653 21704 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.980837 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:31.041698 21704 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.043285 21704 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.044497 19369 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:31.047143 21626 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:30.980824 21738 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.049999 21626 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:31.020677 19120 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 259) took 16255 ms (client timeout 15000 ms). Trace:
I20260709 13:09:31.049036 21635 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:31.030560 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.995085 19295 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:31.064004 21597 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.983119 21169 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:31.064817 21169 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.987452 21638 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.067195 21169 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.052136 21738 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:30.947908 21414 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.068920 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:30.930346 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:31.070044 21169 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:31.052865 21626 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:30.979549 21735 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.061489 21584 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.040113 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:30.983958 21668 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.076639 21554 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.077221 21620 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.080081 21620 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.083778 21584 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:31.116451 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:31.120739 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:31.125057 21626 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:31.127266 21653 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:31.127887 21653 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:31.129323 21653 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.820209 21746 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.148279 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1328) took 2031 ms. Trace:
I20260709 13:09:31.148840 19217 rpcz_store.cc:276] 0709 13:09:29.117181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.118352 (+  1171us) service_pool.cc:224] Handling call
0709 13:09:30.400687 (+1282335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.470002 (+ 69315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.147984 (+677982us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540039a8d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:31.148204 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948242176}
I20260709 13:09:31.154770 19294 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:31.159444 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:30.850764 21685 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.062390 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:31.052258 19120 rpcz_store.cc:269] 0709 13:09:14.765354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.766386 (+  1032us) service_pool.cc:224] Handling call
0709 13:09:15.271860 (+505474us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5400002490. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d910b2 00007fe8ddd0aa89 00007fe8ddca2da6 00007fe8ddc74088 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc
0709 13:09:31.020586 (+15748726us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:27.010822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:27.177390 (+166568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:27.177423 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:09:27.177440 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:27.177818 (+   378us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:27.177901 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:27.177934 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:09:27.178239 (+   305us) tablet.cc:701] Row locks acquired
0709 13:09:27.178256 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:09:27.178405 (+   149us) write_op.cc:270] Start()
0709 13:09:27.178518 (+   113us) write_op.cc:276] Timestamp: P: 1783602567178361 usec, L: 0
0709 13:09:27.178550 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:09:27.219433 (+ 40883us) log.cc:844] Serialized 925 byte log entry
0709 13:09:27.524001 (+304568us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d4dab0ac 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b
0709 13:09:28.063166 (+539165us) op_driver.cc:464] REPLICATION: finished
0709 13:09:28.312080 (+248914us) write_op.cc:301] APPLY: starting
0709 13:09:28.312217 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:28.312332 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:28.312353 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:28.312746 (+   393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:28.312924 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:09:28.312974 (+    50us) write_op.cc:312] APPLY: finished
0709 13:09:28.313193 (+   219us) log.cc:844] Serialized 29 byte log entry
0709 13:09:28.313354 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:28.313440 (+    86us) write_op.cc:454] Released schema lock
0709 13:09:28.313476 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:28.313853 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:28.313880 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":234565,"reported_tablets":32,"spinlock_wait_cycles":26172672,"child_traces":[["op",{"apply.queue_time_us":246279,"apply.run_cpu_time_us":1770,"apply.run_wall_time_us":1773,"num_ops":2,"prepare.queue_time_us":271122,"prepare.run_cpu_time_us":49155,"prepare.run_wall_time_us":671367,"raft.queue_time_us":237230,"raft.run_cpu_time_us":24329,"raft.run_wall_time_us":185965,"replication_time_us":872821,"spinlock_wait_cycles":116707072,"thread_start_us":996778,"threads_started":4,"wal-append.queue_time_us":511371,"wal-append.run_cpu_time_us":56528,"wal-append.run_wall_time_us":1578880}]]}
I20260709 13:09:31.092306 21638 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.098800 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:31.101336 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:31.104876 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:31.106841 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:31.108753 21735 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.101390 21744 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.851259 21647 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.163628 19219 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:31.132911 21492 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:30.829102 21688 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.229615 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:31.084517 21573 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:31.181823 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 119539us
I20260709 13:09:31.234165 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:30.853894 21615 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:31.235637 21573 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.236016 21615 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.239173 21615 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:31.200611 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.239636 21704 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:31.240061 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.204615 21696 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:30.808423 21747 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:30.851760 21648 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.830521 21636 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.210765 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:31.210966 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:31.170107 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45396.4us
I20260709 13:09:31.136082 21633 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:30.830233 21637 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.169155 21146 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:31.213909 21540 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.886s	user 0.006s	sys 0.004s
W20260709 13:09:31.214573 21716 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:09:31.178579 21584 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.837122 21642 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.214188 21169 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:31.232993 21714 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:31.240331 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.235702 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:31.253544 19365 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.247476 19368 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
W20260709 13:09:31.553207 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 317564us
W20260709 13:09:31.298772 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87876.6us
W20260709 13:09:31.252771 21533 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.000s
W20260709 13:09:31.256304 21703 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.002s
W20260709 13:09:31.344103 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.346321 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 223982us
W20260709 13:09:31.295727 21739 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.599s	user 0.001s	sys 0.000s
I20260709 13:09:31.240123 21704 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.241036 21696 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:31.252095 21693 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:31.617996 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.298529 21146 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:31.303869 21615 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:31.252293 21616 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.254429 21483 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:31.247273 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:31.299463 21738 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.619728 21620 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.633912 21637 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.634797 21688 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.306825 21649 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:31.300806 21169 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:31.597723 21492 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.297458 21507 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.334s
I20260709 13:09:31.630827 21615 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.290512 21743 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.818s
W20260709 13:09:31.633968 21741 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.609s	user 0.001s	sys 0.000s
I20260709 13:09:31.627655 21704 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.299633 21584 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.291200 21745 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.909s
I20260709 13:09:31.660029 21169 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.242846 21747 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.556517 21623 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 13:09:31.668370 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.610913 21533 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.643390 21683 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.299309 21540 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.243640 21648 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.312769 21714 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.651746 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:31.721113 19366 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.461238 21639 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:31.661029 19293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.010s	sys 0.075s
I20260709 13:09:31.627818 21703 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.666083 21637 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:31.665689 21649 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:31.592712 21633 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.667735 21615 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.635996 21693 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.639312 21616 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:31.711248 19191 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.546s (SENT)
I20260709 13:09:31.747033 19371 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.710124 21146 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:31.722564 19291 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.709s	user 0.003s	sys 0.007s
W20260709 13:09:31.727615 19293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.010s	sys 0.075s
W20260709 13:09:31.723379 21634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.015s	sys 0.023s
I20260709 13:09:31.746832 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:31.643510 21483 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.748541 19291 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:31.728084 21637 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.748723 19366 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:31.710798 21744 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:31.728324 21655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.037s	sys 0.050s
W20260709 13:09:31.778998 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67797.6us
I20260709 13:09:31.723788 21638 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.796620 21623 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:31.797088 21623 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:31.798172 21703 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.797849 21623 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.799031 21623 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.800653 21540 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.805431 21485 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.751081 19216 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.781811 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:31.656840 21620 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:31.738993 21649 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:31.786705 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.819154 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 324) took 1009 ms. Trace:
I20260709 13:09:31.697851 21668 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:09:31.858737 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:31.778190 21634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.015s	sys 0.023s
I20260709 13:09:31.781813 21573 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:31.698024 21696 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.783047 21683 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:31.809732 21417 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.000s
W20260709 13:09:31.791986 21655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.038s	sys 0.051s
W20260709 13:09:31.810070 21459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.918s	user 0.008s	sys 0.040s
I20260709 13:09:31.748311 21639 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:09:31.819563 19365 rpcz_store.cc:276] 0709 13:09:30.809381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.810267 (+   886us) service_pool.cc:224] Handling call
0709 13:09:30.810615 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.452729 (+642114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.818928 (+366199us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400197154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:31.819098 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017995008}
I20260709 13:09:31.786890 21533 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.847937 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.848341 21500 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:31.848820 21693 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.849361 21649 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.850467 21628 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.853510 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 315) took 1085 ms. Trace:
I20260709 13:09:31.854653 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 320) took 1062 ms. Trace:
I20260709 13:09:31.855290 21616 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.856467 21584 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:31.857730 21714 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.787071 21637 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:31.863584 19372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.016s	sys 0.022s
W20260709 13:09:31.924000 19372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.017s	sys 0.022s
W20260709 13:09:31.822609 21256 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.340s	user 0.012s	sys 0.000s
W20260709 13:09:31.865016 19373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.012s	sys 0.026s
W20260709 13:09:31.927627 19373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.013s	sys 0.026s
I20260709 13:09:31.877573 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:31.880286 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:31.862167 21576 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
W20260709 13:09:31.861097 21695 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.020s	sys 0.037s
W20260709 13:09:31.923375 21679 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.177s	user 0.008s	sys 0.006s
W20260709 13:09:31.879624 19896 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.020s	sys 0.019s
W20260709 13:09:31.879527 21459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.988s	user 0.008s	sys 0.041s
I20260709 13:09:31.890547 19371 rpcz_store.cc:276] 0709 13:09:30.768598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.768763 (+   165us) service_pool.cc:224] Handling call
0709 13:09:30.769074 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.778563 (+1009489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.853274 (+ 74711us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54000d39d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:31.853448 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248621312}
I20260709 13:09:31.890614 19368 rpcz_store.cc:276] 0709 13:09:30.792524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.794463 (+  1939us) service_pool.cc:224] Handling call
0709 13:09:31.854490 (+1060027us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540012ded4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:31.854587 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618079616}
W20260709 13:09:31.890998 21471 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.052s	user 0.011s	sys 0.000s
W20260709 13:09:31.892766 21673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.035s	sys 0.035s
I20260709 13:09:31.889318 21696 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.933449 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.936117 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.937067 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:31.882815 19366 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:31.933745 21641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.000s	sys 0.075s
I20260709 13:09:31.957345 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:31.958027 19365 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:31.889067 21500 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:31.962940 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:31.938822 19896 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.020s	sys 0.019s
I20260709 13:09:31.964488 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:31.932442 21695 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.020s	sys 0.037s
I20260709 13:09:31.930902 21256 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:31.948786 21635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.007s	sys 0.053s
W20260709 13:09:32.008252 19370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.034s	sys 0.056s
W20260709 13:09:31.966361 21673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.035s	sys 0.036s
W20260709 13:09:31.978890 21671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.015s	sys 0.036s
W20260709 13:09:31.962563 21641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.000s	sys 0.075s
W20260709 13:09:31.992285 21605 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.099s	user 0.004s	sys 0.007s
W20260709 13:09:32.016789 21749 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.712s	user 0.002s	sys 0.002s
W20260709 13:09:32.000790 21761 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:31.956692 21539 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.042383 21735 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
W20260709 13:09:32.043061 21635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.013s	sys 0.061s
I20260709 13:09:31.940917 21679 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:32.055018 21671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.015s	sys 0.037s
I20260709 13:09:32.043962 21483 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:32.128225 19188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.000s	sys 0.014s
W20260709 13:09:32.129112 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.007s	sys 0.010s
W20260709 13:09:32.131114 19296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.005s	sys 0.004s
W20260709 13:09:31.856802 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.131819 19297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.010s	sys 0.009s
W20260709 13:09:32.232414 19188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.000s	sys 0.016s
W20260709 13:09:31.812991 19218 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.015s	sys 0.024s
W20260709 13:09:32.132648 19292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.004s	sys 0.004s
W20260709 13:09:32.136639 19295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.011s	sys 0.012s
W20260709 13:09:32.137174 19298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.004s	sys 0.002s
W20260709 13:09:32.131814 19300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.006s	sys 0.005s
I20260709 13:09:32.137854 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
W20260709 13:09:32.143500 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.144578 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.007s
W20260709 13:09:32.145120 19338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.001s	sys 0.011s
W20260709 13:09:32.145622 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.005s	sys 0.007s
I20260709 13:09:31.965659 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:32.253576 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.254666 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1531) took 1003 ms. Trace:
I20260709 13:09:32.254812 21605 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:31.978319 19367 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:32.255847 21605 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.256891 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1530) took 1005 ms. Trace:
I20260709 13:09:32.257439 19367 rpcz_store.cc:276] 0709 13:09:31.250895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.932572 (+681677us) service_pool.cc:224] Handling call
0709 13:09:32.256662 (+324090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:31.965111 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:32.043052 19370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.039s	sys 0.069s
W20260709 13:09:32.156540 19369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.007s	sys 0.034s
W20260709 13:09:32.260812 19369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.008s	sys 0.034s
W20260709 13:09:32.261274 21760 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:09:32.157269 19374 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:32.165958 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.010s	sys 0.011s
W20260709 13:09:32.263643 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.010s	sys 0.011s
W20260709 13:09:32.264294 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 692494us
W20260709 13:09:32.268205 21758 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:09:32.165274 19868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.006s
W20260709 13:09:32.269867 19868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.015s	sys 0.007s
I20260709 13:09:32.042174 21649 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:32.271600 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.068701 21635 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:32.206625 21642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.015s	sys 0.018s
W20260709 13:09:32.272614 21642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.015s	sys 0.019s
W20260709 13:09:32.232129 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.008s	sys 0.010s
I20260709 13:09:32.273910 21649 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:32.066833 21704 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.278317 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1648) took 1390 ms. Trace:
I20260709 13:09:32.279481 21704 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:31.863126 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:32.058845 21500 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:32.237032 19297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.010s	sys 0.010s
I20260709 13:09:32.070572 21539 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:32.248932 19292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.004s	sys 0.004s
W20260709 13:09:32.253171 19218 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.016s	sys 0.024s
I20260709 13:09:32.261454 19368 raft_consensus.cc:2410] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:09:32.231721 19296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.006s	sys 0.005s
W20260709 13:09:32.275355 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.005s	sys 0.007s
W20260709 13:09:32.250847 19300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.006s	sys 0.006s
W20260709 13:09:32.275803 19338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.002s	sys 0.011s
W20260709 13:09:32.251128 19295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.011s	sys 0.012s
W20260709 13:09:32.251360 19298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.005s	sys 0.002s
I20260709 13:09:32.286484 19371 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.255283 19365 rpcz_store.cc:276] 0709 13:09:31.251230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.965388 (+714158us) service_pool.cc:224] Handling call
0709 13:09:32.254407 (+289019us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:32.276121 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.006s	sys 0.007s
I20260709 13:09:32.282191 21471 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.306486 21471 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.294008 21256 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:32.280072 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 1.05046e+06us
I20260709 13:09:32.281023 21772 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:32.283664 21483 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:32.281776 21459 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.284096 21756 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:09:32.278795 19372 rpcz_store.cc:276] 0709 13:09:30.888062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.924035 (+ 35973us) service_pool.cc:224] Handling call
0709 13:09:30.935423 (+ 11388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.935745 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:31.924551 (+988806us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.277445 (+352894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.277567 (+   122us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:32.277684 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.277783 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.278060 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270117,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":27066,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":287,"thread_start_us":1304826,"threads_started":2}
I20260709 13:09:32.283128 21714 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.324997 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 534243us
I20260709 13:09:32.325235 19291 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:32.326205 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1545) took 1114 ms. Trace:
I20260709 13:09:32.326392 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:32.326630 19291 rpcz_store.cc:276] 0709 13:09:31.211873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.861608 (+649735us) service_pool.cc:224] Handling call
0709 13:09:32.326028 (+464420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.327879 21738 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:32.280555 21773 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.325730 21714 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:32.312999 21757 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.247s	user 0.001s	sys 0.002s
I20260709 13:09:32.329784 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1390) took 1488 ms. Trace:
I20260709 13:09:32.282675 21628 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.329861 21738 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:32.332890 21772 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.333166 21483 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.280701 21735 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.278746 21584 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:32.342525 21459 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.343624 21738 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.347833 21628 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.281924 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:32.334095 19366 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:32.350694 19294 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:32.281106 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:32.353669 19222 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:32.353714 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.005s	sys 0.025s
W20260709 13:09:32.364971 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.006s	sys 0.025s
I20260709 13:09:32.368384 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 284) took 1603 ms. Trace:
I20260709 13:09:32.368921 19298 rpcz_store.cc:276] 0709 13:09:30.764519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.837823 (+ 73304us) service_pool.cc:224] Handling call
0709 13:09:30.852931 (+ 15108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.853106 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:31.154013 (+300907us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.364083 (+1210070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.364232 (+   149us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:32.364300 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.364409 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.368285 (+  3876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31700,"prepare.queue_time_us":360118,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":28416,"thread_start_us":1154803,"threads_started":1,"wal-append.queue_time_us":941354}
I20260709 13:09:32.273975 21635 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.373270 21772 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:32.374132 21735 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.352286 21584 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.378249 21483 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.378769 21584 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:32.380635 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1650) took 1491 ms. Trace:
I20260709 13:09:32.339937 21636 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:32.380990 21714 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.381137 19374 rpcz_store.cc:276] 0709 13:09:30.888742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.890777 (+  2035us) service_pool.cc:224] Handling call
0709 13:09:32.380323 (+1489546us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400197b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:32.380546 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908542336}
I20260709 13:09:32.381917 21773 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.385475 21605 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:32.386512 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 1.28771e+06us
I20260709 13:09:32.359079 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1392) took 1197 ms. Trace:
I20260709 13:09:32.379719 21584 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:32.385414 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 286) took 1620 ms. Trace:
I20260709 13:09:32.390877 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1527) took 1140 ms. Trace:
I20260709 13:09:32.392937 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1393) took 1230 ms. Trace:
I20260709 13:09:32.393504 19298 rpcz_store.cc:276] 0709 13:09:31.157925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.371248 (+1213323us) service_pool.cc:224] Handling call
0709 13:09:32.371747 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.372076 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.372113 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.388199 (+ 16086us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.388239 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.388303 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.388429 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.336975 19296 rpcz_store.cc:276] 0709 13:09:30.828562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.146751 (+318189us) service_pool.cc:224] Handling call
0709 13:09:31.147136 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.151098 (+  3962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.151149 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.168057 (+ 16908us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.311556 (+1143499us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:32.311651 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.312945 (+  1294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.313013 (+    68us) raft_consensus.cc:1685] finished
0709 13:09:32.313029 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.316592 (+  3563us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":27410,"thread_start_us":1045419,"threads_started":1,"wal-append.queue_time_us":880937}
I20260709 13:09:32.387735 19294 rpcz_store.cc:276] 0709 13:09:31.157470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.349425 (+1191955us) service_pool.cc:224] Handling call
0709 13:09:32.350154 (+   729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.353489 (+  3335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.355155 (+  1666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.391353 19366 rpcz_store.cc:276] 0709 13:09:31.250114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.957010 (+706896us) service_pool.cc:224] Handling call
0709 13:09:32.387243 (+430233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.399536 19221 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:32.400972 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:32.384078 21647 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.156s	user 0.000s	sys 0.016s
W20260709 13:09:32.403334 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 852083us
I20260709 13:09:32.420300 21576 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:32.421082 21576 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.424295 21640 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.424682 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:32.424921 21640 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.425580 19220 raft_consensus.cc:2410] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:32.426663 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:32.427455 19223 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:32.385623 21417 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:32.428524 21417 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.430629 21417 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:32.432989 21169 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.723s	user 0.022s	sys 0.003s
I20260709 13:09:32.433458 21169 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.435549 21169 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:32.441251 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.443490 19372 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:32.389111 19295 rpcz_store.cc:276] 0709 13:09:30.764977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.069993 (+305016us) service_pool.cc:224] Handling call
0709 13:09:31.070378 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.070753 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.070784 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.071264 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.325015 (+1253751us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:32.325530 (+   515us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.341235 (+ 15705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.354695 (+ 13460us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.358915 (+  4220us) raft_consensus.cc:1685] finished
0709 13:09:32.358931 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.385350 (+ 26419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11707,"prepare.queue_time_us":597,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":21084,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":12927,"thread_start_us":1230567,"threads_started":1,"wal-append.queue_time_us":1018763}
I20260709 13:09:32.444296 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1529) took 1193 ms. Trace:
I20260709 13:09:32.444633 19372 rpcz_store.cc:276] 0709 13:09:31.250649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.340904 (+1090255us) service_pool.cc:224] Handling call
0709 13:09:32.418157 (+ 77253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.443983 (+ 25826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.444225 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.445334 19295 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:32.448635 21146 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.449383 21146 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.460700 19296 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:32.453372 19299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1541) took 1594 ms (client timeout 1639 ms). Trace:
I20260709 13:09:32.451906 21146 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:32.464087 19299 rpcz_store.cc:269] 0709 13:09:30.859184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.930126 (+ 70942us) service_pool.cc:224] Handling call
0709 13:09:32.453122 (+1522996us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001bfb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:32.453290 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455310208}
W20260709 13:09:32.474978 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.476223 21788 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.142s	user 0.001s	sys 0.001s
I20260709 13:09:32.478543 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 540) took 1501 ms. Trace:
I20260709 13:09:32.479630 21784 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:32.474781 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:32.495031 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:32.496462 21545 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.495496 21784 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.468221 21417 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:32.497596 21676 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:32.497534 21417 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.498476 21676 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.486992 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:32.489282 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:32.490744 21576 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.493672 21620 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:32.494408 21685 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.280s	user 0.008s	sys 0.012s
I20260709 13:09:32.496565 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:32.479131 19896 rpcz_store.cc:276] 0709 13:09:30.976708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.979510 (+  2802us) service_pool.cc:224] Handling call
0709 13:09:30.979845 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.980082 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:32.055195 (+1075113us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.477613 (+422418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.477731 (+   118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:32.477849 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.477970 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.478230 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59942,"prepare.queue_time_us":1093847,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":85604,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":121,"thread_start_us":1340351,"threads_started":2,"wal-append.queue_time_us":406202}
I20260709 13:09:32.499866 21784 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:32.488595 21649 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:32.488595 19368 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:32.513561 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 59393.5us
I20260709 13:09:32.460203 21640 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.499765 21539 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.500320 21146 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.416872 21584 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.499969 21417 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.535080 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:32.541239 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1523) took 1417 ms. Trace:
I20260709 13:09:32.545931 19368 rpcz_store.cc:276] 0709 13:09:31.119967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.331288 (+1211321us) service_pool.cc:224] Handling call
0709 13:09:32.410880 (+ 79592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.534768 (+123888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.537268 (+  2500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.495064 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:32.513423 21773 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:32.497174 21545 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.554430 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 319) took 1762 ms. Trace:
I20260709 13:09:32.556260 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1385) took 1766 ms. Trace:
I20260709 13:09:32.556460 21545 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.554848 19370 rpcz_store.cc:276] 0709 13:09:30.792227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.793801 (+  1574us) service_pool.cc:224] Handling call
0709 13:09:30.794079 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.794298 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:31.144724 (+350426us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.261515 (+1116791us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.502471 (+240956us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800483100. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf 00007fe8d7ecf038
0709 13:09:32.532859 (+ 30388us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.536978 (+  4119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.541130 (+  4152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.552349 (+ 11219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.552451 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.554271 (+  1820us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69949,"prepare.queue_time_us":605683,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":135,"raft.queue_time_us":23169,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":4433,"spinlock_wait_cycles":84521344,"thread_start_us":1445370,"threads_started":2,"wal-append.queue_time_us":945771}
I20260709 13:09:32.556898 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:32.564601 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 122036us
I20260709 13:09:32.565871 19294 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:32.558398 21735 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.577781 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:32.579241 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 327) took 1517 ms. Trace:
I20260709 13:09:32.579068 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 285) took 1814 ms. Trace:
I20260709 13:09:32.582630 19366 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:32.559237 21640 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:32.589356 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.537101 21685 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:32.567339 21539 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.596295 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1388) took 1798 ms. Trace:
I20260709 13:09:32.572993 21784 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:32.601065 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1548) took 1030 ms. Trace:
I20260709 13:09:32.604235 19298 rpcz_store.cc:276] 0709 13:09:31.570778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.410112 (+839334us) service_pool.cc:224] Handling call
0709 13:09:32.546045 (+135933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.596559 (+ 50514us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:32.596594 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.600803 (+  4209us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.600840 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.600896 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.601010 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:32.580732 19367 rpcz_store.cc:276] 0709 13:09:31.056112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.258424 (+1202312us) service_pool.cc:224] Handling call
0709 13:09:32.259081 (+   657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.259853 (+   772us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:32.320700 (+ 60847us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.572033 (+251333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.572083 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:32.572118 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.572199 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.573877 (+  1678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3764,"prepare.queue_time_us":237926,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":8305,"raft.queue_time_us":11592,"thread_start_us":172137,"threads_started":1}
I20260709 13:09:32.608132 19223 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:32.579026 21676 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:32.570789 21146 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:32.603439 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 117076us
I20260709 13:09:32.612421 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 240) took 1634 ms. Trace:
I20260709 13:09:32.598345 19300 rpcz_store.cc:276] 0709 13:09:30.798428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.137289 (+338861us) service_pool.cc:224] Handling call
0709 13:09:31.137626 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.137879 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:32.321726 (+1183847us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.538736 (+217010us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.550850 (+ 12114us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.563893 (+ 13043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.573932 (+ 10039us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.596214 (+ 22282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75746,"prepare.queue_time_us":213811,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":29400,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":13697,"thread_start_us":1205761,"threads_started":2}
I20260709 13:09:32.583217 19297 rpcz_store.cc:276] 0709 13:09:30.764761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.041549 (+276788us) service_pool.cc:224] Handling call
0709 13:09:31.041932 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.042280 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:31.206795 (+164515us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.374570 (+1167775us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.563198 (+188628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.566709 (+  3511us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.570332 (+  3623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.570499 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.578966 (+  8467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127077,"prepare.queue_time_us":257487,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":1801,"raft.queue_time_us":44436,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":257,"thread_start_us":1286139,"threads_started":2,"wal-append.queue_time_us":888501}
I20260709 13:09:32.620929 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1646) took 1664 ms. Trace:
I20260709 13:09:32.621536 21539 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:32.621444 19373 rpcz_store.cc:276] 0709 13:09:30.887408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.895213 (+  7805us) service_pool.cc:224] Handling call
0709 13:09:30.895704 (+   491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:30.896303 (+   599us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:09:30.896364 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:30.897151 (+   787us) log.cc:844] Serialized 52 byte log entry
0709 13:09:31.928075 (+1030924us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:31.928130 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.929125 (+   995us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.504137 (+575012us) raft_consensus.cc:1685] finished
0709 13:09:32.532443 (+ 28306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.551309 (+ 18866us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2115,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":1030427,"threads_started":1,"wal-append.queue_time_us":1179290}
I20260709 13:09:32.618980 21576 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:32.625121 21576 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:32.632395 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 135983us
I20260709 13:09:32.610378 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:32.614702 19899 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:32.630895 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1346) took 2204 ms. Trace:
I20260709 13:09:32.628224 19217 raft_consensus.cc:2368] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 3. Current term is 4.
I20260709 13:09:32.598632 21647 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.636206 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 282) took 1872 ms. Trace:
I20260709 13:09:32.631945 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1394) took 1473 ms. Trace:
I20260709 13:09:32.612861 19218 rpcz_store.cc:276] 0709 13:09:30.971413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.971565 (+   152us) service_pool.cc:224] Handling call
0709 13:09:30.971852 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.972069 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:32.352444 (+1380375us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.565520 (+213076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.570179 (+  4659us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:32.598231 (+ 28052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.598300 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.605782 (+  7482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20682,"prepare.queue_time_us":1108836,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":19051,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5975,"thread_start_us":1500583,"threads_started":2,"wal-append.queue_time_us":223533}
W20260709 13:09:32.779855 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.725219 21620 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.638037 19292 rpcz_store.cc:276] 0709 13:09:30.763958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.833397 (+ 69439us) service_pool.cc:224] Handling call
0709 13:09:30.833785 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.834342 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.834370 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.834830 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.143326 (+308496us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.330588 (+1187262us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.598446 (+267858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.610366 (+ 11920us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.614960 (+  4594us) raft_consensus.cc:1685] finished
0709 13:09:32.614970 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.636128 (+ 21158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111302,"prepare.queue_time_us":417548,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":4085,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":9366,"thread_start_us":1514981,"threads_started":3,"wal-append.queue_time_us":598294,"wal-append.run_cpu_time_us":2309,"wal-append.run_wall_time_us":1085156}
I20260709 13:09:33.198551 21620 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.199733 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:32.728704 21656 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:33.201048 21656 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:33.201184 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:32.635743 19216 rpcz_store.cc:276] 0709 13:09:30.426009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.429030 (+  3021us) service_pool.cc:224] Handling call
0709 13:09:30.429335 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.809176 (+1379841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.630314 (+821138us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001572d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:32.630659 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039308672}
W20260709 13:09:32.662737 21485 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.008s
I20260709 13:09:33.202903 21500 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.740955 21640 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.463s
I20260709 13:09:33.203620 21500 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:32.805461 21795 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:09:32.638540 19296 rpcz_store.cc:276] 0709 13:09:31.158251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.401826 (+1243575us) service_pool.cc:224] Handling call
0709 13:09:32.402356 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.463104 (+ 60748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.631696 (+168592us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b54000497d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:32.631891 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121147264}
I20260709 13:09:32.805819 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:33.205255 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.205569 19292 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:33.205830 19366 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.206744 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:32.611097 21773 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:32.556914 19293 rpcz_store.cc:276] 0709 13:09:30.747051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.749223 (+  2172us) service_pool.cc:224] Handling call
0709 13:09:30.753405 (+  4182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:30.753608 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:31.787955 (+1034347us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.340678 (+552723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.359264 (+ 18586us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.392821 (+ 33557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.404972 (+ 12151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.513685 (+108713us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21064,"prepare.queue_time_us":62638,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":3894,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":256,"spinlock_wait_cycles":1155328,"thread_start_us":1373407,"threads_started":2,"wal-append.queue_time_us":539918}
W20260709 13:09:32.779455 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51855us
I20260709 13:09:32.730304 21256 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:32.730621 21633 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:32.725510 21605 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.942194 21770 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.673s	user 0.002s	sys 0.003s
I20260709 13:09:32.903978 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:33.202849 21648 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.717666 21417 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:33.213682 21471 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:32.734122 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:32.944103 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 326) took 1888 ms. Trace:
I20260709 13:09:32.827023 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:32.824676 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:32.722848 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.211175 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:32.730315 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.209765 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:32.830922 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:32.808748 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:32.816751 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:32.627509 21576 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:33.254056 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50711.9us
W20260709 13:09:32.726341 21798 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:32.734195 19370 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.743467 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1661) took 1654 ms. Trace:
W20260709 13:09:32.746893 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 186783us
W20260709 13:09:33.241472 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.208352 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:32.833070 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:33.245630 19300 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:32.735174 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 236) took 1860 ms (client timeout 1947 ms). Trace:
W20260709 13:09:32.833216 21637 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.903s	user 0.017s	sys 0.000s
I20260709 13:09:32.732527 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:32.624032 21539 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:32.780653 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:33.242319 21738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.016s	sys 0.017s
I20260709 13:09:32.734651 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:33.213886 21696 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.918s	user 0.013s	sys 0.006s
I20260709 13:09:32.968904 21639 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.744858 21805 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:09:33.259281 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.744315 21615 consensus_meta.cc:287] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.964s	user 0.016s	sys 0.002s
I20260709 13:09:32.810092 21634 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:33.268918 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1658) took 2222 ms. Trace:
I20260709 13:09:33.251674 19371 rpcz_store.cc:276] 0709 13:09:31.055761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.157771 (+1102010us) service_pool.cc:224] Handling call
0709 13:09:32.158780 (+  1009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.302718 (+143938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.943774 (+641056us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400197654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:32.944008 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292302720}
I20260709 13:09:32.671180 21626 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.666807 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:32.670126 21796 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:32.630252 21584 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:32.663255 21545 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:33.311307 21545 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.311970 21146 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:33.311391 21690 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:33.313117 21690 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.314097 21545 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:33.144204 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 242) took 1933 ms (client timeout 2239 ms). Trace:
I20260709 13:09:32.731778 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:32.976912 21679 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.244831 21605 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:33.316453 19217 rpcz_store.cc:269] 0709 13:09:31.210349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.210487 (+   138us) service_pool.cc:224] Handling call
0709 13:09:33.077168 (+1866681us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540039b2d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:33.144096 (+ 66928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130105088}
I20260709 13:09:33.208922 21685 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.246891 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:33.266523 21738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.017s	sys 0.017s
W20260709 13:09:33.332204 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 130123us
I20260709 13:09:33.243624 21256 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.278652 19903 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:33.279276 19292 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:32.779237 21801 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:33.281214 21653 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:33.281814 19901 raft_consensus.cc:2368] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:32.731523 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:32.733336 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.281221 19299 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:32.726866 21779 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.552s
I20260709 13:09:32.650405 21676 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.619s
I20260709 13:09:33.275923 21637 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.263827 19122 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 4, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:33.283532 21500 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.261274 21773 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.279953 21634 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:33.285985 19370 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:33.288357 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 135846us
I20260709 13:09:33.288995 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.275362 21459 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.248255 21640 consensus_queue.cc:1243] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:33.275897 19369 rpcz_store.cc:276] 0709 13:09:31.042162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.053482 (+ 11320us) service_pool.cc:224] Handling call
0709 13:09:31.053859 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.261555 (+1207696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.261602 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.262724 (+  1122us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.401713 (+138989us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.401770 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.401922 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.250628 (+848706us) raft_consensus.cc:1685] finished
0709 13:09:33.250656 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.264013 (+ 13357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3408,"raft.queue_time_us":18056,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":1299866,"threads_started":2,"wal-append.queue_time_us":279925}
I20260709 13:09:33.304520 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.303789 21615 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.305455 19291 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:33.310045 19298 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:33.353041 21605 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.309989 21796 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.246604 21417 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:33.259307 19219 rpcz_store.cc:269] 0709 13:09:30.874762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.874909 (+   147us) service_pool.cc:224] Handling call
0709 13:09:32.734785 (+1859876us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54000762d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:32.734951 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661579136}
I20260709 13:09:33.320631 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.321090 21690 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.324949 19300 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:33.244328 21633 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.258677 19365 rpcz_store.cc:276] 0709 13:09:31.089084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.317383 (+1228299us) service_pool.cc:224] Handling call
0709 13:09:32.373659 (+ 56276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.452671 (+ 79012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.452718 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.453414 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.601115 (+147701us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:32.601171 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.601264 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.743115 (+141851us) raft_consensus.cc:1685] finished
0709 13:09:32.743157 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.743374 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93313,"raft.queue_time_us":94113,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":2391,"thread_start_us":136928,"threads_started":1,"wal-append.queue_time_us":277465}
I20260709 13:09:33.327718 19367 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.306589 21485 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:33.264273 21628 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.321192 21656 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.334810 21573 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.340632 21686 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.340884 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.320695 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.315960 21539 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:33.325918 21696 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.345278 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 512480us
I20260709 13:09:33.341099 21256 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:33.341641 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.333455 21584 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.351691 19297 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:33.325484 19894 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 3.
I20260709 13:09:33.303193 21639 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.355154 19366 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:33.358712 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.343922 21576 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:33.349035 21649 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:33.377985 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:33.361299 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:33.360714 19122 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 4, term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to <none>, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 2 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:33.363394 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.369228 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.333534 21626 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.380416 19371 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:33.381318 19292 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:33.359139 19293 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:33.366973 21620 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.365023 19897 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:33.393456 19263 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:33.400938 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.388921 21584 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.405656 21584 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.407130 21773 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.364427 21801 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.413764 19367 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:33.393450 21649 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:33.395965 21485 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:33.385073 21256 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:33.398741 19122 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 2 to 3, term changed from 3 to 5, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194), VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 5 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:33.384411 21576 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.419242 21634 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.420742 19895 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:33.411567 21620 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.384393 21573 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.388615 21539 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.381963 21686 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.432508 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:33.417009 21649 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:33.399494 21696 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.436820 21633 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.425572 21637 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.439080 21539 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.431924 21417 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.446949 21639 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.448302 21796 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:33.451196 21807 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 13:09:33.433620 21485 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.452651 21485 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.452992 21696 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:33.475021 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 54956.1us
I20260709 13:09:33.426175 21676 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:09:33.441682 21634 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.484740 21647 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:33.485335 21647 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:33.486336 21647 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.489574 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:33.471225 19122 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 5, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.485476 21626 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:33.484782 21576 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.500567 21696 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.500321 21705 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.502223 21796 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:33.516037 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.516757 21545 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:33.517305 21545 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:33.517553 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:33.517628 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.518412 21545 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.519191 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:33.519867 19297 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:33.516623 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.533102 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.549690 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.545455 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:33.521288 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:33.522716 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.510422 21814 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:09:33.563947 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.520884 19296 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:33.550042 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.570775 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:33.520761 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:33.570418 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 221628us
W20260709 13:09:33.579703 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67145.5us
I20260709 13:09:33.519980 21545 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:33.577051 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 87607.3us
W20260709 13:09:33.590209 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 133814us
I20260709 13:09:33.548902 21615 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.595381 19299 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:33.528317 21146 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:33.515195 21696 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:33.598495 21696 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.522148 21686 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.545334 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:33.595329 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.600708 19294 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.601780 19122 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 3, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.515439 21576 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.514714 21539 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.610080 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.580384 21417 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.577129 21773 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.605619 19216 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:33.608449 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.587960 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.612473 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.613734 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.620682 19299 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:33.622565 19219 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:33.600199 21146 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:33.623982 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.595438 21818 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.624831 19370 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:33.617451 19218 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.629217 19224 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:33.609440 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.603698 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.626875 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:33.633481 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.623011 19219 pending_rounds.cc:85] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 3
I20260709 13:09:33.631260 19122 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.635107 19292 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:33.641428 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.634186 19219 pending_rounds.cc:107] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:33.582832 21705 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.644258 19367 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:33.641887 19299 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:33.593873 21649 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.642592 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:33.627144 21576 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.650210 19292 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:33.649385 19219 raft_consensus.cc:2889] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.613691 21640 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:09:33.640249 19899 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
W20260709 13:09:33.670518 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77373.3us
I20260709 13:09:33.629881 21539 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.671837 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:33.672430 21816 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.632925 19897 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 1.
I20260709 13:09:33.672892 21539 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:33.675521 19299 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:33.678393 19291 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:33.679013 19372 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:33.631211 21417 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.682086 19224 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:33.682467 19224 pending_rounds.cc:85] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 2
I20260709 13:09:33.682703 19224 pending_rounds.cc:107] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:33.682935 19224 raft_consensus.cc:2889] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.675390 21635 raft_consensus.cc:2764] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:33.672921 21816 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.686457 19374 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:33.686475 19299 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:33.687893 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.688758 19299 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:33.693979 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:33.686643 21816 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.681730 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:33.636802 21773 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.681137 21573 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.770385 19296 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:09:33.775381 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 81446.9us
W20260709 13:09:33.701258 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.778360 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 104482us
I20260709 13:09:33.783252 19294 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:33.782312 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:33.693356 21649 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:33.789564 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 113207us
I20260709 13:09:33.790596 21539 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:33.790915 21576 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.791044 21539 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:33.791606 21539 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.791900 19122 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 5, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 5 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:33.794232 19122 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 5, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:33.797412 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 150093us
I20260709 13:09:33.632426 21818 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.786576 21573 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:33.815894 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:33.816771 19224 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:33.827819 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:33.825817 19216 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:33.828581 19122 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 5, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:33.810732 21573 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:33.835883 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.840411 19224 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.842068 19371 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.843293 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.846298 21647 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:33.846582 21573 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.848523 19224 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:33.849030 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1355) took 1464 ms. Trace:
I20260709 13:09:33.849398 19222 rpcz_store.cc:276] 0709 13:09:32.384452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.386687 (+  2235us) service_pool.cc:224] Handling call
0709 13:09:32.735357 (+348670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.735751 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:32.736202 (+   451us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.477115 (+740913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.477170 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.494438 (+ 17268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.494655 (+   217us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.848855 (+354200us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54000762d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:33.848959 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33740,"prepare.queue_time_us":7383,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":46917,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13277,"spinlock_wait_cycles":788992768,"thread_start_us":706564,"threads_started":2,"wal-append.queue_time_us":520068}
I20260709 13:09:33.852836 21801 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.839140 19372 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:33.806296 21648 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:09:33.865376 19122 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:33.877321 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 49020.4us
I20260709 13:09:33.882725 21620 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.883713 21620 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.885327 21417 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:33.886698 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.891685 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:33.893874 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:33.894817 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:33.895433 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.895815 21653 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:33.896306 21653 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:33.880471 21817 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:09:33.897230 21817 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:33.897707 21817 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:33.898126 21676 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:33.898411 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.899304 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 295) took 1076 ms. Trace:
I20260709 13:09:33.900027 19295 rpcz_store.cc:276] 0709 13:09:32.823292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.827225 (+  3933us) service_pool.cc:224] Handling call
0709 13:09:32.827616 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.373085 (+545469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.373105 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.373137 (+    32us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.373163 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.899061 (+525898us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54002a9254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:33.899103 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.899239 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246582656}
I20260709 13:09:33.900048 19122 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:33.902799 21584 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.903391 21584 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:33.903823 21584 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.898586 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:33.899641 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.902894 19122 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 5, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 5 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:33.905939 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.915341 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.883644 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.916510 19896 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:09:33.917033 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.917586 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:33.918164 19224 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:09:33.918301 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46742.2us
I20260709 13:09:33.919091 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:33.919955 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:33.898620 21817 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.921098 19895 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:33.921550 21817 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:33.897265 21653 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:33.923153 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:33.923882 19216 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.927655 19297 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:33.929698 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:33.929826 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:33.931450 19292 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:33.936427 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:33.899245 21676 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:33.879767 21814 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:33.945412 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.960693 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:33.949468 21634 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.961431 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1534) took 2620 ms. Trace:
I20260709 13:09:33.940546 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:33.950754 21813 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:33.952003 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.952907 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.953760 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:33.954582 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:33.956482 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:33.964380 19220 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.899448 19897 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:33.943359 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.963874 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.968329 19367 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:33.957728 21773 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:33.957660 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.997316 19365 raft_consensus.cc:2368] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:33.958323 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:33.909024 21801 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:33.935297 19218 pending_rounds.cc:85] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 4
I20260709 13:09:34.003132 19903 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.003548 19218 pending_rounds.cc:107] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:34.003881 19218 raft_consensus.cc:2889] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.939003 21545 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:33.963516 19223 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.944922 19372 raft_consensus.cc:2376] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6. Re-sending same reply.
I20260709 13:09:33.938593 21417 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:33.997279 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.009146 19219 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:33.961906 19374 rpcz_store.cc:276] 0709 13:09:31.340961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.382480 (+1041519us) service_pool.cc:224] Handling call
0709 13:09:32.383011 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.686993 (+1303982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.952009 (+265016us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400297f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:33.961372 (+  9363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996745088}
I20260709 13:09:33.939388 21676 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:33.959065 21814 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.009577 19370 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
W20260709 13:09:34.012764 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74422us
I20260709 13:09:34.016129 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.016697 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:33.924659 21639 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:09:34.018042 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:33.964491 21796 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:34.019811 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.021606 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.021920 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.027020 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.018030 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.023720 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.018613 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.018850 19122 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:34.025717 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.026048 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.027500 19368 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.036475 19366 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:34.006747 21801 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:34.009660 21637 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:34.009254 21417 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:34.058694 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.036055 19221 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:34.052362 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.021792 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:34.025404 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:34.053222 21639 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:34.077531 19895 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:34.078202 19895 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:34.055655 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.024369 21656 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.085191 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.045205 19372 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:34.012276 21648 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.058001 21801 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.066011 19224 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:09:34.062786 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126231us
I20260709 13:09:34.025795 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:34.032119 21545 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:34.054737 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:33.998337 21634 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:33.944561 21146 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.010414 21539 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:34.084513 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66557.3us
I20260709 13:09:34.073045 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.087369 19122 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.072686 21417 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:34.093051 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.035647 21796 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.086812 21648 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.084496 19898 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
W20260709 13:09:34.092458 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 147086us
I20260709 13:09:34.094077 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.094977 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:34.235196 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 140225us
I20260709 13:09:34.227806 19367 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:34.229671 19216 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:34.232780 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.199779 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:34.237258 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.241736 19221 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:34.243311 19370 raft_consensus.cc:2368] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
W20260709 13:09:34.210577 21826 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:09:34.211459 21824 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:09:34.247807 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.198997 21495 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.218s
I20260709 13:09:34.276605 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.252074 21814 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.199363 21485 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.259140 21705 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:34.266367 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 235007us
I20260709 13:09:34.150985 19894 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:34.270219 19223 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:34.275092 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.210906 21818 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.280750 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.239758 21656 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.114365 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:34.284422 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.284773 19217 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:09:34.294806 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.297137 19223 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:34.173383 21813 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:34.081468 21637 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:34.301179 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 149278us
W20260709 13:09:34.305847 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.297140 19265 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.743s (SENT) [suppressed 28 similar messages]
I20260709 13:09:34.315409 19220 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:34.322788 19903 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:34.324422 19224 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:34.341476 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44358.9us
W20260709 13:09:34.350248 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116636us
I20260709 13:09:34.351270 19122 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:09:34.349702 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 123517us
I20260709 13:09:34.269281 21676 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.312862 21705 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:34.352756 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.362512 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.374019 19224 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:34.379446 19220 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:34.313081 21686 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:09:34.381183 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 100515us
I20260709 13:09:34.301918 21545 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.390826 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:34.395829 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:34.401752 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.402731 19220 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
W20260709 13:09:34.403627 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.405499 21688 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:34.406702 21573 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.002s
I20260709 13:09:34.407166 21573 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.407400 21813 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.410089 21620 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:34.378494 21705 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.411993 21705 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.417655 21834 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:34.418112 19224 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:34.418471 19224 pending_rounds.cc:85] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 3
I20260709 13:09:34.418704 19224 pending_rounds.cc:107] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:34.418959 19224 raft_consensus.cc:2889] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.419407 21849 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.419869 21849 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.420213 21849 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.430260 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.442075 19220 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:34.442121 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.384922 21485 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.443178 19221 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:34.444895 21653 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.442852 19220 pending_rounds.cc:85] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 2
I20260709 13:09:34.447932 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.452584 21849 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.454629 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.465025 19217 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.455695 21633 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:34.398631 21696 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.001s
I20260709 13:09:34.458875 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.481230 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.483129 19224 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:34.458433 19122 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 3, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:34.442730 21647 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:09:34.492271 19221 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:34.492662 19220 pending_rounds.cc:107] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:34.493016 19220 raft_consensus.cc:2889] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.491003 21696 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.456540 21539 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:34.496718 19122 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 5, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 5 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:34.501582 19223 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:34.503854 19216 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:34.507282 19219 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:34.508849 19224 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:34.508952 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.487986 21633 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.509570 19219 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:34.513195 21696 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.513877 19225 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.517086 19224 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:34.520680 19220 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:34.517180 21649 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.002s
I20260709 13:09:34.501735 21845 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:34.525590 21634 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:34.538815 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.525719 21705 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.527153 19220 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:34.528914 21849 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:34.528972 21637 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:34.501255 21648 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:34.545094 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:34.545696 19899 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.549748 21635 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.550333 21796 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.551632 21656 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.551847 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.552656 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.553704 21649 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.553591 21801 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.554251 21649 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.550325 21635 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.556715 21801 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:34.557571 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:34.558068 21841 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 13:09:34.558177 19901 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.491590 21485 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.552022 21656 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.560528 21633 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.561474 21573 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.561787 21633 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.561657 21656 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.562752 21656 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.563156 21676 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.539958 21845 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.565151 21845 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.574553 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:34.530488 21584 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 13:09:34.530851 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.536645 19217 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:34.533330 21146 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.538646 21840 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.540741 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.579586 19224 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:34.541270 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.593132 19220 raft_consensus.cc:2368] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 3. Current term is 4.
I20260709 13:09:34.539247 21634 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.554587 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.589871 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:34.595090 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.579259 21539 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.596483 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.600646 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.601245 19222 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.602949 19220 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.595841 21637 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.604137 21256 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.603807 21649 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.604702 21256 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.605654 21256 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.594408 21573 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.636900 21573 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.637326 21705 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:34.639035 21573 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.588716 21584 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:34.641955 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 45563.2us
I20260709 13:09:34.641992 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:34.643831 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:34.601781 21634 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.644447 21634 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.645268 21846 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:34.647094 21846 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:34.647557 21846 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.648746 19300 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:34.649355 21485 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.620921 21539 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.634596 21417 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.639971 19901 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:34.657977 19222 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.658347 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.654431 19903 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:34.661572 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.641991 21584 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:34.667938 21816 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.879s	user 0.005s	sys 0.006s
I20260709 13:09:34.668370 21846 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.660477 21637 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.669750 19899 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:34.676803 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.713022 21584 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:34.713565 21584 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:34.668540 21816 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.725406 19219 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:34.726745 19294 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
W20260709 13:09:34.714681 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43982.7us
W20260709 13:09:34.729276 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 333467us
W20260709 13:09:34.710615 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.751179 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:34.759354 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.765386 21573 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:34.770893 21573 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.710685 21688 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.772442 21688 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.773079 21573 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:34.674552 21485 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:34.789286 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 126163us
W20260709 13:09:34.789783 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 542036us
I20260709 13:09:34.781975 19901 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:34.792294 19340 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.788259 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.795230 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.792052 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:34.797237 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.798319 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:34.777459 21801 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.789054 21485 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:34.807474 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:34.811159 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.808765 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:34.809733 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 192723us
I20260709 13:09:34.814006 21676 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.821403 21634 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.840868 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 300) took 1319 ms. Trace:
I20260709 13:09:34.845616 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:34.861040 19300 rpcz_store.cc:276] 0709 13:09:33.521442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.587252 (+ 65810us) service_pool.cc:224] Handling call
0709 13:09:33.898416 (+311164us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:34.840701 (+942285us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b54002b84d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:34.840805 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714529920}
W20260709 13:09:34.861694 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53074us
W20260709 13:09:34.862345 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.875871 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.800335 21796 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:34.879870 19265 leader_election.cc:336] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.506s (SENT)
I20260709 13:09:34.782404 21573 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.889104 19373 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:34.863597 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:34.799422 21576 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.799243 21849 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:34.799777 21635 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:34.892592 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100429us
I20260709 13:09:34.833253 21813 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:34.889081 21696 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:34.834134 21801 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:34.876438 21539 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:34.838897 21688 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.776719 21584 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.921710 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:34.922510 19300 raft_consensus.cc:606] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:34.839676 21854 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
W20260709 13:09:34.896905 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51399.6us
W20260709 13:09:34.895112 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 84903us
I20260709 13:09:34.899751 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.900339 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.900990 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.901600 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.930614 19223 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:34.901877 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.930976 19224 raft_consensus.cc:2376] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6. Re-sending same reply.
I20260709 13:09:34.897909 21686 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:34.931715 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.932220 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.932382 19217 raft_consensus.cc:2376] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6. Re-sending same reply.
I20260709 13:09:34.905957 21830 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:34.900694 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.935950 19219 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:34.936064 21256 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:34.936837 21656 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:34.936986 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.934790 21860 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:09:34.900044 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.894321 19266 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:34.901804 21485 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:34.939056 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44866.5us
I20260709 13:09:34.939810 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:34.939806 21849 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:34.897534 21853 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:09:34.837097 21844 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:34.838618 21676 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.911170 21813 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:34.889245 21834 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:34.922823 19300 raft_consensus.cc:614] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:34.909219 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.933331 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.953754 19217 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.954010 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:34.954553 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.911780 21847 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:34.933833 19225 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:34.933576 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.908531 21840 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.908715 21817 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.937618 19219 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:34.907958 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:34.937865 21656 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:34.911512 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 104103us
I20260709 13:09:34.945348 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.947041 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:34.962921 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.952582 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.955664 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:34.901301 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.963671 19222 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:34.963680 19220 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:34.950359 21626 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:09:34.964530 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.964653 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.964732 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.965667 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:34.940909 21830 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.934185 21686 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.958637 19224 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.953436 21633 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.975594 21676 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.976106 21676 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.976558 21676 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.903664 21637 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:34.959026 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.953186 21813 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:34.959527 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.984479 19225 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:34.944556 19191 connection.cc:256] RPC call timeout handler was delayed by -1.5477648579999368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:09:34.986913 19191 connection.cc:256] RPC call timeout handler was delayed by -1.4108425319999469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 13:09:34.987272 19191 connection.cc:256] RPC call timeout handler was delayed by -1.2482392140000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2544s for a response
I20260709 13:09:34.916644 21573 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:34.963266 19223 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:34.965914 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58052.7us
I20260709 13:09:34.966189 19220 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:34.956751 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.993919 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:34.967003 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:34.994944 19366 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.923548 21635 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:34.969252 19371 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:34.946717 21576 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.994339 19370 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:34.969385 21860 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.966723 21656 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:34.982542 19222 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:34.951815 21834 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.958421 21620 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.016969 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:34.959599 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.992961 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:34.918754 21696 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:35.008647 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.019673 19219 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:35.017820 19374 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:35.021149 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.020390 19217 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:35.024752 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:34.987459 21830 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.033761 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:35.035616 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:35.034731 19265 leader_election.cc:336] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.540s (SENT)
I20260709 13:09:34.984643 21686 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.005263 21576 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.037300 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:35.046464 19295 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.978711 21633 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:35.045740 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.016420 21840 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.016659 21834 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.048434 19221 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:35.048837 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.044214 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.060614 19217 raft_consensus.cc:2410] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:35.061405 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.061962 19217 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:35.048075 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:35.014513 21816 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:35.064261 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.064605 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.064878 19373 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:35.050668 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.065829 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.065872 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.066285 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.066617 19365 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:35.066941 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.067370 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:35.067565 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:35.052203 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46016.8us
I20260709 13:09:35.068985 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.067982 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:35.096637 21864 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:09:35.097386 21634 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:35.071419 19225 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:35.107668 19367 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:35.048108 21576 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.987051 21817 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:35.068135 19365 raft_consensus.cc:2376] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5. Re-sending same reply.
I20260709 13:09:35.055845 21648 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.102378 19366 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:34.980621 21801 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:35.067862 19371 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:35.109460 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 60853.8us
I20260709 13:09:35.017333 21846 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:09:35.101649 19370 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:35.113787 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.106302 21417 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:35.128487 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.130251 19225 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:35.130388 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:35.130964 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.131047 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.131613 19225 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
W20260709 13:09:35.109076 21824 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:09:35.112847 21857 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:09:35.135123 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 100444us
I20260709 13:09:35.127552 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:35.136231 19225 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:35.040338 21620 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:35.145334 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.168322 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:35.169232 19894 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8.
I20260709 13:09:35.127022 21844 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:35.175685 19265 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.569s (SENT)
I20260709 13:09:35.176944 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.122046 21860 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:35.183187 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:35.121680 21648 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:35.182996 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:35.192977 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.195021 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.196394 19366 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:35.195355 19297 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:35.199036 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 71542.3us
I20260709 13:09:35.200479 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.201200 19294 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:35.205919 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.140012 21584 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:35.139034 21256 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:09:35.139941 21821 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:09:35.281109 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.229506 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.627182 19296 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:09:35.624967 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 392297us
I20260709 13:09:35.237033 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:35.628244 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:35.194468 21648 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:35.392231 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.285625 19297 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:35.626502 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 450848us
I20260709 13:09:35.370023 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:35.326943 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.519868 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:35.377827 21633 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:35.469306 21849 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:35.210234 21862 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:09:35.553918 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65283us
W20260709 13:09:35.456084 21857 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:09:35.691918 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:35.627229 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
W20260709 13:09:35.539920 21796 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.002s
I20260709 13:09:35.194531 21635 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:35.194084 21417 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:35.705157 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:35.707460 21845 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.142s	user 0.012s	sys 0.000s
W20260709 13:09:35.639174 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 457402us
I20260709 13:09:35.211108 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:35.708455 19368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.019s	sys 0.009s
I20260709 13:09:35.354053 21846 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.356s
I20260709 13:09:35.705405 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:35.505822 21832 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.392458 21639 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:35.266636 21696 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:35.375131 21860 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.610283 21573 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:35.239678 21817 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:35.346271 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:35.719853 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 91401.5us
I20260709 13:09:35.590413 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:35.708333 21485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.014s	sys 0.014s
I20260709 13:09:35.692235 21836 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.725430 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.727207 19296 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.703370 21626 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.753764 19368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.019s	sys 0.018s
W20260709 13:09:35.753818 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 125673us
I20260709 13:09:35.798305 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:35.754329 19294 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:35.799842 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:35.755749 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50418.8us
I20260709 13:09:35.250473 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:35.760383 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:35.801023 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:35.801842 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:35.801892 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:35.729229 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 620851us
I20260709 13:09:35.803262 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.729923 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.767545 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1380) took 1333 ms. Trace:
I20260709 13:09:35.718176 21796 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:35.804349 21573 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.804801 21573 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.805049 19220 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:35.805147 21573 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.807659 19191 leader_election.cc:400] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:35.243077 21844 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:35.809194 19898 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:35.809386 21849 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:35.763839 21847 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:35.810834 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.812569 19300 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:35.804075 19216 rpcz_store.cc:276] 0709 13:09:34.439118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.510547 (+ 71429us) service_pool.cc:224] Handling call
0709 13:09:34.514826 (+  4279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.515187 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.515214 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.515684 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.621276 (+105592us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:34.785643 (+164367us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.785851 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.785925 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.767335 (+981410us) raft_consensus.cc:1685] finished
0709 13:09:35.767358 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.767487 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":199196,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2217,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":205,"thread_start_us":211846,"threads_started":2,"wal-append.queue_time_us":425372}
I20260709 13:09:35.265887 21620 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:35.786229 19868 leader_election.cc:336] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.239s (SENT)
I20260709 13:09:35.517915 21676 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:35.792276 19369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.013s	sys 0.025s
I20260709 13:09:35.691354 21584 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:35.251385 21851 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.519s
I20260709 13:09:35.781165 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:35.771693 21860 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.771935 21801 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.811445 19374 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:35.767124 21880 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.834930 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:35.835552 19369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.027s
I20260709 13:09:35.884979 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:35.821235 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.885453 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87262.9us
I20260709 13:09:35.885589 19365 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.380489 21656 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:35.836225 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.793798 21485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.014s	sys 0.014s
I20260709 13:09:35.809985 21849 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:35.807961 19191 leader_election.cc:403] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:35.874722 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.876777 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:35.810565 19899 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
I20260709 13:09:35.763295 21845 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:35.938177 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 130667us
I20260709 13:09:35.938711 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.939395 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.816193 21688 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:35.894703 19903 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:35.834935 21876 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.771018 21639 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:35.932595 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 215177us
I20260709 13:09:35.935118 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:35.957041 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 170856us
I20260709 13:09:35.876957 21539 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.767908 21832 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:35.798101 21817 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:09:35.879666 21801 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.960055 21635 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.962687 21635 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:35.963102 21635 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.964340 21832 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:35.966830 19221 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:35.933189 19299 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:35.954536 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:35.958928 19265 leader_election.cc:336] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.558s (SENT)
I20260709 13:09:35.968664 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.816751 21626 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:35.970302 19291 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:35.971650 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:35.811883 21836 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:35.945739 21893 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:09:35.978091 19265 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.633s (SENT)
W20260709 13:09:35.978704 19295 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.927s	user 0.010s	sys 0.000s
I20260709 13:09:35.979305 19295 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:35.978601 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.962319 21801 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.961024 21894 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.973836 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:35.987212 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:35.971015 21834 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.861s	user 0.009s	sys 0.002s
I20260709 13:09:35.984786 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:35.992758 21894 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:35.993343 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.993453 21620 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.994020 19295 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:35.992820 21834 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:35.994936 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:35.985196 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:35.996927 19370 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:35.961370 21545 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.001708 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:36.001951 19337 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8.
I20260709 13:09:36.002409 19337 leader_election.cc:403] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:09:36.001849 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.008100 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.009696 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:35.976730 19900 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.011528 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.028712 19294 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:35.994480 19265 leader_election.cc:336] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.804s (SENT)
W20260709 13:09:35.986416 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.016s	sys 0.024s
I20260709 13:09:36.015250 19221 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.006606 21417 raft_consensus.cc:2764] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:09:36.028815 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44120.4us
W20260709 13:09:36.030294 19222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.012s
I20260709 13:09:36.006871 21539 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:36.035360 19222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.008s	sys 0.012s
W20260709 13:09:36.013120 21686 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.000s
W20260709 13:09:36.031776 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.019s	sys 0.024s
I20260709 13:09:36.045854 19365 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:35.952709 21876 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.075805 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:36.075850 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.076198 19293 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:36.078608 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.074517 21686 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.079543 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.100342 19218 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.080634 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.081597 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.082466 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.083467 21874 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:36.086443 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:36.085800 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.090246 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:36.114398 19902 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:36.090324 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:36.098958 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:36.117627 19294 raft_consensus.cc:606] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:36.117940 19294 raft_consensus.cc:614] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:35.982755 21880 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:09:36.004109 21898 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:36.100914 19221 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
W20260709 13:09:36.102505 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 100696us
I20260709 13:09:36.107072 19220 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.123355 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.124120 19216 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.115398 19222 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:36.104882 21539 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:36.118685 19901 raft_consensus.cc:2368] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
W20260709 13:09:36.121338 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 126878us
I20260709 13:09:36.121515 19191 leader_election.cc:400] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:36.047667 21896 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.131544 21584 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.133971 21861 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8.
I20260709 13:09:36.134732 21861 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:36.107031 19223 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
W20260709 13:09:36.136579 21888 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:09:36.139513 21576 consensus_meta.cc:287] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.006s	user 0.009s	sys 0.001s
I20260709 13:09:36.139951 21576 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.142138 21576 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.142860 19292 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:36.142948 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:36.143759 19365 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:36.146423 19894 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:36.127978 19898 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:36.149349 21840 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.040s	user 0.006s	sys 0.003s
I20260709 13:09:36.149797 21840 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:36.152735 21656 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:36.154729 19265 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.970s (SENT)
I20260709 13:09:36.121013 21874 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:36.155655 21830 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.103s	user 0.011s	sys 0.000s
I20260709 13:09:36.108124 21816 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:36.128989 21686 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.129323 21900 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.129521 19220 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:09:36.129699 21892 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:09:36.129889 21845 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.130013 21897 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 13:09:36.130699 21886 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:36.131392 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:36.154891 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.156570 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.157437 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1393) took 1092 ms. Trace:
I20260709 13:09:36.158677 19296 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:36.093967 21847 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:36.101114 21849 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.135267 21861 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:36.163300 19868 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.607s (SENT)
I20260709 13:09:36.162423 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:36.165966 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.170650 19220 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:36.181788 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50449.7us
I20260709 13:09:36.193390 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:36.181996 19217 rpcz_store.cc:276] 0709 13:09:35.065174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.107715 (+ 42541us) service_pool.cc:224] Handling call
0709 13:09:35.108020 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.125133 (+ 17113us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:35.174908 (+ 49775us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.857268 (+682360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.873360 (+ 16092us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.884363 (+ 11003us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:35.884408 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.884485 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.157294 (+272809us) raft_consensus.cc:1685] finished
0709 13:09:36.157307 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.157396 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282433,"prepare.queue_time_us":72884,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":13641,"raft.queue_time_us":938783,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":63854,"spinlock_wait_cycles":16851200,"thread_start_us":424035,"threads_started":3,"wal-append.queue_time_us":591938}
I20260709 13:09:36.185621 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:36.196568 19296 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.185985 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.198006 19300 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:36.172508 19897 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:36.142994 21834 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:36.206511 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.207947 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.209343 19300 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:36.210266 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:36.213333 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58636.7us
I20260709 13:09:36.180846 21816 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:36.218025 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:36.219460 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:36.220103 19300 raft_consensus.cc:606] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:36.220858 19300 raft_consensus.cc:614] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:36.171195 21830 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:36.222152 19188 connection.cc:256] RPC call timeout handler was delayed by -1.7924155179999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 13:09:36.222658 19188 connection.cc:256] RPC call timeout handler was delayed by -1.6268155180000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:09:36.223013 19188 connection.cc:256] RPC call timeout handler was delayed by -1.3910155180000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:09:36.185267 21539 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:36.224876 19188 connection.cc:256] RPC call timeout handler was delayed by -1.3883155180000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 13:09:36.230402 19188 connection.cc:256] RPC call timeout handler was delayed by -1.3613155179999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 13:09:36.230809 19188 connection.cc:256] RPC call timeout handler was delayed by -1.2389155179999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23530000000000004s for a response
I20260709 13:09:36.187080 21904 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.194631 21676 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.208338 19220 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.237308 19296 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:36.199832 21886 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:36.181233 21796 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:36.202126 21845 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.204704 21686 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:36.244944 19265 leader_election.cc:336] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.808s (SENT)
I20260709 13:09:36.181996 21573 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.207047 21875 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:36.247795 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.248526 19220 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:36.249375 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 125503us
I20260709 13:09:36.250351 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:36.251893 19298 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:36.254930 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44763.6us
I20260709 13:09:36.255671 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:36.258239 19265 leader_election.cc:336] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.198s (SENT)
I20260709 13:09:36.258555 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.229614 21639 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.202746 21648 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.260560 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:36.239931 21904 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.242053 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:36.250938 21875 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.275236 19373 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.277174 19296 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:36.243674 21539 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.263576 21880 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.261780 21896 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.288079 21573 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:36.289541 21910 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:36.290871 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1395) took 1157 ms. Trace:
I20260709 13:09:36.291307 19225 rpcz_store.cc:276] 0709 13:09:35.133662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.208852 (+ 75190us) service_pool.cc:224] Handling call
0709 13:09:35.252603 (+ 43751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.890717 (+638114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.890748 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.937756 (+ 47008us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.041981 (+104225us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:36.042065 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.042167 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.290635 (+248468us) raft_consensus.cc:1685] finished
0709 13:09:36.290656 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.290805 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183038,"raft.queue_time_us":510433,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":14646,"thread_start_us":485139,"threads_started":2,"wal-append.queue_time_us":170372}
W20260709 13:09:36.293171 21903 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:36.294631 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1392) took 1338 ms. Trace:
I20260709 13:09:36.296483 21648 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.263430 21836 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.296409 21816 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.297799 21635 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.300659 21830 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.301436 21905 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.301863 21539 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.267911 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:36.254681 21801 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.303234 19897 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:36.267220 21875 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.268726 21897 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.282043 21584 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.305162 21897 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.305724 21897 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.283125 21906 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.306774 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46282.6us
I20260709 13:09:36.302009 21905 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.295199 19219 rpcz_store.cc:276] 0709 13:09:34.956629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.022501 (+ 65872us) service_pool.cc:224] Handling call
0709 13:09:35.047882 (+ 25381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.508704 (+460822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.508754 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.760567 (+251813us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.029625 (+269058us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.029665 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.029733 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.294367 (+264634us) raft_consensus.cc:1685] finished
0709 13:09:36.294391 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.294565 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276593,"raft.queue_time_us":52931,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16545,"thread_start_us":622682,"threads_started":2,"wal-append.queue_time_us":337977}
I20260709 13:09:36.308674 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:36.309324 19295 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:36.309661 19296 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.265887 21904 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.344033 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 352) took 1370 ms. Trace:
I20260709 13:09:36.313413 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:36.344515 19369 rpcz_store.cc:276] 0709 13:09:34.973211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.132104 (+158893us) service_pool.cc:224] Handling call
0709 13:09:35.132440 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.885388 (+752948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.885417 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.138556 (+253139us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b2c001323f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:09:36.138976 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.225000 (+ 86024us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:36.225050 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.225118 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.310031 (+ 84913us) raft_consensus.cc:1685] finished
0709 13:09:36.310059 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.343935 (+ 33876us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2615,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":47862,"spinlock_wait_cycles":2967808,"thread_start_us":825999,"threads_started":2,"wal-append.queue_time_us":116777}
I20260709 13:09:36.304388 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:36.355057 19897 raft_consensus.cc:2368] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5.
I20260709 13:09:36.354669 21886 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.356084 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:36.294519 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:36.359634 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51036.9us
I20260709 13:09:36.361867 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.372082 19365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:09:36.373095 19365 raft_consensus.cc:606] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:36.373620 19365 raft_consensus.cc:614] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:36.375699 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.376622 19296 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:09:36.376677 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 126410us
I20260709 13:09:36.377597 19188 leader_election.cc:400] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7.
I20260709 13:09:36.260063 21911 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 13:09:36.381712 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 68374.1us
I20260709 13:09:36.382638 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:36.385855 19296 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 7. Ops: []
I20260709 13:09:36.307309 21906 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:36.389133 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130900us
I20260709 13:09:36.377409 21896 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.392432 21919 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:36.393144 21919 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:36.393584 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:36.394074 21919 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.395326 19895 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:36.383049 21545 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:36.384603 21635 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.399307 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:36.400352 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.405081 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.388525 21880 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.388305 21648 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.400111 21896 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:36.385879 21914 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.412324 21880 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:36.413225 21861 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.419806 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.425104 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:36.429816 19895 raft_consensus.cc:1813] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Handling vote request from an unknown peer c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.430537 19895 raft_consensus.cc:2410] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:09:36.431018 21813 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.417s	user 0.010s	sys 0.002s
I20260709 13:09:36.430812 21896 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.430547 19899 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.431499 21813 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.429548 21844 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:36.268318 21847 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.414624 21639 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.427254 21880 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:36.441622 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44189.8us
I20260709 13:09:36.449313 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.450937 21920 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.451011 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.443162 19294 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:36.452276 21920 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.439831 19896 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:36.453212 21906 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.454499 21844 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:36.454842 21895 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.570s	user 0.003s	sys 0.004s
I20260709 13:09:36.455143 21844 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:36.457096 21880 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.433130 21539 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.463927 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:36.472309 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.473098 21911 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:36.434201 21801 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.467511 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.475291 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.481019 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.440810 21919 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.492940 21886 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.473372 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1567) took 1289 ms. Trace:
I20260709 13:09:36.468007 21920 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.518510 21886 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.524981 21813 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.527184 21886 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.537264 21905 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.519305 19293 rpcz_store.cc:276] 0709 13:09:35.183736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.198043 (+ 14307us) service_pool.cc:224] Handling call
0709 13:09:36.473120 (+1275077us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003f25d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:36.473270 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480967040}
I20260709 13:09:36.541950 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:36.542836 21923 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:36.543607 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:36.544368 21923 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:36.513706 21919 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.544860 21923 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:36.545114 21919 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.546056 21923 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.547755 21923 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.473699 21911 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.514340 21844 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.549669 21844 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.550827 21911 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.523085 21920 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.552783 21920 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.517204 21849 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:36.539803 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:36.578019 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:36.600315 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 119359us
I20260709 13:09:36.601346 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.602072 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.605054 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 317) took 1963 ms. Trace:
I20260709 13:09:36.606102 19291 rpcz_store.cc:276] 0709 13:09:34.641496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.641712 (+   216us) service_pool.cc:224] Handling call
0709 13:09:36.604816 (+1963104us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400346554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:36.604982 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3052643072}
I20260709 13:09:36.605437 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.573648 19899 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
W20260709 13:09:36.615676 21921 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:09:36.616411 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.617894 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:36.618351 21907 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.196s
I20260709 13:09:36.619212 21539 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.612275 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.598209 21830 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:36.623862 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 139124us
I20260709 13:09:36.623996 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.607532 21849 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.604463 21584 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.631206 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.632894 19291 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:36.627049 21539 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.636950 21796 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.638288 21539 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.638087 21872 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:09:36.640326 21931 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.640837 21931 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:36.647893 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46638.7us
I20260709 13:09:36.648790 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.651572 21539 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.651948 21539 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.652340 21539 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.629650 21911 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.618274 21880 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:36.648730 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.630402 21417 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.653836 19296 raft_consensus.cc:1813] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Handling vote request from an unknown peer c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.659531 19296 raft_consensus.cc:2410] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:09:36.659613 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.655099 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.661093 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.661259 19293 raft_consensus.cc:606] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:36.632519 21801 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:36.663038 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 187854us
I20260709 13:09:36.661758 19293 raft_consensus.cc:614] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:36.641197 21931 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.642128 21847 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:36.667651 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.653900 21872 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:36.663482 21932 raft_consensus.cc:2764] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:36.668692 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.670466 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.658639 21911 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.671661 19217 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.672150 19225 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:36.636461 21875 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.673455 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.674885 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.675477 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.676412 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:36.672093 21849 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.677359 21849 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:36.677470 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.677531 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.675205 21856 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.678283 19223 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:36.678639 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.678776 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.679352 19222 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:36.679636 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.679723 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.680397 19223 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.685036 19216 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:36.680195 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.677772 21849 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.681082 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.687471 19221 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:36.685514 19217 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:36.688949 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.678231 19225 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:36.694271 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.694937 19216 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.667104 21801 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.699098 21856 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:36.699524 21856 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:36.699865 21856 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.700408 21801 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.669363 21847 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.703457 21939 raft_consensus.cc:2764] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:36.704377 21904 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.686527 21845 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:36.706691 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.698416 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.709856 21845 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.674494 21872 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.693003 21932 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.710326 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1563) took 1527 ms. Trace:
I20260709 13:09:36.711632 21911 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.698015 21844 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:36.703701 21919 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.714282 19223 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.720631 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.731986 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:36.705346 21847 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.718909 21845 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.720554 19298 rpcz_store.cc:276] 0709 13:09:35.182540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.182703 (+   163us) service_pool.cc:224] Handling call
0709 13:09:36.710131 (+1527428us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002b7fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:36.710268 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446073600}
I20260709 13:09:36.720220 21830 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:09:36.724874 21872 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.719163 21584 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:36.713716 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1569) took 1527 ms. Trace:
I20260709 13:09:36.735416 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.737058 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.744465 19292 rpcz_store.cc:276] 0709 13:09:35.184339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.236777 (+ 52438us) service_pool.cc:224] Handling call
0709 13:09:36.712008 (+1475231us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54002e7f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:36.712129 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182135168}
I20260709 13:09:36.745512 19298 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:36.734050 21844 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.746735 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.752849 19298 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:36.729064 21932 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.758090 19216 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:36.759776 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.761298 19298 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:36.743575 21923 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.746193 21573 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:36.719446 21897 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:36.766563 21936 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:36.759759 21932 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.783865 19223 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:36.787482 21919 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:36.790934 21943 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:36.768537 21872 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.799172 19220 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.769603 21923 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.802352 21844 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.804684 21875 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.807629 21897 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.809836 19300 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:36.809731 21539 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.778028 21573 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:36.814780 21931 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.819689 21876 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.820472 21904 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.813422 21849 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.800627 21796 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:36.822458 21923 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.839222 21856 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.871937 19295 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.874783 21920 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.876670 19222 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.877944 21920 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.881580 21931 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.883546 21539 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.883688 21894 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.884537 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.884992 21894 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.885270 19223 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:36.890939 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1564) took 1708 ms (client timeout 2242 ms). Trace:
W20260709 13:09:36.891404 19297 rpcz_store.cc:269] 0709 13:09:35.182865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.182967 (+   102us) service_pool.cc:224] Handling call
0709 13:09:36.890773 (+1707806us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54003f2fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:36.890878 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26475392}
I20260709 13:09:36.892416 21573 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.894971 19223 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:36.895988 19296 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:36.896884 21860 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.001s	user 0.007s	sys 0.005s
I20260709 13:09:36.897290 21860 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:36.899479 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.905668 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 244651us
I20260709 13:09:36.906884 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:36.924201 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.927592 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:36.928273 19365 raft_consensus.cc:2376] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7. Re-sending same reply.
I20260709 13:09:36.934656 19365 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:09:36.921954 21931 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.945676 19365 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:36.947561 19365 pending_rounds.cc:85] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 1
I20260709 13:09:36.947897 19365 pending_rounds.cc:107] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:36.948225 19365 raft_consensus.cc:2889] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.948629 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.938635 21931 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:36.949226 19374 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.949575 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.960947 19370 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.961272 21539 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.961796 21539 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.963914 21539 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.965116 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.965322 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.965708 19216 raft_consensus.cc:2376] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7. Re-sending same reply.
I20260709 13:09:36.965914 19217 raft_consensus.cc:2376] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:09:36.967120 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.967789 19217 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:36.968694 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.972949 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.973497 21256 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.973796 19224 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.969070 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.974620 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.974926 21539 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:36.975466 19224 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:36.969973 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.976344 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.975919 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.970111 19216 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:36.976100 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:36.969518 21949 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:09:36.980927 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.981503 19216 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.982717 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:36.981529 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.984575 19224 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:36.976383 19223 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.976547 21950 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:36.970692 19374 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:36.985170 19217 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:36.985002 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.986340 21950 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:36.986817 19224 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.989161 21626 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.939332 21856 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:36.990831 21860 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:36.992233 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.992988 19295 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:36.993754 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:36.994410 19295 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:36.994982 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:36.996246 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:36.997355 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:36.997860 19366 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.001233 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 461) took 1502 ms. Trace:
I20260709 13:09:37.001554 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.001660 19903 rpcz_store.cc:276] 0709 13:09:35.498477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.498617 (+   140us) service_pool.cc:224] Handling call
0709 13:09:35.546279 (+ 47662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.952584 (+406305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.001025 (+1048441us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54005d2854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:37.001173 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800833920}
W20260709 13:09:37.002799 21954 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:36.988770 21950 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:36.995091 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:37.006500 21848 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:37.009510 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1570) took 1825 ms. Trace:
I20260709 13:09:37.009620 21848 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:37.010080 21848 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:37.009791 21923 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.010398 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 324) took 1255 ms. Trace:
I20260709 13:09:37.010790 19299 rpcz_store.cc:276] 0709 13:09:35.755215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.801664 (+ 46449us) service_pool.cc:224] Handling call
0709 13:09:37.010250 (+1208586us) spinlock_profiling.cc:243] Waited 93.3 ms on lock 0x7b540004a1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:37.010345 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214524800}
I20260709 13:09:37.010960 21848 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.011963 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.013043 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.013581 19299 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.016559 19297 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:37.007835 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 358) took 1215 ms. Trace:
I20260709 13:09:37.017805 21834 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:37.018222 21834 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:37.018364 19868 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.061s (SENT)
I20260709 13:09:37.018821 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.019013 21834 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:37.019848 19868 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.141s (SENT)
I20260709 13:09:37.049383 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.034191 19221 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:37.058306 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1572) took 1873 ms. Trace:
I20260709 13:09:37.057502 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:37.047756 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:37.062250 19220 raft_consensus.cc:2368] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8.
I20260709 13:09:37.062134 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:37.062783 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:37.062947 19221 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:37.063117 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:37.063865 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.064219 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.064512 19899 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:37.064899 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.063797 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:37.037503 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.061578 19300 rpcz_store.cc:276] 0709 13:09:35.185033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.245549 (+1060516us) service_pool.cc:224] Handling call
0709 13:09:36.809610 (+564061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.825338 (+ 15728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.058116 (+232778us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540004d8d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:37.058245 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296252800}
I20260709 13:09:37.022655 21932 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.067353 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.067546 19224 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:37.067886 19300 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.068779 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 359) took 1271 ms. Trace:
I20260709 13:09:37.068897 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.069444 21932 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:36.948999 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.070631 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:37.070947 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.023604 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:37.063321 19222 raft_consensus.cc:1813] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Handling vote request from an unknown peer c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.072346 21846 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:37.064532 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.020015 21845 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.056355 21874 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:37.073709 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:37.074318 19296 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.074635 19220 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:37.075541 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.072036 21880 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:37.073724 21905 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:37.076433 21890 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:37.076493 21905 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:37.072667 19222 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:37.071054 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.073443 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.077091 21905 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.077548 19297 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.022390 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:37.078998 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.079504 19293 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.079869 19220 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:37.076975 21890 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.017359 19367 rpcz_store.cc:276] 0709 13:09:35.792867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.793045 (+   178us) service_pool.cc:224] Handling call
0709 13:09:35.835362 (+ 42317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.983310 (+147948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.983362 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:35.983431 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:35.983489 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.007618 (+1024129us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003471d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:37.007663 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.007782 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339748096}
I20260709 13:09:37.080569 21890 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.081190 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.082027 21851 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.082261 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.083423 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.083866 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:37.069199 19373 rpcz_store.cc:276] 0709 13:09:35.797486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.797771 (+   285us) service_pool.cc:224] Handling call
0709 13:09:35.877157 (+ 79386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.276969 (+399812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.068548 (+791579us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400355f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:37.068725 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915047680}
I20260709 13:09:37.084688 21874 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:37.085191 21874 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:37.085522 19224 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:37.085827 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:37.086028 21874 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.086620 19224 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:37.086969 21856 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.087507 21856 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:37.087555 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:37.085206 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.084210 21849 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:37.089123 19373 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:37.089450 19224 raft_consensus.cc:2368] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:37.089614 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:37.089891 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.090410 19373 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.090848 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:37.091379 21872 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.091544 19224 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:37.091943 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:36.951020 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.034097 19218 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:37.092576 19225 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:37.092873 19368 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:37.093767 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.093973 19218 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:37.094861 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:36.973989 21256 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.020071 21834 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.097508 21256 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:37.099336 19300 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:37.100257 19294 rpcz_store.cc:276] 0709 13:09:35.184580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.161928 (+977348us) service_pool.cc:224] Handling call
0709 13:09:36.163100 (+  1172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.452494 (+289394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.009298 (+556804us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002e8e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:37.009456 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643469056}
I20260709 13:09:37.091951 21872 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:37.100899 21931 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.041298 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.101722 21872 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.021293 21146 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.102669 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.103377 19365 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:37.103425 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 83598.7us
I20260709 13:09:37.077450 19371 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 2.
W20260709 13:09:37.104262 19868 leader_election.cc:336] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.171s (SENT)
I20260709 13:09:37.105283 19903 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:09:37.105901 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.076907 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:37.071367 19901 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:37.107952 21923 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:37.111196 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:37.112058 21878 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:37.112383 19223 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:37.108609 21545 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:37.109005 21626 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:37.113263 21545 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:37.113452 21626 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:37.113708 21545 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.114035 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.112746 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:37.114434 21626 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.108776 21688 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:09:37.116392 21688 consensus_queue.cc:1243] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:37.116959 19372 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:37.117929 21931 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.129091 21688 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.121631 19299 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:37.109194 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.129613 21688 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:36.968119 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:37.131611 21688 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:37.132709 19370 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:37.134729 19370 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:37.136664 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:37.088549 21856 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.152294 21688 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:37.152443 21950 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.152799 21688 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.094969 19225 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:37.153340 21688 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:37.050946 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.154359 21931 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:37.124302 21905 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.156368 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:37.157609 19339 leader_election.cc:400] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8.
I20260709 13:09:37.157940 19339 leader_election.cc:403] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:37.158527 21635 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:37.127329 19366 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:37.136060 21878 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:37.096011 19218 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:37.159736 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:37.137861 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:37.160660 21860 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:37.124574 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.161164 21860 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.161784 21860 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.162483 19188 leader_election.cc:400] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5.
I20260709 13:09:37.162937 19188 leader_election.cc:403] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:37.163471 21539 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.164191 21539 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5.
I20260709 13:09:37.115922 21845 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:37.141549 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.123977 19373 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:37.141831 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:37.165510 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.143131 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:37.167114 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:37.143321 19296 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:37.167826 21880 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:37.144228 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:37.168946 19897 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:09:37.156381 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 181668us
I20260709 13:09:37.145234 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:37.145536 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:37.145805 19295 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:37.092597 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:37.179103 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.160822 19300 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:37.140483 19368 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:37.168310 21880 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:37.144358 21923 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:37.179899 19216 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:37.157769 21905 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:37.184914 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.127044 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:37.171173 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:37.207515 19265 leader_election.cc:400] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:37.207940 19265 leader_election.cc:403] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:37.083910 19367 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.128293 19365 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:37.208214 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:37.026113 21848 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.196496 19293 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:37.202302 19223 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.203896 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:37.200529 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1428) took 1227 ms. Trace:
I20260709 13:09:37.189070 19297 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:37.213160 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.212049 19298 rpcz_store.cc:276] 0709 13:09:35.973146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.769694 (+796548us) service_pool.cc:224] Handling call
0709 13:09:36.770163 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:36.771887 (+  1724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.771933 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.801542 (+ 29609us) log.cc:844] Serialized 52 byte log entry
0709 13:09:36.911075 (+109533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:37.172482 (+261407us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.172991 (+   509us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.200204 (+ 27213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.200277 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.200315 (+    38us) raft_consensus.cc:1685] finished
0709 13:09:37.200326 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.200460 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39973,"raft.queue_time_us":5149,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":28377,"thread_start_us":293585,"threads_started":2,"wal-append.queue_time_us":116391}
I20260709 13:09:37.219982 19225 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.250895 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:37.211145 19222 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:37.277187 19221 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.312856 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:37.354187 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:37.355105 19293 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
W20260709 13:09:37.359126 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 158815us
W20260709 13:09:37.361068 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 147998us
I20260709 13:09:37.251561 19298 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:37.217789 21920 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:37.377308 21545 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.378633 19903 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:37.379683 21545 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:37.381693 21905 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:37.382779 21905 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:37.384021 21256 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:37.384500 21256 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:37.384963 21256 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.205376 21948 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.210278 21485 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:37.413442 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 205317us
I20260709 13:09:37.414661 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:37.313781 21903 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:37.217985 21696 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:37.313655 21845 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:37.356518 21904 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.414350 21952 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:09:37.412935 21940 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:37.436740 19367 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:37.412731 21834 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:37.422636 21897 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:37.443001 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:37.443423 21931 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:37.438315 21635 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8.
I20260709 13:09:37.435417 21920 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.447028 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1427) took 1493 ms. Trace:
I20260709 13:09:37.205478 21876 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 13:09:37.420902 21919 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:37.425804 21845 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:37.478896 21845 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.480121 21845 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:37.463395 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.438829 21894 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:37.461905 19292 rpcz_store.cc:276] 0709 13:09:35.953874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.763323 (+809449us) service_pool.cc:224] Handling call
0709 13:09:36.775568 (+ 12245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.840905 (+ 65337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.840950 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.868091 (+ 27141us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.944624 (+ 76533us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:36.944693 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.054292 (+109599us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54003f16d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:37.054363 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.446613 (+392250us) raft_consensus.cc:1685] finished
0709 13:09:37.446644 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.446939 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3598,"raft.queue_time_us":4255,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10106,"spinlock_wait_cycles":140818304,"thread_start_us":64047,"threads_started":1,"wal-append.queue_time_us":523973}
I20260709 13:09:37.205304 21907 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.207s
I20260709 13:09:37.469192 21931 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:37.472873 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.474157 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.269515 21688 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.495998 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.497356 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:37.483901 21485 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.457922 21897 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:37.436944 21904 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.499811 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:37.505622 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:37.489060 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.509925 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 312277us
I20260709 13:09:37.489739 21894 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:37.440757 21880 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.466519 21920 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:37.558290 19219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.026s
W20260709 13:09:37.562134 19219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.026s
W20260709 13:09:37.558233 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47091.4us
I20260709 13:09:37.500749 21834 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:37.500813 21849 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.500911 21948 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.503248 21897 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.512804 21417 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:37.507618 21846 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:37.557108 21844 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:37.584120 21417 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:37.585619 21846 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:37.621063 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 178127us
I20260709 13:09:37.734771 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:37.621691 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 424649us
W20260709 13:09:37.608633 21847 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.011s	sys 0.018s
I20260709 13:09:37.570410 21890 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.649592 21417 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:37.802620 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.803180 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.761890 21847 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.011s	sys 0.018s
I20260709 13:09:37.634567 21696 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:37.806346 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.026s
W20260709 13:09:37.809158 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.026s
I20260709 13:09:37.613198 21860 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.786630 21919 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:37.764261 21801 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.825299 21960 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:09:37.826654 21964 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:37.811560 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 592646us
I20260709 13:09:37.813202 21626 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.839452 21696 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.842712 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:37.821992 21878 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:37.848719 21688 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:37.829339 21919 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:37.730861 21894 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:37.852748 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.008s	sys 0.020s
I20260709 13:09:37.823186 19896 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:37.854148 19291 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.005s	sys 0.025s
I20260709 13:09:37.785332 21931 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:37.883189 19294 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:37.885219 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.888572 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 353102us
W20260709 13:09:37.909425 19291 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.007s	sys 0.027s
I20260709 13:09:37.887445 21688 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:37.860816 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.008s	sys 0.020s
W20260709 13:09:37.910090 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 333783us
I20260709 13:09:37.824455 21801 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:37.916217 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 789168us
W20260709 13:09:37.910861 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56755.5us
I20260709 13:09:37.908432 21920 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:37.968647 21966 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:09:37.969615 21976 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:09:37.970441 21958 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:09:37.970801 21576 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.971930 21959 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:37.971556 21576 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:37.972903 21967 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:09:37.966341 21834 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:37.974406 21576 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:37.974756 21834 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:37.979482 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:37.981288 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1574) took 1039 ms. Trace:
I20260709 13:09:37.981467 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.981715 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.982985 19372 raft_consensus.cc:2368] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:37.983700 19369 rpcz_store.cc:276] 0709 13:09:36.941910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.944242 (+  2332us) service_pool.cc:224] Handling call
0709 13:09:36.969864 (+ 25622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.970228 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.970255 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.970709 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.439995 (+469286us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:37.440317 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.440393 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.981010 (+540617us) raft_consensus.cc:1685] finished
0709 13:09:37.981038 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.981215 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":468872,"threads_started":1,"wal-append.queue_time_us":637915}
I20260709 13:09:37.988663 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.988873 19365 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:37.991842 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:37.995460 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:37.998411 19368 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:38.018534 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:37.988732 21688 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:38.029194 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.029505 19340 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.030352 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:38.030979 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.988595 21974 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.035274 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.036033 19300 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:37.977301 21845 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:09:38.037896 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:38.042686 19218 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:38.021423 21834 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:38.046150 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 294896us
I20260709 13:09:38.045472 19218 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:38.054811 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:38.001818 21911 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:09:38.059578 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.031957 21539 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:38.038887 21256 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.002s
I20260709 13:09:38.075256 21860 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:38.078709 21688 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.080726 21801 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.083477 21990 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.059288 21977 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.086107 21904 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:38.087033 21950 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.934s	user 0.010s	sys 0.000s
I20260709 13:09:38.059420 21573 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.038259 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:38.089686 21851 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:38.058947 21897 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.076150 21860 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:09:38.096661 21897 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.097810 19895 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:38.032294 21919 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.090138 21256 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.104786 21256 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.090795 19217 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:38.108752 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 347709us
W20260709 13:09:38.111454 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 124486us
I20260709 13:09:38.112568 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:38.057682 21890 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:38.094714 21973 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:09:38.094949 21848 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.000s
W20260709 13:09:38.126609 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 370788us
I20260709 13:09:38.109724 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:38.134752 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100376us
I20260709 13:09:38.093932 21851 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:38.142275 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:38.142397 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.116791 21978 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:38.197830 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55512.1us
W20260709 13:09:38.198697 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63791.4us
W20260709 13:09:38.198974 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56812.8us
I20260709 13:09:38.199438 21872 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.199812 21848 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:38.204815 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.218798 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.204427 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:38.227892 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.148108 21637 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:38.146189 21876 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.242615 19266 leader_election.cc:400] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:38.231120 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.236135 19374 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:38.237350 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 575) took 1073 ms. Trace:
W20260709 13:09:38.202734 21959 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:38.243732 19903 rpcz_store.cc:276] 0709 13:09:37.164429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.165363 (+   934us) service_pool.cc:224] Handling call
0709 13:09:37.165639 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.379142 (+213503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.237118 (+857976us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:38.237293 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489185024}
I20260709 13:09:38.203459 21932 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.246410 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.214829 21576 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.199468 21993 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:38.145495 21890 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 13:09:38.253882 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 141395us
I20260709 13:09:38.254112 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.255391 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.251698 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.252257 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.256263 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.250936 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:38.198625 21256 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:09:38.257377 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.257938 19297 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.259438 19367 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:38.202411 21847 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:09:38.237059 21898 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:38.259709 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.239074 21986 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.243449 21637 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.239238 21897 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.261551 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:38.282115 19222 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:38.283041 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:38.262297 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.283699 19371 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.263784 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:38.263784 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.242914 21876 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.245715 21985 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.277604 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.278023 19903 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:38.278368 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:38.253547 22000 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:38.286141 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 216632us
I20260709 13:09:38.251881 21844 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.287385 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:38.298247 19216 raft_consensus.cc:2376] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8. Re-sending same reply.
I20260709 13:09:38.288537 19296 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:09:38.296859 19225 raft_consensus.cc:2376] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:09:38.299254 19296 pending_rounds.cc:85] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 6
I20260709 13:09:38.299659 19296 pending_rounds.cc:107] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:09:38.227291 21872 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.255949 21919 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:38.302937 21919 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:38.292157 19292 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:38.292459 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:38.312521 19222 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:38.285288 19297 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:38.266003 21932 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:38.296303 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45433.3us
I20260709 13:09:38.299957 19296 raft_consensus.cc:2889] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:38.301635 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.302367 21911 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.246937 21988 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:09:38.362826 21988 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:38.363320 21988 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:38.364508 21988 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.366339 21988 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.367569 21872 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.302763 22002 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:38.368806 21919 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.274340 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.297605 22000 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.370640 22000 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.371479 22006 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:38.371892 22006 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:38.372674 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:38.372776 22006 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.373437 19296 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.287477 21997 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:38.311653 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:38.374074 21997 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.374240 19216 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:38.374464 21997 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.285789 21637 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.324538 21978 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:09:38.377403 21969 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:09:38.281950 21950 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.378283 21950 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.311868 19371 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:38.316593 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.380374 21950 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.281740 21980 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.380918 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64408.8us
I20260709 13:09:38.260583 21845 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:09:38.316994 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1770) took 1499 ms. Trace:
I20260709 13:09:38.382640 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:38.384020 21994 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:09:38.382860 19219 rpcz_store.cc:276] 0709 13:09:36.817487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.821240 (+  3753us) service_pool.cc:224] Handling call
0709 13:09:36.821704 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.833889 (+ 12185us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:36.897529 (+ 63640us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.019530 (+1122001us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.026327 (+  6797us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.026824 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.026968 (+   144us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:38.027003 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.027077 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.316790 (+289713us) raft_consensus.cc:1685] finished
0709 13:09:38.316809 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.316916 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90328,"prepare.queue_time_us":72551,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":509053,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":15676,"thread_start_us":1118969,"threads_started":2,"wal-append.queue_time_us":916250}
I20260709 13:09:38.347851 21860 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:09:38.385150 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1401) took 1354 ms. Trace:
I20260709 13:09:38.385339 21978 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.385887 21626 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.385702 19220 rpcz_store.cc:276] 0709 13:09:37.030443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.082230 (+ 51787us) service_pool.cc:224] Handling call
0709 13:09:37.082509 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.102858 (+ 20349us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:37.102888 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.794114 (+691226us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b2c00000f48. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:09:37.802600 (+  8486us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.062828 (+260228us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:38.062968 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.063331 (+   363us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.384865 (+321534us) raft_consensus.cc:1685] finished
0709 13:09:38.384885 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.385096 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21194,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":177868544,"thread_start_us":223523,"threads_started":1,"wal-append.queue_time_us":314737}
I20260709 13:09:38.294137 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:38.388597 19900 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:38.298559 21256 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.349156 21974 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:38.316593 19218 pending_rounds.cc:85] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:09:38.397842 19218 pending_rounds.cc:107] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:09:38.398152 19218 raft_consensus.cc:2889] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:38.399315 21834 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:38.357096 21998 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:38.251353 21851 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.358397 21573 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.296201 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 572) took 1133 ms. Trace:
I20260709 13:09:38.434857 19896 rpcz_store.cc:276] 0709 13:09:37.161648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.161777 (+   129us) service_pool.cc:224] Handling call
0709 13:09:37.162099 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.912895 (+750796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.280802 (+367907us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:38.295148 (+ 14346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487859072}
I20260709 13:09:38.436117 19291 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.436285 21851 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.437963 21872 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.264823 21576 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.360447 21996 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:09:38.361732 21977 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.292831 21876 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.296583 21985 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.381057 21980 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.348591 19895 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:38.345252 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:38.385079 21688 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:38.416402 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.482913 21688 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.382117 21990 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.483358 21688 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.438704 21872 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:38.446321 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 198735us
I20260709 13:09:38.489081 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:38.433578 21417 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.003s
I20260709 13:09:38.490262 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.490348 21872 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.392102 21256 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:38.491428 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.491894 21573 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.492326 21485 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:38.462738 19898 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:38.462060 21980 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.493160 19898 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:38.465505 19296 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:38.465991 19291 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
W20260709 13:09:38.475615 21965 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.499s	user 0.000s	sys 0.001s
W20260709 13:09:38.482403 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.434355 21796 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.495101 21796 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.490042 21417 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:38.501295 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 214223us
I20260709 13:09:38.501897 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:38.502498 19222 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.451687 19895 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:38.509038 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:38.399881 21834 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.464769 21985 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.497462 19295 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:38.389844 21637 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.527880 19371 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:38.530963 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.532927 19224 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:38.533293 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.545512 19222 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:38.550318 19368 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.551306 19369 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:38.550343 19298 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 3: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:38.518242 21993 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:38.511590 21856 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:38.556980 19373 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:38.559180 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1578) took 1649 ms. Trace:
I20260709 13:09:38.570217 21637 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:38.573381 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1772) took 1600 ms. Trace:
I20260709 13:09:38.573794 19217 rpcz_store.cc:276] 0709 13:09:36.973416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.987553 (+ 14137us) service_pool.cc:224] Handling call
0709 13:09:36.987882 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.108278 (+1120396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.559968 (+451690us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:38.573318 (+ 13350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2535504256}
I20260709 13:09:38.576468 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:38.532223 21848 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:38.452493 21844 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:09:38.569304 19895 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.533687 21878 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:38.509377 21860 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:09:38.580129 21996 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.581365 21626 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:38.519328 22005 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:09:38.573101 19294 rpcz_store.cc:276] 0709 13:09:36.910323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.101333 (+191010us) service_pool.cc:224] Handling call
0709 13:09:37.139570 (+ 38237us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:37.139747 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.913980 (+774233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.558882 (+644902us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54001d3154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:38.559106 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794982016}
I20260709 13:09:38.553323 22000 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.534191 21990 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:38.602717 19294 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:38.590723 21848 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.606249 21848 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:38.604928 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 290175us
I20260709 13:09:38.511101 21256 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.581391 21417 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.583846 21986 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.584823 21911 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.593619 21705 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:38.607112 21898 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.611809 21860 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:38.666453 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.607805 21878 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:38.665684 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54597us
I20260709 13:09:38.670374 21986 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.673164 21986 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.674089 21898 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.676980 21898 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.611143 21932 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.621253 21897 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:38.685053 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.651993 21796 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.663102 21256 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.609163 21981 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:09:38.697732 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 206362us
I20260709 13:09:38.709555 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:38.680234 21860 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:38.688362 21705 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:09:38.714524 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46413.1us
I20260709 13:09:38.729674 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.729974 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.730901 19368 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:38.731977 19219 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:38.711462 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 180591us
I20260709 13:09:38.693578 21834 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.724253 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.734104 19367 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:38.664610 21911 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.736593 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.733899 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:38.653043 21997 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.730715 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:38.744474 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:38.744863 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:38.745580 19220 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.691421 21932 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.714181 21985 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.742462 21576 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.695339 21897 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.751209 19217 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:38.721946 21898 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.715899 21796 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:38.765491 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 160163us
I20260709 13:09:38.736014 22011 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:38.721000 21996 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:09:38.742802 22007 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.714778 22012 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:09:38.687093 21993 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.779724 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.797513 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.779992 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.754259 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:38.797912 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:38.804049 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.805262 19294 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:38.805869 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:38.807399 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.751950 21878 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.771067 21576 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.785472 22011 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:38.810570 22013 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:38.811372 22009 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.811839 22010 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:09:38.799750 21639 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:38.821565 19371 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:38.769961 21985 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.769713 21898 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.842185 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:38.850924 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 117102us
I20260709 13:09:38.851114 19224 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.860438 19367 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:38.818567 21931 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.870172 19220 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:38.837486 21897 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.818188 21653 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:38.861500 21635 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:38.821195 21576 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.846421 21639 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:38.838102 21990 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:38.861351 22000 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:38.796520 22007 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.871915 21932 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.914757 19224 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:38.865715 21996 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:09:38.899761 21988 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.533s	user 0.014s	sys 0.000s
I20260709 13:09:38.818563 21705 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.892702 21635 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:38.889344 21905 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:38.837910 22009 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.923858 21637 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:38.877168 21931 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.944978 22030 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.945497 22036 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.946072 22036 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:38.945624 22030 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:38.946791 21997 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:38.962673 19219 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:38.892972 22029 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:09:38.958694 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:38.986455 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:38.987174 19219 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:38.929981 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 89800.6us
W20260709 13:09:38.953770 22015 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:09:38.995138 22016 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:38.995733 22016 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:38.996847 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.997874 22016 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.998008 21919 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.963688 21872 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.999303 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:38.951185 21911 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.016459 21986 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:38.993701 21997 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:39.000420 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:38.956353 21985 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:39.006182 22017 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:09:39.007267 22023 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:09:39.008749 21931 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.954335 21898 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.949438 21637 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.024646 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:39.025255 22009 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.978166 21635 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.026654 21637 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:39.026763 21635 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:39.028916 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.011613 21876 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.000s
I20260709 13:09:39.040603 21876 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.042753 21876 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:39.012192 21573 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.006s
I20260709 13:09:39.043370 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.012323 21576 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.015553 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.015287 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:39.016032 22041 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.965989 22011 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.006266 22016 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.017400 21971 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.021s	user 0.004s	sys 0.000s
I20260709 13:09:39.016723 21872 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.046257 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1582) took 2045 ms. Trace:
I20260709 13:09:39.046975 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.047219 22016 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.047562 21872 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:38.951014 21639 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.049081 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.049444 22016 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.050189 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:39.050485 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.050733 19222 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.948133 22030 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:38.977476 21417 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.025336 19293 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.051870 21417 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.054092 21417 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.027412 22036 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.055840 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.056655 22036 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.057965 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.047602 19365 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:39.046594 19299 rpcz_store.cc:276] 0709 13:09:37.000441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.130927 (+130486us) service_pool.cc:224] Handling call
0709 13:09:37.143972 (+ 13045us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:09:37.144269 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.144490 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.144515 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.145858 (+  1343us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.569614 (+423756us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:37.569669 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.569771 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.016680 (+1446909us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:39.046069 (+ 29389us) raft_consensus.cc:1685] finished
0709 13:09:39.046088 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.046203 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124718720,"thread_start_us":423336,"threads_started":1,"wal-append.queue_time_us":731601}
W20260709 13:09:39.034857 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 367) took 2041 ms (client timeout 1785 ms). Trace:
W20260709 13:09:39.063045 19374 rpcz_store.cc:269] 0709 13:09:36.993092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.039971 (+ 46879us) service_pool.cc:224] Handling call
0709 13:09:39.034581 (+1994610us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000938d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:39.034745 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382844800}
I20260709 13:09:39.062750 19896 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:39.064388 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:39.064985 19299 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.065805 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:39.066987 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:39.043535 21573 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:39.017901 21688 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:09:39.048308 21898 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:39.070370 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.073930 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.074401 19293 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:39.056572 19898 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:39.231448 19300 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.227865 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.362037 19372 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.109895 19222 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:39.225456 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:39.159795 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.290975 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:39.244143 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.364622 19365 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:09:39.082566 19373 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:39.163957 19299 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:39.225800 19297 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:39.220871 21972 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.244s	user 0.004s	sys 0.000s
W20260709 13:09:39.364136 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.370183 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.367556 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 229945us
I20260709 13:09:39.363355 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.372857 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:39.067553 19368 raft_consensus.cc:2376] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:09:39.141264 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.367202 19300 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:39.158756 19219 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:39.368211 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:39.369472 19293 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:39.375077 19897 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:39.372974 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:39.375931 19219 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.376209 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:39.063499 21876 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:39.380411 19299 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:39.383858 19894 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.384764 22011 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.385027 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 473) took 2237 ms. Trace:
I20260709 13:09:39.385706 21999 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:39.386396 21999 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:39.387377 21847 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.387269 21999 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.387760 21847 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:39.224241 21851 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.388408 21851 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:39.389213 21851 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.390224 21851 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.391821 21860 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.392912 21860 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.393827 21894 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.396988 19216 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.399191 19216 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.399820 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.400099 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.403949 21890 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:39.404603 21890 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:39.404897 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.405560 21890 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.385427 19899 rpcz_store.cc:276] 0709 13:09:37.147823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.147936 (+   113us) service_pool.cc:224] Handling call
0709 13:09:37.148262 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.148557 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.148585 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.149114 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.564264 (+415150us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:37.616567 (+ 52303us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.738221 (+121654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.787880 (+ 49659us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.976308 (+188428us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b1800441400. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:39.155463 (+1179155us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:39.384772 (+229309us) raft_consensus.cc:1685] finished
0709 13:09:39.384795 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.384935 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34068,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":143627,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":11404,"spinlock_wait_cycles":161394816,"thread_start_us":386892,"threads_started":1,"wal-append.queue_time_us":642001}
I20260709 13:09:39.409756 19897 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:39.412029 19216 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:39.126554 21813 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:39.081624 21948 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:39.435472 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55462.5us
I20260709 13:09:39.437132 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:39.464006 19365 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:39.102819 21688 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.419737 21813 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:39.431876 21948 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.468288 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.473027 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.206760 21846 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.418980 21876 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.482358 19902 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:39.484263 21975 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:39.484501 21635 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.485091 21846 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.484880 21876 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.488636 22037 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.465878 21845 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.490940 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.469379 21905 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:39.477561 22042 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:09:39.499570 21905 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:39.500633 21905 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.502025 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 344) took 1239 ms. Trace:
I20260709 13:09:39.502454 19296 rpcz_store.cc:276] 0709 13:09:38.262458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.493919 (+231461us) service_pool.cc:224] Handling call
0709 13:09:38.494197 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.555658 (+ 61461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.555704 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:38.555757 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:38.555805 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.501774 (+945969us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54002b7ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:39.501826 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.501960 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140798336}
I20260709 13:09:39.503413 21688 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.504222 21845 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.505043 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 343) took 1242 ms. Trace:
I20260709 13:09:39.505419 19297 rpcz_store.cc:276] 0709 13:09:38.262213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.489467 (+227254us) service_pool.cc:224] Handling call
0709 13:09:39.225624 (+736157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.365667 (+140043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.504853 (+139186us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54002a9250. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:39.504986 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692272000}
I20260709 13:09:39.506369 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:39.506668 21845 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.508773 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:39.510492 21981 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:39.511039 21981 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:39.511889 21981 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.473174 21948 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.513422 21847 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.514315 22036 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:39.473459 22012 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.516549 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 345) took 1253 ms (client timeout 1657 ms). Trace:
I20260709 13:09:39.516422 22012 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:39.516989 19291 rpcz_store.cc:269] 0709 13:09:38.262689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.277345 (+ 14656us) service_pool.cc:224] Handling call
0709 13:09:39.516385 (+1239040us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540004a1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:39.516491 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328371456}
I20260709 13:09:39.518675 22012 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:39.518790 19369 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:39.519326 19369 pending_rounds.cc:85] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 6
I20260709 13:09:39.519613 19369 pending_rounds.cc:107] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:39.519896 19369 raft_consensus.cc:2889] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.520874 19896 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:39.514554 21847 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.523274 21639 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.523819 21639 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.524753 21898 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:39.518800 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 341) took 1257 ms. Trace:
I20260709 13:09:39.525722 19295 rpcz_store.cc:276] 0709 13:09:38.261661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.275408 (+ 13747us) service_pool.cc:224] Handling call
0709 13:09:38.294646 (+ 19238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.525570 (+230924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.518552 (+992982us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400048dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:39.518740 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465458560}
I20260709 13:09:39.529691 22019 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.530167 22019 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:39.531039 22024 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:39.530951 22019 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.534201 21898 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.537731 21931 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:38.197943 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.474303 22048 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
W20260709 13:09:39.549621 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58151.2us
I20260709 13:09:39.541344 19121 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 5, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.550820 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.547360 19265 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.550163 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.556545 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.558095 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:39.563916 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.564127 19897 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:39.572507 19216 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.549289 21988 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.585130 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.590293 19291 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:39.565683 21950 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.569621 21931 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.556510 22043 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.595846 22043 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.596251 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.597204 21931 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.575627 22019 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.597781 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.597949 22043 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.598559 19225 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:39.598517 22043 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.599125 22043 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.599429 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.600234 21988 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.601963 22006 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.602316 21988 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.603634 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.604224 19295 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:39.588600 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.606199 19222 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:39.613055 21639 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.616200 19895 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.613544 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.621034 21907 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.621483 21907 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:39.622143 21830 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.622314 21907 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.623708 21907 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.625260 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.626019 19217 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:39.626814 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.587409 19218 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:39.553936 21932 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:39.636700 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.643759 21932 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.645315 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:39.645988 21932 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.647202 22016 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:39.647612 22016 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.647939 22016 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.648437 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.649413 19217 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:39.651805 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.589243 19216 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:39.550777 21919 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:39.594904 21950 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.634796 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.662211 19903 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:39.577607 21982 raft_consensus.cc:2764] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:39.586934 19370 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:39.642385 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.655704 19365 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:39.656430 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 475) took 1404 ms. Trace:
I20260709 13:09:39.659823 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.664723 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:39.556027 21846 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:39.673499 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.678967 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.680852 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.681804 19292 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:39.668797 21875 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:39.652644 21639 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.685921 19294 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:39.627592 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.681694 19225 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
W20260709 13:09:39.703786 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.588660 22001 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:09:39.702975 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.697619 19218 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:39.669605 22008 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.675802 21964 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:39.731242 19293 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:39.734779 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.735551 19217 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:39.696089 21846 consensus_queue.cc:1243] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:39.675130 21978 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:09:39.754016 19188 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.726311 21656 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.673393 21919 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.737092 21964 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.766168 22043 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.721877 21639 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.717820 22005 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:09:39.757431 21932 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:39.737377 22008 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:39.796031 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.762219 21817 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:09:39.785918 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.780953 21964 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.782755 22048 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:39.828963 22011 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:39.829608 22011 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.831586 22011 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:39.831712 21919 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.815083 21880 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.836779 21948 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.839586 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 284) took 1338 ms. Trace:
I20260709 13:09:39.839728 21948 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.840939 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:39.841606 19896 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.843851 21872 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.844465 21872 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:39.846166 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1718) took 1865 ms (client timeout 1756 ms). Trace:
W20260709 13:09:39.847011 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.846683 21872 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:39.848522 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.849300 19292 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:39.849596 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:39.849982 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.850309 19300 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:39.850529 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.850375 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:39.851001 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.851136 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.851755 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.770538 21656 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:39.846597 19370 rpcz_store.cc:269] 0709 13:09:37.981119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.981227 (+   108us) service_pool.cc:224] Handling call
0709 13:09:39.845999 (+1864772us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400095bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:39.846097 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3595307392}
I20260709 13:09:39.851935 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.857218 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.857585 19292 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:39.802649 21830 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:39.864281 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.865410 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:39.791744 21932 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.867923 19300 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:39.859679 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.869454 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.880419 19370 raft_consensus.cc:2410] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:39.871294 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.873402 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.873570 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.882972 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.883682 19374 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:39.878383 19371 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:39.868374 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.840229 19223 rpcz_store.cc:276] 0709 13:09:38.501422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.505095 (+  3673us) service_pool.cc:224] Handling call
0709 13:09:38.528797 (+ 23702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.529135 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.529163 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.569387 (+ 40224us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.679667 (+110280us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:38.837263 (+157596us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.390102 (+552839us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4800080058. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:09:39.839229 (+449127us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54002c4aa0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e30733 00007fe8d7eb5dbf 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c
0709 13:09:39.839286 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.839363 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.839403 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:39.839414 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.839531 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160541,"prepare.queue_time_us":132969,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":6751,"raft.run_cpu_time_us":2591,"raft.run_wall_time_us":875307,"spinlock_wait_cycles":118179328,"thread_start_us":249903,"threads_started":2,"wal-append.queue_time_us":199850}
I20260709 13:09:39.886790 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.889003 19225 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:39.889359 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.854981 21982 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.892386 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:39.849269 21948 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:39.891424 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.890648 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:39.894388 19300 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:39.895144 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.866210 21999 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:39.820669 21851 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:39.890025 19366 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:39.893508 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.898561 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.901101 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:39.901929 19370 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:39.909387 19374 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:39.902930 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:39.902952 21948 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.876708 21813 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.918478 21813 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.902980 21880 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.920791 21639 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:39.922346 21656 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:39.922595 21948 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:39.920756 21880 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.899670 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:39.925063 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.908432 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:39.908445 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:39.936535 22016 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:39.937991 19365 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:39.940716 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:39.941041 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:39.941470 19292 raft_consensus.cc:2368] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9.
I20260709 13:09:39.941629 19903 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
W20260709 13:09:39.941695 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 394428us
I20260709 13:09:39.944517 19216 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:39.949136 19373 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:39.957685 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.958346 19373 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:39.959110 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:39.900642 22037 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.923648 21880 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.961753 19300 raft_consensus.cc:2368] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5.
I20260709 13:09:39.963233 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.964989 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:39.897249 19266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.756s (SENT) [suppressed 29 similar messages]
W20260709 13:09:39.977380 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.981460 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:39.984299 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.986261 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:39.989264 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:39.947781 21983 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.943584 21931 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.999279 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:39.910786 21851 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:39.994940 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.957983 22018 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.983467 19292 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:40.005452 19373 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:39.966323 21573 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.001881 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.007592 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:40.006765 21875 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.994184 21872 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.998003 21817 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.993885 21576 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.962195 21919 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:09:39.981986 21905 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:40.012975 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:39.964486 22037 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.010991 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:40.029611 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:40.031337 19291 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:40.025285 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.026978 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:40.006788 22064 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:39.995121 21417 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:09:40.035275 19292 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:40.001037 21931 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:39.990628 21874 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:40.011545 21573 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:40.019564 22065 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:40.022449 21830 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.003669 22036 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:40.028879 21653 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.033097 22037 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.037377 22005 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.041384 21931 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.049038 21573 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.034838 21948 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:09:40.050765 21830 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.041091 22064 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:40.064685 22057 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:09:40.067111 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 169867us
I20260709 13:09:40.039485 22063 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:09:40.056301 21898 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:40.048722 21981 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.060451 19896 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:09:40.121124 19295 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:40.071709 21984 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:40.119879 19292 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:40.122840 22000 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.007s	sys 0.014s
I20260709 13:09:40.070116 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:40.145504 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:40.145722 19368 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:09:40.146095 19903 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.146896 19368 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:40.108769 21830 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:40.150416 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 110495us
I20260709 13:09:40.150590 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.152508 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.153337 22041 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.154614 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.155507 22041 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.155851 19903 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:40.156325 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.115900 21932 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.162618 22064 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.166077 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1434) took 1164 ms. Trace:
I20260709 13:09:40.167382 22063 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.167778 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 140896us
I20260709 13:09:40.139694 21576 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.143078 21981 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.175127 19296 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:40.148824 22016 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:40.176421 21874 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:40.176874 22051 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.710s	user 0.002s	sys 0.000s
I20260709 13:09:40.176950 21851 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:40.176800 21984 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.178442 19295 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:09:40.148473 22000 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.007s	sys 0.014s
W20260709 13:09:40.179023 22066 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:40.178442 19297 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:40.052475 22065 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.190258 19224 rpcz_store.cc:276] 0709 13:09:39.001726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.371658 (+369932us) service_pool.cc:224] Handling call
0709 13:09:39.386880 (+ 15222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.538331 (+151451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.538362 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.538934 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.876678 (+337744us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:39.892136 (+ 15458us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.892409 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.892483 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.163907 (+271424us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b18001cd560. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:40.165712 (+  1805us) raft_consensus.cc:1685] finished
0709 13:09:40.165849 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.166004 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151078,"prepare.queue_time_us":120972,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":152401,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":4482,"spinlock_wait_cycles":10798464,"thread_start_us":330856,"threads_started":1,"wal-append.queue_time_us":482875}
I20260709 13:09:40.194131 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:40.269456 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75396.2us
I20260709 13:09:40.168105 21872 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:40.195312 21417 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:40.138792 21898 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.196846 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:40.198143 19219 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:40.177240 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 580) took 1794 ms. Trace:
W20260709 13:09:40.282713 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 85929.8us
W20260709 13:09:40.280903 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 130379us
I20260709 13:09:39.664559 19895 rpcz_store.cc:276] 0709 13:09:38.252373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.253876 (+  1503us) service_pool.cc:224] Handling call
0709 13:09:38.314311 (+ 60435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.615726 (+1301415us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b58005954d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:09:39.655972 (+ 40246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.656000 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.656056 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:39.656106 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.656225 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.656357 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7999,"spinlock_wait_cycles":2144660736}
I20260709 13:09:40.205657 21932 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.255025 21950 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:40.240195 22064 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:09:40.273819 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:40.286541 19222 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.193090 21982 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.245512 19216 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:40.255664 21880 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.283038 19902 rpcz_store.cc:276] 0709 13:09:38.382604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.384801 (+  2197us) service_pool.cc:224] Handling call
0709 13:09:38.385089 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.482909 (+1097820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.177027 (+694118us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006702d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:40.177185 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520491392}
I20260709 13:09:40.296629 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:40.285920 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:40.211054 21576 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.289587 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:40.294054 22041 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.306336 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:40.281924 21874 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.279876 21872 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:40.335162 19222 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:09:40.341090 21981 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.342877 21576 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.355623 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:40.302068 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:40.310635 22041 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:40.208515 22063 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.335569 22081 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.331298 21874 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.287043 21417 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.359809 21576 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:40.297591 21932 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.357764 21984 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:40.369170 22041 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.370208 21874 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.369776 19896 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:40.399520 19224 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:40.388386 21948 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:40.411232 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 105564us
W20260709 13:09:40.401401 21964 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 13:09:40.413991 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:40.421970 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 115733us
I20260709 13:09:40.426589 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:40.384493 21981 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:40.432876 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:40.434206 21576 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:40.434741 21576 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:40.435621 21576 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.382088 22081 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.389809 22078 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:09:40.385841 21872 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.394558 22037 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.444571 21984 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:40.412534 21931 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.432468 21964 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.470683 21984 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.483896 21984 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:40.478740 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51954us
I20260709 13:09:40.496670 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:40.497843 19216 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:40.498941 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:40.462504 22065 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.473094 21898 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.502106 19373 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:40.476853 21872 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.474088 22007 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.522517 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:40.514592 22089 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:40.547052 22037 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:40.545374 22065 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:40.552356 22065 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:40.649540 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 127116us
I20260709 13:09:40.581830 21688 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:40.521130 22063 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:40.694396 22089 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:09:40.665226 22095 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:40.717777 21964 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:40.721956 22099 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:09:40.692875 22007 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.692509 21932 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:40.696617 21876 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.739248 21573 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.001s
W20260709 13:09:40.740728 21830 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
W20260709 13:09:40.764391 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 99466.3us
I20260709 13:09:40.697039 21688 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:40.764358 22085 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:40.756822 21948 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.768067 21931 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.761332 22081 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.763195 22095 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:40.756882 22006 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:09:40.798115 22103 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:40.769690 21830 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.801817 21830 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.759820 21874 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.805893 21874 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.766989 21876 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.810746 21876 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.762950 22007 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.767545 21573 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:40.828696 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 402143us
I20260709 13:09:40.857019 21984 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.880342 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1599) took 1034 ms. Trace:
I20260709 13:09:40.881683 19300 rpcz_store.cc:276] 0709 13:09:39.846078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.908242 (+ 62164us) service_pool.cc:224] Handling call
0709 13:09:40.880072 (+971830us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b54003f2fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:40.880275 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74380544}
I20260709 13:09:40.888150 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:40.890503 22008 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:40.894682 21688 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:40.895960 21573 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:40.897397 22007 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:40.905896 21905 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:40.906817 21984 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:41.067277 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 300126us
W20260709 13:09:40.904148 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 906326us
I20260709 13:09:40.865412 22095 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:40.884795 22041 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:40.906649 21905 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.092437 22108 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:09:41.156436 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 269156us
I20260709 13:09:41.177057 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1745) took 1301 ms. Trace:
I20260709 13:09:41.177645 19366 rpcz_store.cc:276] 0709 13:09:39.876015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.906973 (+ 30958us) service_pool.cc:224] Handling call
0709 13:09:39.907282 (+   309us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:39.924920 (+ 17638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.924962 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:39.925577 (+   615us) log.cc:844] Serialized 78 byte log entry
0709 13:09:40.182373 (+256796us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18004424e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:09:40.272767 (+ 90394us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:40.288882 (+ 16115us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.154734 (+865852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.154817 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.154860 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:41.174705 (+ 19845us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.176972 (+  2267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883060,"prepare.queue_time_us":15963,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":881820,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8995,"spinlock_wait_cycles":3898752,"thread_start_us":90206,"threads_started":1,"wal-append.queue_time_us":379838}
I20260709 13:09:41.151894 21851 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:41.184576 22105 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.229s	user 0.000s	sys 0.007s
I20260709 13:09:41.173096 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:41.198158 19366 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:41.197330 21851 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:41.224720 22072 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.099s	user 0.005s	sys 0.005s
I20260709 13:09:41.199071 22008 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.226296 22008 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:41.229079 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.236039 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 360) took 1403 ms. Trace:
W20260709 13:09:41.236109 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 81081.7us
I20260709 13:09:41.237413 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.236496 19293 rpcz_store.cc:276] 0709 13:09:39.832559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.834651 (+  2092us) service_pool.cc:224] Handling call
0709 13:09:39.835000 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.835314 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.835341 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.835885 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.011707 (+175822us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:40.011763 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.014319 (+  2556us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.224127 (+1209808us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:41.228382 (+  4255us) raft_consensus.cc:1685] finished
0709 13:09:41.228403 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.235976 (+  7573us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1148,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":26051456,"thread_start_us":175430,"threads_started":1,"wal-append.queue_time_us":289083}
I20260709 13:09:41.240288 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:41.240309 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 87299.7us
W20260709 13:09:41.242969 19191 leader_election.cc:336] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.118s (SENT)
I20260709 13:09:41.197576 22116 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.232302 21860 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:41.251446 19191 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.176s (SENT)
I20260709 13:09:41.252099 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:41.236538 22000 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.253154 19191 leader_election.cc:336] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.230s (SENT)
I20260709 13:09:41.255657 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.257586 19374 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:41.250051 21847 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:41.259331 21847 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.259716 21847 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:41.244068 22012 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.260711 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:41.244904 22019 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.243794 21999 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.243734 21980 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.262967 19191 leader_election.cc:336] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.242s (SENT)
I20260709 13:09:41.248885 21907 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:41.256469 21984 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.253403 21860 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:41.267555 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:41.268663 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:41.250523 21905 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.266820 21980 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.253545 21894 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:09:41.265514 22019 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.272724 21980 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:41.253322 21964 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:41.264636 21931 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.275187 21860 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.276011 22041 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:41.269871 21907 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.254396 22116 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.266570 21999 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:41.283684 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.284557 21931 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:41.285035 21931 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:41.285424 21931 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:41.291100 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 120535us
I20260709 13:09:41.292501 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.296893 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:41.260699 22000 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.276252 21860 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.299918 21417 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:41.292284 21980 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:41.296005 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.287961 22042 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.304111 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1748) took 1423 ms. Trace:
I20260709 13:09:41.290213 21894 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.305680 19367 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:41.291404 21964 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:41.265616 22012 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.307150 19370 rpcz_store.cc:276] 0709 13:09:39.880344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.911418 (+ 31074us) service_pool.cc:224] Handling call
0709 13:09:39.911720 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.022852 (+111132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.022882 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.022928 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:40.022965 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.303882 (+1280917us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400093dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:41.303927 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.304040 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255101312}
I20260709 13:09:41.314429 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.315503 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.318874 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.318794 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.322542 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:41.323064 19897 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.323792 19903 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:41.324532 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:41.325098 19899 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:41.325264 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83502.5us
I20260709 13:09:41.319576 19370 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:41.328136 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:41.329973 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.334369 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:41.340176 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:41.346160 21905 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.347450 21999 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.316293 21964 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.351709 21964 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.354813 21653 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.364055 19899 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:41.313550 21894 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.339313 19216 raft_consensus.cc:2955] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:41.311539 22042 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.367673 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:41.378188 19370 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.356745 22008 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.385562 19367 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:41.341570 22108 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:41.387410 19368 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:41.396489 19366 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:09:41.397809 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.400563 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:41.406384 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:41.407109 19370 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:41.411159 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:41.389439 21860 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:41.413086 21860 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.389621 22008 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.417217 22008 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.419668 22008 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.410099 22116 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.420974 21980 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:41.421428 21980 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:41.421810 21980 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:41.423911 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:41.428412 19897 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:41.438426 19896 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:41.438653 21931 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.407680 21905 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:09:41.441152 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1449) took 1795 ms (client timeout 1575 ms). Trace:
W20260709 13:09:41.441762 19218 rpcz_store.cc:269] 0709 13:09:39.636231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.636408 (+   177us) service_pool.cc:224] Handling call
0709 13:09:41.431515 (+1795107us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b54000780d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:41.431652 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123215232}
W20260709 13:09:41.456696 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 122363us
W20260709 13:09:41.565322 22118 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:09:41.567440 22042 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.569003 21894 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.569670 21931 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.430691 22098 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:41.572469 22098 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.572921 22098 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.430801 22041 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:41.576493 22041 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:41.576882 22041 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.431855 21984 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:41.572002 21980 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.580413 21984 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:41.588472 22012 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.689819 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1587) took 2909 ms. Trace:
I20260709 13:09:41.698354 21980 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:41.708091 22123 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:09:41.717116 22042 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:41.718921 22037 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:41.720920 19372 rpcz_store.cc:276] 0709 13:09:38.780824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.808400 (+ 27576us) service_pool.cc:224] Handling call
0709 13:09:38.810080 (+  1680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.362572 (+552492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.689435 (+2326863us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54000b40d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:41.689731 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106933120}
I20260709 13:09:41.734268 21894 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:41.696024 22080 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:41.717198 21905 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:41.730746 21964 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.731043 22042 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:41.734853 21894 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.696817 21847 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.732306 22037 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.743515 21964 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:41.800189 19371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1597) took 2683 ms (client timeout 1540 ms). Trace:
W20260709 13:09:41.802145 19371 rpcz_store.cc:269] 0709 13:09:39.067551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.070141 (+  2590us) service_pool.cc:224] Handling call
0709 13:09:41.750356 (+2680215us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54001626d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:41.750514 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191208192}
I20260709 13:09:41.805151 19374 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:41.742730 21905 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:41.811784 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 254021us
W20260709 13:09:41.813072 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83014.7us
I20260709 13:09:41.739897 22080 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:41.815235 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:41.749311 21984 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.820706 22125 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.846635 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:41.847690 19371 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:41.851275 19371 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:41.815685 22042 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.055781 22000 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.853921 22116 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.077802 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:42.078399 21964 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:41.897921 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 971418us
I20260709 13:09:41.940269 21905 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.901432 21847 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:42.038224 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.981841 21860 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.054185 21851 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.888899 22098 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.037931 22063 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:42.038604 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:41.994871 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1606) took 1995 ms (client timeout 2080 ms). Trace:
I20260709 13:09:41.836359 22129 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:41.990769 21980 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.052872 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1802) took 1782 ms. Trace:
I20260709 13:09:42.003978 22019 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:41.902698 21948 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.890861 22041 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:41.954825 22080 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:41.856218 21696 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:41.900107 21830 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.051761 19122 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 248) took 18394 ms (client timeout 15000 ms). Trace:
I20260709 13:09:41.847589 22125 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:41.896274 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 1.06199e+06us
I20260709 13:09:42.049232 19121 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:41.899183 22065 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.079854 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:42.082681 19896 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:42.083496 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:42.083724 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:42.084429 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:42.085085 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:42.086472 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:42.087122 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:42.089598 19373 rpcz_store.cc:269] 0709 13:09:39.999658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.012724 (+ 13066us) service_pool.cc:224] Handling call
0709 13:09:41.994571 (+1981847us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54004263d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:41.994780 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088716672}
I20260709 13:09:41.892078 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 367) took 1185 ms. Trace:
W20260709 13:09:42.178395 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 77845.1us
I20260709 13:09:41.980332 22012 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:42.182330 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.183306 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:42.091380 19224 rpcz_store.cc:276] 0709 13:09:40.270659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.276660 (+  6001us) service_pool.cc:224] Handling call
0709 13:09:40.285950 (+  9290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.401850 (+115900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.052525 (+1650675us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001c4654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:42.052791 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256691712}
W20260709 13:09:42.089691 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51180us
I20260709 13:09:42.091835 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:42.194139 19371 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.094856 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:42.186830 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:42.199753 19368 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.200830 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.190256 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:42.202359 19902 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:42.191108 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:41.895917 21874 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.095697 19121 catalog_manager.cc:5697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 7, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 7 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.195699 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:42.210024 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 115244us
I20260709 13:09:42.211181 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:42.211393 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:42.216689 19367 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.008069 21880 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.038178 21907 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.090700 22129 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.219187 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:42.224655 19903 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:42.205374 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:41.902511 21576 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.235348 19121 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.857676 21894 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.087160 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:42.089389 21919 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.081040 22042 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.083855 21890 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.086129 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:41.888502 22008 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.276590 22106 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.093379 22041 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.175132 22084 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.088938 22063 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.094389 22098 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.186599 22065 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.196704 22086 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.187577 21417 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.271523 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52466.4us
I20260709 13:09:42.310809 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:42.291576 19894 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:42.250401 21874 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:42.093796 19122 rpcz_store.cc:269] 0709 13:09:23.657594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.657807 (+   213us) service_pool.cc:224] Handling call
0709 13:09:42.051615 (+18393808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:34.823310 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:34.841280 (+ 17970us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:34.841336 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:09:34.841369 (+    33us) tablet.cc:662] Decoding operations
0709 13:09:34.936484 (+ 95115us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:34.936566 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:34.936593 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:09:34.937958 (+  1365us) tablet.cc:701] Row locks acquired
0709 13:09:34.938018 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:09:34.938182 (+   164us) write_op.cc:270] Start()
0709 13:09:34.938327 (+   145us) write_op.cc:276] Timestamp: P: 1783602574938123 usec, L: 0
0709 13:09:34.938345 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:09:34.971843 (+ 33498us) log.cc:844] Serialized 6772 byte log entry
0709 13:09:35.401667 (+429824us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb0e28 00007fe8db8eb581 00007fe8db8ead58 00007fe8db8ef9f1 00007fe8db8ef9a9 00007fe8db8ef939 00007fe8db8ef901 00007fe8db8eeb2d 000000000038f354 000000000038f199
0709 13:09:36.127820 (+726153us) op_driver.cc:464] REPLICATION: finished
0709 13:09:36.407465 (+279645us) write_op.cc:301] APPLY: starting
0709 13:09:36.407568 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:36.407925 (+   357us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:36.407963 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:36.426131 (+ 18168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:36.426550 (+   419us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:09:36.428717 (+  2167us) write_op.cc:312] APPLY: finished
0709 13:09:36.526571 (+ 97854us) log.cc:844] Serialized 119 byte log entry
0709 13:09:36.526797 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.526962 (+   165us) write_op.cc:454] Released schema lock
0709 13:09:36.527041 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:36.604406 (+ 77365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.612781 (+  8375us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1694362,"reported_tablets":44,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":251270,"apply.run_cpu_time_us":5592,"apply.run_wall_time_us":165958,"num_ops":17,"prepare.queue_time_us":254676,"prepare.run_cpu_time_us":20459,"prepare.run_wall_time_us":611762,"raft.queue_time_us":812390,"raft.run_cpu_time_us":13825,"raft.run_wall_time_us":280433,"replication_time_us":1160085,"spinlock_wait_cycles":7182720,"thread_start_us":1280369,"threads_started":4,"wal-append.queue_time_us":235131,"wal-append.run_cpu_time_us":45694,"wal-append.run_wall_time_us":2307970}]]}
I20260709 13:09:41.989180 22037 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:42.336526 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 131270us
I20260709 13:09:42.339171 21874 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.315053 22065 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.342583 22065 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.335078 21417 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.349447 19292 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:42.350620 21417 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.310106 22084 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.315308 22086 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.358577 22086 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.359125 22084 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.360543 22120 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:42.361126 22120 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.363483 22120 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.363870 21931 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:42.364573 21931 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:42.091892 21948 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.256814 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.300051 19898 raft_consensus.cc:2376] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6. Re-sending same reply.
I20260709 13:09:42.378269 19293 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:09:42.307997 22041 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.288760 19121 catalog_manager.cc:5697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 4, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.188081 22019 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:42.235093 22093 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.082571 22116 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.236888 22064 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:42.302080 22008 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.235921 21851 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.257679 19371 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:42.248757 22007 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:42.201221 21817 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:09:42.091101 21980 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.273357 21880 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:42.092857 21696 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.273141 22129 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.424065 22019 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:42.376953 19368 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:42.187726 22016 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:42.260804 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:42.234002 22080 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.171818 19298 rpcz_store.cc:276] 0709 13:09:40.706663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.706790 (+   127us) service_pool.cc:224] Handling call
0709 13:09:40.707043 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.707229 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:40.790489 (+ 83260us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.891413 (+1100924us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b1800376600. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:09:41.891613 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.891683 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:41.891753 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.891845 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.892001 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10203,"prepare.queue_time_us":59168,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":1102734,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":60573440,"thread_start_us":49761,"threads_started":1}
W20260709 13:09:42.407519 19365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.080s	sys 0.069s
W20260709 13:09:42.473326 19365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.080s	sys 0.069s
I20260709 13:09:42.407795 22041 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.291049 21576 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.298475 21890 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.423319 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.476936 19293 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:42.422880 22120 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:42.096215 22125 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.366402 21801 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.248546 21845 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:42.431648 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:42.485966 19292 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.428547 22064 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.437310 22063 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.449837 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.491117 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.491971 19296 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:42.234403 22012 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.454958 22007 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.406677 21875 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:42.365582 21931 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.093159 21830 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.445737 21851 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.425477 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:42.467883 21880 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:42.516754 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 90762.1us
I20260709 13:09:42.485070 22080 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.485553 21845 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:42.474695 22016 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.514725 21851 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:42.525602 22121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.067s	sys 0.093s
I20260709 13:09:42.523012 22000 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:42.526392 21845 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:42.534896 22121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.067s	sys 0.094s
I20260709 13:09:42.513559 21875 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.541534 22000 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.582419 22138 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:42.582892 22016 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.527601 22019 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.584565 22000 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.638650 22064 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.638940 22116 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:42.639838 22136 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:09:42.615446 22135 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:42.660207 22119 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:42.660857 22119 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:42.661993 22119 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.663614 22119 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.667320 22129 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.672709 22129 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.709702 19121 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 4 to 6, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 6 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.716598 19121 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 6, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 6 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:42.724547 19225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.001s
I20260709 13:09:42.729322 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:42.494717 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:42.642728 22114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.010s	sys 0.016s
I20260709 13:09:42.786458 21696 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.797278 21696 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:42.798799 21880 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.798944 22080 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.787393 21980 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.789103 19293 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:42.802093 21830 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.802846 21875 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.802985 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.804383 22084 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.804874 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.805167 22012 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.805063 22084 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:42.805820 19293 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:42.807238 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:42.808274 19225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.002s	sys 0.002s
I20260709 13:09:42.809653 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1807) took 2537 ms. Trace:
I20260709 13:09:42.810036 19225 rpcz_store.cc:276] 0709 13:09:40.272460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.275868 (+  3408us) service_pool.cc:224] Handling call
0709 13:09:40.277024 (+  1156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.277484 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.277517 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.282777 (+  5260us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.901943 (+619166us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4800080058. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:09:42.213970 (+1312027us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18003d1a40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:09:42.809069 (+595099us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:42.809131 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.809239 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.809305 (+    66us) raft_consensus.cc:1685] finished
0709 13:09:42.809315 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.809520 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":251676,"raft.queue_time_us":1196,"raft.run_cpu_time_us":9318,"raft.run_wall_time_us":620417,"spinlock_wait_cycles":10747520,"thread_start_us":594652,"threads_started":1,"wal-append.queue_time_us":2314847}
I20260709 13:09:42.812546 22090 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.813566 21948 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.813349 22090 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.815518 21576 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.745103 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:42.479593 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.816084 22090 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.749394 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:42.767994 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:42.798631 22113 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.745965 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.816203 19293 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:42.816581 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.804394 22095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.502s	user 0.005s	sys 0.032s
W20260709 13:09:42.862563 22095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.561s	user 0.005s	sys 0.033s
I20260709 13:09:42.748912 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.817808 19292 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:42.820294 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:42.861416 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 113585us
I20260709 13:09:42.861884 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:42.789743 22114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.010s	sys 0.016s
I20260709 13:09:42.820392 21801 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:42.868489 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.869230 21696 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:42.874359 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:42.874959 22095 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:42.874527 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 145606us
I20260709 13:09:42.874480 19121 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.829389 21890 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.865163 19296 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.791952 22041 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.875428 22113 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.790496 22008 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:42.820657 22064 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:09:42.898699 19291 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:42.792399 21984 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:09:42.885468 21696 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:42.912403 19293 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:42.902091 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.908350 21801 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:42.909132 19368 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.892038 22095 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:42.792932 22065 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:09:42.925927 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:42.923872 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.008s
W20260709 13:09:42.951000 19188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.013s	sys 0.002s
W20260709 13:09:42.961222 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.004s	sys 0.008s
W20260709 13:09:42.963739 19188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.013s	sys 0.003s
I20260709 13:09:42.925688 22041 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:42.969179 19298 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:42.970284 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.967249 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:42.950052 22084 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:42.972841 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:42.973591 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 151384us
I20260709 13:09:42.974124 19295 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:42.963279 19121 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 4 to 5, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:42.976200 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.010s	sys 0.028s
I20260709 13:09:42.978302 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1603) took 3131 ms. Trace:
I20260709 13:09:42.967748 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.972942 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:42.968065 19297 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:09:42.985930 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.010s	sys 0.028s
I20260709 13:09:42.983124 19291 rpcz_store.cc:276] 0709 13:09:39.847048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.032121 (+185073us) service_pool.cc:224] Handling call
0709 13:09:40.880242 (+848121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.950765 (+2070523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.976956 (+ 26191us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54003f2fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:42.978046 (+  1090us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54003f2fd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:42.978188 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6498796544}
I20260709 13:09:42.989106 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:42.979698 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.000903 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.001288 21931 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.001958 21931 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.004092 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.004387 21931 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:42.996237 19300 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:43.004932 19218 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:43.005024 19223 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:43.011822 19293 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:42.988808 22041 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:42.986512 22008 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.005088 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.021685 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:43.022118 22000 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.023242 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:43.023670 22113 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:43.025072 19295 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:43.025492 19295 pending_rounds.cc:85] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 3
I20260709 13:09:43.025784 19295 pending_rounds.cc:107] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:43.026047 19295 raft_consensus.cc:2889] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:43.025305 19121 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:43.019004 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:42.993513 21984 consensus_queue.cc:1243] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:43.024035 19221 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.038734 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.038873 19217 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:42.974200 21696 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.033929 19216 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:43.179960 19296 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:43.059863 19294 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:43.049199 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:43.182775 19368 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:09:43.039985 19224 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:43.051448 21980 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:43.055459 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:43.253314 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.067817 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:43.254465 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 275231us
I20260709 13:09:43.255198 19894 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:43.255726 22120 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:43.256304 21851 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
I20260709 13:09:43.055313 22008 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.256834 21851 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.257407 19371 raft_consensus.cc:2410] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:43.068255 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.258337 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:43.258776 19903 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:43.055456 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.259126 21851 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.259496 19372 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:43.259665 22008 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:43.260572 21919 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.968s	user 0.008s	sys 0.012s
I20260709 13:09:43.261112 21919 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:43.261938 22120 raft_consensus.cc:2764] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:43.253386 21980 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:43.052883 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 742135us
I20260709 13:09:43.265343 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:43.266091 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.266750 19374 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:43.267409 22084 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.267685 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.265159 21980 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.270620 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.271107 21980 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.267740 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.272342 19374 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:43.269316 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:43.268718 19369 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:43.043340 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:43.042018 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:43.053215 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:43.284857 19372 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
W20260709 13:09:43.062832 21845 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.512s	user 0.003s	sys 0.009s
I20260709 13:09:43.059664 19121 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.182439 22000 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.069154 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.060703 22144 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:43.058640 22007 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.300798 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:43.301499 19366 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:43.301427 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 291225us
I20260709 13:09:43.300880 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:43.052256 22064 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:43.303550 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:43.305719 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:43.300814 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:43.309548 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:43.312578 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 270839us
I20260709 13:09:43.316306 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:43.055033 22095 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.316300 19298 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.319422 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:43.056279 22041 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.327196 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.297919 21845 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.331502 22012 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:43.325589 21851 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.340354 19295 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:43.340986 22012 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:43.342233 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.344491 19299 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 5: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:43.325335 22019 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:43.328922 21801 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.363721 19366 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:43.359298 19298 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:09:43.395429 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62059us
I20260709 13:09:43.352747 21851 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.400588 22106 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:43.402033 22166 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:43.345561 22144 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.332752 22064 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:43.403867 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 134718us
W20260709 13:09:43.425690 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 141487us
I20260709 13:09:43.407615 21851 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.407631 22106 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.424571 19121 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:43.395799 22019 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.440454 22106 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.459086 19903 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:43.469434 22146 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:43.470074 22146 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:43.477231 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.477633 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:43.478516 19217 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:09:43.483769 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.471323 22146 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.495875 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.500185 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.484561 21845 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:43.522605 19217 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:43.523746 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.524971 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.525781 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1481) took 1205 ms. Trace:
I20260709 13:09:43.534536 19216 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:43.537953 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.545996 19224 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:43.527432 19121 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 5, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.507594 21919 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:43.550812 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.550745 19121 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:43.551781 19220 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:43.552755 19121 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:43.562707 22007 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:43.563401 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.565199 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.565919 19220 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:43.566850 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:43.568971 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.569670 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.525260 21801 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:09:43.535811 19300 rpcz_store.cc:276] 0709 13:09:42.320200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.015368 (+695168us) service_pool.cc:224] Handling call
0709 13:09:43.057763 (+ 42395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.058163 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.058190 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.058659 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.319319 (+260660us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:43.319365 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.319427 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.525557 (+206130us) raft_consensus.cc:1685] finished
0709 13:09:43.525592 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.525727 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1124,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":260203,"threads_started":1,"wal-append.queue_time_us":358853}
I20260709 13:09:43.499370 22012 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.543479 22144 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.588742 19903 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:43.584122 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.585897 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:43.649087 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.654353 19903 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:09:43.659016 22000 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:43.659766 22000 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.665364 19224 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:43.597460 22146 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:43.736308 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:43.656415 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:43.698621 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 189576us
I20260709 13:09:43.737980 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.749902 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:43.774293 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 275738us
I20260709 13:09:43.752113 19216 raft_consensus.cc:2410] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:09:43.775897 19220 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:43.772852 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 118840us
W20260709 13:09:43.758328 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.588902 21919 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:43.612152 22084 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:09:43.783326 19221 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
W20260709 13:09:43.785339 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 128321us
W20260709 13:09:43.782029 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 241319us
I20260709 13:09:43.781354 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:43.798089 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.798820 19224 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:43.800805 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.801484 19217 raft_consensus.cc:1813] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:09:43.801998 19217 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:43.802963 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:43.808907 22007 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:43.810693 21830 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:43.811199 21830 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:43.812273 21830 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:43.813666 21919 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:43.814466 22175 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:09:43.815337 19218 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:43.815744 19218 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:43.817071 19218 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:43.817800 22173 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:09:43.820674 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:43.818397 19218 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:43.833734 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47505.1us
I20260709 13:09:43.834056 22019 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:43.870754 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64873.5us
I20260709 13:09:43.837356 21890 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:43.867973 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73384.7us
I20260709 13:09:43.865548 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:43.867328 19339 leader_election.cc:336] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.514s (SENT)
I20260709 13:09:43.885605 19221 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:43.891052 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:43.854598 22008 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:43.898792 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:43.887733 22064 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.917279 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:43.917538 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:43.911816 22000 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:43.908401 22095 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.923137 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:43.934062 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 97360us
W20260709 13:09:43.954397 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 157099us
W20260709 13:09:43.959748 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49469.5us
I20260709 13:09:43.909456 22019 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.966192 19219 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:43.933123 22095 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:44.013345 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.956194 21890 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:43.970741 22098 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:43.912192 22008 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:43.978621 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 113275us
I20260709 13:09:43.979735 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.981820 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.980901 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:43.990159 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.020083 19224 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:43.969436 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.022456 22012 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:44.026753 19223 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:09:44.027125 19191 leader_election.cc:336] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.507s (SENT)
I20260709 13:09:43.976969 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.027168 19223 pending_rounds.cc:85] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 3
I20260709 13:09:43.996995 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:44.028590 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116296us
W20260709 13:09:43.984630 22182 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
W20260709 13:09:43.976123 22172 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.515s	user 0.006s	sys 0.000s
I20260709 13:09:44.025759 22012 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.029683 19218 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:44.005620 22000 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:43.977677 22187 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:09:43.978260 22194 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:44.032847 19223 pending_rounds.cc:107] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:44.057112 19223 raft_consensus.cc:2889] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.034636 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:43.964989 22064 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:44.010825 21830 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.018780 22095 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.044329 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.013132 22114 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:44.043857 19221 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:44.051735 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.041402 19218 pending_rounds.cc:85] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:09:44.069388 19218 pending_rounds.cc:107] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:44.069749 19218 raft_consensus.cc:2889] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.063326 19220 raft_consensus.cc:2410] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:44.060444 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.029809 22098 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:44.080567 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53484.7us
W20260709 13:09:44.087906 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58626.4us
W20260709 13:09:44.089277 22193 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:09:44.026937 21890 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:44.092490 19339 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.575s (SENT)
W20260709 13:09:44.095208 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66759.5us
I20260709 13:09:44.044610 22000 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:44.108753 22064 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:44.109542 22113 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.109619 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.110195 22113 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.097123 22007 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:44.111325 22007 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:44.111800 22007 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.073926 22114 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:44.120592 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 123712us
I20260709 13:09:44.096351 22146 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.120877 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:44.106058 22000 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.104367 22019 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.127363 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:44.119530 22114 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.131084 19903 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.131327 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:44.131953 22191 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 13:09:44.132138 19898 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
W20260709 13:09:44.133023 22169 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.619s	user 0.000s	sys 0.003s
W20260709 13:09:44.133505 22181 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.610s	user 0.002s	sys 0.000s
W20260709 13:09:44.135361 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 107061us
I20260709 13:09:44.136211 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.131206 19899 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.129889 19340 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:44.144277 22106 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:09:44.144857 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.144793 22106 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.146049 21801 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:44.146258 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.146595 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.146801 21801 consensus_queue.cc:1243] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:44.146958 22106 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.147157 19216 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:44.148458 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.149434 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1454) took 1122 ms. Trace:
I20260709 13:09:44.149549 22090 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.148458 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.150295 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.150177 22090 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.150641 19374 raft_consensus.cc:2368] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:44.151172 19216 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:44.151885 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1482) took 1776 ms. Trace:
I20260709 13:09:44.152215 22008 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:44.152755 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.152266 19292 rpcz_store.cc:276] 0709 13:09:42.375058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.017436 (+642378us) service_pool.cc:224] Handling call
0709 13:09:43.061137 (+ 43701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.061574 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:43.061911 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.286680 (+224769us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.295989 (+  9309us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.296154 (+   165us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:43.296220 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.296281 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.975101 (+678820us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:44.151588 (+176487us) raft_consensus.cc:1685] finished
0709 13:09:44.151688 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.151808 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":205,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":47,"raft.queue_time_us":2173,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":6121,"spinlock_wait_cycles":33331968,"thread_start_us":223487,"threads_started":1,"wal-append.queue_time_us":375270}
I20260709 13:09:44.153986 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.154000 22012 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:44.155069 22090 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.126124 22019 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:44.156205 22019 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.156538 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.157702 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.158799 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.159531 19218 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:44.159569 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:44.160377 22064 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:44.161077 22064 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.164484 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.164974 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.165247 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.165621 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.165913 19217 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:44.166311 19218 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:44.166772 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.167009 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.167364 19217 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:44.167515 19218 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:44.149829 19223 rpcz_store.cc:276] 0709 13:09:43.027271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.524444 (+497173us) service_pool.cc:224] Handling call
0709 13:09:43.524727 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.084125 (+559398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.149210 (+ 65085us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001b2954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:44.149377 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127289216}
I20260709 13:09:44.169121 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1828) took 1167 ms. Trace:
I20260709 13:09:44.169579 19219 rpcz_store.cc:276] 0709 13:09:43.001841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.036330 (+ 34489us) service_pool.cc:224] Handling call
0709 13:09:43.056717 (+ 20387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.966655 (+909938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.168802 (+202147us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54003c7dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:44.169002 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789469440}
I20260709 13:09:44.173506 19225 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:44.149696 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.174870 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.175287 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.175570 19217 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.177989 19899 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:44.183646 19903 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:44.140771 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48338.6us
W20260709 13:09:44.190341 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 62901.4us
I20260709 13:09:44.191330 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.129192 22113 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:44.198187 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.198987 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77410us
I20260709 13:09:44.208899 19903 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:44.215919 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:44.198031 21880 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:44.217442 21880 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.217783 22095 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.218677 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.219336 19295 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:44.220549 22144 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.221297 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:44.173648 21801 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:44.224601 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.249886 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.250947 19216 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:44.257330 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58369.2us
I20260709 13:09:44.330986 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.313419 19217 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:44.340154 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.329013 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.344262 19224 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:44.264459 19220 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:44.283740 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.259799 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.351122 19223 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:44.258510 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.353744 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:44.356029 19339 leader_election.cc:336] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.651s (SENT)
I20260709 13:09:44.356494 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:44.365598 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 107342us
I20260709 13:09:44.366890 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:44.316812 21851 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.837s	user 0.010s	sys 0.003s
I20260709 13:09:44.217824 21880 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.369886 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:44.368964 19371 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:44.284554 22084 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:44.374748 22084 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.375185 22084 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.379172 22007 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.380303 19368 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:44.381100 19300 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:44.248615 21801 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:44.382335 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.258531 22012 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:44.365020 22098 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:44.382927 21801 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.384583 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:44.370831 22095 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.385145 21801 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.369040 22008 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:44.386159 22008 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:44.386555 22008 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.380287 22207 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.388648 21851 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.392982 22080 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:44.393462 22080 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.393939 22080 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.393517 22084 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.394693 21851 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:44.396267 22084 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.396528 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.372402 22146 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.397161 22146 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.397476 22146 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.393005 19370 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:44.314458 22000 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.401893 21696 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.402243 22000 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:44.402484 21696 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.404903 19374 raft_consensus.cc:2368] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7.
I20260709 13:09:44.409271 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.368448 21890 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.415246 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.412351 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:44.416808 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.421337 19265 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.426177 22197 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:44.426241 19339 leader_election.cc:336] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.785s (SENT)
I20260709 13:09:44.427629 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.428508 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.428836 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.429296 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:44.432901 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.435530 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.438304 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.434046 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:44.440898 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.427722 22144 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:44.444744 22080 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.447132 19372 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:44.447352 22080 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.448155 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.448446 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.448555 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:44.448884 19372 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:44.449287 19368 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.449537 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.449676 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.450656 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.450814 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.451853 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.452536 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:44.452973 19217 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:44.453284 19366 raft_consensus.cc:2368] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:44.453863 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.454113 19370 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:44.456899 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.419775 22095 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.460400 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.461018 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.464614 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.434273 21830 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.469583 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:44.437103 22064 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.466743 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.467531 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.472600 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.468315 19368 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:44.475477 19369 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:44.453015 21696 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.461740 22095 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.490741 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.491770 19366 raft_consensus.cc:2410] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:44.493150 22008 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.493604 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.476527 22064 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.495318 22064 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.496784 22041 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:44.497545 22041 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:44.498804 22041 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.470377 22113 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.439319 22106 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:09:44.459985 22144 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:44.466378 22098 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.437783 21890 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.457878 22019 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.516115 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:44.516634 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47499.9us
I20260709 13:09:44.525792 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.525939 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.528959 21830 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:44.530023 21830 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:44.531078 21830 consensus_queue.cc:1243] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:44.531693 21830 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.532521 21830 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.535454 21830 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.536216 21830 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.496001 22008 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:44.537974 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.463630 22114 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.502678 22095 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:44.540496 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79565.5us
W20260709 13:09:44.542692 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.547034 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 68995.7us
I20260709 13:09:44.510061 22113 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.543685 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.541672 19219 raft_consensus.cc:2376] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7. Re-sending same reply.
I20260709 13:09:44.550141 22012 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.551039 22019 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:44.552260 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.554623 22218 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:44.544479 21830 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.564936 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.565464 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:44.558441 22113 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.545827 22007 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:44.580703 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.560047 22207 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.558117 22012 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:44.558288 22218 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:44.594532 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.595131 22012 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.601634 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.602324 19374 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:44.594628 22000 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:44.609902 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44103.2us
I20260709 13:09:44.598837 21696 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.625066 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.598199 21830 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.603622 22207 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.645663 21830 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.586807 22190 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:09:44.611691 22000 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:44.663962 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 101305us
W20260709 13:09:44.666999 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 101596us
I20260709 13:09:44.671089 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.679247 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:44.670240 22000 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.655372 21696 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.682982 19374 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:44.688741 22216 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:44.691147 19300 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:44.691610 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.692306 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.692890 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.693547 21696 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.694039 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.694625 19294 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:44.694720 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.695178 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet ce726108fd4e452b9a0b91d535939c7d with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41698
I20260709 13:09:44.695549 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.696535 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:44.697286 19191 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.629s (SENT)
I20260709 13:09:44.697311 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.699795 19298 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:44.701169 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.709453 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:44.676378 22080 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.712419 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:44.713214 19299 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:44.714619 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:44.715199 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.676138 21890 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.668396 21830 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.732227 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.731241 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.628314 22144 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.740376 21830 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.744736 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:44.688010 22218 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.746537 22218 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.747062 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:44.747232 22095 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.748664 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:44.746266 22146 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.770533 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.771481 19294 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:44.749349 22095 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.778110 19218 raft_consensus.cc:2368] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:44.760542 22114 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:44.774187 22019 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:44.792614 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 177413us
W20260709 13:09:44.794384 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 89587.5us
I20260709 13:09:44.782928 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:44.817554 19337 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:44.820811 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:44.821993 22221 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.824100 19897 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:44.737120 22224 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:09:44.824360 19294 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:44.780864 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:44.853615 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.832840 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.815191 22019 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.857777 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.854360 19222 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:44.859531 19296 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:44.865468 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48045.8us
I20260709 13:09:44.866220 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:44.870436 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 101955us
I20260709 13:09:44.878403 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:44.865056 22019 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.884227 19292 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:44.870761 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:44.881569 21880 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:44.885092 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:44.885210 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58654.5us
I20260709 13:09:44.883491 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.883569 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:44.886336 19298 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:44.885807 19294 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:44.833218 22008 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:44.896226 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:44.902262 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.878669 22229 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.904215 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:44.832916 22235 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:09:44.902136 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:44.907950 19219 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:44.896474 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.897991 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:44.832856 22241 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:09:44.902230 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.906595 19294 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.908751 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.909158 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:44.911700 19291 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:44.916216 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.902940 22207 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:44.901796 22203 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:44.920917 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.922281 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:44.925884 19291 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:44.915128 22236 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:44.907823 22229 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.939180 22241 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:44.940685 21851 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:44.941447 22000 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:44.945462 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:44.946205 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:44.966356 19369 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.947190 19295 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:44.947259 22245 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:44.935883 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:44.964666 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45870.8us
I20260709 13:09:44.921610 22207 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.992892 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.993645 19291 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:44.953517 21880 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:44.971244 22234 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:44.954850 22236 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:45.022095 22236 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.024016 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.004148 22249 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:45.005357 22098 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.016752 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:44.995311 22207 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.016798 19293 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:45.017472 22000 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:44.925251 22203 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:45.019479 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66586.6us
I20260709 13:09:44.972636 22106 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:45.020258 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:45.028829 19297 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:45.016930 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.029433 22249 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.025589 22146 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:45.033764 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.032585 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 283967us
I20260709 13:09:45.016680 22237 tablet_replica.cc:333] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:09:45.055120 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.044793 21880 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.069396 19294 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:45.055754 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:45.069737 19369 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:45.066745 19300 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:45.045455 22106 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:45.092459 22106 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.094666 22250 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.096544 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:45.101783 22064 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.002s
I20260709 13:09:45.102394 22064 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.103983 19222 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:45.052489 19894 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.124576 22146 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:45.075773 19298 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:45.081149 22203 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.083076 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:45.085444 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.086326 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.088496 21880 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.069584 22235 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:45.079818 22229 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.127832 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:45.399055 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.128477 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:45.284884 19191 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.006s	sys 0.007s
W20260709 13:09:45.519066 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 459152us
W20260709 13:09:45.519459 19191 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.011s	sys 0.012s
W20260709 13:09:45.517805 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 463865us
I20260709 13:09:45.520609 19297 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:45.212558 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.201550 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.197343 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.520646 22114 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:45.525837 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 398064us
I20260709 13:09:45.530045 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:45.531129 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.533649 19296 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:45.232059 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:45.519841 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 821523us
W20260709 13:09:45.254817 22012 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.005s
I20260709 13:09:45.534358 19293 raft_consensus.cc:2376] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6. Re-sending same reply.
I20260709 13:09:45.079763 22249 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:45.160943 22113 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.001s
I20260709 13:09:45.541215 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.252707 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:45.544135 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.544700 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.311693 22144 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.547369 22249 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:45.544049 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.963s (SENT) [suppressed 45 similar messages]
I20260709 13:09:45.295771 22241 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:45.552630 19293 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:45.526048 22098 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:45.125406 22146 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.548756 22239 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.569182 19297 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:45.541198 22114 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:45.218806 22019 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.539574 22012 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.576041 19297 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:45.553464 22249 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:45.581296 19191 leader_election.cc:336] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.159s (SENT)
I20260709 13:09:45.582131 22239 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.566533 22098 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.597378 22098 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:45.603304 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 527) took 1137 ms. Trace:
I20260709 13:09:45.604034 19898 rpcz_store.cc:276] 0709 13:09:44.466074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.203018 (+736944us) service_pool.cc:224] Handling call
0709 13:09:45.603207 (+400189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.551149 22207 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.554386 22113 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.570838 22064 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:45.620447 22236 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:09:45.611028 22249 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.627405 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:45.613303 21851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.038s	sys 0.053s
I20260709 13:09:45.630239 21880 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.563720 22144 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.581802 19894 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:09:45.614116 22239 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:45.633165 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58266.5us
I20260709 13:09:45.636762 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.640698 19297 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:45.634753 21851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.039s	sys 0.053s
I20260709 13:09:45.643641 22256 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:45.645342 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1850) took 1205 ms. Trace:
I20260709 13:09:45.647236 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:45.651290 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.651741 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.650084 19218 rpcz_store.cc:276] 0709 13:09:44.440441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.454701 (+ 14260us) service_pool.cc:224] Handling call
0709 13:09:45.645133 (+1190432us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400076cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:45.645261 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702808448}
I20260709 13:09:45.653182 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:45.656914 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.657577 19296 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
W20260709 13:09:45.673038 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.632629 22236 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.701247 19298 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:45.693449 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.696889 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1610) took 1006 ms. Trace:
I20260709 13:09:45.704337 19292 rpcz_store.cc:276] 0709 13:09:44.690922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.696274 (+  5352us) service_pool.cc:224] Handling call
0709 13:09:45.696641 (+1000367us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001d3b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:45.696813 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430088576}
I20260709 13:09:45.648660 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:45.649034 21880 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:45.652582 22235 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:45.719609 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:45.658066 22225 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:45.730170 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:45.730806 19371 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.738360 19296 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:45.740470 19294 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:45.637988 22241 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.753420 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:45.754181 19366 raft_consensus.cc:2368] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:45.707777 22000 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:45.650357 22114 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.758924 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:45.732698 22256 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.715523 22204 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:45.766563 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.773701 19294 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:45.774849 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:45.767928 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:45.750617 22106 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.002s
I20260709 13:09:45.719967 22229 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:45.771057 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:45.780073 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.780910 19292 raft_consensus.cc:2376] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9. Re-sending same reply.
I20260709 13:09:45.777112 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:45.788817 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:45.791754 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.792855 19294 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:45.794440 19265 leader_election.cc:400] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:45.794893 19265 leader_election.cc:403] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:45.745618 22098 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 13:09:45.796255 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 276381us
I20260709 13:09:45.798753 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.732926 21880 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.787108 22243 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:45.786072 22012 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:45.813877 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.794274 22235 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.800360 22201 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:45.796829 22146 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.815022 22064 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:45.825265 22064 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.827481 22064 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:45.827533 22119 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:45.819012 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.828207 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:45.831826 22236 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.832847 22237 raft_consensus.cc:2243] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:45.833843 22237 raft_consensus.cc:2272] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:45.836680 22197 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.837630 21880 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:45.838174 22000 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:45.788039 22106 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.840828 19299 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:45.841678 19371 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:45.841789 22106 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.828244 22119 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.828981 19296 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:45.806241 22245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.016s	sys 0.024s
I20260709 13:09:45.865175 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.850556 19297 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
W20260709 13:09:45.879618 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63862.3us
I20260709 13:09:45.869906 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:45.828668 22258 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:09:45.813499 22207 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:45.812737 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:45.885183 19292 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:45.832867 22229 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:45.889211 19294 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:45.815310 22113 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.891855 19294 raft_consensus.cc:614] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:45.844270 22201 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:45.886132 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.895601 19297 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.896248 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.896871 19293 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:45.888741 22245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.016s	sys 0.024s
I20260709 13:09:45.900000 22229 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.901691 22144 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:45.906512 22249 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.915618 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.916267 19296 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.917690 19294 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:45.920013 19297 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:45.890810 22225 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:45.924197 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 196826us
I20260709 13:09:45.908044 22245 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:45.947335 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:45.911451 22119 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:45.961146 19372 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:45.954499 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:45.963348 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:45.964078 19894 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:45.964200 22225 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.914804 22262 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:45.968406 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:45.968523 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:45.941653 22261 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:45.969576 22261 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.969851 22263 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:45.970963 22264 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:45.971349 22264 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:45.941272 22218 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:45.952209 22106 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:45.940982 22203 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:45.976491 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 211002us
W20260709 13:09:45.980780 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61744.3us
I20260709 13:09:45.981953 19293 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:45.982332 19266 leader_election.cc:400] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:45.987747 19293 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:45.987599 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:45.989133 19299 raft_consensus.cc:606] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:45.989717 19299 raft_consensus.cc:614] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:45.992960 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:45.997148 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:45.997829 19221 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.958328 22144 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.998310 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:45.972013 22261 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:45.972673 22106 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.013147 19897 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.009771 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:45.981874 22266 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.014498 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:46.024295 19291 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.013746 19300 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.016358 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:46.003742 19225 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.976441 22203 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:46.024093 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.003989 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.067165 19295 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:46.069072 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 72893us
W20260709 13:09:46.073047 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58000.3us
W20260709 13:09:46.073738 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100036us
I20260709 13:09:46.074828 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.075541 19219 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:09:46.075800 19897 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:45.972524 22218 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:45.999822 22064 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:46.090391 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:46.085290 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.012629 22237 ts_tablet_manager.cc:1916] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:46.007309 22249 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:46.067200 22241 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.109977 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:46.112612 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:46.115553 19300 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:46.002856 21880 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:09:46.087859 22146 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:46.118481 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94463.1us
I20260709 13:09:46.088547 22251 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:46.103363 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 110471us
W20260709 13:09:46.120790 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.017859 22019 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:46.089865 22064 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:46.135488 22064 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:46.124683 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 120772us
I20260709 13:09:46.136297 22204 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:46.136998 22204 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.077389 19296 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:46.130286 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.134147 21801 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:46.139673 19221 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:46.046500 22144 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:45.960244 22201 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.158078 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.159741 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1656) took 1071 ms. Trace:
I20260709 13:09:46.160132 19298 rpcz_store.cc:276] 0709 13:09:45.088142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.530618 (+442476us) service_pool.cc:224] Handling call
0709 13:09:45.696787 (+166169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.701714 (+  4927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.159563 (+457849us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001d3b50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:46.159683 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350887040}
I20260709 13:09:46.142475 21801 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:46.164798 21801 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.129675 22084 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.167325 22251 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:46.168922 22241 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.169498 22241 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.168545 22251 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.171844 22241 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:45.972420 22264 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.174888 19225 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:46.091568 22266 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.118197 22267 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:46.178406 22270 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:46.117677 22245 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.180045 22146 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.137789 22106 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.182240 22218 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:46.182760 22119 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:46.186695 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:46.229550 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 83886.3us
I20260709 13:09:46.230295 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.187855 19218 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:46.188344 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:46.198117 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67890.7us
I20260709 13:09:46.187142 22000 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.216876 22266 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:46.210227 22267 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.218128 22197 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:46.149613 22203 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.204720 22264 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.223084 22064 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.231889 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:46.242540 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 82412.6us
I20260709 13:09:46.244774 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.249832 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.251178 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:46.252611 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 145381us
I20260709 13:09:46.241829 22019 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.240674 22262 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.230723 22241 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:46.259406 22207 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.261636 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:46.300839 19369 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.259635 22249 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.304558 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:46.267205 22012 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.253340 22146 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.299600 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48522.1us
W20260709 13:09:46.304580 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.325415 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.262153 22260 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:46.316478 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 242044us
I20260709 13:09:46.317256 22267 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.320350 22144 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.320832 19898 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.339095 21801 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.341370 21801 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.321408 22064 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.314654 22278 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.342439 22278 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.333578 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.346683 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.350232 19366 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:46.361387 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.297622 22000 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:09:46.368784 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105098us
I20260709 13:09:46.369742 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:46.370363 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45038us
I20260709 13:09:46.370772 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:46.371106 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.364717 21801 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:46.378208 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:46.380014 22276 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:46.384716 22000 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:46.385135 22000 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:46.385898 22000 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.387054 22000 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.388527 22201 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.392408 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 63755us
I20260709 13:09:46.393690 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.361490 22207 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.391834 19898 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:46.397560 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:46.397729 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:46.404570 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.408543 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.375052 22144 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:46.375195 22064 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.422389 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.423619 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.424235 19222 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
W20260709 13:09:46.429370 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.423111 19219 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:46.404645 22203 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.433322 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.434202 19337 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:46.408633 22251 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.396850 22225 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.408414 22260 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:46.414261 22249 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:46.438978 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45374.7us
I20260709 13:09:46.440888 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.407608 22256 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:46.393041 22288 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:46.483428 19291 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:46.425050 22012 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:46.492087 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43904.3us
W20260709 13:09:46.493029 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59628.9us
I20260709 13:09:46.495636 19224 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.496912 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:46.497514 19291 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.441852 22241 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.441613 22266 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.434929 22285 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.501816 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:46.442391 22260 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:09:46.506259 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65430.9us
I20260709 13:09:46.507702 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.509894 19300 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.428975 22019 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:09:46.517148 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:46.514206 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:46.514829 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 106393us
I20260709 13:09:46.515228 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:46.519366 19296 raft_consensus.cc:606] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.519712 19296 raft_consensus.cc:614] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.516052 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:46.526631 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 92503.7us
I20260709 13:09:46.527778 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:46.528852 19295 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:46.505568 22106 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:46.529778 19291 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
W20260709 13:09:46.538648 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44739.9us
I20260709 13:09:46.539427 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.511296 22260 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.518718 22285 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.543289 22285 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.502148 22261 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:09:46.502383 22084 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:09:46.544649 22084 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:46.545058 22084 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:46.548444 22241 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:46.548982 22241 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:46.550076 22295 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:46.549860 22241 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.550637 22295 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.532873 22266 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.560580 19224 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:46.536641 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:46.560647 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.544114 22261 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:46.561154 22249 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:46.568148 22225 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.596792 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59743.8us
I20260709 13:09:46.598192 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:46.598933 19295 raft_consensus.cc:606] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.599365 19295 raft_consensus.cc:614] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:46.599807 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 92367.3us
I20260709 13:09:46.600590 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.601964 19292 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:46.606980 22237 ts_tablet_manager.cc:1929] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:09:46.611367 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50783.2us
I20260709 13:09:46.613490 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:46.615876 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.617367 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:46.593350 22261 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:46.611008 22266 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.619794 22249 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.624418 22295 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.601678 22264 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.625917 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.626709 22285 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.627394 22285 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.615864 22229 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:46.628602 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.629284 22229 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.630303 22146 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.630535 22229 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:46.632578 22204 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:46.633333 22229 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:46.634755 22278 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:46.634980 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:46.636797 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7547528ebe74640917580adfe8092bd"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:46.637410 19294 raft_consensus.cc:606] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.637723 19294 raft_consensus.cc:614] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:46.636848 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.644336 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.595958 22288 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:46.650064 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:46.650573 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50064.2us
I20260709 13:09:46.653623 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.654843 19266 leader_election.cc:400] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:46.654501 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:46.656002 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58307.3us
I20260709 13:09:46.656667 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.668236 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:46.673077 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.674821 19903 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:46.682624 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:46.667788 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:46.676479 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:46.686352 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.690166 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.692529 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:46.667578 22237 log.cc:1199] T ce726108fd4e452b9a0b91d535939c7d P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/ce726108fd4e452b9a0b91d535939c7d
I20260709 13:09:46.699931 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:46.709331 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:46.664824 22264 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:46.665795 22282 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.667089 22229 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:46.721181 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64508.2us
I20260709 13:09:46.725605 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.726616 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.684580 22266 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:46.730093 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:46.716848 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:46.731715 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.735755 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.737452 19369 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.737949 19217 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.703895 22197 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.744921 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.748059 19224 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:46.748993 19219 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:46.745841 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:46.714671 22207 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.751930 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:46.757313 19369 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:46.759037 19225 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:46.753522 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67236.5us
I20260709 13:09:46.761111 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.754319 19224 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:46.717123 22229 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.716265 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:46.755622 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:46.755867 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:46.763875 22237 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41698 (request call id 78) took 2135 ms. Trace:
I20260709 13:09:46.699263 22285 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:09:46.753445 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:46.767019 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.729689 22019 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:46.771524 19219 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:46.772226 19369 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:46.861349 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.745139 22204 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:46.858592 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 97595.9us
I20260709 13:09:46.787763 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:46.858665 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105292us
I20260709 13:09:46.867295 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:46.867935 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:46.857529 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:46.778790 19370 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.713137 22195 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:46.744987 22236 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.747217 22241 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.716572 22261 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.885005 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.886023 19223 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:46.750672 22267 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:46.772068 22229 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:46.860646 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 114875us
W20260709 13:09:46.813082 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.745168 22279 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.862192 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:46.893437 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.863343 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:46.864063 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.895217 19216 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.865097 19371 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.897357 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:46.897908 19371 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:46.865455 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.898767 19219 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.868695 19367 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:46.881686 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:46.748690 22266 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:46.744679 22299 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:09:46.799906 19898 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:46.889413 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:46.776376 22207 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.864307 22294 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.907465 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:46.914124 19370 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:46.909777 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:46.917156 19224 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:46.924890 19224 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.880878 22146 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:46.883746 21801 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:46.886441 22012 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:46.888377 22267 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:46.772902 22288 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:46.892608 22241 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:46.942688 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:46.945921 19367 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:46.888990 22236 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.925118 22204 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:46.944664 22012 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.941484 22249 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.955145 19373 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:46.955325 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:46.960507 19370 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:09:46.961129 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 93904.9us
I20260709 13:09:46.947988 22267 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.948328 22264 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.955145 22144 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:46.946861 22197 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:46.959930 22012 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.944878 22146 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:46.778427 22237 rpcz_store.cc:276] 0709 13:09:44.677587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.694880 (+ 17293us) service_pool.cc:224] Handling call
0709 13:09:44.968639 (+273759us) ts_tablet_manager.cc:1151] Deleting tablet ce726108fd4e452b9a0b91d535939c7d
0709 13:09:44.999349 (+ 30710us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:46.387371 (+1388022us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:46.606824 (+219453us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:46.763733 (+156909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656851,"tablet-delete.queue_time_us":227466,"thread_start_us":129397,"threads_started":1}
W20260709 13:09:46.974560 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 487657us
I20260709 13:09:46.977183 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:46.963551 22296 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.993088 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:46.973126 22144 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.999085 22144 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.997004 22296 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:47.001173 22296 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:47.014752 22306 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:46.973124 22264 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.015821 22307 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.037590 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 145869us
I20260709 13:09:47.060315 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.060999 19297 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:47.061159 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.062419 22279 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:47.062899 22279 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:47.051607 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.049265 22309 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.054083 22146 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.054921 22197 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.060410 22307 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.087976 22307 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:47.088475 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.082515 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:47.013104 22241 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.089720 19221 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:47.090835 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:47.071183 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.055968 22236 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.074862 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:47.101770 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:47.092451 22119 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.106004 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:47.106684 22012 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.107153 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.109163 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.075455 19219 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:47.014762 22305 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.988787 22266 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.081204 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:47.082491 22084 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.083585 19373 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:47.084969 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.085599 22264 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.068524 22306 consensus_queue.cc:1243] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:47.122262 22305 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:47.123315 22305 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.063733 22279 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.076210 22249 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:47.112391 19219 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:47.100271 22146 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.141605 22249 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.142067 22146 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.073280 19216 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:47.060097 22207 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:47.013140 22204 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:47.145241 22260 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.577s	user 0.004s	sys 0.007s
I20260709 13:09:47.145751 22260 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.089205 19371 raft_consensus.cc:2368] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9.
I20260709 13:09:47.146890 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.148866 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:47.151186 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:47.151770 19894 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:47.155025 19894 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:47.155702 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:47.098383 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:47.129767 19217 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:47.156343 19897 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:09:47.130951 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:47.113332 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 136265us
I20260709 13:09:47.109774 22243 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.138983 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.139655 22084 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.157408 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:47.132869 22225 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 13:09:47.162547 19366 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:09:47.159514 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61229.7us
I20260709 13:09:47.166118 19374 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:47.148530 22262 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.172765 19266 leader_election.cc:400] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7.
I20260709 13:09:47.183799 19266 leader_election.cc:403] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.158922 22207 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:47.185074 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 257466us
W20260709 13:09:47.198151 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.230015 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 166284us
I20260709 13:09:47.163913 22225 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.170977 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:47.239285 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.169878 22236 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:47.159313 22297 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:47.248837 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 84259.2us
W20260709 13:09:47.251027 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 80091.9us
I20260709 13:09:47.261283 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:47.174636 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:47.268350 19225 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:47.268426 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93883.9us
I20260709 13:09:47.274719 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.248373 22012 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:47.276827 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:47.277400 22251 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.169031 22267 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.276953 22279 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.237526 22307 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7.
I20260709 13:09:47.279105 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.285212 19291 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.276047 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.278154 22313 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:47.243180 22146 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:47.292109 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.293241 22229 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.249158 22264 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:09:47.296553 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.298015 19294 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:47.298600 19369 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:47.299597 19221 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:47.185997 22262 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.297339 22146 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.308625 22146 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.309279 22229 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:47.310488 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.310616 22146 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:47.311249 22307 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.311878 22307 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.311816 22260 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:47.313786 22302 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.493s	user 0.001s	sys 0.003s
I20260709 13:09:47.311741 19266 leader_election.cc:400] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8.
I20260709 13:09:47.297444 22236 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:47.321412 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.324522 19297 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:47.324986 19297 pending_rounds.cc:85] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:09:47.324795 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.297175 22207 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:09:47.282656 22225 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.325313 19297 pending_rounds.cc:107] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:47.341697 19297 raft_consensus.cc:2889] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:47.262362 22144 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.302819 19291 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:09:47.346346 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 110775us
I20260709 13:09:47.364133 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:47.365090 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:47.365324 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.367584 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.370410 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.370630 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.371263 19296 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:09:47.371623 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 60688.1us
I20260709 13:09:47.372694 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.323117 22197 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.430375 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.431180 19292 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:47.432711 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.434026 19295 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:47.433353 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 60955.5us
I20260709 13:09:47.434319 19293 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:47.435017 19218 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:47.435431 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.435536 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:47.370116 22229 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:09:47.346853 22084 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.348241 22225 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.440883 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.442271 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.446411 19299 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:47.447526 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.448585 19293 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:47.451649 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.452466 19293 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.458799 19293 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:09:47.459017 19296 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:09:47.459992 19293 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 13:09:47.460827 19296 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:47.462596 19295 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:47.463606 22249 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.449553 22262 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.432832 22146 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:47.477865 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.475967 19298 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:47.478899 22256 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:47.482124 22256 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.485286 22256 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:47.466338 22332 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:47.489596 22332 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.490011 22332 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.493425 19295 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 13:09:47.494225 22296 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.497488 22144 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.498339 22144 raft_consensus.cc:2764] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:47.428517 22285 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:09:47.446100 22225 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.515538 22267 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:47.449067 22019 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 13:09:47.522212 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 157137us
I20260709 13:09:47.523695 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.521486 22262 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:09:47.524776 22119 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:47.531208 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.532297 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:47.532665 19292 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:47.562834 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.566045 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.581869 19191 leader_election.cc:400] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9.
I20260709 13:09:47.582258 19191 leader_election.cc:403] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.586333 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:47.594430 22290 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:47.594961 22290 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:47.606273 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:47.607704 19222 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:47.610476 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:47.605432 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:47.615125 19898 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:47.616426 22324 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:09:47.620545 22260 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:47.621138 22260 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.621570 22260 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.622648 19292 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:47.626506 22332 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.643013 22296 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:47.578094 22264 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:47.647058 19292 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:47.595837 22290 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:47.664191 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83536.3us
I20260709 13:09:47.669131 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.654022 22342 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:47.672686 22332 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:47.703141 22313 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:47.703779 22313 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:47.705071 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.705657 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.696768 22293 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:09:47.707337 22293 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:47.707846 22293 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:47.713335 19894 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.716602 19903 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:47.718534 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:47.718865 19897 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:47.720407 19898 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:47.723466 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:47.725018 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.725235 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.726105 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:47.726290 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:47.726980 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.728698 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:47.728724 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.729142 19371 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:47.729494 19372 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:47.695891 22260 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.708647 22293 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:47.707208 22313 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.736394 19292 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:47.739117 19292 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:47.739418 22261 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.731765 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:47.746919 22303 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.840s	user 0.002s	sys 0.005s
I20260709 13:09:47.749456 22012 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:47.749902 22012 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:47.750267 22012 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.757419 22241 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:47.764205 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1647) took 1027 ms. Trace:
I20260709 13:09:47.764642 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:47.764582 19366 rpcz_store.cc:276] 0709 13:09:46.736661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.736789 (+   128us) service_pool.cc:224] Handling call
0709 13:09:46.745467 (+  8678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.163614 (+418147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.763957 (+600343us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:47.764130 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958594304}
I20260709 13:09:47.765273 19221 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.774101 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.781430 19297 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:47.780227 22218 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:47.794368 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:47.796867 22341 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.800755 22279 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:09:47.820619 22297 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:47.821120 22297 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.780534 22243 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.825213 22243 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.809379 22218 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.828495 22218 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.828909 22218 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.817198 22245 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:09:47.831202 22245 consensus_queue.cc:1243] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:47.832048 22245 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:47.832389 22245 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:47.834674 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.834980 22304 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.968s	user 0.009s	sys 0.000s
I20260709 13:09:47.833652 22245 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.848963 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:47.847779 22241 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:47.838892 19221 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:09:47.864529 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:47.784364 21880 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:47.889247 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:47.872280 22342 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9.
W20260709 13:09:47.898197 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 229126us
W20260709 13:09:47.887355 22294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.009s	sys 0.020s
W20260709 13:09:47.898113 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 209201us
I20260709 13:09:47.903245 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.904152 22355 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:47.883356 22295 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:47.911172 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.911805 19298 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.912498 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:47.913074 19294 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.914292 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.900036 22266 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:47.914903 19297 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:47.863870 22229 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:47.911701 22295 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.905040 22119 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:47.917662 22295 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.917775 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 323) took 1051 ms. Trace:
I20260709 13:09:47.918200 22295 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:47.918228 19225 rpcz_store.cc:276] 0709 13:09:46.867114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.907760 (+ 40646us) service_pool.cc:224] Handling call
0709 13:09:46.908124 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.269003 (+360879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.917541 (+648538us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54001554d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:47.917716 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827814784}
I20260709 13:09:47.918851 22295 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.898873 22245 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.921922 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.926318 19294 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:47.908259 22332 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.896556 22260 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.937984 22012 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:47.939975 19291 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:47.942802 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:47.942260 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:47.875712 22241 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:47.927870 22294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.009s	sys 0.021s
W20260709 13:09:47.961956 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 82011.8us
I20260709 13:09:47.952533 19298 raft_consensus.cc:2410] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:47.966635 19297 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:47.931872 22243 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:47.962152 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:47.965621 22294 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:48.025748 22146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.026s	sys 0.052s
I20260709 13:09:48.132761 22261 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.133234 22294 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:48.064191 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 109219us
I20260709 13:09:48.136822 22362 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:48.137135 22280 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:48.052518 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.138173 22280 consensus_queue.cc:1243] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:47.962338 22355 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.075717 22241 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:47.969506 22260 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:48.139966 22260 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.140144 22355 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.142221 22260 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:48.076902 22225 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.004s
I20260709 13:09:48.142882 22225 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.074795 19294 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:48.079222 22119 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:48.082508 22299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.011s	sys 0.007s
I20260709 13:09:48.144436 19219 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:09:48.144753 22299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.012s	sys 0.008s
I20260709 13:09:48.145188 22225 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.077203 22305 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.086871 22357 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.146010 22305 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.146191 22357 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.146422 22298 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:48.091269 22332 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:48.148798 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.148669 22332 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.148916 22119 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.091611 22144 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:48.149636 19373 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.149973 22144 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.150077 19373 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.150749 22332 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.091996 22345 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:48.092121 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.159291 19217 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:48.093256 22358 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:48.093600 22313 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.094585 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:48.094872 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:48.097401 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1529) took 1160 ms. Trace:
I20260709 13:09:48.097595 19225 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:48.098547 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:48.099336 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 156615us
I20260709 13:09:48.099570 22019 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:48.103315 19299 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:48.105343 19221 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:47.953347 22203 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.112490 19369 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:09:48.079757 22297 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.114717 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.115809 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:48.116139 19900 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:48.116655 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.117292 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:48.122740 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.133522 22261 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:48.126183 22347 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.222s	user 0.007s	sys 0.009s
I20260709 13:09:48.130913 22290 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.108646 22295 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:48.132913 22146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.026s	sys 0.052s
I20260709 13:09:48.138440 19896 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:47.984306 22201 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:48.075887 22249 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:48.089879 22012 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.150938 22144 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.150971 19373 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.152925 22305 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:48.153792 22119 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:48.156455 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.286253 22201 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:48.286587 19371 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:48.286074 22249 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.286901 22144 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.287374 22249 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.287796 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:48.287577 22201 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.288463 19371 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.288751 22201 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.224220 22245 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:48.291465 22245 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.292092 19369 pending_rounds.cc:85] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 7
I20260709 13:09:48.292438 19369 pending_rounds.cc:107] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:09:48.292733 19369 raft_consensus.cc:2889] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.293339 19299 pending_rounds.cc:85] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 9
I20260709 13:09:48.293650 19299 pending_rounds.cc:107] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:48.293924 19299 raft_consensus.cc:2889] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.286154 22146 consensus_queue.cc:1243] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:48.294423 22245 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.261633 22345 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:48.295521 22345 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.083209 22218 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.297605 22345 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.199221 22357 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:48.299516 22357 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:48.300180 22357 consensus_queue.cc:1243] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:48.160341 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:48.302016 19219 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:48.303045 22249 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.291090 19901 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:48.303767 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.222316 22298 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:09:48.304797 22218 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:48.183032 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.305491 19218 rpcz_store.cc:276] 0709 13:09:46.937251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.080892 (+143641us) service_pool.cc:224] Handling call
0709 13:09:48.097211 (+1016319us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54000762d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:48.097344 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710610304}
I20260709 13:09:48.188439 22225 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:48.307374 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:48.307256 22225 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.308635 22229 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:48.308372 22358 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.309173 22229 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.183615 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:48.311611 22358 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.202814 22332 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:48.312203 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:48.199126 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:48.316057 19374 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:48.308401 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 209924us
I20260709 13:09:48.314208 19337 leader_election.cc:400] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:48.182060 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.317474 19337 leader_election.cc:403] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.314818 22261 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.214808 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:48.232300 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 140238us
I20260709 13:09:48.311486 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.320772 19372 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:48.321856 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:48.295871 19371 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:48.322449 19372 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.317884 19367 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:48.328457 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.336387 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:48.339516 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.325740 19903 pending_rounds.cc:85] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 7
I20260709 13:09:48.341370 19903 pending_rounds.cc:107] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:48.341773 19903 raft_consensus.cc:2889] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.344178 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.346194 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:48.357321 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.312790 22332 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.364236 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.370862 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.370865 19291 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:48.372221 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.344063 22358 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.375290 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.375944 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.310241 22229 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.377170 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.360399 22019 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:48.381162 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 60680.3us
I20260709 13:09:48.390962 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.393339 19294 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.383740 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.366195 22295 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.384781 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.366477 22296 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:48.385617 19370 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:48.387184 19293 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:48.378857 19372 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:48.359422 22345 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.389189 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.376567 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:48.405369 19369 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:48.363096 22298 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:48.412784 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.407401 22019 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.181346 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.360605 22357 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:48.366640 22260 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:09:48.435544 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51005.4us
W20260709 13:09:48.424537 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 265660us
I20260709 13:09:48.404022 22296 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:48.434742 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43829.8us
I20260709 13:09:48.437000 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.369503 22315 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:48.439586 19340 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.436678 22296 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.440691 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.403221 22358 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.396061 22146 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:48.366466 22364 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:09:48.423614 22262 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.472900 22350 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.473852 22340 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:09:48.449311 22245 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.475561 22301 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.478957 19369 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:48.394953 22355 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:48.452661 22207 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:48.455966 19339 leader_election.cc:400] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:48.455809 22295 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:48.456892 19218 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.457223 19224 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.458016 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.458920 19219 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:48.459396 22294 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:48.461088 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.462752 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.465905 19373 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.447779 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.483781 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:48.485725 19293 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:48.487936 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:48.527987 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:48.486323 22332 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.488984 22305 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.489495 22359 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.489868 22261 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:48.489995 22344 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.490329 22306 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.493299 22293 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:48.497983 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55951.3us
I20260709 13:09:48.498505 19120 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 6 to 7, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 7 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.464861 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet ce726108fd4e452b9a0b91d535939c7d (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:09:48.548650 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:48.548971 19110 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 1.08417e+06us
I20260709 13:09:47.716413 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.504819 22297 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.505733 22358 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.549664 22282 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:48.550115 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.550412 22320 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.422194 22019 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.551096 22320 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.523339 19224 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.524588 19216 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:48.524693 19219 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.525125 19223 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:48.525596 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77909.9us
I20260709 13:09:48.538332 19374 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
W20260709 13:09:48.527184 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43483.7us
W20260709 13:09:48.520578 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64749.3us
I20260709 13:09:48.594338 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.588335 19224 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.594933 19339 leader_election.cc:400] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:48.532913 22288 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.518872 22249 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:48.524467 22298 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.548676 19120 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 5 to 6, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 6 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.540720 22144 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.521217 19218 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.536410 22309 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:48.545104 22106 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:48.578112 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.599642 19219 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:48.503917 19121 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 262) took 21270 ms (client timeout 15000 ms). Trace:
I20260709 13:09:48.627475 19219 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.524312 22294 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.590076 22359 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.551052 22282 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:48.606802 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:48.599769 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47212.5us
I20260709 13:09:48.600229 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:48.659726 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52995.8us
W20260709 13:09:48.660353 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 60227.3us
I20260709 13:09:48.660612 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:48.543637 22305 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.552003 22266 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:09:48.547763 22261 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.624995 19224 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.551839 22306 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.629654 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:48.686632 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:48.629797 22340 consensus_queue.cc:1175] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0316f581086f40549fea44a772fc2dec" responder_term: 6 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:48.615136 22345 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:48.630177 19120 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:48.694849 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.614967 22298 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.598459 22363 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6.
I20260709 13:09:48.671608 22313 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:48.627658 19121 rpcz_store.cc:269] 0709 13:09:27.233329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.236276 (+  2947us) service_pool.cc:224] Handling call
0709 13:09:28.971522 (+1735246us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:48.503811 (+19532289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:43.919468 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:43.992742 (+ 73274us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:43.992816 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:09:43.992857 (+    41us) tablet.cc:662] Decoding operations
0709 13:09:43.994751 (+  1894us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:43.994851 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:43.994898 (+    47us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:09:44.022576 (+ 27678us) tablet.cc:701] Row locks acquired
0709 13:09:44.022630 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:09:44.022802 (+   172us) write_op.cc:270] Start()
0709 13:09:44.025562 (+  2760us) write_op.cc:276] Timestamp: P: 1783602584022736 usec, L: 0
0709 13:09:44.025590 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:09:44.026334 (+   744us) log.cc:844] Serialized 5981 byte log entry
0709 13:09:44.354029 (+327695us) op_driver.cc:464] REPLICATION: finished
0709 13:09:44.555076 (+201047us) write_op.cc:301] APPLY: starting
0709 13:09:44.555243 (+   167us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:44.555737 (+   494us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:44.586247 (+ 30510us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:44.739432 (+153185us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:44.739849 (+   417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:09:44.739897 (+    48us) write_op.cc:312] APPLY: finished
0709 13:09:44.740353 (+   456us) log.cc:844] Serialized 107 byte log entry
0709 13:09:44.740547 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:44.740707 (+   160us) write_op.cc:454] Released schema lock
0709 13:09:44.740779 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:44.741197 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:44.741223 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6620442,"reported_tablets":34,"spinlock_wait_cycles":1016018688,"child_traces":[["op",{"apply.queue_time_us":159531,"apply.run_cpu_time_us":6410,"apply.run_wall_time_us":200280,"num_ops":15,"prepare.queue_time_us":335547,"prepare.run_cpu_time_us":22323,"prepare.run_wall_time_us":208779,"raft.queue_time_us":217233,"raft.run_cpu_time_us":17898,"raft.run_wall_time_us":82566,"replication_time_us":328276,"thread_start_us":457160,"threads_started":4,"wal-append.queue_time_us":98822,"wal-append.run_cpu_time_us":76238,"wal-append.run_wall_time_us":1621282}]]}
I20260709 13:09:48.634347 22249 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.627266 22309 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.516525 22225 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:48.661679 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 62325.5us
I20260709 13:09:48.599370 22344 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.671921 19217 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:48.713852 19120 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 5 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 6 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.677369 19373 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:48.598845 22288 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:48.678573 19220 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.685700 19223 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:48.689803 19222 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:48.690905 19216 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:48.594013 22203 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.706176 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:48.678831 22106 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:48.706995 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.614998 22146 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:48.753412 19120 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.682292 22290 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.750408 19293 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.717823 19220 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:48.703917 22205 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:48.755954 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 49056.4us
I20260709 13:09:48.713946 22309 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.679922 22144 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:48.745270 22300 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:48.761016 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.751955 19224 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:48.672209 22359 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.769640 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:48.711678 22267 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:48.788771 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 349863us
I20260709 13:09:48.798173 19293 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:48.799635 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.800705 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:48.760701 22290 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.749985 22225 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:09:48.760533 22207 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.777280 19120 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 3 to 5, VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) evicted. New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:48.805511 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:48.777325 22285 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:48.810773 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.777033 19902 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.747993 22249 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.822606 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:48.820498 19902 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:48.758504 22301 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:48.707123 22345 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:48.830803 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.811878 22290 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.802168 22000 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:09:48.823969 19902 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.814302 22019 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:48.765318 22205 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.842370 19902 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:48.848394 19868 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.692s (SENT)
I20260709 13:09:48.844854 19120 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 5 to 6, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 6 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.860641 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.803300 22267 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.811429 22296 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.839653 22279 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:48.881868 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 78812.9us
I20260709 13:09:48.882963 19120 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 2 to 3, leader changed from <none> to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 3 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:48.853142 19900 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:48.888432 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.861581 22019 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:48.891248 19868 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.716s (SENT)
I20260709 13:09:48.892052 22381 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:48.901922 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:48.905467 22378 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:09:48.907505 22379 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:09:48.909039 22345 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.899547 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:48.909904 22288 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:48.804279 22298 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.911298 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.899631 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:48.901304 22282 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:48.841904 22375 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:48.885550 22313 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.939296 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.940215 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:48.837563 22106 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.951486 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.953294 19222 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:09:48.954257 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:48.954803 19222 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:48.957340 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:48.960255 19366 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:48.899520 22305 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:48.952286 22313 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:48.898653 22377 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.900388 22261 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:48.948001 22256 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.950258 22288 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.999475 22197 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:49.007630 19220 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.065104 19220 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.956822 22201 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:49.030586 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 369262us
I20260709 13:09:48.989198 22218 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.019608 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:49.078054 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:49.014195 22249 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:49.071231 19219 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:49.042086 22000 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.066908 22201 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.091516 22201 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:49.092772 22382 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:09:49.090052 22205 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:49.096521 22386 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:09:49.099642 22371 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:49.103168 22201 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.068948 22359 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.096068 19902 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:09:49.071769 22388 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:09:49.023716 22300 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:49.123644 22332 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.112484 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.121361 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 128087us
I20260709 13:09:49.058485 22019 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:49.129215 22383 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:09:49.129448 19902 pending_rounds.cc:85] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 9
I20260709 13:09:49.150166 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:49.150610 19902 pending_rounds.cc:107] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:09:49.151064 19902 raft_consensus.cc:2889] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.144243 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:49.155251 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 133458us
I20260709 13:09:49.072881 22197 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.135371 19298 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:49.134675 19898 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:49.142737 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.161273 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:49.156248 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:49.088935 22218 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.083220 22146 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 13:09:49.161307 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 169499us
I20260709 13:09:49.123835 22296 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.088344 22000 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.123970 22267 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.171432 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:49.171603 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:49.159365 22309 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.178840 22309 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.140376 22313 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:49.182005 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.132067 22201 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:49.166823 22249 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.116535 22371 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.180327 22395 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:49.124228 22397 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.190701 19371 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:49.132978 22345 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:09:49.206643 22144 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:49.164736 22300 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:09:49.180984 22279 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.140691 22332 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:49.213763 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52563.6us
I20260709 13:09:49.186658 22388 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:49.197440 22395 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.202353 22266 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:49.217070 22296 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:49.196457 22203 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:49.220484 22144 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:49.247360 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.249658 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.248291 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.202530 22249 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.252113 19217 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.252774 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.236231 22395 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.252156 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.255218 19224 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:49.231251 22305 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:49.235899 22266 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:49.243814 22293 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 13:09:49.265431 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.242712 22296 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:49.269363 22414 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:49.269976 22416 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.270562 22416 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.271852 22197 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.272559 22144 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.273591 22371 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.276748 19365 raft_consensus.cc:2410] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:49.227301 22279 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.282399 22416 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:49.266103 22266 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.288831 22298 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.290448 19220 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:49.268045 22305 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.293040 22305 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.293121 22332 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.294652 22407 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.295171 22407 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.296976 19218 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.298121 19218 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.300130 22390 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:49.300410 22279 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.300575 22390 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:49.237283 22388 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.304210 22388 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.301532 22390 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.276273 22296 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.297346 22407 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.309268 19221 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:49.313967 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:49.314661 19368 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
W20260709 13:09:49.316923 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.317579 19218 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:49.321545 19221 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:49.321451 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:49.322103 19221 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:49.320425 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.323678 19217 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:49.331656 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.331758 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.294703 22249 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:49.333765 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.324862 19221 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.334987 19218 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:49.334569 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 171399us
I20260709 13:09:49.333083 19223 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:49.338855 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.334879 19221 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.352028 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:49.354611 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:49.373980 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:49.374220 19901 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:09:49.353369 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.335090 22390 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:49.333853 22407 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:49.351545 22000 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:49.341534 22229 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:49.377463 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:49.379143 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.380451 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.328564 22290 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.382910 19218 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.386775 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.388751 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:49.352553 22218 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.373410 22301 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:49.376978 22407 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.379740 22416 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:49.398072 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.401248 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.403292 19218 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:49.351857 22012 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:49.405586 19372 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:49.407550 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.408263 19223 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:49.376824 22295 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:09:49.388262 22000 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:49.398696 22407 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:49.413057 22422 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:09:49.412048 22000 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.405622 22416 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.391981 22340 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:09:49.407582 22363 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.410574 22361 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:49.438086 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.440802 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1680) took 1284 ms. Trace:
I20260709 13:09:49.446447 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.402292 22144 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:49.429693 22000 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.449421 19300 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:49.449390 19296 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:49.468631 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.449545 22361 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.448686 19371 rpcz_store.cc:276] 0709 13:09:48.156541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.323471 (+166930us) service_pool.cc:224] Handling call
0709 13:09:48.323864 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.197831 (+873967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.440429 (+242598us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b5400298e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:49.440698 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992924544}
I20260709 13:09:49.472749 19294 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:49.496451 19295 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
W20260709 13:09:49.476776 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 88100.7us
I20260709 13:09:49.437528 22416 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:49.499329 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:49.447757 22388 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.523181 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:09:49.501950 22424 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:49.504539 22144 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:49.508878 22000 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.530421 22000 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:49.530896 19294 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:49.533972 22019 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.533804 22407 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.534547 22285 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.534538 22019 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.535257 22285 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:49.535653 22285 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:49.536816 22019 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.500864 22420 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.527479 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.544427 19300 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:49.522135 22361 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.526149 22144 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:49.523253 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.536012 22285 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.555433 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.556380 19294 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
W20260709 13:09:49.556794 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.458637 22363 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.497659 22266 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.582147 22306 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.585675 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.586283 19221 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.588629 19224 pending_rounds.cc:85] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 4
I20260709 13:09:49.588958 19224 pending_rounds.cc:107] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:49.589205 19224 raft_consensus.cc:2889] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.590899 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.591646 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:49.525058 22388 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:49.622375 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.684523 22290 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:49.697638 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 174496us
I20260709 13:09:49.712005 19295 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:49.714186 19221 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:49.765686 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.767452 19221 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:49.768021 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:49.768461 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.775895 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:49.827152 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49067.1us
I20260709 13:09:49.828498 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:49.831898 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58558.5us
I20260709 13:09:49.833518 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:49.832780 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:49.839908 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:49.841789 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:49.838493 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:49.844273 19294 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:49.848963 19896 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:49.779172 22363 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:49.838165 22395 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.004s
I20260709 13:09:49.780131 22425 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:49.867841 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:49.769714 22359 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:09:49.863204 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:49.862213 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 450363us
I20260709 13:09:49.872867 19368 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.873329 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:49.874071 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:49.874794 22421 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:09:49.692847 22144 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.853317 22295 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:49.883652 22359 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:49.884184 22344 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:49.898504 19191 leader_election.cc:336] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.910s (SENT)
W20260709 13:09:49.902228 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.907136 22430 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.925504 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:49.926860 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:49.910645 22298 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:49.861989 22119 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.865229 22407 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.934159 22430 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.951012 22430 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.956511 22119 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.958499 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:49.959542 22119 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.960824 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:49.961324 22388 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.959403 19896 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:09:49.855892 22426 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.422s
I20260709 13:09:49.965981 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:49.967170 22345 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:49.967646 22345 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.968044 22345 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:49.970600 22390 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.001s
I20260709 13:09:49.971304 22266 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:49.924021 22344 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:50.010824 22344 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.012213 22344 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.870738 22425 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:49.963641 22361 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.976706 19896 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:50.017148 22425 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:50.020393 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:49.988565 22298 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:50.022028 22425 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:50.022624 22298 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:50.024065 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.025862 22300 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.026352 22300 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.924985 22359 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.029400 22359 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:49.916306 22295 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.032637 22295 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.038511 22358 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.039217 22358 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:49.912864 22218 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:50.040365 22300 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:50.040536 22218 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.017189 22361 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:50.041311 22340 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.042014 22340 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.042860 22218 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.864871 22395 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.045343 22340 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:50.045498 22395 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:49.943512 22296 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.005s
I20260709 13:09:50.023173 22425 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.047603 22425 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:50.047427 22296 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.050707 22296 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:49.943876 22416 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.051851 19297 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:50.053352 22416 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:50.054919 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:50.060999 22280 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.061754 22280 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.063011 22358 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:50.065003 22280 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.066313 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.067134 19373 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:50.068864 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:50.069921 22203 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.070457 22203 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.070924 22203 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.001689 22345 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:49.909924 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1676) took 1754 ms (client timeout 1910 ms). Trace:
W20260709 13:09:50.084510 19365 rpcz_store.cc:269] 0709 13:09:48.155434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.155777 (+   343us) service_pool.cc:224] Handling call
0709 13:09:49.909593 (+1753816us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400297a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:49.909820 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231308160}
I20260709 13:09:50.088371 19368 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:49.943239 22144 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:50.082736 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.101423 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.123898 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.090139 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:50.127964 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.128912 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 286872us
W20260709 13:09:50.129208 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.048789 22425 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.129544 22218 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.173952 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.137606 22390 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:50.168473 22361 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.187500 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.188040 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.172319 22395 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:50.209221 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 184468us
I20260709 13:09:50.211825 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.172221 22416 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:09:50.186949 22425 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.172430 22358 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:50.182735 22012 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.193403 22390 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:50.268817 19296 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:50.269130 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:50.269665 19299 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.270007 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:50.270539 19294 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.268697 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:50.272552 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:50.274631 22390 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.275789 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:50.276473 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:50.212024 22395 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.282483 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:50.249562 22280 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:50.256830 22285 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.001s
W20260709 13:09:50.275991 22427 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.776s	user 0.002s	sys 0.009s
I20260709 13:09:50.280836 22397 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.180305 22218 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.283530 22315 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.288255 22256 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.289928 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:50.310647 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:50.293664 22295 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.187588 22359 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.296936 22395 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.209585 22361 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:50.304333 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 465918us
W20260709 13:09:50.311118 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51158.7us
I20260709 13:09:50.328544 19294 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:50.302122 22298 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:50.334313 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 437156us
I20260709 13:09:50.346117 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:50.301798 22280 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.355839 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.309962 22315 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.335616 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:50.300051 22201 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:09:50.360271 19372 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:50.332612 22399 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.313506 22229 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.375698 22229 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.377112 22361 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:50.377842 22229 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.381700 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:50.382295 19216 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.382639 19216 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:50.382855 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:50.383343 19216 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:50.384479 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48947.2us
I20260709 13:09:50.384611 22012 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:50.385207 22012 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:50.386114 22012 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.387035 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:50.389133 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:50.389714 19219 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.340894 22416 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:09:50.383962 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:50.392598 19218 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.357741 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:50.301982 22285 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.337417 22266 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.394016 19216 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.302735 22397 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:50.403146 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45517.1us
I20260709 13:09:50.363438 22305 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.412824 22305 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:50.300843 22301 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:09:50.332512 22256 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.406098 19373 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:50.406541 22218 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.406544 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1914) took 1059 ms. Trace:
I20260709 13:09:50.409741 22397 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.369361 22315 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.416990 19369 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:50.417488 19219 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:09:50.358911 22298 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.435308 19220 rpcz_store.cc:276] 0709 13:09:49.346822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.347649 (+   827us) service_pool.cc:224] Handling call
0709 13:09:49.348031 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.354409 (+  6378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.354450 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.375990 (+ 21540us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.444647 (+ 68657us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:49.444685 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.444751 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.275463 (+830712us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:50.403257 (+127794us) raft_consensus.cc:1685] finished
0709 13:09:50.403282 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.406477 (+  3195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224387,"raft.queue_time_us":335,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":231966,"spinlock_wait_cycles":53114240,"thread_start_us":45506,"threads_started":1,"wal-append.queue_time_us":116567}
W20260709 13:09:50.417934 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.416100 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:50.395438 22288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.010s	sys 0.025s
I20260709 13:09:50.370234 22207 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.421671 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.445788 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.447139 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:50.447742 19370 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.449580 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.413620 22359 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:50.422433 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:50.465739 19366 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:50.422827 22295 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:50.367910 22280 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.425305 22203 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.427424 22285 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.431042 22256 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.433568 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:50.373404 22438 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:09:50.481316 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 527) took 1712 ms. Trace:
I20260709 13:09:50.403503 22345 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:50.501261 19895 rpcz_store.cc:276] 0709 13:09:48.752238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.752653 (+   415us) service_pool.cc:224] Handling call
0709 13:09:48.753005 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.883340 (+130335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.883370 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.883408 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:48.883443 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.464564 (+1581121us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54004d0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:50.464623 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.464777 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299294464}
W20260709 13:09:50.506177 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.487303 19218 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:09:50.500440 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61008.7us
I20260709 13:09:50.514492 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:50.515162 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:50.515621 19219 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:50.515944 19220 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.517593 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:50.489444 22207 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.522334 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.522944 19299 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:50.523954 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:50.559749 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:50.524402 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.561923 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:50.524139 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:50.563313 19218 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:50.451014 19216 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:50.557178 19373 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:50.566958 19216 pending_rounds.cc:85] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 3
I20260709 13:09:50.567770 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.494664 22358 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:50.576293 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 241673us
I20260709 13:09:50.567667 19216 pending_rounds.cc:107] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:50.577320 19216 raft_consensus.cc:2889] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.577497 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.413815 22305 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.577739 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:50.597822 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.578792 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:50.610975 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.611697 19220 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:09:50.569097 22452 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:50.622902 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.618249 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:50.629097 19901 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.624559 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:50.618050 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:50.633610 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:50.635533 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:50.636992 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:50.640219 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:50.640254 19373 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:50.557895 22388 raft_consensus.cc:2764] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:50.641093 19219 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.568156 22340 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.609040 22362 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.677569 19373 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:09:50.679579 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56796us
I20260709 13:09:50.690930 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.580621 22438 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:50.643291 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:50.766682 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 123462us
W20260709 13:09:50.767251 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 73426us
W20260709 13:09:50.767905 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.768417 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.766716 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:50.765045 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:09:50.771723 19219 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:09:50.647310 22144 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:09:50.776577 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:50.645498 22380 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.646178 22345 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:50.674973 22344 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.003s
I20260709 13:09:50.574350 22207 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:50.680833 22451 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:09:50.821806 19225 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:09:50.862323 19225 pending_rounds.cc:85] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:09:50.862747 19225 pending_rounds.cc:107] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:50.826052 19370 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:09:50.829735 22447 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:09:50.835261 19372 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:50.651831 22359 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.682035 22357 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:50.848142 22439 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.451s	user 0.000s	sys 0.001s
W20260709 13:09:50.843235 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 264901us
I20260709 13:09:50.844761 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 499) took 1302 ms. Trace:
W20260709 13:09:50.844087 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 265324us
I20260709 13:09:50.781868 22425 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.778247 22293 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:50.848665 22380 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.614696 22358 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.863302 19225 raft_consensus.cc:2889] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.867906 19222 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:09:50.890547 19222 pending_rounds.cc:85] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 4
I20260709 13:09:50.890887 19222 pending_rounds.cc:107] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:50.891207 19222 raft_consensus.cc:2889] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.847123 22229 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.646190 22285 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:50.842878 22438 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:50.840673 22144 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:50.688371 22340 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.883143 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:50.883286 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:50.847630 22362 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.839102 22301 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:09:50.845307 22397 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:50.899217 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:50.850940 22415 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.875955 19367 rpcz_store.cc:276] 0709 13:09:49.542663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.542869 (+   206us) service_pool.cc:224] Handling call
0709 13:09:49.543302 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.580634 (+ 37332us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:50.079828 (+499194us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.465077 (+385249us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.466988 (+  1911us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.467322 (+   334us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:50.467421 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.688985 (+221564us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b54004245d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:50.689051 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.823234 (+134183us) raft_consensus.cc:1685] finished
0709 13:09:50.844573 (+ 21339us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.844709 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499115,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":99847,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":24057,"spinlock_wait_cycles":78024576,"thread_start_us":883593,"threads_started":3,"wal-append.queue_time_us":293622}
I20260709 13:09:50.867367 22345 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.874883 22344 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:50.913131 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74226.1us
I20260709 13:09:50.883986 22425 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.923513 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 534) took 1222 ms. Trace:
I20260709 13:09:50.923949 19898 rpcz_store.cc:276] 0709 13:09:49.701307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.701641 (+   334us) service_pool.cc:224] Handling call
0709 13:09:49.781022 (+ 79381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.781511 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.781581 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.782183 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.186248 (+404065us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.188911 (+  2663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.188993 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.923317 (+734324us) raft_consensus.cc:1685] finished
0709 13:09:50.923335 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.923461 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10346,"thread_start_us":318111,"threads_started":1,"wal-append.queue_time_us":488062}
I20260709 13:09:50.925494 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1570) took 1343 ms. Trace:
I20260709 13:09:50.925994 19217 rpcz_store.cc:276] 0709 13:09:49.581916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.584124 (+  2208us) service_pool.cc:224] Handling call
0709 13:09:49.584497 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.643170 (+ 58673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.643217 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.696094 (+ 52877us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.311486 (+615392us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.311521 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.311583 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.925220 (+613637us) raft_consensus.cc:1685] finished
0709 13:09:50.925251 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.925422 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68819,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":460328,"threads_started":1,"wal-append.queue_time_us":664845}
I20260709 13:09:50.909448 22293 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.910871 22298 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:50.903404 22441 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:50.910211 22416 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.926344 22425 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.929548 22306 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.907006 22357 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:09:50.975625 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.905900 22229 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.012377 22358 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:51.012593 22207 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:51.013391 22229 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:51.013578 22461 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:09:51.014479 22295 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:50.923931 22203 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.015009 22295 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:51.016045 22295 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.016973 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1929) took 1091 ms. Trace:
I20260709 13:09:51.017768 22295 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.907768 22144 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.923024 22415 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.022291 22144 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.022419 22415 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:51.023763 22457 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:09:51.028196 22440 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:50.911206 22397 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.961417 22012 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:50.927623 22344 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:50.972795 22280 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:50.925040 22345 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:50.994655 22416 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.054646 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.138109 19901 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:09:51.064265 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.061901 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:51.513870 22464 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.552s	user 0.000s	sys 0.000s
I20260709 13:09:51.513778 22425 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.517591 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1589) took 1198 ms. Trace:
I20260709 13:09:51.518126 19292 rpcz_store.cc:276] 0709 13:09:50.319228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.320469 (+  1241us) service_pool.cc:224] Handling call
0709 13:09:50.342028 (+ 21559us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:50.342416 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.342443 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:50.358580 (+ 16137us) log.cc:844] Serialized 78 byte log entry
0709 13:09:50.614858 (+256278us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:50.614898 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.614961 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.513288 (+898327us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:09:51.517170 (+  3882us) raft_consensus.cc:1685] finished
0709 13:09:51.517202 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.517513 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1046,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":16366,"spinlock_wait_cycles":20273024,"thread_start_us":178068,"threads_started":1,"wal-append.queue_time_us":536145}
I20260709 13:09:51.521286 19373 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:51.528895 22425 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.529521 22425 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:51.530018 22425 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.532452 22294 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.533900 22294 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:51.386462 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.052649 22440 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.537748 22244 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:51.538177 22244 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:51.539165 22440 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:51.539072 22244 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.539911 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1684) took 1161 ms. Trace:
I20260709 13:09:51.540510 22244 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.541071 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.542243 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1594) took 1107 ms. Trace:
I20260709 13:09:51.542610 19300 rpcz_store.cc:276] 0709 13:09:50.434858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.434996 (+   138us) service_pool.cc:224] Handling call
0709 13:09:50.518391 (+ 83395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:50.556769 (+ 38378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.556798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:50.645906 (+ 89108us) log.cc:844] Serialized 52 byte log entry
0709 13:09:50.872811 (+226905us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:50.872857 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.873506 (+   649us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.453296 (+579790us) raft_consensus.cc:1685] finished
0709 13:09:51.453321 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.542185 (+ 88864us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38274,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":44778,"thread_start_us":49716,"threads_started":1,"wal-append.queue_time_us":744879}
I20260709 13:09:51.540300 19368 rpcz_store.cc:276] 0709 13:09:50.379024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.394857 (+ 15833us) service_pool.cc:224] Handling call
0709 13:09:50.395158 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.404917 (+  9759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.404948 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.420343 (+ 15395us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.646565 (+226222us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:50.646606 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.646668 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.168284 (+521616us) raft_consensus.cc:1685] finished
0709 13:09:51.168313 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.539849 (+371536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30018,"raft.queue_time_us":9797,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":156702,"threads_started":1,"wal-append.queue_time_us":673108}
I20260709 13:09:51.545948 19368 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:51.548214 22415 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:51.540391 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:51.548832 22415 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.549541 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:51.550511 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:51.550889 22415 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.551549 22305 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.552604 22305 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.552946 22305 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.553267 22305 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.556595 22446 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:51.557392 22446 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:51.558537 22446 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.532047 22425 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.564733 19224 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:51.568778 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:51.470701 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.004s	sys 0.005s
W20260709 13:09:51.570663 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.005s	sys 0.006s
W20260709 13:09:51.571856 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.572718 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.073186 22280 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:51.057266 19216 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:51.069746 22315 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.625s	user 0.005s	sys 0.004s
I20260709 13:09:51.603259 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.017406 19222 rpcz_store.cc:276] 0709 13:09:49.925115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.927976 (+  2861us) service_pool.cc:224] Handling call
0709 13:09:49.934448 (+  6472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.891741 (+957293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.016728 (+124987us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54003c7dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:51.016912 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145952000}
I20260709 13:09:51.073808 22380 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.041457 22438 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:51.164753 22447 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.125s	user 0.005s	sys 0.010s
I20260709 13:09:51.037735 22019 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:51.048337 22399 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:51.056618 22344 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:51.145722 19217 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:51.196957 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.633911 19263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.010s	sys 0.010s
W20260709 13:09:51.635426 19263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.010s	sys 0.010s
W20260709 13:09:51.500849 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 397376us
I20260709 13:09:51.069439 22416 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:51.354832 22466 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.471s	user 0.002s	sys 0.003s
W20260709 13:09:51.355058 22460 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.425s	user 0.000s	sys 0.005s
I20260709 13:09:51.058668 22345 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:51.470896 22469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.009s
W20260709 13:09:51.507048 19295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1574) took 1984 ms (client timeout 1944 ms). Trace:
I20260709 13:09:51.600576 19216 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:51.039654 22363 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.258562 22456 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.364s	user 0.000s	sys 0.005s
I20260709 13:09:51.054585 22397 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:51.045317 22340 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:51.066882 22441 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:51.631906 22440 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:51.046123 22306 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.642987 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.683470 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1590) took 1297 ms. Trace:
I20260709 13:09:51.648910 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:51.614682 22381 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:51.614939 22377 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:51.654029 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.632759 22358 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.706844 19294 rpcz_store.cc:276] 0709 13:09:50.386104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.388100 (+  1996us) service_pool.cc:224] Handling call
0709 13:09:50.388457 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.394306 (+  5849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.394337 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:50.394795 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.581238 (+186443us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:50.581273 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.581338 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.683246 (+1101908us) raft_consensus.cc:1685] finished
0709 13:09:51.683265 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.683397 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":148695,"threads_started":1,"wal-append.queue_time_us":354701}
I20260709 13:09:51.054880 22012 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.648221 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:51.682415 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.601905 22280 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.706125 19218 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:51.714381 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:51.638885 22453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.009s	sys 0.009s
I20260709 13:09:51.713295 19299 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:51.709726 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 80781.2us
W20260709 13:09:51.717185 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.704953 19295 rpcz_store.cc:269] 0709 13:09:49.522551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.522709 (+   158us) service_pool.cc:224] Handling call
0709 13:09:51.506824 (+1984115us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003f20d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:51.506941 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379362688}
W20260709 13:09:51.719609 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.720820 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.721621 19218 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:51.644387 22285 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.705317 22469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.000s	sys 0.014s
I20260709 13:09:51.736840 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:51.734153 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:51.614784 22315 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.654043 22415 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.727375 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.739408 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:51.764899 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.677s (SENT) [suppressed 6 similar messages]
I20260709 13:09:51.761559 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.741982 19220 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:51.682051 22320 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:51.718402 22453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.009s	sys 0.014s
I20260709 13:09:51.763001 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:51.760403 19293 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:51.761947 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.768913 19222 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:51.743160 19295 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.638707 22019 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.639247 22399 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.722167 22425 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.737100 22397 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:51.784340 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.799271 19374 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:51.787608 22473 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.788251 22306 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:51.759262 22285 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.769897 22415 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.766456 22480 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:51.714001 22363 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.791465 22315 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:51.791952 19370 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:51.793606 22441 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.759186 22340 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:51.796218 19295 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:51.763310 22345 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:09:51.805923 19371 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
W20260709 13:09:51.806919 19266 connection.cc:256] RPC call timeout handler was delayed by -1.1894019950000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:09:51.722806 22358 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.809286 22381 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:51.809727 22279 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:51.809836 22019 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:51.810381 22470 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:51.839570 19223 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:51.862112 19223 pending_rounds.cc:85] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:09:51.862365 19223 pending_rounds.cc:107] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:51.862596 19223 raft_consensus.cc:2889] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.718933 22377 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.865680 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:51.836535 22480 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:51.867200 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.879171 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.881894 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:51.882652 19369 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.779863 22320 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.845782 22306 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:51.853128 19266 connection.cc:256] RPC call timeout handler was delayed by -1.0590729120000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:09:51.889000 19266 connection.cc:256] RPC call timeout handler was delayed by -1.0531193710000935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:09:51.889689 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:51.853211 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.855175 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:51.714460 22440 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.855851 22361 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.837358 22397 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.893728 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:51.890821 19217 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:51.894301 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.897833 19366 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:51.857838 22340 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:51.900051 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 166768us
I20260709 13:09:51.826426 22425 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.906654 19222 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:51.921113 19369 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:51.866089 22381 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.928900 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.895072 22481 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:51.865916 22279 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:51.930168 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:51.893728 22415 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:51.936709 19366 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:51.879529 22470 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.900959 22361 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:51.956828 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 191934us
I20260709 13:09:51.895268 22306 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.933740 19369 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:51.953990 22481 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:52.040266 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 277339us
I20260709 13:09:51.955744 22218 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:52.043265 19896 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:52.043787 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.047284 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:52.047526 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.047703 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:52.051923 19895 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:52.054400 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:52.055536 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.056656 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:52.050011 22486 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:09:52.059818 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.060186 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:51.931953 22480 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:52.036870 22012 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.065800 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:52.065196 22415 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.068197 22415 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:52.068660 22415 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.068811 22425 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.066704 19219 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:52.069362 22320 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:52.070245 22491 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:09:52.071430 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:52.071554 22397 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.072744 22397 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:52.073094 22397 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.073382 22440 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:52.073096 22499 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.073603 22397 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.077286 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:52.080912 22345 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.081455 22497 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.081409 22345 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.081905 22285 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.081959 22497 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:52.082337 22425 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.082625 22497 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.050494 22280 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.009842 22305 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:52.092293 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 202671us
I20260709 13:09:52.094045 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1588) took 1712 ms. Trace:
I20260709 13:09:52.094756 19221 rpcz_store.cc:276] 0709 13:09:50.381819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.386651 (+  4832us) service_pool.cc:224] Handling call
0709 13:09:50.386875 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.387066 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:50.571232 (+184166us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.093307 (+1522075us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18002da840. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a
0709 13:09:52.093572 (+   265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.093641 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:52.093710 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.093809 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.093963 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":396915,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1663,"spinlock_wait_cycles":3375488,"thread_start_us":434067,"threads_started":2,"wal-append.queue_time_us":904242}
I20260709 13:09:52.067473 22399 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:52.099579 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 229143us
I20260709 13:09:52.102977 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.103615 19895 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:52.105439 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:51.970939 22340 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.105990 19298 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:52.108201 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.108435 22388 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:52.096264 22320 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:52.117977 19291 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:52.118269 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.120280 19299 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:52.098551 22363 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:52.119212 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.123817 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.134711 19291 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:52.135946 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:52.136686 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.137223 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.124213 19297 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:52.139271 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.140395 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:52.141038 22305 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.141357 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.141660 22305 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:52.141918 19294 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:52.142673 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.143581 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.144491 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.107542 22471 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:09:52.145581 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.074509 22499 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:52.146239 19295 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:52.146960 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.147493 22499 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.147876 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.147524 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:52.150162 19293 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:52.155190 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:52.155437 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.156260 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.156812 19293 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:52.157747 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.159971 19291 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:52.162555 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.115274 22377 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:52.170006 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:52.171361 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.172119 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:52.173810 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.180532 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:52.181149 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 133503us
I20260709 13:09:52.182808 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.147675 22425 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:09:52.184689 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.185461 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.188581 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:52.190343 22377 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:52.192209 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:52.082309 22306 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.158905 22225 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:52.202010 19895 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:52.206707 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.171510 22396 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:52.224198 22396 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:52.225361 22425 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.225100 22396 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.225909 22425 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.226293 22396 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:52.206142 22452 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.318s	user 0.004s	sys 0.000s
I20260709 13:09:52.225373 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:52.149008 22320 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:52.250324 22494 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:09:52.229336 22203 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:52.254844 22203 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:52.261379 22496 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:09:52.262025 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.263186 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.264397 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:52.265040 19292 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.265882 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.272019 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1698) took 1850 ms. Trace:
I20260709 13:09:52.162730 22481 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:52.232697 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 125288us
I20260709 13:09:52.272540 19370 rpcz_store.cc:276] 0709 13:09:50.421540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.871485 (+449945us) service_pool.cc:224] Handling call
0709 13:09:50.871869 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.844385 (+972516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.271793 (+427408us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400095bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:52.271957 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115505024}
I20260709 13:09:52.274780 22225 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.275315 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 516) took 1196 ms. Trace:
I20260709 13:09:52.275533 22225 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:52.275797 19367 rpcz_store.cc:276] 0709 13:09:51.079143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.087588 (+  8445us) service_pool.cc:224] Handling call
0709 13:09:51.087882 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.760703 (+672821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.760735 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.760791 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.760835 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.275079 (+514244us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400137ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:52.275123 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.275256 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546876288}
W20260709 13:09:52.278365 22467 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.436s	user 0.013s	sys 0.027s
I20260709 13:09:52.281972 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.205659 22499 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:52.321201 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:52.248190 22285 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.249336 22504 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.325673 22504 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.320331 22499 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.328102 22499 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.229682 19297 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.370787 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:52.373507 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 519) took 1270 ms. Trace:
I20260709 13:09:52.376965 22019 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:52.374297 22508 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:52.376415 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 486610us
I20260709 13:09:52.380017 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:52.380869 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:52.381923 22245 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.382282 22245 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.382658 22245 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.382305 22297 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:52.383342 22297 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:52.383496 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 107234us
I20260709 13:09:52.383798 22297 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.384310 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:52.385432 22502 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.211275 22358 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.423352 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:52.424435 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.429826 19296 raft_consensus.cc:1217] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[8.5-9.6]   Dedup: 8.5->[9.6-9.6]
I20260709 13:09:52.431097 19296 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [8.5-9.6]
W20260709 13:09:52.403528 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 195548us
I20260709 13:09:52.423965 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:52.441545 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:52.377249 19374 rpcz_store.cc:276] 0709 13:09:51.102855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.826102 (+723247us) service_pool.cc:224] Handling call
0709 13:09:51.847386 (+ 21284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.847584 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:51.847876 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.173466 (+325590us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b24001cf2f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e0709d 00007fe8d7a3910e 00007fe8d7a5088c 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221
0709 13:09:52.367663 (+194197us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b1800484b40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:09:52.367917 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.367981 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:52.368040 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.368116 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.373425 (+  5309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32482,"prepare.queue_time_us":2848,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":527051,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":34250368,"wal-append.queue_time_us":7704}
I20260709 13:09:52.432829 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:52.205380 22377 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:52.453584 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:52.454291 19300 raft_consensus.cc:1217] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-6.4]   Dedup: 4.3->[6.4-6.4]
I20260709 13:09:52.454869 19300 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:09:52.460469 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 343096us
W20260709 13:09:52.462584 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 270451us
W20260709 13:09:52.464757 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.465888 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:52.467036 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:52.467852 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.449542 22358 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.471982 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:52.472771 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:52.476861 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.477492 19367 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:52.478224 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.479218 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.480595 19292 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:52.480840 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.480023 19368 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:52.449225 22019 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.473379 19223 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:52.485930 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.486865 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.491550 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:52.453639 22469 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.452610 22279 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.491825 19300 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:52.495306 22470 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.496037 22415 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.498809 22203 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:52.473152 22463 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.499884 22361 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:52.472321 22358 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:52.501663 22388 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.473404 22280 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:52.472941 22301 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:52.530023 22301 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:52.453032 22290 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:09:52.501173 22441 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.523761 19292 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:52.470081 22390 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:52.488570 22019 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:52.487576 22294 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:52.525909 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:52.547777 19218 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:52.528085 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:52.548388 19898 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:52.529285 22377 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:52.505491 22469 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.532681 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:52.567504 19368 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:09:52.538801 22415 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:52.544703 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:52.576710 19222 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.525034 22358 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.491991 22500 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:09:52.486385 22320 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.550462 19297 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:52.522595 22340 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.532837 22388 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:52.554525 22294 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.591253 22471 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:52.591725 22471 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:52.547773 22019 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.546511 22441 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:52.556658 22473 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.013s
I20260709 13:09:52.532136 22301 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:52.527053 22345 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:52.561134 22295 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.543s	user 0.019s	sys 0.005s
I20260709 13:09:52.540360 22280 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:52.564541 22245 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:52.566401 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:52.569689 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:53.100234 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.099078 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.101688 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:53.104974 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 556673us
I20260709 13:09:52.576007 22469 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.711460 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:53.108557 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 538926us
I20260709 13:09:53.102526 19216 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:09:52.595747 22297 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.110021 22290 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:52.756199 22484 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:52.743624 19371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1702) took 2151 ms (client timeout 1656 ms). Trace:
W20260709 13:09:53.136231 19371 rpcz_store.cc:269] 0709 13:09:50.557562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.559430 (+  1868us) service_pool.cc:224] Handling call
0709 13:09:52.708296 (+2148866us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000b40d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:52.708418 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2864166784}
W20260709 13:09:53.112288 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 509671us
I20260709 13:09:53.112475 22476 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:53.114482 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1571) took 3532 ms. Trace:
I20260709 13:09:53.141986 19225 rpcz_store.cc:276] 0709 13:09:49.582304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.584785 (+  2481us) service_pool.cc:224] Handling call
0709 13:09:49.653726 (+ 68941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.890225 (+1236499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.114230 (+2224005us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000181d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:53.114417 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594038656}
I20260709 13:09:52.551681 22504 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.127640 22480 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.709811 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1600) took 1061 ms. Trace:
I20260709 13:09:53.143699 19298 rpcz_store.cc:276] 0709 13:09:51.648247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.648450 (+   203us) service_pool.cc:224] Handling call
0709 13:09:52.709623 (+1061173us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54002e7554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:52.709754 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918031744}
I20260709 13:09:53.130122 22344 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:53.144533 22245 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.144858 22344 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.145329 22344 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.147168 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:53.133809 22388 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.148186 22390 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:53.148607 22390 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.148924 22390 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.119544 22473 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.123801 22340 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.151628 22340 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.127764 22481 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.153749 22481 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.118618 22441 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.109128 22012 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.155440 22012 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.155797 22012 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.121986 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:53.122586 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.124107 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:53.125176 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 558823us
I20260709 13:09:53.125756 19217 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:53.123564 22294 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.120097 22218 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:52.592603 22471 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.156097 19903 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:09:52.594300 22381 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.169023 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.170145 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.155861 22481 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.179412 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:53.188445 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 66523.5us
W20260709 13:09:53.166229 22285 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.836s	user 0.009s	sys 0.005s
I20260709 13:09:53.191316 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:53.170387 22019 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 13:09:53.195092 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.194998 22019 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.191529 22361 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:53.197052 22019 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.197710 19367 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:53.136111 22484 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:53.201591 22469 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.204277 19295 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.205734 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1606) took 1006 ms. Trace:
I20260709 13:09:53.205518 22280 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.206103 19295 rpcz_store.cc:276] 0709 13:09:52.199309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.497300 (+297991us) service_pool.cc:224] Handling call
0709 13:09:52.497597 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.204689 (+707092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.205488 (+   799us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54002b8ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:53.205679 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624781568}
I20260709 13:09:53.206123 19898 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:53.207756 22425 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.175226 22218 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.206559 22469 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.200273 22484 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.210637 22218 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.175638 22517 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:53.138110 22290 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.229138 22290 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.229393 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 657) took 1185 ms. Trace:
I20260709 13:09:53.211573 22340 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:09:53.229838 19903 rpcz_store.cc:276] 0709 13:09:52.043813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.044254 (+   441us) service_pool.cc:224] Handling call
0709 13:09:53.229224 (+1184970us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54004f0954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:53.229327 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2526322944}
I20260709 13:09:53.229688 22517 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:53.236776 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46016.3us
I20260709 13:09:53.238176 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.238389 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.240513 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.215010 22285 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.156075 22390 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:53.251639 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 541211us
I20260709 13:09:53.253970 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.260828 19370 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:53.254839 22245 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.230434 22244 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:53.255138 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.262266 22244 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:53.262756 22244 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:53.262967 19366 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:53.263525 19373 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:53.230142 22396 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.003s	user 0.021s	sys 0.042s
I20260709 13:09:53.241060 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.232506 22484 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:53.225507 22524 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:53.265136 22225 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:53.291769 22358 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.002s
I20260709 13:09:53.257100 22416 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:09:53.263830 22244 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.333303 22358 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:53.317941 22497 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.234s	user 0.021s	sys 0.002s
I20260709 13:09:53.334657 22497 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:53.335517 22514 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 13:09:53.335752 22476 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.336257 22476 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.302881 22524 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:53.347641 22390 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.347790 19365 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:53.315779 22297 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.363561 22524 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:53.393678 22390 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.411938 22397 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.321s	user 0.012s	sys 0.010s
W20260709 13:09:53.415776 22499 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.087s	user 0.008s	sys 0.012s
I20260709 13:09:53.411072 22344 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:51.075747 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:53.682075 19191 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.021s
I20260709 13:09:53.573192 19299 raft_consensus.cc:2410] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:09:53.687373 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.589807 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.524718 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.639268 19265 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:53.537719 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:53.708702 22320 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:53.709369 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1614) took 1205 ms. Trace:
I20260709 13:09:53.708777 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:53.721560 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.708765 19293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.014s	sys 0.030s
I20260709 13:09:53.530237 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:53.438905 22397 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.426867 22390 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.713544 22396 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.438725 22519 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.883s	user 0.004s	sys 0.007s
I20260709 13:09:53.551671 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:53.533138 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:53.531651 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:53.734747 19217 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:53.735132 19216 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:53.737753 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:53.738121 19220 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:53.740255 19895 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.553015 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:53.637850 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 377594us
W20260709 13:09:53.601501 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45351.3us
I20260709 13:09:53.437628 22471 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.722514 22119 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:53.728698 19222 consensus_meta.cc:287] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.143s	user 0.013s	sys 0.009s
I20260709 13:09:53.416050 22358 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:53.732576 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.724745 19191 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.010s	sys 0.022s
W20260709 13:09:53.743811 19293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.014s	sys 0.030s
I20260709 13:09:53.740309 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:53.753577 19365 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:53.754594 22344 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.751019 19222 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:53.746173 22476 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.754725 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:53.758649 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 119926us
I20260709 13:09:53.756908 19900 raft_consensus.cc:2368] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:53.764475 19216 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.765406 19223 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:53.768707 19221 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:53.765340 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 1955) took 1221 ms. Trace:
I20260709 13:09:53.769685 19222 rpcz_store.cc:276] 0709 13:09:52.544295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.544459 (+   164us) service_pool.cc:224] Handling call
0709 13:09:53.765224 (+1220765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:53.772595 22476 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:53.772783 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1714) took 1295 ms. Trace:
I20260709 13:09:53.437522 22499 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.760094 22244 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.778115 22469 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.774487 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:53.784571 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:53.779827 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 653915us
I20260709 13:09:53.776562 19372 rpcz_store.cc:276] 0709 13:09:52.477134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.478837 (+  1703us) service_pool.cc:224] Handling call
0709 13:09:52.495044 (+ 16207us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:52.912340 (+417296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.912393 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:53.124198 (+211805us) log.cc:844] Serialized 52 byte log entry
0709 13:09:53.620295 (+496097us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:53.620395 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.620531 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.765709 (+145178us) raft_consensus.cc:1685] finished
0709 13:09:53.765730 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.772598 (+  6868us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25299,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":10908,"thread_start_us":861194,"threads_started":2,"wal-append.queue_time_us":536390}
I20260709 13:09:53.789428 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.791289 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.780071 22388 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:53.792797 22531 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.792927 22388 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.793853 22531 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.726106 19224 rpcz_store.cc:276] 0709 13:09:52.503532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.510600 (+  7068us) service_pool.cc:224] Handling call
0709 13:09:53.563532 (+1052932us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b54004381a8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dce59ebc 00007fe8dce8f08c 00007fe8dce7993b 00007fe8dce793d2 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c
0709 13:09:53.563871 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.564778 (+   907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.564819 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.565763 (+   944us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.682969 (+117206us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:53.683010 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.683075 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.708823 (+ 25748us) raft_consensus.cc:1685] finished
0709 13:09:53.708849 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.709131 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75599,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":9694592,"thread_start_us":116727,"threads_started":1,"wal-append.queue_time_us":117151}
I20260709 13:09:53.787150 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:53.785524 22396 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.740296 22493 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:09:53.802376 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.796006 22388 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.827596 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.789907 22480 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:53.832743 19895 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:53.775583 22320 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.835060 22505 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:53.836030 22505 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.838661 22505 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.840368 22390 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.840627 22476 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.843400 22476 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.844003 22280 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:53.844653 22280 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.848328 19373 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:53.849164 22012 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.007s
I20260709 13:09:53.849637 22012 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.851027 19374 raft_consensus.cc:2368] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:09:53.820670 22344 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:53.848341 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.852945 22344 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.853749 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:53.854040 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.855072 19368 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:09:53.856067 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.854770 19298 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:53.860083 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:53.821328 22407 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:53.778733 22119 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:53.856721 19120 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 158) took 21371 ms (client timeout 15000 ms). Trace:
I20260709 13:09:53.866091 22531 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.866441 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:53.866778 22012 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.867182 19291 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:53.869566 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:53.871328 22388 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:53.881210 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:53.882490 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.886916 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.893328 19895 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.893568 22012 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.894263 22012 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:53.895125 19370 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:53.896188 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.897729 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.898980 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:53.889575 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 90423.5us
I20260709 13:09:53.905138 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:53.883000 22344 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.907720 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.884696 22505 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:53.914701 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1702) took 1788 ms. Trace:
I20260709 13:09:53.910780 19295 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:53.918686 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:53.889588 22531 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:53.922441 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.923132 19370 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:53.923386 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:53.920401 22530 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:09:53.924258 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:53.925540 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.927429 22484 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.936004 22484 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.936062 22531 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.938823 22484 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.927383 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:53.940302 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:53.864140 19120 rpcz_store.cc:269] 0709 13:09:32.385038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.385301 (+   263us) service_pool.cc:224] Handling call
0709 13:09:53.749813 (+21364512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:49.104331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:49.104860 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:49.104889 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:09:49.104906 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:49.105749 (+   843us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:49.105806 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:49.105832 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:49.106440 (+   608us) tablet.cc:701] Row locks acquired
0709 13:09:49.106454 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:09:49.106595 (+   141us) write_op.cc:270] Start()
0709 13:09:49.106701 (+   106us) write_op.cc:276] Timestamp: P: 1783602589106543 usec, L: 0
0709 13:09:49.106715 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:09:49.172910 (+ 66195us) log.cc:844] Serialized 3234 byte log entry
0709 13:09:49.535539 (+362629us) op_driver.cc:464] REPLICATION: finished
0709 13:09:49.962238 (+426699us) write_op.cc:301] APPLY: starting
0709 13:09:49.962343 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:49.962609 (+   266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:49.962750 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:49.963752 (+  1002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:49.964043 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:09:49.964107 (+    64us) write_op.cc:312] APPLY: finished
0709 13:09:49.964472 (+   365us) log.cc:844] Serialized 65 byte log entry
0709 13:09:49.964663 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.964813 (+   150us) write_op.cc:454] Released schema lock
0709 13:09:49.964875 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:49.965272 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.965305 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":9908,"mutex_wait_us":2321122,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":399121,"apply.run_cpu_time_us":3032,"apply.run_wall_time_us":3032,"num_ops":8,"prepare.queue_time_us":174447,"prepare.run_cpu_time_us":14205,"prepare.run_wall_time_us":227329,"raft.queue_time_us":116954,"raft.run_cpu_time_us":82295,"raft.run_wall_time_us":310242,"replication_time_us":428665,"thread_start_us":503376,"threads_started":4,"wal-append.queue_time_us":214835,"wal-append.run_cpu_time_us":7711,"wal-append.run_wall_time_us":1572882}]]}
I20260709 13:09:53.939005 22531 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.941457 22497 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.913841 22340 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.942622 22340 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.945036 22340 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.936009 22517 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.946997 19373 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:09:53.947703 22524 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.006s
I20260709 13:09:53.948338 22524 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.921700 22407 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.958626 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:53.920565 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:53.922735 22469 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:53.956288 22505 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:53.972223 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:53.926841 22012 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:53.979456 19371 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:53.986835 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 1957) took 1426 ms. Trace:
I20260709 13:09:53.986989 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:53.987172 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:53.988183 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:53.987339 19218 rpcz_store.cc:276] 0709 13:09:52.551637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.551807 (+   170us) service_pool.cc:224] Handling call
0709 13:09:52.552156 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.565900 (+ 13744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.565957 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.097552 (+531595us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.526387 (+428835us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:53.526512 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.526694 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.977710 (+451016us) raft_consensus.cc:1685] finished
0709 13:09:53.977731 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.977851 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164930,"raft.queue_time_us":17526,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11862,"thread_start_us":428080,"threads_started":1,"wal-append.queue_time_us":604700}
I20260709 13:09:53.989689 22521 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.990748 22358 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.991472 22358 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:53.992903 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 177516us
I20260709 13:09:53.993268 22493 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:53.993829 22358 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:53.994374 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66090.9us
I20260709 13:09:53.995729 22453 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:53.996381 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:53.996608 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:53.997161 19291 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:53.998816 22119 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:53.999481 22500 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:54.000078 22500 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:54.000448 19368 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:54.001904 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:54.002416 22453 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:54.002668 19297 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:54.002981 22453 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:53.928056 22388 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.002671 22305 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.990458 22521 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:54.003885 22305 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.005262 22388 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:54.005975 22521 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:54.006095 22396 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:54.006500 22499 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:54.007519 22397 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:53.919221 22480 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.009369 22505 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:54.009639 19370 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:54.010300 22480 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:54.005975 22305 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:54.011318 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:53.915059 19293 rpcz_store.cc:276] 0709 13:09:52.119643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.471146 (+351503us) service_pool.cc:224] Handling call
0709 13:09:52.471523 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.491390 (+ 19867us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:52.500382 (+  8992us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.711580 (+211198us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180030ee00. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:09:52.916102 (+204522us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.107921 (+191819us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.108105 (+   184us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:53.779136 (+671031us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.867763 (+ 88627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.883725 (+ 15962us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.900847 (+ 17122us) raft_consensus.cc:1685] finished
0709 13:09:53.900869 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.908344 (+  7475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20559,"prepare.queue_time_us":264096,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":29154,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":8896,"spinlock_wait_cycles":3475200,"thread_start_us":811422,"threads_started":2,"wal-append.queue_time_us":697784}
I20260709 13:09:54.012957 19372 raft_consensus.cc:2410] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:09:53.996821 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:54.001490 22500 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:54.003154 19299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1703) took 1883 ms (client timeout 2068 ms). Trace:
I20260709 13:09:54.024216 19220 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:53.987991 19899 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:09:54.023447 19299 rpcz_store.cc:269] 0709 13:09:52.119937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.123606 (+  3669us) service_pool.cc:224] Handling call
0709 13:09:54.002925 (+1879319us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540034f154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:54.003088 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3304439680}
I20260709 13:09:54.025163 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:54.025812 19297 raft_consensus.cc:1813] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Handling vote request from an unknown peer c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:54.026988 19895 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:54.028568 19297 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:54.002345 22315 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:54.037429 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:54.038076 19898 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:54.039288 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:54.039260 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45042.4us
I20260709 13:09:54.032774 22397 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:54.045218 22501 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:54.045307 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1613) took 1542 ms. Trace:
I20260709 13:09:54.046219 22484 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:54.033042 22407 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:54.052441 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 61663.7us
I20260709 13:09:54.054507 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:54.050684 19223 rpcz_store.cc:276] 0709 13:09:52.503164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.505538 (+  2374us) service_pool.cc:224] Handling call
0709 13:09:52.505832 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.777582 (+1271750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.040023 (+262441us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001b2e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:54.045237 (+  5214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878566144}
I20260709 13:09:54.049363 22397 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:54.074424 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77941.7us
I20260709 13:09:54.051492 22484 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:54.078316 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48473.3us
I20260709 13:09:54.079995 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:54.075896 22397 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:54.078279 22484 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.086849 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:54.090698 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 128095us
I20260709 13:09:54.091781 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d1dbf9a24f4b489920281c72245ab4 with delete_type TABLET_DATA_TOMBSTONED (TS c6a09cefdddd4ca8a10b66682ed27dad not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53982
I20260709 13:09:54.086921 19366 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:54.092617 22524 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:54.096436 19897 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:54.096575 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:54.097846 19899 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:54.076364 22501 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:54.055291 22315 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.107352 19369 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.110790 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:54.128403 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:54.095629 22453 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.137349 22545 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:54.135593 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:54.148280 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:54.111413 22501 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.145962 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:54.158231 22471 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:54.158672 22471 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:54.156457 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:54.161229 19903 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:54.190474 22562 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:54.160207 19299 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:09:54.167598 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.198782 19370 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:54.159646 22471 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:54.215641 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.215790 22471 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:54.200664 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43578.1us
W20260709 13:09:54.200989 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.205896 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:54.200114 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60296.5us
I20260709 13:09:54.209218 22565 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:54.223014 22546 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:09:54.248400 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 166790us
I20260709 13:09:54.249158 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:54.223816 22565 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:54.267975 22562 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:09:54.276765 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.277603 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49901.4us
W20260709 13:09:54.295673 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 167417us
I20260709 13:09:54.259188 22565 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.290979 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:54.225069 22505 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:09:54.298971 22562 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.299921 19898 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:54.312454 19896 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:54.316236 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:54.317116 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:54.321534 19294 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.329051 22551 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.329931 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:54.329723 22551 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:54.331225 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:54.331887 19299 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:54.333324 22505 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:54.333755 22505 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:54.334678 22505 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.294711 22476 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:09:54.631824 19294 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:54.633610 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:54.633244 19220 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:54.636420 19219 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:54.504475 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 255969us
I20260709 13:09:54.338193 19291 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:54.629124 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:54.634322 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 380732us
I20260709 13:09:54.632066 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:54.508919 19369 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:54.314076 22493 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:54.590005 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:54.649952 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 532) took 1292 ms. Trace:
I20260709 13:09:54.589130 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:54.650478 19369 rpcz_store.cc:276] 0709 13:09:53.348301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.348496 (+   195us) service_pool.cc:224] Handling call
0709 13:09:54.041695 (+693199us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:54.640526 (+598831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89707264}
I20260709 13:09:54.337647 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:54.395278 22549 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:54.685474 19218 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.554004 22570 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.437911 22483 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.336977 22453 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:54.659001 22505 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:54.557341 22544 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.426s
W20260709 13:09:54.714547 22567 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:09:54.715198 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1635) took 1070 ms. Trace:
I20260709 13:09:54.715638 19217 rpcz_store.cc:276] 0709 13:09:53.648409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.761166 (+112757us) service_pool.cc:224] Handling call
0709 13:09:53.773627 (+ 12461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.829518 (+ 55891us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:53.885216 (+ 55698us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.034616 (+149400us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.034864 (+   248us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.035359 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.035497 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:54.035679 (+   182us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.036022 (+   343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.036090 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.714948 (+678858us) raft_consensus.cc:1685] finished
0709 13:09:54.714967 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.715110 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16700,"prepare.queue_time_us":23904,"prepare.run_wall_time_us":25,"raft.queue_time_us":21450,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12689,"spinlock_wait_cycles":28580608,"thread_start_us":111987,"threads_started":1,"wal-append.queue_time_us":171352}
I20260709 13:09:54.467768 22315 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:54.653867 22564 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:54.690317 22493 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:54.705191 22483 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.705597 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:54.706125 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 306947us
I20260709 13:09:54.537042 22524 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.164s
I20260709 13:09:54.711735 22565 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.731217 19219 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:09:54.766847 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64362.7us
W20260709 13:09:54.758283 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.717093 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:54.717738 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:54.756783 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.734378 22557 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.509s	user 0.001s	sys 0.000s
W20260709 13:09:54.771418 22568 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:09:54.875078 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:54.737962 22500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.011s	sys 0.028s
W20260709 13:09:54.876966 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 176050us
I20260709 13:09:54.899132 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:54.900234 19369 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:54.866763 22305 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.926359 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:54.930414 19337 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:54.936645 22575 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:09:54.937444 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:54.934861 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:54.704331 22570 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:54.938467 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:54.898751 22500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.020s	sys 0.041s
W20260709 13:09:54.953042 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 629672us
W20260709 13:09:54.957167 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 77564.5us
W20260709 13:09:54.959383 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66193.7us
I20260709 13:09:54.967017 22545 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.967993 22545 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:54.969802 19897 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:54.979676 22340 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:54.986119 19340 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.944s (SENT)
I20260709 13:09:54.989472 19221 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:54.992645 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.008481 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.009344 22584 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:55.010006 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.010610 22584 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:55.010963 22537 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.227s	user 0.012s	sys 0.014s
I20260709 13:09:55.011072 22584 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:54.957072 22305 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.013978 22469 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:55.014454 22469 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:55.016271 22397 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.865s	user 0.009s	sys 0.003s
I20260709 13:09:55.016728 22397 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.018829 22397 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.020469 22500 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.021209 22500 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:54.987875 22340 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:55.022874 22340 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.026013 19218 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:55.026697 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:54.970752 22545 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:55.014508 22305 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:54.991593 22524 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:55.035111 22583 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:09:54.866267 22564 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.043538 19366 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:55.039072 22471 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.000s
I20260709 13:09:55.047645 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:55.046228 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.053149 22581 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:09:55.055778 22305 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.056241 22305 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:55.056604 22305 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.056782 22483 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.057439 22565 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.057488 22407 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:55.058046 22407 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:55.059008 22407 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.033915 22493 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.063522 19223 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:55.066286 22407 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:55.051309 22484 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.939s	user 0.010s	sys 0.002s
I20260709 13:09:55.033440 22584 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:55.068833 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56761us
I20260709 13:09:55.069111 22570 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.074867 22280 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:55.076725 22581 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:55.088400 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:55.088865 22320 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.092728 22358 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:55.092842 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58178.1us
W20260709 13:09:55.094300 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 132936us
I20260709 13:09:55.049105 22545 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.109606 22517 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:55.115453 22469 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.107988 22358 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:55.116400 22524 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:55.116983 22524 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:55.117758 22469 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.115847 22517 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.118012 22524 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.118743 22517 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.104974 22484 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.122301 22484 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:55.122361 19216 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:55.116977 22358 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.125505 22358 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.126336 22554 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:55.126807 22554 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:55.117633 22564 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.129133 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.129760 22501 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:55.130647 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.130409 22501 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.131295 22545 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.143301 22397 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:55.143734 22397 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:55.145298 22397 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.146550 22397 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.152352 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:55.155014 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:55.127686 22554 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.138145 22584 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:55.156919 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.157002 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:55.157656 19298 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.158321 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.159725 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:55.160905 19222 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:55.161145 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.161275 22225 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.161897 19291 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:55.162147 22225 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:55.162590 22225 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:55.162998 22225 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.163278 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.136885 22320 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:55.164688 22551 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:55.165067 19295 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:55.162173 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.163208 19191 leader_election.cc:400] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:09:55.169082 19191 leader_election.cc:403] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:55.171257 19296 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:55.108112 22340 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.173820 19216 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:55.174499 19901 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:55.175362 22340 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.175674 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:55.180714 22554 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:55.186757 22536 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.061s	user 0.011s	sys 0.021s
I20260709 13:09:55.187541 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.187623 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.188576 19219 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:55.188501 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.189193 19222 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:55.191422 22501 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:55.186657 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.192128 19223 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:55.193027 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.201370 19222 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:55.201779 19293 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:55.192518 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.203074 19221 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:55.207242 19222 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:55.201704 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:55.215819 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 170244us
I20260709 13:09:55.209400 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.218406 19220 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:55.221195 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.222728 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.196309 22493 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:55.197264 22469 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:55.195504 22551 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.233430 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.197408 22562 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:09:55.231336 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.232466 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:55.235617 19295 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:55.243564 19373 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:55.245682 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.242020 19292 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:55.225636 22501 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:55.249260 22582 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:55.194159 22305 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.252822 19225 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:55.229449 22280 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:55.253819 19225 pending_rounds.cc:85] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 3
I20260709 13:09:55.253465 19293 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:55.250407 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:55.255735 22320 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:55.257205 22320 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:55.257761 22320 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:55.259220 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.258924 22320 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.256637 19119 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 5 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 6 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.263566 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:55.265654 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.267230 19224 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:55.254132 19225 pending_rounds.cc:107] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:55.268261 19225 raft_consensus.cc:2889] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.274891 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.275707 19293 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:09:55.276412 19218 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:55.245735 22551 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.280870 22561 tablet_replica.cc:333] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:09:55.281611 22545 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.282015 22561 raft_consensus.cc:2243] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.272526 22577 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:55.286898 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.282397 22551 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:55.288295 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.285313 22397 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.273491 22524 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:55.277758 22582 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:55.303037 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.296751 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.283510 22280 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:55.260702 22493 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.287566 22320 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:55.307387 19367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1840) took 2012 ms (client timeout 2187 ms). Trace:
I20260709 13:09:55.332732 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.333762 19220 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:55.310734 22476 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:55.284387 22315 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:09:55.305285 22397 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:55.331271 19367 rpcz_store.cc:269] 0709 13:09:53.295298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.295683 (+   385us) service_pool.cc:224] Handling call
0709 13:09:54.043697 (+748014us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:55.205909 (+1162212us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90e9c 00007fe8d4d90a5b 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:09:55.307315 (+101406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18734720}
W20260709 13:09:55.361415 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.306711 22577 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:55.330919 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.311014 22524 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:55.367022 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 83771.1us
I20260709 13:09:55.363721 22476 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.329803 22225 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.374673 22476 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:55.375133 22225 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:55.375392 19224 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:55.379594 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.380488 19293 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:55.382226 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.380400 19119 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 4 to 5, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:55.382949 19217 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:55.376295 22561 raft_consensus.cc:2272] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:55.395623 22591 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:09:55.397089 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.397324 22582 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:55.400877 22592 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:55.406551 22577 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.419683 19293 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:55.420650 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:55.422184 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116226us
I20260709 13:09:55.424190 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.424942 22469 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:55.426214 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.382594 22545 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:55.433748 22585 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:55.436095 22586 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:09:55.436966 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.437647 22524 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.438465 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.439098 19295 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:09:55.440270 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.442231 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.442787 19295 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:09:55.444446 22585 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:55.446882 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.446033 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.447880 19293 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:55.448792 19291 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:55.448694 22280 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.450822 22585 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:55.452970 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.431406 19292 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:55.432955 19119 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 5 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:55.383596 22517 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.463367 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.474664 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.465626 19216 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:55.468395 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.472318 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:55.465992 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:55.463979 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.471113 19298 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:55.464840 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.464458 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:55.487303 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:55.494683 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.454317 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 91760.9us
I20260709 13:09:55.469995 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.492698 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.580605 19223 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:55.580812 19220 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:55.582062 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.583001 19220 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:55.582741 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:55.461464 22561 ts_tablet_manager.cc:1916] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:55.584052 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.584532 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.586215 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.587260 19224 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:55.588223 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.588539 22594 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:55.588879 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.588979 19224 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:55.590202 19224 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:55.590415 19222 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:55.591564 19224 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:09:55.575459 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 180768us
W20260709 13:09:55.639109 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 92125.3us
W20260709 13:09:55.716049 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.684446 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 191896us
I20260709 13:09:55.650429 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:55.574712 19119 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.677537 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:55.652346 19219 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:09:55.665723 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.719276 19292 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:09:55.680544 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.641188 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 188265us
I20260709 13:09:55.474246 22521 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:55.696130 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:55.721525 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.458848 22493 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:55.489384 22585 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:55.604238 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.467489 22305 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:55.725920 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 75559.4us
I20260709 13:09:55.480312 22397 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:55.727100 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.525224 22469 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.730325 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:55.731518 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65876.9us
I20260709 13:09:55.597668 22483 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.740514 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:55.740513 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.657569 22594 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:55.681077 22545 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.732831 19296 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:55.743363 19119 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 3 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 4 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:55.740512 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.722544 22521 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:55.760700 22521 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.761718 22521 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.765256 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.659714 22560 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:55.733350 22358 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260709 13:09:55.757714 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.730989 22562 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:55.768296 19898 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:09:55.770895 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:55.774881 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.777179 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.781189 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.777659 19291 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:55.783494 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:55.784785 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.785590 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.786433 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.769869 22225 raft_consensus.cc:2764] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:55.783913 22562 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:55.793638 22562 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.796115 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:55.804838 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:55.806238 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.796340 19188 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:55.806995 19291 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:55.812485 19219 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:55.815069 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:55.820427 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.778036 22577 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:09:55.815092 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.831665 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.753616 22584 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:09:55.833223 19365 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:55.828089 19119 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:55.765954 22453 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:09:55.845296 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 61889.5us
I20260709 13:09:55.846040 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:55.835861 22560 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.859221 22560 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:55.860992 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:55.861578 22560 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:55.862286 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.863004 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:55.863941 19903 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:55.865141 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:55.865814 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.865959 19296 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:55.852432 22493 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:55.875137 22320 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.002s
I20260709 13:09:55.814576 22225 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:55.836681 22517 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:55.826146 22344 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:55.880621 22344 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.881098 22344 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.884110 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:55.885102 19296 raft_consensus.cc:606] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:55.885510 19296 raft_consensus.cc:614] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:55.891249 19374 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:55.893115 19223 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:55.897468 19296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:55.898310 19296 raft_consensus.cc:606] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:55.898717 19296 raft_consensus.cc:614] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:55.898823 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:55.905619 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:55.922222 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:55.846688 19367 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:55.770802 22594 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:55.931200 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:55.933316 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:55.937762 19292 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:09:55.941191 19903 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:55.941599 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:55.938038 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:55.947948 19221 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:09:55.936152 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 195240us
I20260709 13:09:55.949488 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:55.952889 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.930099 22320 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:55.957751 19898 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:09:55.960119 19119 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:55.975464 22585 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:09:55.979353 22585 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:55.985030 22305 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:55.985503 22305 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.985824 22305 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:55.988670 22602 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:09:55.991325 22493 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:55.991858 22493 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.992617 22476 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:56.008176 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:55.958977 22320 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.019939 22607 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:56.036155 19119 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 3 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:09:56.036010 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 566028us
W20260709 13:09:56.041672 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50222.4us
W20260709 13:09:56.042101 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 101800us
I20260709 13:09:56.020576 22320 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.018939 22225 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.047466 19263 leader_election.cc:400] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:56.048867 19263 leader_election.cc:403] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:56.069092 19225 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.072117 19901 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:56.062810 22545 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:09:56.073350 22545 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:56.043684 22607 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:56.085316 22607 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.031356 22577 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:09:56.081193 22600 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:09:56.097983 22594 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:56.080780 19119 catalog_manager.cc:5697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 6, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 6 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:09:56.081656 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 124820us
W20260709 13:09:56.102572 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 55282.7us
I20260709 13:09:56.098089 22315 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:09:56.111284 19217 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:56.075115 22545 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:56.113837 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.098681 22612 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:09:56.114495 19119 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 5 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:56.116393 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.124037 19219 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:56.116381 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.111366 22607 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.137934 19119 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:09:56.131685 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.141003 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.114712 22545 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:56.150358 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.154145 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:56.137558 22480 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.144770 22517 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:56.137343 22012 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:56.131055 22585 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.156558 22469 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.181246 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:56.155398 22612 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:56.189100 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.168994 22480 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:56.218936 22480 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.221156 22608 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.221666 22608 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.222029 22608 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:56.213497 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 103352us
I20260709 13:09:56.228403 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:56.218441 22469 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:56.229971 22469 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:56.230873 22469 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.232506 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:56.232455 22545 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.234390 22545 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:56.238891 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 108787us
I20260709 13:09:56.149796 22609 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:09:56.160970 22581 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:09:56.257616 22517 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.260946 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.214231 22612 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:56.258303 22225 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.267482 22551 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.288376 22551 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:56.288815 22551 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.189561 22493 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.283630 22612 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.196130 22012 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.286554 22594 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.285782 22611 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:56.298700 22305 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:56.312649 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.324446 22305 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:56.316979 22611 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:56.337438 22611 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.338620 22611 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.316520 22594 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:56.340794 22594 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.343794 22493 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:56.345028 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 112605us
W20260709 13:09:56.351035 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.352466 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:56.352772 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:56.353536 19219 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.354307 19898 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:56.355288 22012 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:56.356321 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.357218 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:56.374610 19219 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:09:56.383591 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 103476us
W20260709 13:09:56.385035 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47874.8us
I20260709 13:09:56.291371 22480 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.389055 22320 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.390280 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:56.390533 22480 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:56.375911 22397 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.391130 22320 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:56.391767 22397 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.312341 22344 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:56.416121 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 155252us
W20260709 13:09:56.575886 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 432323us
I20260709 13:09:56.315481 22561 ts_tablet_manager.cc:1929] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:09:56.768886 22561 log.cc:1199] T 78d1dbf9a24f4b489920281c72245ab4 P c6a09cefdddd4ca8a10b66682ed27dad: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/wals/78d1dbf9a24f4b489920281c72245ab4
I20260709 13:09:56.770253 22561 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53982 (request call id 76) took 2728 ms. Trace:
I20260709 13:09:56.770588 22561 rpcz_store.cc:276] 0709 13:09:54.068345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.084601 (+ 16256us) service_pool.cc:224] Handling call
0709 13:09:54.219006 (+134405us) ts_tablet_manager.cc:1151] Deleting tablet 78d1dbf9a24f4b489920281c72245ab4
0709 13:09:55.228829 (+1009823us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:56.029790 (+800961us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:56.315341 (+285551us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:56.770160 (+454819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16361,"tablet-delete.queue_time_us":112143,"thread_start_us":41978,"threads_started":1}
W20260709 13:09:56.628787 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 459433us
I20260709 13:09:56.772277 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.773427 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.774199 22630 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.774549 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.747535 22344 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:56.748181 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 597836us
I20260709 13:09:56.775066 22630 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.775579 22630 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.775847 22585 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.775960 22630 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.776757 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:56.778111 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.750572 22551 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.784492 22551 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:56.786253 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.404470 22493 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:56.788142 22630 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.790522 22630 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:56.791162 22630 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:56.791828 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43587us
I20260709 13:09:56.764689 22562 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.794724 22493 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:56.756203 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.766373 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 409967us
W20260709 13:09:56.766528 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 380677us
W20260709 13:09:56.805889 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.779987 19263 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:56.780745 22585 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.786908 22626 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.792484 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.806771 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:56.810279 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:56.749933 22607 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.005s
I20260709 13:09:56.766158 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.813868 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:56.814167 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:56.815665 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:56.816282 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:56.816402 19292 raft_consensus.cc:2376] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7. Re-sending same reply.
I20260709 13:09:56.817301 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:56.817595 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:56.762236 22612 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.818223 19294 raft_consensus.cc:2376] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8. Re-sending same reply.
I20260709 13:09:56.819624 22544 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:56.819877 22320 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.819989 22562 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:56.809729 22626 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.824610 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet 78d1dbf9a24f4b489920281c72245ab4 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
W20260709 13:09:56.859261 19110 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50572.6us
I20260709 13:09:56.826228 22344 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.826619 22469 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.827144 22480 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.827684 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:56.827942 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:56.828717 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:56.829039 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:56.829455 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:56.829632 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:56.819646 22615 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.830565 19297 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:56.836277 22624 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.837220 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:56.839195 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:56.839483 19295 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:56.809900 22623 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.771807 22594 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:56.863816 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 97716.1us
W20260709 13:09:56.883792 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48575.8us
W20260709 13:09:56.896889 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52147.2us
I20260709 13:09:56.888909 19372 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.895747 19291 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:56.886960 19370 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:56.904299 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66263.1us
I20260709 13:09:56.905272 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:56.906443 19293 raft_consensus.cc:2376] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8. Re-sending same reply.
I20260709 13:09:56.856145 22628 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.863992 22344 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:56.886632 22480 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.910276 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:56.844609 22544 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:56.916116 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.897102 22623 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.861932 22626 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:56.909998 22608 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.006s
I20260709 13:09:56.926113 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:56.928042 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:56.928788 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:56.862411 22581 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:09:56.902486 22615 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.917395 22493 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.908257 22628 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:56.928834 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 87526.7us
W20260709 13:09:56.931222 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.936708 19868 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.602s (SENT)
I20260709 13:09:56.930878 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:56.957530 19293 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:09:56.930527 19295 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:56.929601 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:56.947046 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49414.5us
I20260709 13:09:56.925796 22544 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.930358 22623 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.920415 22480 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.854604 22551 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:09:56.917757 22344 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.864364 22562 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.917234 22607 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.959594 19896 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:41602
I20260709 13:09:56.974417 19896 raft_consensus.cc:606] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.959179 22407 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.950340 19370 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:09:56.902163 22624 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:56.958799 19297 raft_consensus.cc:2376] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6. Re-sending same reply.
I20260709 13:09:56.929606 22320 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:56.971148 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:56.930757 22524 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.953038 22628 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.946394 22608 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:56.994782 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:56.999980 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45432.7us
I20260709 13:09:56.985352 22607 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:09:56.956104 22493 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.003026 19898 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:56.988408 22524 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:57.024678 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53606.4us
I20260709 13:09:57.025676 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:57.033674 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.643s (SENT) [suppressed 43 similar messages]
I20260709 13:09:57.036984 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.037947 19218 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.039970 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.040694 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.043088 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.000044 22585 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.058414 22624 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.007395 22607 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.055720 22612 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:56.999720 22469 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:09:57.061074 22594 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:57.063031 22562 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.013468 22524 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.064503 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.107822 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:57.114440 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:57.109913 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.112721 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:57.122944 22480 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.124424 19896 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:57.124307 22594 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:56.995402 22320 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.126260 22641 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:09:57.127827 22641 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:57.014359 22305 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:09:57.128422 22641 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:57.128952 22609 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:57.129215 22612 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:57.129673 22612 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:57.129937 22609 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:57.130357 22609 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:57.130748 22612 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.131424 22493 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.132568 22562 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.133038 22562 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.133280 22608 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:57.133456 22562 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.124326 22644 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.136873 22644 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.138022 19291 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:57.137734 22638 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:57.139365 22644 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:56.993916 22407 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.141839 22407 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.125020 22594 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.140055 22544 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.144308 22594 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.129612 22641 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.148515 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.131129 22609 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.148651 22544 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:57.150180 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.150691 22609 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.127898 22320 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.152812 22305 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.004776 22397 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.160497 22397 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.161481 22644 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.162099 22644 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.164482 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.164732 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:57.166340 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 53716.8us
I20260709 13:09:57.168746 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.172137 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.174388 19372 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:57.177820 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.176692 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.179448 22305 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.181420 22305 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.183728 22305 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.177151 22612 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.183909 22607 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.186208 22607 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:57.188892 22615 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.190425 22524 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.165099 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:57.179641 22320 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.192567 19368 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:57.128317 22653 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:57.195919 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:57.196868 22644 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.197510 22545 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.197993 22320 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:57.198539 22320 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:57.199591 22320 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.200634 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.199939 22397 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.201303 19368 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:09:57.201576 22397 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.203171 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.204391 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:57.205972 19263 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:57.208485 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:57.220798 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.224577 19218 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:09:57.226773 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 327041us
W20260709 13:09:57.248724 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.255170 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:57.257864 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.258364 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:57.267629 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59260.8us
I20260709 13:09:57.269373 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:57.272567 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 238915us
I20260709 13:09:57.292722 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:57.292835 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:57.293196 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.293630 19292 raft_consensus.cc:2368] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7.
I20260709 13:09:57.293776 19896 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:57.221154 22305 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.294322 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:57.294921 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:57.296712 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.297398 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:57.303658 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.304188 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:57.299197 19291 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:57.202065 22397 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.192150 22562 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:57.312204 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 473015us
W20260709 13:09:57.312773 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 285652us
I20260709 13:09:57.311255 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:57.284547 22654 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:57.286410 22545 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.294265 22625 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:57.298142 22305 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.302983 22624 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:57.323053 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:57.307224 22611 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.344020 22585 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:57.337040 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:57.296387 22615 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:57.350317 19292 raft_consensus.cc:606] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.350423 22615 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:57.350744 19292 raft_consensus.cc:614] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:57.350865 22615 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.354889 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:57.355690 19298 raft_consensus.cc:606] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.329761 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.348503 19869 leader_election.cc:400] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7.
I20260709 13:09:57.358394 19869 leader_election.cc:403] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:57.296346 22344 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.363941 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.366438 19216 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.327471 22469 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.384222 19294 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:57.363580 22608 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:57.385982 22524 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:57.346019 22305 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.396250 22480 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.341051 22545 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.390043 22608 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:57.350095 22585 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:57.413403 19368 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:57.318161 22650 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:09:57.410826 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:57.419214 19298 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:57.425177 22344 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:57.427090 19868 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.533s (SENT)
I20260709 13:09:57.427604 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.428639 22407 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.428711 22562 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.390537 22544 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.389994 22315 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.432497 22315 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.434002 22608 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.434453 22315 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.434566 19220 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.436288 22612 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:57.444010 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.437649 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.389645 22646 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.425731 22626 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.451339 22553 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.451891 22553 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.452294 22626 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.453903 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.454140 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.454671 19898 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:57.448889 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:09:57.456372 19298 raft_consensus.cc:606] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.412753 22545 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.360102 22615 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:57.475220 19868 leader_election.cc:336] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.931s (SENT)
I20260709 13:09:57.475837 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:57.481407 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.497507 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:09:57.472770 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 151999us
I20260709 13:09:57.500038 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.456763 22646 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:57.502048 19868 leader_election.cc:336] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.160s (SENT)
I20260709 13:09:57.453910 22553 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.473721 19216 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:57.505702 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:57.507296 19901 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:57.509958 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:57.520326 22666 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.520917 22666 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.522907 22624 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:57.523300 22663 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:57.523587 22655 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.523705 22624 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.519822 22665 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.509694 22658 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:57.524111 22655 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.530794 22655 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.499567 22672 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.531570 22672 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.531531 22665 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.532105 22624 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.533789 22665 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.499411 22012 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.524531 22669 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.530373 22585 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.534307 22630 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:57.534375 22012 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.535202 22630 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:57.535295 22669 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.536717 22012 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.444897 22628 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.536494 22630 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.537765 19296 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:57.541939 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.544507 19221 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:57.544659 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44707.4us
I20260709 13:09:57.523054 22666 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.540565 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.546087 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:57.543991 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46579us
I20260709 13:09:57.504030 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:57.499814 22584 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.455545 22305 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.504312 22646 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.561201 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:57.573414 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.447721 22623 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:57.576807 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 228498us
I20260709 13:09:57.504015 22397 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.578269 19225 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:57.578780 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.580416 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.580636 19368 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.584255 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.585356 22672 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.588496 19225 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:57.588953 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.589531 19222 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:09:57.579487 19223 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:09:57.594231 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.594729 19223 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.595628 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.538862 22628 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.596501 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:57.596704 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50679.8us
I20260709 13:09:57.565672 22553 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.633104 19297 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:09:57.632310 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51123.8us
I20260709 13:09:57.638721 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.599246 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.578401 22012 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.644647 19372 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:57.643275 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.647770 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:57.648218 19223 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:57.610452 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:57.647434 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49707.8us
I20260709 13:09:57.651770 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.651770 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:57.652468 19223 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:57.653215 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.653364 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.653832 19223 raft_consensus.cc:2368] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7.
I20260709 13:09:57.654263 19216 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:57.650122 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.632469 22407 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.655194 19365 raft_consensus.cc:2410] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:57.647924 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.633519 22553 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.635319 22585 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.595938 22660 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.666556 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.668298 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:57.579033 22584 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.677798 19218 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:57.677829 19371 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:57.672067 19222 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:57.645561 22676 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.642855 22675 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.695384 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:57.680861 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.696460 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:57.662968 22670 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:57.682662 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:57.678864 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.645972 22397 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.645712 22638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41594 (request call id 0) took 2766 ms. Trace:
I20260709 13:09:57.700372 19903 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:57.707000 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:57.707088 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:57.708756 19372 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.667094 22553 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.710409 22671 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:57.670578 22407 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.710943 22671 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:57.711382 22671 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:57.710453 22638 rpcz_store.cc:276] 0709 13:09:54.876335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.878351 (+  2016us) service_pool.cc:224] Handling call
0709 13:09:54.988194 (+109843us) log.cc:844] Serialized 508 byte log entry
0709 13:09:55.194709 (+206515us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b180045b3e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7e0eb0b 00007fe8d7e93b63 00007fe8d7ebb752 00007fe8d7eb39fa
0709 13:09:55.401528 (+206819us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b180045b3e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:09:57.634566 (+2233038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147836,"raft.queue_time_us":162763,"raft.run_cpu_time_us":1202,"raft.run_wall_time_us":13894,"spinlock_wait_cycles":8492672,"thread_start_us":45700,"threads_started":1,"wal-append.queue_time_us":118971,"wal-append.run_cpu_time_us":12573,"wal-append.run_wall_time_us":1637153}
I20260709 13:09:57.712563 22407 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.655143 22012 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.732880 22305 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.733525 22594 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:57.735405 22650 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:57.737207 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:57.697427 22675 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:57.694891 22615 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:09:57.857169 22678 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:09:57.890767 22584 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.717746 22624 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:09:57.892424 22665 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.838598 22675 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.928103 19372 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:57.941566 19221 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:57.863020 22607 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:57.697918 22676 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.717561 22397 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.892060 22638 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.821481 22407 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
W20260709 13:09:57.947804 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 210657us
W20260709 13:09:57.954990 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 265138us
W20260709 13:09:57.952310 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.955989 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:57.945961 22544 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:09:57.950423 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.960212 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.960381 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:57.962978 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 280426us
I20260709 13:09:57.965971 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:57.966295 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:57.966682 19371 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:09:57.960021 19374 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:09:57.947027 22305 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:57.975273 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:57.976147 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:57.977352 19292 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:57.977267 19298 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:57.956284 22607 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:57.978904 22607 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:57.979279 22631 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:09:57.979817 22305 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.982591 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:57.983184 22305 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.979028 22397 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:57.987056 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:57.989015 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:57.989647 19292 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:57.965696 22665 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.965802 22594 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.965770 22544 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7.
I20260709 13:09:57.972741 22628 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.946184 22624 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:57.965586 22623 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:57.991956 22615 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:57.997429 22674 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.997532 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.016125 22615 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:58.016575 22615 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.016852 19292 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:57.998967 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.017431 22615 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.018555 19298 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:09:58.001175 22611 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.003s
I20260709 13:09:58.018939 22615 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.019416 22611 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.001870 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.020192 19296 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.020246 22608 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:58.020459 19291 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:58.003474 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.022413 19293 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.022814 22624 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.004129 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.005154 22671 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.025303 19295 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.026553 22671 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.005816 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.027350 19300 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:09:57.973815 22582 raft_consensus.cc:2764] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:57.993669 22646 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.029462 19370 raft_consensus.cc:2368] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:09:58.008265 19896 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:09:58.009070 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.010241 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.012953 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.011524 22628 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.035972 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.009374 22665 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:58.037359 22665 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:58.037825 22665 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:58.038125 22582 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:58.038986 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.039471 22582 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:58.040877 19300 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:58.040987 22397 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.041718 22628 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.041580 22397 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.041721 22623 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:58.038673 22665 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.043512 22397 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.044293 22655 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.044653 22623 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:58.044772 22655 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.045548 22623 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.046811 22655 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.045979 19295 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:58.048127 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.048460 22612 raft_consensus.cc:993] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:09:58.048503 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.049085 22612 raft_consensus.cc:1081] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:09:58.049134 19292 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:58.040819 19219 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:58.049911 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.050382 22644 raft_consensus.cc:993] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:09:58.050493 19292 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:58.049211 19295 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.050920 22644 raft_consensus.cc:1081] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:09:58.048524 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.048141 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.055027 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.029964 22646 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:58.146504 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 186361us
I20260709 13:09:58.121161 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.057729 19293 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:09:58.151819 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:58.156127 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.055603 19222 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:58.156424 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.156836 19222 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:58.098712 19299 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:58.058132 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.158963 19218 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
W20260709 13:09:58.154060 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 99105us
I20260709 13:09:58.154356 19295 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:09:58.156850 19292 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:58.160498 19869 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.098582 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.155570 19868 leader_election.cc:400] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7.
I20260709 13:09:58.161821 19221 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:58.165577 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:57.957813 22664 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:57.994042 22012 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.157677 19222 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.203152 19222 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.169543 19292 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.183954 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.206226 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.208276 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.212718 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.212951 19216 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:58.213400 19367 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:09:58.212998 19295 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:58.223202 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:09:58.072045 22689 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:58.224432 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.225510 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:58.226598 19216 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.149852 22676 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.227200 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.227447 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.073657 22594 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.203107 19107 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:58.230232 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.097517 22544 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.232667 19297 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.205396 22612 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.234375 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.238444 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.133054 19223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:09:58.239487 19223 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:58.239737 19223 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.148398 19219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:09:58.185576 22305 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.234740 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.183410 22638 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.133073 22628 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:09:58.247385 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:09:58.212842 22625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.013s	sys 0.018s
I20260709 13:09:58.241272 19219 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:58.248697 19219 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.243809 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.247516 22305 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.251495 22305 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.227893 19293 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:09:58.246695 19292 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:58.228225 22646 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:58.212625 22607 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:09:58.265877 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.266458 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.267519 19292 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.265055 19293 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.226673 22630 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:09:58.244485 22676 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.272626 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.237491 22493 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:58.277675 19219 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:58.255033 22625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.013s	sys 0.019s
I20260709 13:09:58.261777 19223 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:58.246179 19107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 60747.1us
I20260709 13:09:58.244975 22638 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.245937 22631 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:58.303170 19219 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.253957 22012 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:09:58.310259 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 94160.1us
W20260709 13:09:58.311234 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66575.9us
I20260709 13:09:58.266964 22646 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.245471 22612 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.315119 19223 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.317034 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.317577 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.319680 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.301792 22638 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:58.321386 22692 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:09:58.323524 19223 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:09:58.298753 22625 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:58.332882 19223 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.333380 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:58.239626 22643 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:09:58.348119 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 176747us
I20260709 13:09:58.348526 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.352720 19293 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.350148 19216 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:09:58.350559 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.354359 19299 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:09:58.351661 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1692) took 1043 ms. Trace:
I20260709 13:09:58.355091 19217 rpcz_store.cc:276] 0709 13:09:57.308692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.308993 (+   301us) service_pool.cc:224] Handling call
0709 13:09:57.309432 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.363738 (+ 54306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.363769 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.381405 (+ 17636us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.560267 (+178862us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:57.560310 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.329971 (+769661us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54003c8cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:58.330048 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.330113 (+    65us) raft_consensus.cc:1685] finished
0709 13:09:58.330133 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.351589 (+ 21456us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9317,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7577,"spinlock_wait_cycles":38632704,"thread_start_us":173683,"threads_started":1,"wal-append.queue_time_us":199946}
I20260709 13:09:58.349853 22671 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:58.360656 22631 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.364259 22453 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:58.365252 22669 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.365468 22665 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.365860 22665 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:58.366755 22612 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.330515 22012 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.366649 22665 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.368203 22665 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.369181 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.370065 19295 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.370385 22643 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:58.370909 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.309015 22553 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.352802 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:58.373773 22553 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.375140 22650 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:58.374743 22625 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.374497 19369 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:58.375530 22650 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.375895 22650 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:58.378988 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.380831 19293 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:09:58.381798 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.382634 19370 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:58.383348 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.383534 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:58.383916 19292 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:58.382802 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.385471 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.386513 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.371968 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.387912 19295 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.385485 19293 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:58.389112 19294 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.410434 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.410712 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.413648 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:09:58.419430 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.425720 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.440028 19219 raft_consensus.cc:2955] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:09:58.442610 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.445082 22650 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.446768 22677 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:58.447175 22677 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.447217 22650 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.447952 22682 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:58.449174 22682 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:58.449517 22682 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:58.450358 22682 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.451525 22682 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.457363 19897 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12.
I20260709 13:09:58.365252 22646 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:58.469998 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 43665.9us
W20260709 13:09:58.474251 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.428992 22669 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.425154 22544 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:58.428613 22594 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.483341 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.438953 22695 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.438275 22671 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:58.494493 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.493454 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.488488 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.502228 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.501324 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.428203 22675 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.479976 22706 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.510205 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.511162 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:09:58.486493 22551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.038s	sys 0.093s
I20260709 13:09:58.526158 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.529038 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:58.528218 22551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.038s	sys 0.093s
I20260709 13:09:58.500475 22695 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.537643 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:58.482708 22669 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.533349 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 573) took 1115 ms. Trace:
I20260709 13:09:58.536128 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.485961 22702 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.488611 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.533782 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 587) took 1115 ms. Trace:
I20260709 13:09:58.540580 19372 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:09:58.507092 22544 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.551160 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:58.551789 19894 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.552395 22671 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.555862 22407 raft_consensus.cc:993] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: : Instructing follower c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:09:58.542313 19901 rpcz_store.cc:276] 0709 13:09:57.410357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.410773 (+   416us) service_pool.cc:224] Handling call
0709 13:09:57.411067 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.510697 (+ 99630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.525381 (+1014684us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b54005d2854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:58.525539 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220867328}
I20260709 13:09:58.545065 22705 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.533985 22706 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.537557 22612 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.535250 22397 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.547464 22625 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.548957 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.551187 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.577174 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.555573 22544 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.556664 22675 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:58.448087 22677 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.557545 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.592597 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.593429 19294 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:58.593809 19294 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:58.556942 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:09:58.557866 22615 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.002s
I20260709 13:09:58.558681 19337 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.597977 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.598564 22397 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:58.598968 22397 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.599056 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.599340 22397 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.599900 22697 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.600719 22697 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:58.600879 22665 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:58.541899 22669 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.601668 22703 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.602164 22703 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.605810 19902 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.566056 22638 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.607563 22703 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.608318 22638 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.543569 22702 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.609069 22702 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.609946 19368 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:58.611404 19368 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:58.539705 22695 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.616408 22612 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:58.620918 22676 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:58.621351 22676 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:58.559758 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.577998 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.579977 19894 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:58.541100 22653 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:58.628376 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 68704.1us
I20260709 13:09:58.584654 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.629001 19298 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.629303 19298 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:09:58.629864 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.585842 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.586398 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:58.541638 22594 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:58.595865 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.596480 19372 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.631033 19901 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.583525 22625 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:58.630637 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.539706 19896 rpcz_store.cc:276] 0709 13:09:57.409914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.410548 (+   634us) service_pool.cc:224] Handling call
0709 13:09:58.524625 (+1114077us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54006a68d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:09:58.524732 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340603264}
W20260709 13:09:58.633502 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56311.5us
I20260709 13:09:58.586957 22562 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:58.629983 19298 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.643724 19298 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.644704 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.597345 22658 raft_consensus.cc:1081] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Signalling peer c6a09cefdddd4ca8a10b66682ed27dad to start an election
I20260709 13:09:58.634932 19294 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.649533 19294 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.638808 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.653695 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.651105 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.655861 19366 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.586759 22674 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:09:58.636327 22704 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:58.665373 22397 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.665975 22704 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:58.666352 22704 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.667152 22704 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.667898 22397 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.668661 22397 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:58.669135 22397 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:58.669296 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.670022 19898 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:09:58.670068 22397 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.622227 22676 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.668661 22704 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.672619 22676 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.675499 19371 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.670181 22695 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.680881 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.642445 22623 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.645107 22615 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:58.695642 19372 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:09:58.683580 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.679960 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.697496 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:58.688521 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:09:58.691378 19293 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:58.699615 19900 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:58.699581 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:58.681466 19373 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.694152 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.649284 22677 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.709741 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.701843 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.703238 19299 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:58.649111 22562 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:58.706974 19298 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:09:58.712636 19295 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:58.713260 19368 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:09:58.716672 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.717999 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.718911 19372 raft_consensus.cc:2368] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:09:58.719033 19369 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:09:58.720290 19869 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:58.646461 22638 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:58.721903 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.722918 19367 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.721869 19369 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:58.723551 19369 pending_rounds.cc:85] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 9
I20260709 13:09:58.723838 19369 pending_rounds.cc:107] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:58.724072 19372 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:58.729176 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.731129 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.732271 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.732777 19368 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.736203 19901 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:58.736068 22562 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.724123 19369 raft_consensus.cc:2889] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.725193 22718 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.725531 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:09:58.737823 19366 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:09:58.738981 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:09:58.744611 22696 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.475s	user 0.000s	sys 0.004s
I20260709 13:09:58.744712 19370 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.739923 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:58.740453 22703 raft_consensus.cc:2764] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:09:58.708671 22594 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:58.746279 22718 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.700080 22623 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.748679 22665 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.748407 22625 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.749464 22625 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.749997 22623 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:58.750597 19291 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:09:58.741640 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.715090 22553 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.747455 22718 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.756001 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.742305 19294 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:58.757997 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.757267 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:58.760329 19372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:49022
I20260709 13:09:58.760927 19372 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:58.761344 19372 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:58.758486 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:09:58.763273 22584 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:58.763720 22584 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.762511 19368 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:09:58.764082 22584 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.755460 22702 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.770426 19370 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.759940 19373 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:09:58.754808 22594 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.784554 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.788539 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:58.800002 19220 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:09:58.801944 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.773561 22551 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:58.816860 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.817574 19372 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:58.785912 22702 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.821873 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:58.823228 19225 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:58.823505 19220 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.830246 22608 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:58.830718 22608 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:58.830250 19372 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:58.838868 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.835855 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:58.840590 19901 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:09:58.843582 19220 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:09:58.844508 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:58.845068 19220 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:09:58.845762 19216 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:58.847337 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:09:58.848064 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.848795 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.855094 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:58.855823 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:58.857700 19901 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.859652 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:58.861403 19220 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:09:58.869385 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 230660us
I20260709 13:09:58.871323 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.873947 22397 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:58.874439 22397 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:58.862375 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.875624 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:58.876778 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:58.800931 22584 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:58.920251 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43540us
I20260709 13:09:58.920480 19902 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:58.924048 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:58.921026 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.930516 19901 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.931811 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:09:58.936775 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53414us
I20260709 13:09:58.942930 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:58.948895 19901 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:09:58.950160 19225 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:58.932387 22717 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:58.953145 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.929566 22480 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.927681 22674 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.919816 22707 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.929875 22695 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:58.959573 22397 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:58.879649 22702 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:09:58.968901 19225 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.925186 22607 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:09:58.945084 22562 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.955878 22623 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.987771 22655 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:58.988245 22655 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:58.988610 22655 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.988703 19294 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:58.989647 22623 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.016889 22623 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.956349 22480 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:59.020385 22480 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.021700 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:59.022297 22607 consensus_queue.cc:1243] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:59.031850 19291 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:09:59.034087 22723 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:09:59.037016 22725 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:09:59.037225 22651 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:59.038393 22651 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:59.035617 22608 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.038712 22651 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:59.042259 22664 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:58.927006 22594 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.024438 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:09:59.051995 19365 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:09:58.955561 22705 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:09:59.039549 22651 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.023345 22731 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:59.071256 22653 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.073076 19903 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
W20260709 13:09:59.094731 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.028735 22707 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.991215 22702 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:09:59.165033 22562 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:59.081910 22731 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:59.217344 22630 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.227607 22682 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.000s
I20260709 13:09:59.262537 22651 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.284797 22584 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:59.285369 22562 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:59.123063 22669 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.317354 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:09:59.310685 22732 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:59.164671 22717 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:59.289033 22630 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:59.371173 22625 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 13:09:59.311014 22480 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.445093 22707 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:59.445683 22707 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.447275 22480 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:59.385008 22734 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:09:59.320999 22646 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:09:59.399219 22706 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:59.453392 19263 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:59.403010 22562 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.396831 22584 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:59.408259 22674 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.396468 22731 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.412061 22623 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:59.417996 22730 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.396s	user 0.000s	sys 0.013s
W20260709 13:09:59.418133 22698 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.106s	user 0.001s	sys 0.014s
W20260709 13:09:59.452926 22722 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.465s	user 0.000s	sys 0.010s
I20260709 13:09:59.419507 19901 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:59.418795 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:09:59.426182 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 91258.6us
W20260709 13:09:59.426486 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.426357 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:09:59.520524 19896 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:59.520889 19896 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:59.431870 22705 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.428815 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:59.425122 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:09:59.427554 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:09:59.532184 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 107110us
W20260709 13:09:59.511359 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 58074.5us
I20260709 13:09:59.430805 22676 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.514708 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:59.535722 19300 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.449903 22594 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 13:09:59.454113 22728 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.432s	user 0.001s	sys 0.000s
I20260709 13:09:59.423947 22655 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:59.523289 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.552374 22585 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:59.553627 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:09:59.554198 22585 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:59.555349 22585 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:59.555540 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:09:59.532351 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.418677 22669 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:09:59.534353 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 105579us
I20260709 13:09:59.564456 22453 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:59.448137 22707 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:59.432106 22607 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:09:59.521756 19896 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:09:59.530380 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.072s	sys 0.093s
W20260709 13:09:59.570231 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.072s	sys 0.093s
W20260709 13:09:59.570567 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 638756us
I20260709 13:09:59.515905 22612 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.323249 19224 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:59.556680 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:59.571182 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:59.557806 19295 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:59.558759 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:59.556715 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:09:59.562301 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:09:59.562839 19293 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:59.517905 22671 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:59.521644 22584 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:09:59.544721 22677 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:59.541759 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.029s
I20260709 13:09:59.543803 22706 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.582028 19222 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:59.595009 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.555815 22585 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:09:59.581156 22397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.012s	sys 0.017s
I20260709 13:09:59.573056 22674 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.601092 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.030s
I20260709 13:09:59.570904 22453 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:59.588881 22669 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:59.535337 22705 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.548754 22625 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:09:59.620926 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 597735us
I20260709 13:09:59.591543 22677 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:59.610706 22640 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.609208 22582 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:09:59.619441 22397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.013s	sys 0.017s
I20260709 13:09:59.623768 19899 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:59.627023 19221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.000s	sys 0.017s
I20260709 13:09:59.549758 22676 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.581492 22671 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:59.632937 19221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.000s	sys 0.017s
I20260709 13:09:59.618965 22682 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:09:59.629097 22706 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:09:59.636210 19219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.006s	sys 0.013s
I20260709 13:09:59.629557 22651 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:59.566177 22717 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:59.638862 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.629774 22677 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.629859 22453 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:09:59.644317 19219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.006s	sys 0.013s
I20260709 13:09:59.631366 22612 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.624126 22674 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.628726 22669 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.632499 22640 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.679332 22707 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.680264 22651 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:59.714576 19221 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:59.715888 22651 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.723555 22651 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.629639 22584 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.637049 22582 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.741918 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:59.745002 19219 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.709527 22630 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:59.637183 22585 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.678521 22682 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.682155 22706 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.725133 22741 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.708591 22612 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.692826 22702 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:09:59.741422 22623 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:59.739758 22738 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:09:59.777570 22742 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:59.782135 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:09:59.739871 22707 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:09:59.791780 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 236308us
I20260709 13:09:59.799819 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:09:59.796948 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 260124us
I20260709 13:09:59.779115 22655 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:59.724874 22671 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.787588 22585 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.781783 22742 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:59.808189 22747 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:59.814190 22747 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:59.817269 22674 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:59.779340 22453 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.780081 22741 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.826642 22741 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:59.815364 22747 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.806394 22615 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:59.827565 22615 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:09:59.828734 22615 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:09:59.830066 22615 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:59.836778 22746 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:09:59.841495 22707 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:59.847959 19221 pending_rounds.cc:85] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:09:59.848338 19221 pending_rounds.cc:107] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:09:59.848570 19221 raft_consensus.cc:2889] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:59.851016 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:09:59.787771 22738 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.863247 19300 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:09:59.866321 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 503) took 1179 ms. Trace:
I20260709 13:09:59.866758 19300 rpcz_store.cc:276] 0709 13:09:58.687475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.514092 (+826617us) service_pool.cc:224] Handling call
0709 13:09:59.866243 (+352151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.812278 22705 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:09:59.851794 22671 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.864321 22707 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.852954 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 269557us
I20260709 13:09:59.876089 22724 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.900401 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:59.901187 19222 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:59.905529 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1707) took 1124 ms. Trace:
I20260709 13:09:59.906064 19224 rpcz_store.cc:276] 0709 13:09:58.781607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.783692 (+  2085us) service_pool.cc:224] Handling call
0709 13:09:58.784065 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.580240 (+796175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.905241 (+325001us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54001c4154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:09:59.905457 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239589248}
I20260709 13:09:59.893244 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:09:59.911473 19300 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:59.929556 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:59.938280 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:59.892011 22676 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:09:59.892244 22705 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:09:59.954782 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.957121 19298 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:59.946966 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:09:59.922786 22748 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:59.918282 22669 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:09:59.959735 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 349603us
I20260709 13:09:59.967633 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:09:59.979487 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:09:59.982136 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.983552 19223 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.946009 22651 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:09:59.896793 22707 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.988153 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:09:59.885035 22742 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.919216 22724 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.048254 19220 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:09:59.949815 22582 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:00.055127 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.969725 22608 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:00.065071 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 496380us
W20260709 13:10:00.067700 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 260706us
I20260709 13:09:59.986228 22682 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:00.072392 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.076030 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.082913 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 115365us
W20260709 13:10:00.084029 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.960695 22705 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:09:59.989553 22748 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:00.061074 22676 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.152541 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 504) took 1464 ms. Trace:
I20260709 13:10:00.098109 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:00.154475 19220 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
W20260709 13:10:00.086380 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0478710899999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:10:00.155361 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0253710900000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:10:00.156113 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:00.065692 19223 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:00.143384 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:00.151407 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:00.172942 19217 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:10:00.175544 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:00.178162 22750 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:00.180347 19365 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:00.182632 22682 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:00.182751 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:00.183153 22682 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.149827 22669 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.072491 22742 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:00.201574 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50252.5us
I20260709 13:10:00.154166 19296 rpcz_store.cc:276] 0709 13:09:58.687859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.616650 (+928791us) service_pool.cc:224] Handling call
0709 13:09:59.617158 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.617390 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:59.882325 (+264935us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.152158 (+269833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.152231 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.152284 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.152355 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.152482 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":533984,"threads_started":2}
W20260709 13:10:00.186383 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.209786 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.180397 19371 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:59.852519 22553 consensus_queue.cc:1175] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0316f581086f40549fea44a772fc2dec" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:00.085673 22744 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:10:00.178256 22756 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:00.188414 19223 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:00.193837 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.069561 22753 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.985697 22751 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:10:00.067976 22759 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.215893 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:00.089289 22612 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:00.064220 22745 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.217963 19295 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:00.344537 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 544739us
I20260709 13:10:00.064424 22752 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.192s
I20260709 13:10:00.364537 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:00.358917 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:00.342993 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 161539us
I20260709 13:10:00.368446 19337 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12.
I20260709 13:10:00.368959 19337 leader_election.cc:403] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.369024 19223 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:00.370289 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:00.371322 19223 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:10:00.255640 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 99564.3us
W20260709 13:10:00.342808 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.380842 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.381451 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.222676 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 232738us
I20260709 13:10:00.353590 19218 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:00.359588 19902 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:00.386162 19297 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:00.109812 22755 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:00.353825 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 176426us
W20260709 13:10:00.283430 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.262746 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:00.109321 22741 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.402114 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:00.404186 19218 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:00.121105 22762 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.342025 22731 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.406982 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:00.444975 19294 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:00.446622 19191 leader_election.cc:400] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:10:00.408690 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:00.409420 22676 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:00.125599 22628 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.289s
I20260709 13:10:00.410233 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:00.410709 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:00.459169 19903 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
I20260709 13:10:00.410943 22582 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12.
I20260709 13:10:00.412194 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:00.463922 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51810.3us
I20260709 13:10:00.413491 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:00.464718 19293 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.420846 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:00.465921 19299 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.421558 22623 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.471849 19295 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:00.432518 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:00.473842 19896 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:00.436138 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:00.339752 22760 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.216588 22594 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.339448 22706 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:00.248307 22584 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:00.217027 22562 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.185731 22669 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.447764 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:00.409646 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:00.447816 22612 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.390301 22653 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:00.447901 19900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.015s
I20260709 13:10:00.457620 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:00.469398 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:00.532915 19900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.015s
I20260709 13:10:00.424072 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:00.485069 19899 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:00.533738 19296 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.478456 22717 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.534169 22706 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.534667 22653 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.535033 22706 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.536859 22640 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:00.385774 22745 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.537678 22776 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.538177 22776 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.538839 22745 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:00.441365 22738 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:00.542105 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 84559.7us
I20260709 13:10:00.451380 22676 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:00.366037 22759 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.433547 22741 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.404780 22755 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.390770 22753 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.543133 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:00.578408 22768 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:10:00.621168 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.691278 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.534832 22717 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:00.645715 22750 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.691659 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1923) took 1140 ms. Trace:
W20260709 13:10:00.691908 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.691955 22717 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.560616 19370 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:00.652616 19299 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:00.585966 19896 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:10:00.692063 19367 rpcz_store.cc:276] 0709 13:09:59.551569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.556860 (+  5291us) service_pool.cc:224] Handling call
0709 13:09:59.557260 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.798779 (+241519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.798820 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.802635 (+  3815us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.992355 (+189720us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.992404 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.992484 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.691382 (+698898us) raft_consensus.cc:1685] finished
0709 13:10:00.691410 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.691586 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7589,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":396984,"threads_started":2,"wal-append.queue_time_us":441500}
I20260709 13:10:00.701228 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:00.701491 19365 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:00.548363 19291 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:00.547726 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 146260us
W20260709 13:10:00.700845 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 253133us
I20260709 13:10:00.598832 19296 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:00.714550 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:00.714798 19299 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:10:00.447819 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 196076us
W20260709 13:10:00.716897 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.464111 22751 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.717756 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 704) took 1291 ms. Trace:
W20260709 13:10:00.718796 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.730760 19896 rpcz_store.cc:276] 0709 13:09:59.426028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.426134 (+   106us) service_pool.cc:224] Handling call
0709 13:10:00.459207 (+1033073us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b58004a15d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb927c 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c
0709 13:10:00.717695 (+258488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128042240}
W20260709 13:10:00.690827 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 147759us
I20260709 13:10:00.576514 19293 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
W20260709 13:10:00.663828 22767 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:10:00.733096 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:00.723803 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:00.721454 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:00.734149 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:00.732138 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:00.649713 22752 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.593607 22651 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.740605 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:00.543509 22762 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.744251 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.745090 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:00.760830 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:00.594921 22584 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:00.578634 22582 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.570176 22612 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.765241 22582 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.590688 22682 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:00.542260 22736 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.579597 22640 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.590372 22763 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.579243 22764 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.692093 22750 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.764065 22676 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.768323 22770 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.767030 22612 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:00.715729 22669 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:00.737581 22756 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:00.780014 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 387499us
W20260709 13:10:00.787580 19372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.018s
I20260709 13:10:00.743835 22724 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:00.752184 22738 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.489722 22664 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.792781 19264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.017s
I20260709 13:10:00.804600 22630 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:00.463797 22748 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:00.806730 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.490568 22623 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.755421 22752 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:00.812642 19372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.004s	sys 0.018s
I20260709 13:10:00.777546 22640 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.815497 19296 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:10:00.817615 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.818953 19264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.017s
I20260709 13:10:00.528528 22594 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.718799 22706 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:00.781131 22653 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:00.767364 22651 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.803313 22625 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.801687 22628 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:00.871477 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 147725us
I20260709 13:10:00.486698 22760 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.781884 22682 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:10:00.810977 22676 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.812283 22743 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.810449 22738 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:00.885447 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.873577 22630 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:00.865303 22612 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.911731 19294 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:00.881567 22669 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.900805 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:00.809890 22770 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.883229 22752 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.799693 22764 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.792131 22763 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.823371 22756 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:00.770334 22762 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.883461 22640 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.961685 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2037) took 1148 ms. Trace:
W20260709 13:10:00.898947 22766 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
W20260709 13:10:00.980830 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.071477 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.868832 22664 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.909682 22628 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:00.933746 22761 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
W20260709 13:10:00.943868 22615 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.113s	user 0.011s	sys 0.000s
I20260709 13:10:00.953871 22651 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:00.931969 22775 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:10:00.959281 22798 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.958899 22787 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:00.933701 22738 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.968683 22747 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:00.929441 22774 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:10:00.994041 22585 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.182s	user 0.011s	sys 0.000s
I20260709 13:10:00.942786 22794 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.991132 22777 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:00.938369 22682 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:01.050155 22612 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:01.133379 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.156467 22704 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:00.913529 22625 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:00.956105 22753 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:00.894038 22584 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:01.122720 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 222120us
I20260709 13:10:01.187536 22612 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.196341 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:01.197618 19191 leader_election.cc:400] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:10:01.197883 19191 leader_election.cc:403] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.198770 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:01.198942 22731 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.747s	user 0.007s	sys 0.003s
I20260709 13:10:00.954550 22741 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:01.109908 22782 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:10:01.199596 22731 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.199796 22743 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8.
I20260709 13:10:00.955899 22750 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:00.957489 22623 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:00.932775 22780 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:10:01.162006 19369 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:01.109656 22763 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:00.948495 22742 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.729s	user 0.000s	sys 0.010s
I20260709 13:10:01.164573 19225 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:01.122716 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.002s	sys 0.006s
I20260709 13:10:01.108523 22453 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:01.140511 22677 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.435s	user 0.011s	sys 0.002s
I20260709 13:10:01.244841 22677 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.246956 22677 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.120249 22628 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:01.155934 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 409726us
W20260709 13:10:01.179939 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 419156us
W20260709 13:10:01.180238 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.005s	sys 0.018s
I20260709 13:10:00.945127 22594 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:01.091866 19219 rpcz_store.cc:276] 0709 13:09:59.845097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.849272 (+  4175us) service_pool.cc:224] Handling call
0709 13:09:59.849551 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.861004 (+ 11453us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:59.885649 (+ 24645us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.184833 (+299184us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.185296 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.185447 (+   151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.185477 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.185540 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.961456 (+775916us) raft_consensus.cc:1685] finished
0709 13:10:00.961477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.961622 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69790,"prepare.queue_time_us":16076,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":114271,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":19932,"thread_start_us":190265,"threads_started":1,"wal-append.queue_time_us":964762}
I20260709 13:10:01.061299 22759 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.141209 22582 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:01.083160 22562 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:10:01.187599 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1928) took 1634 ms. Trace:
I20260709 13:10:01.188776 19296 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:01.189208 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.165241 22608 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.092s	user 0.012s	sys 0.000s
I20260709 13:10:01.159145 22615 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.188699 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:00.939596 22760 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.200444 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 588) took 1632 ms. Trace:
I20260709 13:10:01.200558 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1681) took 2772 ms. Trace:
I20260709 13:10:01.200729 22745 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.162932 22798 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.203125 22664 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.203416 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:01.206058 22671 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.321s	user 0.009s	sys 0.003s
I20260709 13:10:01.178794 22787 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.193737 22704 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.207693 22625 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:01.182862 22630 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.209028 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.209189 22764 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.182770 22794 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.210577 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.211923 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2045) took 1234 ms. Trace:
I20260709 13:10:01.182543 22682 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:01.210649 22762 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:01.187053 22735 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.214135 22804 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.214864 22770 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:01.212056 22755 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.163602 22789 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.216113 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:01.243042 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.002s	sys 0.007s
I20260709 13:10:01.244278 22453 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:01.283221 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.506274 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 317612us
W20260709 13:10:01.508364 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 1.0654e+06us
I20260709 13:10:01.508788 22480 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.509209 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:01.509425 22644 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:01.510006 22644 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.510670 22763 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:01.511739 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.512328 22807 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.266023 19217 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:01.513710 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.514377 19300 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:10:01.515661 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.369194 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1726) took 1164 ms. Trace:
I20260709 13:10:01.512056 22763 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:01.516366 22754 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.303170 22651 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.516932 22754 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.517787 19294 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:01.518060 22644 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.365877 22808 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:01.518793 22480 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.519306 22644 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.519289 22754 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:01.292557 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.520620 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.519986 22644 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.521054 22480 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.507467 22453 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.516564 19220 rpcz_store.cc:276] 0709 13:10:00.204955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.340020 (+135065us) service_pool.cc:224] Handling call
0709 13:10:00.340407 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.867956 (+527549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.868001 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.877272 (+  9271us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.155071 (+277799us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:01.155111 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.181339 (+ 26228us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54001b2954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:01.181390 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.270992 (+ 89602us) raft_consensus.cc:1685] finished
0709 13:10:01.271019 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.369116 (+ 98097us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90970,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":31634,"spinlock_wait_cycles":879183232,"thread_start_us":412665,"threads_started":2,"wal-append.queue_time_us":382286}
I20260709 13:10:01.268258 22706 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.522807 22754 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:01.518752 22808 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.522521 22453 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.527876 22704 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.258672 22756 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:01.529722 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.005s	sys 0.027s
I20260709 13:10:01.522531 22644 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.524447 22804 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:01.548548 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 1.13985e+06us
I20260709 13:10:01.523253 22706 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.298496 22751 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.525426 22707 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.518631 19900 rpcz_store.cc:276] 0709 13:09:59.568003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.568175 (+   172us) service_pool.cc:224] Handling call
0709 13:09:59.585958 (+ 17783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.885847 (+299889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.885887 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.888366 (+  2479us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.533327 (+644961us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.533364 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.533425 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.200262 (+666837us) raft_consensus.cc:1685] finished
0709 13:10:01.200279 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.200387 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39217,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":900467,"threads_started":2,"wal-append.queue_time_us":863541}
I20260709 13:10:01.243587 22623 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:01.531090 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.531463 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.532197 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.594462 19370 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:01.594770 19368 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:10:01.534600 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:01.595997 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.505453 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1730) took 1299 ms. Trace:
I20260709 13:10:01.536693 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.537333 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.537744 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.538280 22562 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.597622 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.594475 19300 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:01.597155 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.599514 19224 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:01.538612 19366 rpcz_store.cc:276] 0709 13:09:59.553283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.561688 (+  8405us) service_pool.cc:224] Handling call
0709 13:09:59.562055 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.807158 (+245103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.807188 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.810915 (+  3727us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.988227 (+177312us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:00.046135 (+ 57908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.046243 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.187326 (+1141083us) raft_consensus.cc:1685] finished
0709 13:10:01.187347 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.187523 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2998,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":418641,"threads_started":2,"wal-append.queue_time_us":549953}
I20260709 13:10:01.529134 19222 rpcz_store.cc:276] 0709 13:09:59.973844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.973956 (+   112us) service_pool.cc:224] Handling call
0709 13:09:59.974328 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.986160 (+ 11832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.986190 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.986663 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.366728 (+380065us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.366786 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.366878 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.207948 (+841070us) raft_consensus.cc:1685] finished
0709 13:10:01.207970 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.208115 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55764,"raft.queue_time_us":12632,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":67737,"thread_start_us":253890,"threads_started":1,"wal-append.queue_time_us":781441}
I20260709 13:10:01.597272 19216 rpcz_store.cc:276] 0709 13:10:00.206247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.207649 (+  1402us) service_pool.cc:224] Handling call
0709 13:10:00.207874 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.645986 (+438112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.646042 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.646107 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.646160 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.220557 (+574397us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000186d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:01.505193 (+284636us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.505379 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006837504}
I20260709 13:10:01.324536 22738 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.543546 22808 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.544838 19297 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:01.545867 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 342490us
I20260709 13:10:01.484042 22748 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:01.277520 22717 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 13:10:01.607990 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:01.547957 22615 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.641333 22615 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:01.558617 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 101671us
I20260709 13:10:01.559758 19373 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.560364 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1725) took 1355 ms. Trace:
I20260709 13:10:01.643465 19217 rpcz_store.cc:276] 0709 13:10:00.204596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.204734 (+   138us) service_pool.cc:224] Handling call
0709 13:10:00.339740 (+135006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.513866 (+1174126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.560115 (+ 46249us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400019ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:01.560307 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129358592}
I20260709 13:10:01.247090 22776 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:01.588810 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46418.9us
I20260709 13:10:01.644492 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 589) took 1465 ms. Trace:
I20260709 13:10:01.512887 22807 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.644872 19373 rpcz_store.cc:276] 0709 13:10:00.179138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.181659 (+  2521us) service_pool.cc:224] Handling call
0709 13:10:00.342190 (+160531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.643400 (+1301210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.644242 (+   842us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002d0354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:01.644431 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2799443328}
I20260709 13:10:01.549230 22742 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.548353 22745 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.646678 22807 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.646585 22742 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.648849 22742 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.599364 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.649211 22612 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.650322 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.650414 22553 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:01.650890 19300 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:01.651376 22553 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:01.651578 22612 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.651820 22553 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:01.652480 19291 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:01.646585 22757 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:01.652755 22553 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.653934 22757 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:01.653993 22553 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.654385 22757 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:01.540361 22787 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:01.600764 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.658329 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:01.600773 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:01.659910 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59227.6us
I20260709 13:10:01.660127 22644 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.662448 22644 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.662257 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.662925 22644 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.663115 19896 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:01.664675 19899 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:01.601431 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.666896 19216 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:01.604919 19295 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:01.605247 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.667150 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.667874 19300 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:01.605971 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.668202 19897 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:01.668762 19224 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:01.546990 22755 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.610802 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:01.675822 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65053.9us
I20260709 13:10:01.676416 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.676630 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:01.666640 22752 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 13:10:01.678855 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:01.679435 22752 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.612589 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.613137 22791 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:01.680977 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.613891 22738 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.614452 19299 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:01.614274 22717 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.615031 22706 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.615428 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:01.691462 19297 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.615581 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2050) took 1150 ms. Trace:
I20260709 13:10:01.624436 22671 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.709000 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.709969 19896 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:01.626266 22705 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.626152 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:01.627774 22640 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.629161 22731 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:01.629696 22702 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:01.630483 22802 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:01.632383 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 95734.9us
I20260709 13:10:01.632229 22748 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:01.635255 22804 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:01.637189 22798 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.608290 22682 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.605931 22623 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.514472 19292 rpcz_store.cc:276] 0709 13:09:58.427991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.515272 (+1087281us) service_pool.cc:224] Handling call
0709 13:09:59.517044 (+  1772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.533343 (+ 16299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.533379 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.564193 (+ 30814us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.917891 (+353698us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b180046ec40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:10:00.082121 (+164230us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:00.484610 (+402489us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.796074 (+311464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.796150 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.200227 (+404077us) raft_consensus.cc:1685] finished
0709 13:10:01.200345 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.200496 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49149,"prepare.queue_time_us":496378,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":67649,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":14363,"spinlock_wait_cycles":4934016,"thread_start_us":713877,"threads_started":3,"wal-append.queue_time_us":1130568}
I20260709 13:10:01.719496 22615 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.659940 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.670629 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.661872 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:01.767478 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105687us
I20260709 13:10:01.768996 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:01.524875 22794 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.682080 19365 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:01.682356 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.683490 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.771910 19222 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:01.772555 19222 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:01.684234 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.685047 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.690253 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:01.773227 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:01.694609 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:01.774296 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79748.6us
W20260709 13:10:01.711869 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 85790.4us
I20260709 13:10:01.692786 19221 rpcz_store.cc:276] 0709 13:10:00.465254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.535595 (+ 70341us) service_pool.cc:224] Handling call
0709 13:10:00.535868 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.722960 (+187092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.722990 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.723028 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.723062 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.615305 (+892243us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001c3754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:01.615368 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.615510 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429867904}
I20260709 13:10:01.715171 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.749624 22802 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:01.682049 22724 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.727486 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:01.681847 22752 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.679893 22628 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.681260 22791 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.698830 22742 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:01.754969 19897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 578) took 2923 ms (client timeout 2063 ms). Trace:
W20260709 13:10:01.814869 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 87458.5us
W20260709 13:10:01.815228 19897 rpcz_store.cc:269] 0709 13:09:58.833565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.841544 (+  7979us) service_pool.cc:224] Handling call
0709 13:10:01.750504 (+2908960us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:01.750633 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6188953856}
I20260709 13:10:01.754964 19293 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:01.751434 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:01.817651 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66309.5us
I20260709 13:10:01.818468 19220 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:01.757408 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:01.707739 22638 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:01.708218 22805 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.638981 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1924) took 2087 ms. Trace:
I20260709 13:10:01.691833 22755 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.689332 22562 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.728925 22480 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.723448 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.774794 22615 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.747439 22582 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:01.776392 19219 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:01.776135 19225 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:01.791318 19222 raft_consensus.cc:1217] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[7.8-8.9]   Dedup: 8.9->[]
I20260709 13:10:01.793197 19224 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:01.794128 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:01.794032 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:01.795238 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:01.795710 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:01.796422 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.797029 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.796969 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.804927 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.754532 22585 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.808192 19223 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:01.808880 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.810218 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.714972 22743 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:01.812530 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:01.722239 22671 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:02.067233 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.028030 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.178690 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 512) took 1368 ms. Trace:
I20260709 13:10:02.175894 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.846411 22717 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.842330 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.196229 22804 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.197451 22804 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.814105 22724 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.174080 22702 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.198765 19903 raft_consensus.cc:2376] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7. Re-sending same reply.
I20260709 13:10:02.198643 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:01.787335 22704 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:02.199851 22804 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:01.787384 22731 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:02.193868 19293 rpcz_store.cc:276] 0709 13:10:00.810636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.814028 (+  3392us) service_pool.cc:224] Handling call
0709 13:10:00.814438 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.816855 (+1002417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.178365 (+361510us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b540008f554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:02.178619 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162302720}
I20260709 13:10:02.194515 19369 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:02.195784 19368 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:02.061513 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.195948 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.041082 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:02.171154 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 352569us
I20260709 13:10:02.207515 19299 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:10:01.819530 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.099771 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:02.169512 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.081867 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 438713us
I20260709 13:10:02.193281 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:01.775516 22608 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:02.068002 19266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.235s (SENT) [suppressed 9 similar messages]
W20260709 13:10:02.210485 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 142512us
I20260709 13:10:02.201122 19222 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
W20260709 13:10:02.116840 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 298638us
W20260709 13:10:02.173230 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 395360us
I20260709 13:10:02.191915 19300 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:01.844660 19216 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.837658 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.214035 19894 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:02.194690 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.215849 19217 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:02.196940 19298 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:02.174989 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:01.842327 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.200681 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.214090 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:01.808030 22802 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.804896 22682 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.836244 22584 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.217932 19374 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:02.219038 19370 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:02.211069 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:01.838522 22807 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.178027 22795 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.848304 22754 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:01.919349 22453 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:02.221863 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.221683 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.196851 22638 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.198050 19372 rpcz_store.cc:276] 0709 13:09:59.552027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.557820 (+  5793us) service_pool.cc:224] Handling call
0709 13:09:59.558196 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.681423 (+123227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.681473 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.705369 (+ 23896us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.066908 (+361539us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.877258 (+810350us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.877472 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.638592 (+761120us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000ea454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:01.638643 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.638690 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:01.638780 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.638923 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89133,"prepare.queue_time_us":829716,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":63467,"raft.queue_time_us":306330,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":19328,"spinlock_wait_cycles":272224128,"thread_start_us":909154,"threads_started":2,"wal-append.queue_time_us":759437}
I20260709 13:10:01.842558 22801 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.389s
I20260709 13:10:02.199975 22704 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.223140 22584 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:02.026512 22756 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:02.179232 22735 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:10:01.845829 22640 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:01.986408 22748 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.209157 22804 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.172964 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:02.204201 22615 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.236622 19297 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:10:02.237999 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.263213 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.209484 19218 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:02.239658 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.214716 22608 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.850350 22791 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:01.848197 22628 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.263963 19374 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:02.196408 22805 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.211113 22480 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:01.847059 22745 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.221065 22731 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:02.250347 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.305909 19369 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:02.199574 22702 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.237303 22754 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.212517 22585 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.253083 22756 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.251438 22704 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:02.288868 22814 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:10:02.255472 22584 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:02.296999 22644 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.004s
I20260709 13:10:02.238855 22795 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.258351 22752 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.302716 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.256894 22801 consensus_queue.cc:1243] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:02.344038 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.344956 19365 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:02.230234 22807 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:02.306754 19297 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
W20260709 13:10:02.266485 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 93600.2us
I20260709 13:10:02.307112 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:02.311826 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.246959 22453 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.293295 22748 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:02.278957 22608 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.326565 19895 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:02.339241 22717 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:02.341631 19293 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:02.347556 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:02.379244 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:02.321738 22754 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.279227 22804 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.366912 19369 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.398406 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.366443 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:02.401774 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.403256 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.386055 22752 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.386409 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.424347 19366 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:10:02.387020 19224 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:02.341153 22644 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.418114 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:02.419567 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53218.7us
I20260709 13:10:02.366523 22807 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.427577 19900 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:02.427511 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.470978 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.489259 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.496225 19223 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:10:02.493741 19368 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:02.497622 19368 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:10:02.492014 19868 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.611s (SENT)
I20260709 13:10:02.485147 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:02.491879 19365 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:02.495712 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:02.501983 22755 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:02.502108 22757 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.502665 22755 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:02.503270 22757 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.494457 19369 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:02.372557 22735 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:02.515202 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:02.516041 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 305464us
I20260709 13:10:02.508992 19374 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:02.519011 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:02.373463 22717 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:02.522159 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:02.397593 22748 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:02.523339 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:02.531656 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:02.476135 22704 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:02.516422 22823 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:02.503743 22755 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.452379 22795 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.435211 22743 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:02.535605 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:02.538201 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:02.539328 19899 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:10:02.548430 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 338676us
I20260709 13:10:02.505489 22763 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:02.473835 22801 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.549440 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:02.553669 19896 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:02.535773 22808 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.541851 22742 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:02.527137 22671 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:02.555208 22801 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.585282 22752 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:02.587052 22638 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.593581 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 598) took 1058 ms. Trace:
I20260709 13:10:02.569569 22795 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:02.569437 22743 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:02.595494 22748 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.569779 22808 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.447857 22731 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.546802 22562 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:02.635205 22562 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.635614 22562 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.637567 22608 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.505686 22594 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:10:02.640406 22805 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.640663 22704 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:02.641258 22480 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.641510 22830 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:02.642072 22830 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:02.642938 22830 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.644436 22717 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.645728 22717 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.617542 19371 rpcz_store.cc:276] 0709 13:10:01.535321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.535443 (+   122us) service_pool.cc:224] Handling call
0709 13:10:01.535770 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.591132 (+ 55362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.591163 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.600199 (+  9036us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.120231 (+520032us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:02.120275 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.120358 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.593312 (+472954us) raft_consensus.cc:1685] finished
0709 13:10:02.593340 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.593509 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54940,"raft.queue_time_us":55076,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11650,"thread_start_us":463794,"threads_started":1,"wal-append.queue_time_us":644739}
I20260709 13:10:02.640599 22594 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:02.647290 22594 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:02.525029 22735 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.553941 22585 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.566645 22787 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:02.648135 22594 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.648674 22787 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:02.648957 22804 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:02.649170 22787 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.649343 22594 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.649583 22804 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.650604 22808 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.633018 22752 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:02.652310 22752 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:02.652647 22752 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:02.653482 22752 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.634052 22453 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.634210 22801 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.524389 22745 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:10:02.643538 22802 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:02.644048 22553 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.989s	user 0.011s	sys 0.002s
I20260709 13:10:02.613157 22742 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:02.697655 19367 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:02.640044 22608 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:02.630506 22702 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.698823 19296 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
W20260709 13:10:02.696615 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 175591us
W20260709 13:10:02.710765 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 189000us
W20260709 13:10:02.696102 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 202845us
I20260709 13:10:02.672559 22582 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:02.706377 22745 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.630146 22743 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.706730 22584 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.698222 22742 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:02.740396 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 202267us
I20260709 13:10:02.732267 22644 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.746153 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:02.751509 22802 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.755141 22835 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:02.756444 22842 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:02.756871 22842 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:02.757714 22842 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.759130 22842 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.760876 22615 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.761962 22754 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.763342 22615 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:02.764251 19902 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:02.764489 19900 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:02.765522 22840 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.765973 22840 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.766268 22840 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.767201 22584 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.768059 19369 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:02.779448 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 247239us
I20260709 13:10:02.733311 22745 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:02.746615 22682 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.004s
I20260709 13:10:02.746796 22702 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.782295 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 603) took 1002 ms. Trace:
I20260709 13:10:02.784806 19372 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:02.785385 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 236053us
I20260709 13:10:02.790256 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:02.794974 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 255440us
I20260709 13:10:02.784616 19898 rpcz_store.cc:276] 0709 13:10:01.776863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.777092 (+   229us) service_pool.cc:224] Handling call
0709 13:10:01.817478 (+ 40386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.817740 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:02.238442 (+420702us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.778807 (+540365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.778861 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:02.778912 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.778972 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.779082 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":487984,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":32291,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":914042,"threads_started":3,"wal-append.queue_time_us":497699}
I20260709 13:10:02.797868 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.786927 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:02.787259 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 265147us
I20260709 13:10:02.788357 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.789393 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.797628 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.802264 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.803807 19222 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:02.805377 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:02.805377 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.806154 19225 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.807371 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:02.807940 19221 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.809314 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.810034 19219 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:02.812862 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:02.813457 19223 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.803990 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:02.814955 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.818341 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:02.819059 19370 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 3: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:02.819619 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.820067 19365 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:02.820885 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.782548 22745 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.824087 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:02.821404 19365 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:02.826256 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.826956 19365 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:02.830420 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:02.830724 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93654.1us
I20260709 13:10:02.831012 19299 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:02.787927 22754 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:02.830879 19297 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:02.838598 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.839610 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:02.840373 19365 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.841616 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:02.810959 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:02.834353 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.844046 19295 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:02.834959 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:02.835461 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:02.845146 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 707) took 1055 ms. Trace:
I20260709 13:10:02.835541 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:02.845739 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:02.846004 19216 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:02.836195 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46018.8us
I20260709 13:10:02.845476 19897 rpcz_store.cc:276] 0709 13:10:01.789732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.866789 (+ 77057us) service_pool.cc:224] Handling call
0709 13:10:02.835377 (+968588us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90f8c 00007fe8d4d90ef6 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:10:02.845097 (+  9720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12319104}
I20260709 13:10:02.795751 22735 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:02.852141 19223 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:02.875363 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:02.795301 22702 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:02.883841 22731 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:02.885164 22844 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.888685 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:02.887821 19222 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:02.823561 22562 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.851135 22828 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:02.895630 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.921200 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:02.902506 19365 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:10:02.940308 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47121.1us
I20260709 13:10:02.937995 22828 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.929378 22731 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:03.217602 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.907626 19221 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
W20260709 13:10:03.372844 19219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.012s	sys 0.054s
I20260709 13:10:03.520462 22584 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.568492 19219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.021s	sys 0.062s
I20260709 13:10:03.525240 22756 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:03.526098 19368 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:03.531499 22640 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.532655 22623 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:03.532711 22763 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.836189 22582 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:02.892078 22802 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:02.886898 22553 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:10:03.543856 19216 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.697s	user 0.005s	sys 0.005s
I20260709 13:10:03.606870 19216 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:03.547286 19225 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.003s
I20260709 13:10:03.609649 19225 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:02.936929 22776 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:03.548419 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1929) took 1755 ms (client timeout 1639 ms). Trace:
W20260709 13:10:03.515955 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 628212us
W20260709 13:10:03.574420 22594 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.925s	user 0.000s	sys 0.022s
W20260709 13:10:03.554682 19371 consensus_meta.cc:287] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.004s
W20260709 13:10:03.562667 22833 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.779s	user 0.003s	sys 0.009s
W20260709 13:10:03.580711 22846 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.684s	user 0.002s	sys 0.010s
I20260709 13:10:02.882875 22836 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.403s
W20260709 13:10:03.613155 19373 rpcz_store.cc:269] 0709 13:10:01.793407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.793719 (+   312us) service_pool.cc:224] Handling call
0709 13:10:02.982800 (+1189081us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400424e28. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc92924 00007fe8dce7b227 00007fe8dce7aab8 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:03.548336 (+565536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64891136}
W20260709 13:10:03.575102 22808 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.008s
I20260709 13:10:03.614030 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:03.615751 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.724272 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.595554 22763 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.615392 19371 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:03.573328 22828 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.566049 22860 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:03.612919 22623 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:03.612828 22845 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:03.771111 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 157137us
I20260709 13:10:03.814656 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:03.803154 22742 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.027s	user 0.007s	sys 0.010s
I20260709 13:10:03.590631 22584 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:03.817015 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 272334us
W20260709 13:10:03.840546 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.836297 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:03.842496 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:03.802914 22860 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:03.927178 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.865738 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 405) took 2074 ms (client timeout 2666 ms). Trace:
W20260709 13:10:03.990293 19224 rpcz_store.cc:269] 0709 13:10:01.791647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.195676 (+404029us) service_pool.cc:224] Handling call
0709 13:10:03.865480 (+1669804us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000e3154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:03.865652 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413275008}
I20260709 13:10:03.940467 22859 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:03.755712 22808 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:04.071502 19903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 596) took 2381 ms (client timeout 2063 ms). Trace:
W20260709 13:10:04.068753 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.019s
I20260709 13:10:04.072286 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:04.072844 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.012s	sys 0.019s
I20260709 13:10:04.071005 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.073153 19901 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
W20260709 13:10:04.044893 22844 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.008s
W20260709 13:10:03.991494 22842 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.232s	user 0.021s	sys 0.000s
I20260709 13:10:04.057906 22865 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:04.014676 22848 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.452s	user 0.000s	sys 0.001s
I20260709 13:10:04.093592 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:03.941636 22795 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:04.069239 22867 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.994520 22840 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.228s	user 0.020s	sys 0.000s
W20260709 13:10:03.994872 22745 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.145s	user 0.011s	sys 0.005s
W20260709 13:10:03.928128 22854 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 13:10:04.071970 19903 rpcz_store.cc:269] 0709 13:10:01.689920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.690040 (+   120us) service_pool.cc:224] Handling call
0709 13:10:04.071302 (+2381262us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.071423 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977455488}
W20260709 13:10:03.995012 22807 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.476s	user 0.018s	sys 0.005s
I20260709 13:10:04.112068 22844 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:04.108354 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.116271 22795 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:03.954492 22861 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.898751 22756 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:03.800419 22612 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:03.994627 22562 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:03.819267 22623 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:04.184682 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 341996us
I20260709 13:10:04.212553 22802 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.213301 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:04.213753 22802 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.214689 22623 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.186136 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.011s	sys 0.004s
W20260709 13:10:04.216504 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.004s
W20260709 13:10:04.217133 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 672014us
I20260709 13:10:04.217465 22802 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.134065 22807 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.114652 22804 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:10:04.017293 22787 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.368s	user 0.011s	sys 0.011s
I20260709 13:10:04.220839 22562 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:04.221863 22807 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.221395 22787 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.222114 22562 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.112254 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:03.993155 22731 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.121526 19898 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.075919 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.114423 22584 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:03.993942 22724 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.278941 22873 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.958253 22738 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.015728 22742 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.280257 22873 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.283296 22742 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.045048 22828 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.113030 19897 raft_consensus.cc:2410] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:04.121425 22745 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.284422 19300 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:04.287277 22828 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.287752 19899 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:04.141419 22844 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.290642 22795 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.193097 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.122344 22842 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:04.292994 22842 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.186031 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1789) took 1376 ms. Trace:
I20260709 13:10:04.294385 22584 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:04.188094 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.295199 22584 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.295764 22842 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.017060 22857 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.076869 22859 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.116144 22863 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.139133 22861 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.141144 22756 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.113931 22865 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.118563 22867 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.148450 22868 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.100314 22871 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:04.051057 22860 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.235486 22623 raft_consensus.cc:2764] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:04.299443 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.283866 22873 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.119891 22840 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.326946 22840 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.290398 22844 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.329694 22844 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.330538 22844 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.330926 19901 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:04.297534 22808 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.297708 22828 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.299160 22787 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:03.838091 22845 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.316378 22731 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.342032 22731 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.342098 22871 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.319186 22868 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.343760 22845 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.346575 22868 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.320439 22863 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:04.309078 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.349254 22871 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.349645 22857 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:04.350328 22857 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.350935 22582 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:04.352025 22582 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.354143 22861 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.355127 22882 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.356050 22882 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.358755 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.321905 22865 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.371378 22879 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:04.334151 22828 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.375466 22562 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.116535 22855 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:10:04.377200 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 606) took 2119 ms. Trace:
I20260709 13:10:04.377624 19369 rpcz_store.cc:276] 0709 13:10:02.257480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.519265 (+261785us) service_pool.cc:224] Handling call
0709 13:10:02.519630 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.768557 (+248927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.376505 (+1607948us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54000b3bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:04.376946 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570866048}
I20260709 13:10:04.378582 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1791) took 1568 ms. Trace:
I20260709 13:10:04.379467 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.379006 19292 rpcz_store.cc:276] 0709 13:10:02.810108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.810213 (+   105us) service_pool.cc:224] Handling call
0709 13:10:02.816077 (+  5864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.816565 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.816604 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.825320 (+  8716us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.957853 (+132533us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:02.958125 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.958632 (+   507us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.378185 (+1419553us) raft_consensus.cc:1685] finished
0709 13:10:04.378218 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.378412 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":940,"raft.queue_time_us":118,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":12650,"thread_start_us":70601,"threads_started":1,"wal-append.queue_time_us":957878}
I20260709 13:10:04.373521 22879 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.381891 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.382918 19370 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:04.383637 22879 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.332731 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 59495.3us
I20260709 13:10:04.385490 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.375994 22828 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.373595 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.389628 19366 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:04.347641 22863 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:04.390930 19896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 599) took 2674 ms (client timeout 1565 ms). Trace:
I20260709 13:10:04.149602 22763 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.388094 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:04.393399 19900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 710) took 2601 ms (client timeout 2546 ms). Trace:
I20260709 13:10:04.324040 22859 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.365597 19367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1932) took 2569 ms (client timeout 2197 ms). Trace:
I20260709 13:10:04.330538 22756 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:04.393836 19900 rpcz_store.cc:269] 0709 13:10:01.791639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.514950 (+723311us) service_pool.cc:224] Handling call
0709 13:10:04.392837 (+1877887us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400560254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.393109 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561433984}
I20260709 13:10:04.369004 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.395469 19368 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:04.395553 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.397286 22879 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:04.370080 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.398433 19365 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 4: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:04.398242 22787 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:04.395890 19902 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 711) took 2603 ms (client timeout 1988 ms). Trace:
I20260709 13:10:04.399559 22776 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:10:04.399718 19902 rpcz_store.cc:269] 0709 13:10:01.792206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.210822 (+418616us) service_pool.cc:224] Handling call
0709 13:10:04.395526 (+2184704us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54006a5c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.395711 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241951104}
I20260709 13:10:04.400179 22776 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.349110 22877 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.401536 22877 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.405372 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.407130 22879 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:04.287569 22745 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.390872 19898 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
W20260709 13:10:04.394322 19367 rpcz_store.cc:269] 0709 13:10:01.795406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.795507 (+   101us) service_pool.cc:224] Handling call
0709 13:10:04.364912 (+2569405us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400426dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.365212 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162609408}
I20260709 13:10:04.331382 22844 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.411139 22844 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.412020 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:04.413311 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.399263 22628 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:04.399986 22763 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.372531 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:04.413833 22821 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 2.021s	user 0.007s	sys 0.000s
I20260709 13:10:04.416414 22628 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:04.416500 22879 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.397439 19903 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:04.389695 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 706) took 2601 ms. Trace:
W20260709 13:10:04.391562 19896 rpcz_store.cc:269] 0709 13:10:01.721583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.723100 (+  1517us) service_pool.cc:224] Handling call
0709 13:10:04.390497 (+2667397us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54006dced4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.390712 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812184832}
I20260709 13:10:04.403923 22877 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.346987 22867 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.372421 22731 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.425001 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.371644 19373 raft_consensus.cc:1217] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Deduplicated request from leader. Original: 8.8->[10.9-11.10]   Dedup: 10.9->[11.10-11.10]
I20260709 13:10:04.426689 19373 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:10:04.426184 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.372309 22876 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:04.219815 22682 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:10:04.421212 22879 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:04.430660 22879 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.421949 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.432839 19898 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:10:04.433650 22553 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:04.433836 22628 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:04.434234 22553 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:04.294685 19291 rpcz_store.cc:276] 0709 13:10:02.809133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.810562 (+  1429us) service_pool.cc:224] Handling call
0709 13:10:02.810844 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.811049 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.811074 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.814080 (+  3006us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.902219 (+ 88139us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:02.902273 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.902351 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.185123 (+1282772us) raft_consensus.cc:1685] finished
0709 13:10:04.185202 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.185678 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":87832,"threads_started":1,"wal-append.queue_time_us":1253721}
I20260709 13:10:04.420516 19895 rpcz_store.cc:276] 0709 13:10:01.788652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.788775 (+   123us) service_pool.cc:224] Handling call
0709 13:10:01.840525 (+ 51750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.369054 (+528529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.389127 (+2020073us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:04.389492 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116812160}
W20260709 13:10:04.425359 22841 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.687s	user 0.004s	sys 0.007s
W20260709 13:10:04.427062 22849 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.862s	user 0.000s	sys 0.001s
I20260709 13:10:04.438992 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1788) took 1630 ms. Trace:
W20260709 13:10:04.370198 19265 connection.cc:256] RPC call timeout handler was delayed by -1.06643016299995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:10:04.354952 22582 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.446588 19222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2083) took 1605 ms (client timeout 1749 ms). Trace:
I20260709 13:10:04.451352 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1962) took 1661 ms. Trace:
W20260709 13:10:04.448521 19296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 519) took 2915 ms (client timeout 1623 ms). Trace:
W20260709 13:10:04.457156 19296 rpcz_store.cc:269] 0709 13:10:01.532656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.537112 (+  4456us) service_pool.cc:224] Handling call
0709 13:10:04.448087 (+2910975us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001d3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.448239 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2530445696}
I20260709 13:10:04.456712 19374 rpcz_store.cc:276] 0709 13:10:02.789343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.789459 (+   116us) service_pool.cc:224] Handling call
0709 13:10:04.365198 (+1575739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.366205 (+  1007us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:04.366252 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.366344 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:04.366391 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.366500 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.448045 (+ 81545us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400426dd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.451123 (+  3078us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2223,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":330,"spinlock_wait_cycles":3622876544}
W20260709 13:10:04.447608 19372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 1957) took 2347 ms (client timeout 1713 ms). Trace:
I20260709 13:10:04.436580 22553 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:04.458767 19372 rpcz_store.cc:269] 0709 13:10:02.105575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.242817 (+137242us) service_pool.cc:224] Handling call
0709 13:10:04.447250 (+2204433us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54000d34d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.447426 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875658496}
I20260709 13:10:04.439109 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:04.455075 19300 rpcz_store.cc:276] 0709 13:10:02.808417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.808526 (+   109us) service_pool.cc:224] Handling call
0709 13:10:02.808795 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.285229 (+1476434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.438668 (+153439us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001d4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:04.438928 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254476160}
I20260709 13:10:04.436091 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:04.455480 19265 connection.cc:256] RPC call timeout handler was delayed by -1.0070301629999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260709 13:10:04.460476 22553 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.440747 22584 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:04.456657 19222 rpcz_store.cc:269] 0709 13:10:02.841283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.841410 (+   127us) service_pool.cc:224] Handling call
0709 13:10:04.446140 (+1604730us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54001b2454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:04.446333 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104847744}
I20260709 13:10:04.436965 22861 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:04.468446 22824 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.469004 22824 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:04.469126 22861 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:04.469643 22861 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:04.470026 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:04.470690 22824 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.470976 22861 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.440341 22867 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.472512 22839 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.473044 22839 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.472692 22867 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.473488 22839 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.474200 22628 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:04.474637 19868 connection.cc:256] RPC call timeout handler was delayed by -1.3764328260000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:10:04.475083 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.471876 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:04.477396 22776 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.478200 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.479374 22791 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:04.479843 22791 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.480377 22791 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:04.480437 22640 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.875s	user 0.015s	sys 0.009s
I20260709 13:10:04.481032 22640 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:04.481861 22640 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:04.482194 22755 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:04.482604 22867 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.482915 22755 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.483462 22861 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.483752 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.484429 19897 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.484620 22731 raft_consensus.cc:476] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:04.485817 22731 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.486531 22731 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.450274 22882 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.452561 22876 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:04.489490 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.475122 19868 connection.cc:256] RPC call timeout handler was delayed by -1.3509482860000617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:10:04.479897 22776 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.504300 22628 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.506273 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.507223 22731 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.511348 22702 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:04.512388 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 76596.7us
I20260709 13:10:04.514508 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.514650 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.515964 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.516351 22608 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.499513 22824 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.544034 19224 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:04.548032 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.548842 19903 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:04.549592 19901 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.518275 22876 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.497629 22562 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.552891 22562 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:04.553687 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1819393389999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:10:04.554104 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1729393389999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:10:04.554411 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1126393389999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
I20260709 13:10:04.521315 22863 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.562388 22863 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.535501 22857 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.525231 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.526248 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.527977 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.528017 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.528963 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.564831 19296 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:10:04.564719 22876 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:04.564846 19291 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.498735 22845 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.566287 22845 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.534030 19223 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:04.534139 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.535117 19219 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:04.570655 22845 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.571507 22707 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:04.571916 22707 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:04.537472 19897 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:10:04.517537 19339 connection.cc:256] RPC call timeout handler was delayed by -2.9040930879999678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:10:04.543208 19895 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:04.543673 22608 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:04.544305 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.581316 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.541872 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:04.544719 22830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.775s	user 0.008s	sys 0.012s
I20260709 13:10:04.544673 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:04.545370 22856 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.486s	user 0.006s	sys 0.006s
W20260709 13:10:04.584646 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.545542 22638 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.546121 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.541528 22865 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.589952 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48166.7us
I20260709 13:10:04.590109 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:04.546538 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.555539 22731 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:10:04.536197 22628 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:04.557665 22757 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.009s	sys 0.014s
I20260709 13:10:04.545621 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.522779 19222 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:04.563380 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.565218 19292 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.530400 19217 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:10:04.584728 22830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.823s	user 0.008s	sys 0.012s
I20260709 13:10:04.576498 19291 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:04.579625 19901 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:04.555553 22562 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.585261 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.597497 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.600659 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.603204 19374 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:04.606237 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:04.608278 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.608561 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.608865 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.609387 19216 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:04.609995 22628 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.610174 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.610384 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:04.594766 22757 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.010s	sys 0.014s
I20260709 13:10:04.592293 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.611770 19220 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:04.612432 22776 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.612552 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:04.612896 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.613140 19224 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.614173 22674 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.614307 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.614949 22674 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:04.615307 19296 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:10:04.615898 22607 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:04.616338 22607 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:04.616819 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.616992 22706 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.617604 22706 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:04.617974 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.618216 22608 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.619073 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:04.619704 19263 connection.cc:256] RPC call timeout handler was delayed by -1.6703219319999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:10:04.607527 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 122187us
W20260709 13:10:04.616854 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 77577.7us
I20260709 13:10:04.620675 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.621317 19223 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:04.621630 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.622840 19902 raft_consensus.cc:2410] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:04.623435 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1786) took 1816 ms. Trace:
I20260709 13:10:04.624428 22671 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.624550 22865 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.620230 22845 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:10:04.625195 22671 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.626793 22845 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.626993 22865 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.627348 22671 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:04.613000 22776 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:04.628386 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.586334 22638 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.629400 22776 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.630226 22638 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.615545 19294 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:04.618660 22706 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.595970 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:04.622860 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.670271 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:04.648228 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61415.9us
W20260709 13:10:04.649518 19266 connection.cc:256] RPC call timeout handler was delayed by -1.0856559390000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:10:04.647747 19300 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.689445 19219 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:04.607501 22839 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.691828 22839 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.601243 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.624751 22562 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:04.694007 22562 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.694418 22562 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.618661 19293 raft_consensus.cc:2376] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9. Re-sending same reply.
I20260709 13:10:04.651033 22791 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:04.595809 22707 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.650288 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.649212 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.700872 19896 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:04.700136 19373 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:04.631487 19225 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:10:04.647993 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48791.9us
I20260709 13:10:04.706117 19292 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:10:04.707242 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.648301 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.713989 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.715188 19224 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:04.616837 22607 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.718298 22731 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.718798 22731 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:04.719221 22731 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:04.720691 19263 connection.cc:256] RPC call timeout handler was delayed by -1.2399853890000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:10:04.720760 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 95335.9us
I20260709 13:10:04.601119 22857 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.623867 19298 rpcz_store.cc:276] 0709 13:10:02.806783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.806884 (+   101us) service_pool.cc:224] Handling call
0709 13:10:02.807182 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.807526 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.807554 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.818508 (+ 10954us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.044240 (+225732us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:03.044299 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.044409 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.532990 (+1488581us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:04.622917 (+ 89927us) raft_consensus.cc:1685] finished
0709 13:10:04.622945 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.623245 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":431,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8662,"spinlock_wait_cycles":17165056,"thread_start_us":153777,"threads_started":1,"wal-append.queue_time_us":1100598}
I20260709 13:10:04.627367 22845 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:09:58.724996 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.728775 19217 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:04.728595 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.730015 19291 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:04.733736 22755 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:04.737318 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.741111 19369 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:04.741798 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.742641 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:04.744974 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.760489 19222 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:04.761596 19263 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:04.749965 19122 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 4, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:10:04.766366 19119 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 260) took 29702 ms (client timeout 15000 ms). Trace:
I20260709 13:10:04.755214 19371 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:04.746824 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.747306 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.756508 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.772464 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:04.800693 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.774711 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73268.5us
I20260709 13:10:04.777922 22638 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.779590 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.782349 22752 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.782902 22836 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:04.783463 22707 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:04.788967 22890 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.081s	user 0.003s	sys 0.002s
I20260709 13:10:04.789501 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.790246 19293 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:04.790122 22745 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:04.792187 22791 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.647149 22674 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.802634 19373 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:10:04.801142 19372 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:04.814671 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.815510 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.815665 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.816329 19216 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:04.816699 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.817807 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.818781 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.819336 19374 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.819603 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.820236 19291 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:04.820457 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 58944us
I20260709 13:10:04.821660 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:04.822805 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.823441 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.832850 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.835556 19292 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:04.833566 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.837991 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.838224 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.831821 22776 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:04.839834 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.839977 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.840471 19373 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.841034 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.841637 19367 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:04.842540 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.843171 19367 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:04.844425 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.845013 19220 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:10:04.845351 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.845790 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.846462 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.849269 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.850083 19371 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:04.850894 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.851433 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:04.851758 22861 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:04.852324 22861 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:04.853216 22861 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.855309 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:04.856210 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.847748 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.857650 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.859302 19365 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:04.860361 22776 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:04.860385 19298 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.861472 22776 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.864447 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.843993 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.865589 19367 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:04.866389 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 55740.8us
I20260709 13:10:04.866056 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:04.856475 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.822433 22755 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:04.837738 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:04.865195 19222 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:04.877662 19373 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:04.812784 22878 raft_consensus.cc:2764] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:04.880456 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:04.881891 19365 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:04.884563 19293 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:04.882190 19300 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
W20260709 13:10:04.889525 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51646.8us
I20260709 13:10:04.837682 19122 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 9, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 9 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.891475 19221 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:04.897410 19369 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:04.898407 19371 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:04.902308 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:04.902671 22638 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:04.903079 19293 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.905748 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.906255 22838 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:04.907219 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.908046 19224 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:04.910249 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:04.912406 22748 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:04.912935 22671 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:04.913012 22748 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:04.913342 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.914738 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.916987 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:04.920476 22682 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:04.921306 22682 consensus_queue.cc:1243] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:04.921942 22757 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:04.922456 22757 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:04.922012 22562 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.922693 19223 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:04.923269 19219 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:04.923377 22757 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.884573 22840 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:04.925184 22840 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:04.926194 22840 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.928146 22757 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.914785 22745 raft_consensus.cc:2764] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:04.932754 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:04.933226 22745 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:04.934263 22745 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:04.934616 22745 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.935007 22745 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.936762 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:04.914429 22748 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:04.938342 19298 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:10:04.922120 19122 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.942713 19367 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:04.879220 22755 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:04.945017 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 227758us
I20260709 13:10:04.947597 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:04.952636 19366 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:04.944849 19374 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:04.951990 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 130431us
I20260709 13:10:04.954749 19219 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.952986 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:04.963426 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.913187 22743 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:04.967739 19298 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:04.965871 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:04.968843 19369 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.884104 22731 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:04.973832 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 270056us
W20260709 13:10:04.982798 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46654.5us
I20260709 13:10:04.988294 22832 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.988813 22832 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.989245 22832 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.991305 22840 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.977262 19122 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:04.953444 22755 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.997583 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.000306 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.002739 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.003638 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.005488 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.005649 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:04.967500 22743 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.014662 19291 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:05.020710 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:05.026607 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.952155 22888 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:10:05.026691 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.031332 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.033855 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.036005 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.029211 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.040118 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.041119 19367 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:05.041167 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.041977 19371 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:04.800770 19119 rpcz_store.cc:269] 0709 13:09:35.063920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.068294 (+  4374us) service_pool.cc:224] Handling call
0709 13:09:35.383554 (+315260us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:04.766054 (+29382500us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:56.747001 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:56.751100 (+  4099us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:56.751148 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:09:56.751162 (+    14us) tablet.cc:662] Decoding operations
0709 13:09:56.752463 (+  1301us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:56.752558 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:56.752596 (+    38us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:56.753717 (+  1121us) tablet.cc:701] Row locks acquired
0709 13:09:56.753772 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:09:56.753937 (+   165us) write_op.cc:270] Start()
0709 13:09:56.754131 (+   194us) write_op.cc:276] Timestamp: P: 1783602596753864 usec, L: 0
0709 13:09:56.754160 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:09:56.754891 (+   731us) log.cc:844] Serialized 4450 byte log entry
0709 13:09:57.367800 (+612909us) op_driver.cc:464] REPLICATION: finished
0709 13:09:57.475231 (+107431us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d4dab0ac 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8db8ebef0
0709 13:09:57.957161 (+481930us) write_op.cc:301] APPLY: starting
0709 13:09:57.971971 (+ 14810us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:58.150279 (+178308us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:58.150335 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:58.448600 (+298265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:58.448926 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:58.448981 (+    55us) write_op.cc:312] APPLY: finished
0709 13:09:58.449367 (+   386us) log.cc:844] Serialized 83 byte log entry
0709 13:09:58.583803 (+134436us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.585719 (+  1916us) write_op.cc:454] Released schema lock
0709 13:09:58.587460 (+  1741us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:58.598923 (+ 11463us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.598951 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2907,"reported_tablets":48,"spinlock_wait_cycles":132965248,"child_traces":[["op",{"apply.queue_time_us":525646,"apply.run_cpu_time_us":23761,"apply.run_wall_time_us":654765,"num_ops":11,"prepare.queue_time_us":403507,"prepare.run_cpu_time_us":45489,"prepare.run_wall_time_us":216778,"raft.queue_time_us":253453,"raft.run_cpu_time_us":28013,"raft.run_wall_time_us":354159,"replication_time_us":584213,"spinlock_wait_cycles":43363328,"thread_start_us":885140,"threads_started":5,"wal-append.queue_time_us":439022,"wal-append.run_cpu_time_us":19515,"wal-append.run_wall_time_us":2325827}]]}
I20260709 13:10:05.049310 22731 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.028534 22865 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:05.052415 19122 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.039552 22674 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.056416 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.055123 19122 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.058483 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.070271 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:05.056370 22594 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:05.055796 22702 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:05.057578 19298 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.043273 19224 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:05.019515 22743 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.088583 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.089352 19218 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:10:05.090008 22894 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:05.070716 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:05.068499 19266 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.639s (SENT)
I20260709 13:10:05.076726 19366 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.092542 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:05.076884 22857 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:05.077667 19122 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.078235 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:05.084296 22594 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:05.084717 22702 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:05.100198 22702 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:05.097041 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 102691us
I20260709 13:10:05.102007 19293 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:05.098315 22553 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:05.097041 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49948.1us
I20260709 13:10:05.103556 19219 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:05.002974 22845 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.126010 19366 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:05.130160 19263 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:10:05.130679 19263 leader_election.cc:403] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.104758 22731 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.105445 22553 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:05.136380 19122 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 7, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 7 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.139122 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:05.149605 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 71490.1us
I20260709 13:10:05.138890 22553 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.148370 19122 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 7 to 9, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 9 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.167528 19367 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.169495 19369 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:05.170913 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:05.175544 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 240430us
I20260709 13:10:05.139914 22562 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.144657 22674 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.186239 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:05.190068 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 121601us
I20260709 13:10:05.196581 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:05.200539 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 202989us
I20260709 13:10:05.208947 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:05.178300 22594 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:05.178563 22706 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:10:05.213009 19122 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:05.215339 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.215837 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.215866 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.216797 19217 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.217101 19896 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.219158 19224 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:05.220849 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 113115us
I20260709 13:10:05.222381 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.224941 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.225584 19898 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:05.162812 22858 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:10:05.228588 19122 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 7, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 7 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.235101 19122 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:05.205541 22830 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:05.230983 19367 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:05.238090 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:05.245864 19898 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:10:05.213657 22906 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.247031 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:05.247994 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:05.229180 22869 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.251542 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:05.238104 22638 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:05.232609 22594 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:05.252116 19122 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:05.253507 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:05.258224 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.257982 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 84477.6us
I20260709 13:10:05.273720 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.251821 22674 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.254992 22835 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.256734 22752 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.252265 22562 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:05.260550 22638 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:05.283598 22752 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:05.283910 22907 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:10:05.275626 22872 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.292284 22752 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.288388 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.282450 22706 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.258543 22830 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:05.278412 22674 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:05.309120 19122 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:05.256068 22869 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.279711 22835 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:05.325781 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57152.3us
I20260709 13:10:05.326303 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.279517 22879 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.311378 19293 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:05.274363 22832 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.337992 22832 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:05.338781 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 82290.4us
I20260709 13:10:05.340556 19365 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:05.340406 22594 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.344735 22755 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.347193 22755 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.310369 22839 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.309036 22872 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:05.353300 22872 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.271735 22906 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:05.356612 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75965.4us
I20260709 13:10:05.357972 22906 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.294572 22562 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:05.285741 22638 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:05.329334 19896 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:05.327145 22706 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:05.332691 22830 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.333773 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:05.327509 22707 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 13:10:05.321837 19122 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:05.323263 22674 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:05.324283 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50032.6us
I20260709 13:10:05.365221 19217 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:05.375062 19371 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:05.376869 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:05.315450 22742 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.388178 19291 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.356741 22702 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.328750 22835 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.395404 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.308357 22787 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:10:05.398716 19293 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.399847 19297 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:05.402851 19292 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.388607 22879 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:05.407068 19122 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:05.408773 22903 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:10:05.410210 22895 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:10:05.397439 22906 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:05.416735 19294 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:05.420442 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 150504us
W20260709 13:10:05.405390 22897 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:10:05.424491 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.422574 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:05.399370 22742 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.434407 22742 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.435055 22906 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:05.435139 19122 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 7, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 7 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:05.397954 22832 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:05.443864 22858 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:05.448501 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.436057 22906 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.455370 19122 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 6 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:05.442312 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.456861 19122 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:05.446625 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.443040 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.439692 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.459764 19296 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.459901 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:05.460670 19292 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:05.460762 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.451382 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.461679 19294 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:05.444947 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.438859 19898 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:05.462620 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.442391 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.445282 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.454883 22858 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:05.458127 19122 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 6, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 6 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.449249 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.470994 19291 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:05.443835 19295 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [4.3-7.5]
I20260709 13:10:05.440443 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.474085 19901 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:05.460788 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.475653 19296 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:05.471330 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.476533 19898 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.427246 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:05.422360 22607 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.001s
I20260709 13:10:05.477571 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.479431 19897 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:10:05.478689 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 138186us
I20260709 13:10:05.480123 19122 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.482019 19293 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:05.483479 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.477550 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.484469 19266 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 3. Current term is 4.
I20260709 13:10:05.485107 19900 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:10:05.485261 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58070.1us
I20260709 13:10:05.486179 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:05.478248 22757 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 13:10:05.496537 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.475102 22858 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:05.487112 19122 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 2 to 5, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 5 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:05.526571 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.526837 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.527568 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:05.499948 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.528558 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48015.4us
I20260709 13:10:05.534346 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.534446 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:05.535537 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:05.537431 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51363.3us
I20260709 13:10:05.539089 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.537995 19900 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.539731 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:05.444242 22743 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.444486 22745 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.544783 19222 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:05.537957 22915 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:05.533597 22638 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.440917 22562 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.486266 22872 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.553515 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.561369 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.561633 19221 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:05.547665 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.561986 19900 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:05.543108 22757 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.487819 22706 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.537338 22839 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:05.565762 19296 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:05.567322 22743 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:05.567952 22832 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.568848 22638 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:05.569442 19896 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.570658 19293 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.582537 22915 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:05.582723 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.583540 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.557750 22752 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.565086 19898 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:05.571620 19901 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:05.484305 22607 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.812686 19902 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.813207 19894 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:10:05.799139 22839 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.814234 22830 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.814541 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.814837 22830 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.610239 22832 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:05.583588 22915 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.816803 22832 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.817070 22830 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.819453 19368 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:05.819518 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.776098 22838 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.593565 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.820557 22838 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.821447 19901 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:05.821775 19901 pending_rounds.cc:85] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 9
I20260709 13:10:05.821987 19901 pending_rounds.cc:107] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:05.822242 19901 raft_consensus.cc:2889] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.602852 22878 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:05.822657 22838 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.822842 22878 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:05.823236 22607 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:05.823813 19901 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:05.564627 22553 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.584777 22919 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.227s
W20260709 13:10:05.601976 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.811945 22752 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.600524 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.583884 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.579097 22836 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.235s
I20260709 13:10:05.600936 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:05.805954 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.820895 19292 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:05.563962 22921 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:05.783360 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.824533 19293 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.823885 22878 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.598577 19899 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:05.614229 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 535) took 1011 ms. Trace:
I20260709 13:10:05.567992 22913 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.826308 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.878481 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.827311 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:05.827684 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 293337us
I20260709 13:10:05.599790 22879 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.601398 22872 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.828945 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.829325 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.572861 22757 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:05.896325 22836 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:05.896657 22757 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.897202 22836 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.897022 22858 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:05.828811 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.611135 19291 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:05.770586 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.830399 19219 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.599246 22674 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:05.833559 22922 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:10:05.834374 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.835366 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.836495 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.836676 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.837702 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.899802 22836 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.912562 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.862612 22553 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.863369 19373 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.913265 19292 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:05.864440 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.865068 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.914050 19296 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.865945 19367 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:05.866681 19369 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:05.870227 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.873818 19903 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 4: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:05.874091 19294 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.879655 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.606839 22869 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.735312 22835 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.916985 19224 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:05.917855 19902 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.918399 19897 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:05.905004 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.910584 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:05.919224 19370 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:05.877979 19299 rpcz_store.cc:276] 0709 13:10:04.603242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.616359 (+ 13117us) service_pool.cc:224] Handling call
0709 13:10:05.613913 (+997554us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002b7ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:05.614124 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147092224}
I20260709 13:10:05.901434 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.906980 19223 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:05.921859 19291 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:10:05.885898 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.900785 19218 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:05.896409 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:05.911077 19374 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:05.920105 19219 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:05.930779 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 533) took 1317 ms. Trace:
I20260709 13:10:05.828806 22832 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:05.934486 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64314us
I20260709 13:10:05.880089 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.938402 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.935429 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:05.939749 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:05.939953 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60392.5us
I20260709 13:10:05.931223 19297 rpcz_store.cc:276] 0709 13:10:04.598776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.608491 (+  9715us) service_pool.cc:224] Handling call
0709 13:10:05.898843 (+1290352us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b540034f154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:05.916405 (+ 17562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817423232}
I20260709 13:10:05.880844 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.940708 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.941882 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:05.941987 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.943655 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:05.934366 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:05.944780 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.945427 19219 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:05.946193 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.946877 19219 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.947269 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:05.948987 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.900309 22671 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:05.950001 19218 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:05.950857 19366 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:05.950982 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.901808 22745 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:05.953514 19222 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:05.956148 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.958364 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.955561 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:05.905961 22674 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:05.954846 19899 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.930924 22857 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:05.962427 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.959412 19297 raft_consensus.cc:2376] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7. Re-sending same reply.
I20260709 13:10:05.962723 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.879274 22913 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:05.963614 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.960435 19371 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:05.935721 22869 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.965752 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.958869 19225 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:05.963343 19292 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:05.964280 19297 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:10:05.963959 19216 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:05.949398 22791 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.964000 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.950742 22671 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:05.966032 22607 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:05.967715 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:05.951715 22927 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.965291 19220 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:05.948933 22743 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:05.969566 19224 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.966924 22913 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.951822 22888 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:10:05.971101 19369 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:05.971175 19222 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:05.949761 22926 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:05.974792 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:05.976907 19297 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.978049 22835 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:05.978988 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44689.3us
I20260709 13:10:05.971868 22791 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:05.980199 22607 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:05.980613 22791 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.980659 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:05.981199 22607 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:05.984858 19899 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:05.985160 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.986069 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:05.986294 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:05.986662 19299 raft_consensus.cc:2376] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4. Re-sending same reply.
I20260709 13:10:05.986888 22832 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:05.987448 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:05.987550 22832 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:05.974706 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:05.964051 22878 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:05.994488 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:05.987655 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:05.988097 22925 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:06.000100 19295 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:05.943068 22836 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:05.964519 22915 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.001145 22915 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.001269 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.002501 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.002300 22915 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.003523 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.005959 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.007084 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.008734 19216 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.993923 22756 raft_consensus.cc:2764] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:05.973891 22927 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.950857 22906 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:06.009876 22927 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.010409 22906 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.010773 22906 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:06.011595 22906 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.013088 22906 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.987887 22900 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.739s	user 0.003s	sys 0.000s
I20260709 13:10:06.016980 19299 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.988754 22682 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:10:06.017561 19300 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.019868 19300 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:06.013553 19901 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:10:06.007107 22743 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:05.997896 22857 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.026104 19900 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:06.026597 22743 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.027595 22857 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:05.997985 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.020643 22872 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.029062 22872 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.029443 22872 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.031558 22858 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:06.033543 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.034152 19223 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:06.034204 19218 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:06.036283 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.037134 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.037405 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.037950 19218 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:06.020545 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.038390 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.038534 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.039126 19216 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.039186 19222 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
W20260709 13:10:06.021121 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83090.3us
I20260709 13:10:06.040132 19295 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:06.021347 22888 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:06.022260 22836 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:05.993503 19297 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:06.046458 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:06.048807 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.052564 19365 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:06.058393 19368 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:06.060415 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:06.062471 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75121.8us
I20260709 13:10:06.063257 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.063194 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.064666 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.065804 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.067098 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.066779 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.071727 19296 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:06.072734 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 128792us
I20260709 13:10:06.073047 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:06.073436 19219 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:06.073532 19296 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.058504 22791 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.081720 22791 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:06.082026 22702 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:06.083910 19299 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.089185 22924 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:06.089643 22924 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.046085 22838 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:06.058810 22745 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:06.078754 19296 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.092489 19296 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.093261 19222 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:06.094085 19220 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:06.096587 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.046758 22888 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.046521 22836 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.106245 22921 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:06.106793 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 159600us
W20260709 13:10:06.107124 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43956.9us
I20260709 13:10:06.107517 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.091519 22869 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:10:06.107754 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:06.090546 22924 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.102200 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:06.110410 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.106657 19224 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:06.124202 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:06.124753 19903 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:06.125216 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.126899 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.128535 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.129639 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:06.131152 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:06.132062 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.108397 22707 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:06.108250 22553 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.145714 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:06.138228 19222 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:06.138863 19224 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:06.116896 22838 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.147324 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:06.136554 22791 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.129456 22832 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.149513 22924 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.149847 22832 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.150074 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:06.147280 22731 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:06.151026 22756 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:06.151278 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:06.151536 22756 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:06.152297 22926 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:06.152825 22926 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.152483 22756 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.153717 22926 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.155068 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:06.156255 22838 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.156848 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:06.158807 22861 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:06.158990 22594 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:06.159237 22861 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.130028 22830 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.072839 22925 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:10:06.150296 22832 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.163056 19296 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:06.117342 22858 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:10:06.169260 19296 pending_rounds.cc:85] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:10:06.171273 19225 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.172966 19296 pending_rounds.cc:107] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:06.092417 22933 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:10:06.168578 22638 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:06.123664 22752 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:10:06.176896 22638 consensus_queue.cc:1243] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:06.177505 22638 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.177806 22638 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:06.178000 22752 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.178697 22638 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.180624 22925 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.181066 22757 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.145730 22707 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.166777 22830 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:06.184656 22830 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.184737 22707 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.186308 22707 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.167371 22731 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:06.166769 22791 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.188990 22836 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.190265 22836 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.190160 22791 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.168978 22640 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:10:06.192505 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:06.194061 22671 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.195493 22671 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:06.179925 22638 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.148617 22553 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.166595 22835 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.173429 19296 raft_consensus.cc:2889] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.169103 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.197407 19223 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:06.159660 22861 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:06.170820 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:06.135272 22932 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.156713 22838 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:06.214296 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45278.7us
I20260709 13:10:06.215616 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.219862 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:06.227348 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 110811us
I20260709 13:10:06.178719 22752 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.232293 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.234319 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.237349 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.213577 22553 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.237838 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:06.219280 22776 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.217031 22932 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.219257 22731 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:06.249375 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 90787.7us
I20260709 13:10:06.250928 19298 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:06.253159 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 101949us
I20260709 13:10:06.229628 22876 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:06.258030 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.239527 22594 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:06.226867 22835 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.256024 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.156718 22888 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.240847 22745 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.260753 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:06.262667 19298 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:06.263836 19221 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:06.266093 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:06.268850 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 154294us
I20260709 13:10:06.255532 22932 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.255125 22731 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:06.261005 22776 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.277493 22906 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:06.277899 19903 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:06.278575 19218 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:06.279186 22757 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:06.279965 22927 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.281726 22913 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.291981 22743 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:06.293529 22638 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:06.294001 22913 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:06.282835 22941 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:06.295599 22878 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:06.244603 22742 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:10:06.272578 22731 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.285491 19903 pending_rounds.cc:85] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 8
I20260709 13:10:06.309576 19903 pending_rounds.cc:107] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:06.309825 19903 raft_consensus.cc:2889] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.296716 22927 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:06.297344 19296 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.263862 22752 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.316401 19900 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:06.316834 19900 pending_rounds.cc:85] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 8
I20260709 13:10:06.313726 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:06.317102 19900 pending_rounds.cc:107] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:06.265873 22939 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.271797 22876 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:06.317355 19900 raft_consensus.cc:2889] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.284255 22888 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.306679 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.264537 22835 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.326423 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.319615 22757 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:06.330096 22757 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.330873 22757 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.331965 22757 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.332348 22906 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.332602 22776 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.332930 22906 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.319281 22939 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.321380 22752 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.335589 22939 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.335918 22752 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.337332 22876 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.339811 22906 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:06.342448 22731 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.343842 19218 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:06.343982 22835 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:06.345434 22757 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:06.345582 22920 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:06.346012 22682 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:06.349756 22869 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.350142 22869 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:06.350492 22869 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.352146 22757 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:06.353320 22757 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.310029 22913 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.360996 22913 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:06.361564 22913 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.362792 22913 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:06.366689 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 97907.7us
I20260709 13:10:06.370390 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:06.380191 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.321600 22706 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:10:06.388713 19294 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.399149 19216 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:10:06.409454 19291 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
W20260709 13:10:06.396564 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 106362us
I20260709 13:10:06.287185 22940 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:10:06.325496 22941 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:10:06.434468 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 113459us
W20260709 13:10:06.436424 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 129813us
I20260709 13:10:06.416589 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:06.437290 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.409263 22913 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.442649 19896 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:06.439131 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.378726 22640 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:10:06.379181 22915 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:10:06.416250 22949 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.388134 22832 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.390846 22553 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.412388 22830 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:06.486725 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.491374 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:06.405097 22594 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.505880 19298 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:06.485842 22858 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:06.492717 22927 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.521778 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:06.528527 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 91300.5us
I20260709 13:10:06.462978 22757 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.484764 22743 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:06.505443 22702 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.502628 22951 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:06.545961 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.493372 22742 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:06.516259 22858 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:06.556403 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.520960 22952 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:06.574927 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 128884us
W20260709 13:10:06.583174 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.549127 22731 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:06.589182 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.574476 22776 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:06.540652 22927 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.641940 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:06.642619 19374 raft_consensus.cc:2368] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:10:06.643736 19365 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:06.584255 22757 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:06.652464 19367 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.652765 19370 pending_rounds.cc:85] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 4
I20260709 13:10:06.653076 19370 pending_rounds.cc:107] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:06.653328 19370 raft_consensus.cc:2889] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.648923 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:06.650725 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 129041us
I20260709 13:10:06.647521 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:06.655352 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:06.635828 22948 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 13:10:06.658795 19373 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:06.755872 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:06.645529 22702 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:06.760332 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 171219us
I20260709 13:10:06.654196 22906 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:06.797633 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 142304us
I20260709 13:10:06.798875 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.658749 22731 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.803683 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.831612 19218 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.837361 19225 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:06.831337 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.029s	sys 0.066s
W20260709 13:10:06.839210 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.029s	sys 0.066s
I20260709 13:10:06.838384 19225 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:06.839936 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 585363us
W20260709 13:10:06.824699 22946 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:10:06.837347 19369 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:06.758673 22952 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.829846 22702 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:06.801532 22906 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:06.836794 22945 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.394s	user 0.010s	sys 0.000s
I20260709 13:10:06.668373 22776 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.853031 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:06.850796 19225 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:06.874874 19225 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.850302 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.876634 19367 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:06.880564 19373 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:06.850251 22964 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.796878 22858 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.903294 19367 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:06.830564 22731 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:06.908183 19291 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:06.910135 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57184.3us
I20260709 13:10:06.862571 22832 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:06.863000 22553 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:06.910882 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:06.890339 22940 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.924365 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:06.924971 19367 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.862138 22942 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:10:06.870033 22835 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:06.853538 22830 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:06.927695 19373 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.936093 19294 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
W20260709 13:10:06.931406 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 69495.8us
W20260709 13:10:06.948442 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 98209.9us
I20260709 13:10:06.948885 19373 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.924149 22952 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:06.960393 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.968479 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.970980 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.973448 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.974066 19297 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.969892 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:06.974900 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.001s	sys 0.013s
W20260709 13:10:06.990880 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.001s	sys 0.013s
I20260709 13:10:06.937664 22832 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:06.991878 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 575357us
I20260709 13:10:06.993264 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.996320 19291 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.990315 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:06.976430 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:06.940178 22858 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:06.999401 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.000584 19367 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:07.001710 19295 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:07.001597 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:07.004326 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:07.004751 19218 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 13:10:07.005849 19367 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:07.006680 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:07.008222 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:07.008926 19224 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.915544 22965 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:10:06.922938 22964 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:10:06.921818 22970 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
W20260709 13:10:06.986719 22958 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:10:06.959336 22553 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.011242 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:06.966979 22934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.009s	sys 0.007s
I20260709 13:10:07.028806 19297 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:10:07.016619 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105809us
I20260709 13:10:07.037617 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:06.974519 22977 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:07.012799 22702 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:07.077535 19224 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:06.994498 22756 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:07.019933 22707 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:07.084239 19367 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:07.037465 22955 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
W20260709 13:10:07.041546 22934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.009s	sys 0.007s
I20260709 13:10:06.993937 22942 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:07.039177 22927 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:07.099675 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.099998 22924 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.950s	user 0.011s	sys 0.001s
I20260709 13:10:07.100888 22731 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:07.104705 22707 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:07.105362 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.105705 22956 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.519s	user 0.000s	sys 0.001s
I20260709 13:10:07.106113 22925 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:07.106454 22953 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
W20260709 13:10:07.107326 22968 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:10:07.074637 22977 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:07.115873 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.149159 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.139350 22872 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.109s	user 0.013s	sys 0.000s
W20260709 13:10:07.103941 22752 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.002s
I20260709 13:10:07.135025 19367 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:07.094561 22963 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:10:07.141330 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:07.142122 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 136236us
I20260709 13:10:07.042944 22553 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.151898 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:07.183063 22752 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:07.183831 22757 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.001s
I20260709 13:10:07.169827 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:07.152572 22977 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:07.186957 22913 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.744s	user 0.004s	sys 0.005s
I20260709 13:10:07.188890 22920 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.172766 22707 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:07.143790 22969 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:07.192548 22969 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:07.172952 22954 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:10:07.178328 22950 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.816s	user 0.004s	sys 0.000s
I20260709 13:10:07.193631 22969 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.137553 22980 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:07.196928 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46331.5us
W20260709 13:10:07.126087 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.164471 19291 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:07.201587 19225 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:07.177667 22974 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:10:07.176311 22937 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.848s	user 0.000s	sys 0.007s
W20260709 13:10:07.182742 22861 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.001s
I20260709 13:10:07.180549 22978 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:07.243201 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 438783us
I20260709 13:10:07.244899 19903 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:07.261600 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:07.203028 22980 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:07.104754 22702 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:07.274112 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 236575us
I20260709 13:10:07.189428 22920 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:07.296973 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:07.305224 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:07.312101 19367 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:07.312101 19225 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:10:07.313639 19225 pending_rounds.cc:85] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:07.313967 19225 pending_rounds.cc:107] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:10:07.314268 19225 raft_consensus.cc:2889] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.315413 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:07.218739 22671 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:10:07.202605 22872 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.317113 19894 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:10:07.319253 19868 leader_election.cc:336] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.501s (SENT)
I20260709 13:10:07.323102 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:07.324226 19223 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:07.332196 19223 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:07.325834 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:07.326107 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.244763 22978 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:07.308808 22638 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.272646 22674 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:07.340349 22985 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:07.296272 22980 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:07.347009 19868 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.610s (SENT)
I20260709 13:10:07.350445 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:07.351356 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 413184us
I20260709 13:10:07.351758 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 623) took 1136 ms. Trace:
I20260709 13:10:07.258948 22861 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:07.337376 22869 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.986s	user 0.012s	sys 0.001s
I20260709 13:10:07.352376 19898 rpcz_store.cc:276] 0709 13:10:06.208103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.216789 (+  8686us) service_pool.cc:224] Handling call
0709 13:10:06.217183 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.221249 (+  4066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.221273 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.240309 (+ 19036us) log.cc:844] Serialized 52 byte log entry
0709 13:10:06.460721 (+220412us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:06.460780 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.460868 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.344074 (+883206us) raft_consensus.cc:1685] finished
0709 13:10:07.344095 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.344255 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48517,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17586,"spinlock_wait_cycles":887040,"thread_start_us":193194,"threads_started":1,"wal-append.queue_time_us":267835}
W20260709 13:10:07.356575 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 380179us
I20260709 13:10:07.318038 22878 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:07.340407 22988 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.382449 19901 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:07.376698 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:07.358028 22836 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.165s	user 0.013s	sys 0.002s
I20260709 13:10:07.358541 22970 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:07.370039 22876 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:07.405992 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:07.370280 22951 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.013s	sys 0.003s
W20260709 13:10:07.407318 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 71175.8us
I20260709 13:10:07.348882 22638 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:07.383706 22731 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:07.399096 22949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.036s	sys 0.065s
I20260709 13:10:07.362049 22674 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:07.413269 22951 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.014s	sys 0.003s
I20260709 13:10:07.373754 22869 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.385596 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:07.408192 22970 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:07.414003 22752 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:07.508469 22951 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:07.508380 23000 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
W20260709 13:10:07.395978 22743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.005s	sys 0.014s
I20260709 13:10:07.387742 22926 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:07.410853 22745 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:07.511574 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 179402us
W20260709 13:10:07.512992 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 142352us
I20260709 13:10:07.465061 19266 leader_election.cc:400] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
W20260709 13:10:07.487378 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.584s (SENT) [suppressed 51 similar messages]
I20260709 13:10:07.542652 19266 leader_election.cc:403] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:07.455128 22838 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.217s	user 0.013s	sys 0.000s
I20260709 13:10:07.389801 22988 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:07.545640 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:07.426873 22949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.039s	sys 0.065s
W20260709 13:10:07.566383 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 160513us
I20260709 13:10:07.567162 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:07.512517 22743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.006s	sys 0.014s
I20260709 13:10:07.476487 22985 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:07.577306 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46250.5us
I20260709 13:10:07.577672 19894 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:07.508119 22674 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:07.476150 22776 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:07.503645 22872 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:07.496258 22553 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:07.577919 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:07.420933 22878 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:10:07.506323 22972 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:07.504643 23009 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:07.508240 22990 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:07.416837 22876 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:07.617750 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130408us
I20260709 13:10:07.619179 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:07.522447 22939 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.186s	user 0.008s	sys 0.015s
I20260709 13:10:07.409076 22978 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:07.504829 22977 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.565549 23001 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.647617 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.595139 22562 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:07.566123 22838 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.595335 22743 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:07.661249 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:07.673282 23003 log.cc:927] Time spent T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:07.626292 22990 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:07.610436 22998 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.674496 22861 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:07.674858 19292 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:07.675504 22994 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.676278 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:07.676890 19293 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:07.676995 23005 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:07.677418 22638 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:07.589092 22745 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:07.594502 22752 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.576088 22949 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:07.682821 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.623014 23009 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:07.625991 22985 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:10:07.558750 22951 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:07.882396 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 273118us
I20260709 13:10:08.015900 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:07.757926 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.008782 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.989187 22932 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.680s	user 0.005s	sys 0.009s
W20260709 13:10:07.886373 22996 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:10:07.740387 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:07.754001 22987 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:10:07.713137 19222 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.839854 22978 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:07.867336 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 402443us
I20260709 13:10:07.840057 22869 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:07.944950 19293 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:07.730399 22920 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:07.755999 22952 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.963754 22638 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.018034 23015 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.989634 23010 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.676316 22994 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:07.784924 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.961505 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 468272us
W20260709 13:10:08.029937 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.887416 22977 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.024626 22752 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.729965 22926 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.739966 19294 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:07.666657 22970 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:07.756917 23004 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:07.692762 22990 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:08.024850 22992 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:08.032264 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:07.669402 22674 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.362s
I20260709 13:10:08.017346 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:08.028045 22998 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:08.040611 22876 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:07.670199 23001 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:07.657397 22939 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.021677 22988 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.031265 23012 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:10:08.037477 23008 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.051640 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 370787us
I20260709 13:10:08.025259 22976 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:10:08.042397 22858 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.028s	user 0.009s	sys 0.004s
W20260709 13:10:08.060853 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43582.1us
I20260709 13:10:08.028878 22932 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.062883 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:08.041242 22638 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.079241 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 1994) took 1488 ms. Trace:
I20260709 13:10:08.049801 22994 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:08.054402 22969 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.084568 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.041409 22952 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.093721 19370 rpcz_store.cc:276] 0709 13:10:06.590857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.591005 (+   148us) service_pool.cc:224] Handling call
0709 13:10:06.652594 (+ 61589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.760739 (+108145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.760767 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.761227 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.336927 (+575700us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:07.336976 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.337065 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.079021 (+741956us) raft_consensus.cc:1685] finished
0709 13:10:08.079041 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.079182 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":484433,"threads_started":1,"wal-append.queue_time_us":638563}
I20260709 13:10:08.070603 23021 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:08.108779 19369 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:08.054396 22926 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.045895 23010 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.075938 22949 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.055083 22752 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.112283 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 741) took 1675 ms. Trace:
I20260709 13:10:08.114594 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:08.211169 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 96674.6us
I20260709 13:10:08.212270 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:08.122363 19220 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:08.110172 22969 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.133822 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1805) took 1129 ms. Trace:
W20260709 13:10:08.118876 23016 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:08.214663 23004 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:08.134536 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71776.4us
I20260709 13:10:08.342947 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:08.123281 19299 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:08.132216 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 50864.1us
I20260709 13:10:08.209690 19901 rpcz_store.cc:276] 0709 13:10:06.436692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.436802 (+   110us) service_pool.cc:224] Handling call
0709 13:10:06.437107 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.386755 (+949648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.111981 (+725226us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54006b3354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:08.112208 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173351680}
I20260709 13:10:08.213716 19220 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:08.118247 23014 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:10:08.099892 22888 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.745s	user 0.010s	sys 0.005s
I20260709 13:10:08.228921 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.354257 19369 raft_consensus.cc:2410] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:08.226254 19218 rpcz_store.cc:276] 0709 13:10:07.003956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.018229 (+ 14273us) service_pool.cc:224] Handling call
0709 13:10:07.018451 (+   222us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.022709 (+  4258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.022742 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.041429 (+ 18687us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.397641 (+356212us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:07.397695 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.397787 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.133489 (+735702us) raft_consensus.cc:1685] finished
0709 13:10:08.133520 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.133714 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97194,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8401,"thread_start_us":293035,"threads_started":1,"wal-append.queue_time_us":589278}
I20260709 13:10:08.134717 22939 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:08.114383 22638 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.215678 22832 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.095099 23008 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.104295 22745 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.117697 23001 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:08.132521 23012 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:08.134985 23022 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.122805 22932 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.324846 22926 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:08.324687 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 112546us
I20260709 13:10:08.136260 22994 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.328269 23033 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.332818 22980 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.970s	user 0.011s	sys 0.000s
I20260709 13:10:08.392899 22980 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.394169 22969 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.395309 22980 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.228297 22960 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.396620 19224 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:08.201570 22985 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:10:08.063673 23009 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.331861 22990 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.398811 22984 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:08.399745 22990 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.130775 22995 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.340682 22972 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.401028 22972 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.403307 22972 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.125857 22965 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:08.353550 19895 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.064s	sys 0.184s
I20260709 13:10:08.351260 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:08.404497 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.358392 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:08.358717 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:08.208639 23000 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:10:08.360934 19368 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:08.363521 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.405481 19298 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:08.405807 19295 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.360069 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.341717 22858 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.367468 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:08.104519 22998 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.262s
I20260709 13:10:08.366005 19220 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.371891 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:08.408404 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57258.3us
I20260709 13:10:08.374210 23015 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:08.388535 23033 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.390292 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.371042 22921 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:08.391191 22776 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:10:08.364054 23020 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:08.392004 22976 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:08.367789 23021 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.399443 22984 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:08.404069 19895 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.065s	sys 0.184s
I20260709 13:10:08.357342 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:08.434746 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.435276 19297 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:08.408875 19291 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:08.363862 22933 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.410323 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:08.410702 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:08.414674 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.416429 23015 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.437629 19292 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.417505 22915 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:08.438650 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.419646 19220 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.405900 22872 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.420264 22995 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:08.419661 22858 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.424787 19295 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:08.403949 22965 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:08.427102 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.429967 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:08.431339 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.431797 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:08.454238 19371 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:08.432085 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:08.427718 22998 consensus_queue.cc:1243] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:08.456236 19221 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:08.432669 19191 connection.cc:256] RPC call timeout handler was delayed by -1.3582885690000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260709 13:10:08.435837 19370 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:08.437561 19901 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:08.417196 22752 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:08.438670 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.418363 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 619) took 1122 ms. Trace:
I20260709 13:10:08.374154 22876 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:08.374487 22707 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:10:08.439317 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.470868 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 61368.4us
I20260709 13:10:08.440156 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:08.424386 22926 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:08.439850 19365 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:08.420619 22997 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:08.420871 22832 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.441215 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.477149 19366 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:10:08.440333 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 634) took 1069 ms. Trace:
I20260709 13:10:08.477487 19367 rpcz_store.cc:276] 0709 13:10:07.371422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.371947 (+   525us) service_pool.cc:224] Handling call
0709 13:10:07.372369 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.372801 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.372842 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.376884 (+  4042us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.546161 (+169277us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:07.546200 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.546267 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.440100 (+893833us) raft_consensus.cc:1685] finished
0709 13:10:08.440125 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.440278 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":14021,"thread_start_us":124881,"threads_started":1,"wal-append.queue_time_us":510389}
I20260709 13:10:08.478695 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.443681 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.407064 23012 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:08.410152 22920 consensus_queue.cc:1175] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 11 status { last_received { term: 10 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:08.445782 22858 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.427597 22960 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.427446 22951 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.458191 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.494264 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.461828 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.495514 19371 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:10:08.458124 19191 connection.cc:256] RPC call timeout handler was delayed by -1.3573885690000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 13:10:08.461791 19896 rpcz_store.cc:276] 0709 13:10:07.296018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.296135 (+   117us) service_pool.cc:224] Handling call
0709 13:10:07.334770 (+ 38635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.346489 (+ 11719us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:07.346519 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.356065 (+  9546us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.510486 (+154421us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:07.510523 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.510585 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.418106 (+907521us) raft_consensus.cc:1685] finished
0709 13:10:08.418131 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.418295 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23160,"raft.queue_time_us":20294,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2483,"thread_start_us":113817,"threads_started":1,"wal-append.queue_time_us":500967}
I20260709 13:10:08.496748 19371 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:08.460390 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:08.424886 22638 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:08.440771 22980 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.500543 22980 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.501632 23033 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.488005 22832 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.503599 22980 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.479697 19218 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:08.481379 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:08.507750 19367 raft_consensus.cc:2368] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:08.508563 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:08.481819 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71619.3us
I20260709 13:10:08.446527 23010 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.493527 19292 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:08.497251 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.455614 22872 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.504207 22832 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.438841 22702 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:08.505409 19371 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:08.510972 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:08.514518 19367 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:08.514652 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1810) took 2237 ms. Trace:
I20260709 13:10:08.515772 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.520731 19365 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:10:08.498667 19370 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:08.516712 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:08.480815 22995 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:08.442070 23021 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.464860 23004 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.507354 22985 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:08.522719 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.624560 19369 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:10:08.596396 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 98889.3us
W20260709 13:10:08.641808 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.495754 23024 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:08.647576 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:08.680346 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:08.676185 19372 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:08.680442 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 169569us
I20260709 13:10:08.680523 19299 rpcz_store.cc:276] 0709 13:10:06.267499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.267666 (+   167us) service_pool.cc:224] Handling call
0709 13:10:06.267948 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.347138 (+2079190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.504859 (+157721us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54001d56d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:08.505118 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4266241280}
W20260709 13:10:08.637435 23040 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:10:08.523504 23025 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:10:08.692827 19369 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:08.705441 19371 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:08.645268 23015 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.684275 22985 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.714241 19365 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:08.693058 22832 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:08.499480 22960 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.718837 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.719893 19299 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:08.519729 22977 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:08.732511 22977 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.735646 22977 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.573107 22980 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:08.756485 22980 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.757335 19220 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:08.757710 19220 pending_rounds.cc:85] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:10:08.757933 19220 pending_rounds.cc:107] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:08.758147 19220 raft_consensus.cc:2889] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:08.709504 19366 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:08.758862 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2133) took 1494 ms. Trace:
I20260709 13:10:08.516453 22976 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
I20260709 13:10:08.710412 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.698504 22997 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:08.507010 22951 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.721863 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.716087 23024 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.776280 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:08.522091 23033 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.189s
I20260709 13:10:08.692013 19370 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:08.725605 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.717185 22876 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.736677 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.719027 22832 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.778687 19365 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:08.736929 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 559) took 1065 ms. Trace:
I20260709 13:10:08.600946 22965 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.697103 22984 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.690889 22702 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.736984 23053 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:08.738119 19294 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:10:08.738387 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58152.5us
I20260709 13:10:08.795122 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:08.775669 22742 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:10:08.795686 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:08.717144 22985 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.739868 23019 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:08.690501 22707 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.797518 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.760740 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:08.761551 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.764310 19221 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:08.759199 19220 rpcz_store.cc:276] 0709 13:10:07.264093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.264363 (+   270us) service_pool.cc:224] Handling call
0709 13:10:07.264709 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.122222 (+857513us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54002c81a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb71c0 00007fe8d7eb8231 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c
0709 13:10:08.758604 (+636382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.758807 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726394240}
W20260709 13:10:08.768021 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 61934.1us
I20260709 13:10:08.799790 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:08.799829 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.801110 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:08.801208 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:08.801494 19220 raft_consensus.cc:2376] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9. Re-sending same reply.
I20260709 13:10:08.802033 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:08.802286 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:08.802618 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:08.802702 19900 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:08.803352 19903 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:08.803285 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.802711 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.804190 23015 raft_consensus.cc:2764] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:10:08.771857 19374 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:08.773023 19299 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:08.779675 19300 rpcz_store.cc:276] 0709 13:10:07.671466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.678647 (+  7181us) service_pool.cc:224] Handling call
0709 13:10:07.679017 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.075799 (+396782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.075844 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.081582 (+  5738us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.364729 (+283147us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.364781 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.364887 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.736719 (+371832us) raft_consensus.cc:1685] finished
0709 13:10:08.736738 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.736872 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31833,"raft.queue_time_us":328873,"spinlock_wait_cycles":5917440,"thread_start_us":248080,"threads_started":2,"wal-append.queue_time_us":334680}
I20260709 13:10:08.806273 19299 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:08.782544 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:08.808619 19370 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:08.758698 22980 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.809569 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:08.796877 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.811991 19365 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:10:08.797122 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.809289 19373 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:08.813047 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.774497 23012 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.816046 19220 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:08.818292 19295 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:08.821480 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:08.824326 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.783336 22832 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.828725 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:08.831773 19370 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:08.833107 19370 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:08.834112 19370 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:08.797679 23019 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:08.835888 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:08.836915 19366 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:08.816284 22965 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.841260 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:08.842016 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.824119 22984 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.808326 23053 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.824484 23054 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:08.794924 22876 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.845600 19366 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:08.849251 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:08.849968 19218 raft_consensus.cc:2410] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:08.789373 23024 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.830368 22776 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:10:08.815217 22995 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:08.853595 22980 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.850672 23054 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:08.869621 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:08.869917 19292 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:08.870324 19218 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.887409 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:08.888495 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:08.869788 23054 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.859884 23019 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:08.885108 22962 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 2.038s	user 0.006s	sys 0.008s
I20260709 13:10:08.895732 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:08.897730 19191 leader_election.cc:400] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:08.887279 23021 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.891523 22984 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:08.846714 22997 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.898722 23055 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.892365 22960 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.902510 22745 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:08.923254 22832 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:08.934120 22832 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:08.911650 22951 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:08.908888 23019 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.941102 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:08.908762 22702 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.910337 23055 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.917284 22745 consensus_queue.cc:1243] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:10:09.032738 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.225896 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.026657 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.389130 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.352602 19218 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:08.957617 22702 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.403474 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:09.404714 19218 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:10:09.408320 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 467229us
I20260709 13:10:09.411186 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:08.956765 22876 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:08.956586 22984 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.462s
I20260709 13:10:08.951036 23055 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:09.423213 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.191485 22878 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.119676 23053 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:09.171772 23024 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:09.467988 23011 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.795s	user 0.010s	sys 0.015s
I20260709 13:10:09.495986 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:09.459242 22876 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:09.505745 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 243349us
I20260709 13:10:09.487433 22832 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:09.486063 23050 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.512878 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 103527us
I20260709 13:10:09.514216 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:09.517002 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:09.486354 22878 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:09.533599 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.543576 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:09.544256 19218 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:09.544721 19218 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:09.545073 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2142) took 1476 ms. Trace:
I20260709 13:10:09.545360 19218 rpcz_store.cc:276] 0709 13:10:08.068721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.537273 (+1468552us) service_pool.cc:224] Handling call
0709 13:10:09.545017 (+  7744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.515600 22876 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.547134 22838 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:09.524267 23050 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.541849 22872 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:09.560359 23062 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:09.561784 22876 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.562649 23071 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:09.563254 23071 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.564035 22990 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:09.564450 22990 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:09.564940 23067 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:10:09.565289 22990 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.566601 22990 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.566710 19370 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:09.569613 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:09.570391 19218 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:09.569875 23071 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.571673 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2140) took 2237 ms. Trace:
I20260709 13:10:09.572085 19225 rpcz_store.cc:276] 0709 13:10:07.321141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.341555 (+ 20414us) service_pool.cc:224] Handling call
0709 13:10:07.341888 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.342319 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.342350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.342947 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.412140 (+ 69193us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:07.412219 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.412315 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.402753 (+1990438us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:09.553726 (+150973us) raft_consensus.cc:1685] finished
0709 13:10:09.553747 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.558028 (+  4281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28650,"raft.queue_time_us":1194,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9548,"spinlock_wait_cycles":46649728,"thread_start_us":67610,"threads_started":1,"wal-append.queue_time_us":329664}
W20260709 13:10:09.557579 22985 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
W20260709 13:10:09.578246 23023 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.443s	user 0.006s	sys 0.009s
I20260709 13:10:09.553797 22997 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.586616 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2146) took 1510 ms (client timeout 1721 ms). Trace:
I20260709 13:10:09.596343 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:09.597061 19218 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.599231 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:09.595111 19224 rpcz_store.cc:269] 0709 13:10:08.076614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.084245 (+  7631us) service_pool.cc:224] Handling call
0709 13:10:09.586400 (+1502155us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400077bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:09.586551 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678947200}
I20260709 13:10:09.602944 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:09.603809 19224 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:09.604317 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1814) took 1202 ms. Trace:
I20260709 13:10:09.604700 19224 rpcz_store.cc:276] 0709 13:10:08.401878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.602680 (+1200802us) service_pool.cc:224] Handling call
0709 13:10:09.604246 (+  1566us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.598340 23054 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
I20260709 13:10:09.614284 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:09.601171 22965 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.000s
I20260709 13:10:09.594125 22997 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.593518 23071 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.606577 22878 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.598104 22985 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.594879 23051 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:10:09.636241 22985 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.637305 23050 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:09.643356 22997 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:09.645319 22743 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:09.645905 22743 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:09.647182 22743 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.648609 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1765) took 1979 ms. Trace:
I20260709 13:10:09.649037 19291 rpcz_store.cc:276] 0709 13:10:07.668927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.679461 (+ 10534us) service_pool.cc:224] Handling call
0709 13:10:08.035734 (+356273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.436367 (+400633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.647475 (+1211108us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54001d2c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:09.648423 (+   948us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001d2c50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:09.648552 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675607552}
I20260709 13:10:09.652693 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:09.653663 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 624) took 2076 ms. Trace:
I20260709 13:10:09.654011 19897 rpcz_store.cc:276] 0709 13:10:07.577056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.577184 (+   128us) service_pool.cc:224] Handling call
0709 13:10:09.652591 (+2075407us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:10:09.653605 (+  1014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3865728}
W20260709 13:10:09.654728 23070 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:10:09.645953 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1810) took 2640 ms. Trace:
I20260709 13:10:09.655923 19222 rpcz_store.cc:276] 0709 13:10:07.005407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.016368 (+ 10961us) service_pool.cc:224] Handling call
0709 13:10:07.016585 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.032125 (+1015540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.645719 (+1613594us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54001d5454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:09.645899 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601398144}
I20260709 13:10:09.658383 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2147) took 1578 ms. Trace:
I20260709 13:10:09.659004 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:09.658730 19222 rpcz_store.cc:276] 0709 13:10:08.080318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.657623 (+1577305us) service_pool.cc:224] Handling call
0709 13:10:09.657919 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.658089 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.658113 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.658150 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.658177 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.658233 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.658331 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.665424 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:09.660684 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:09.670349 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:09.671947 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:09.616953 23054 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.673307 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:09.670444 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:09.682735 19300 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:09.675654 23034 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.676286 22942 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:09.643989 23009 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.679176 23008 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.680527 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:09.683279 19291 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:09.711176 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:09.686069 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:09.687889 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:09.689131 22906 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:09.691164 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1807) took 1264 ms (client timeout 1555 ms). Trace:
W20260709 13:10:09.724855 19373 rpcz_store.cc:269] 0709 13:10:08.426577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.426740 (+   163us) service_pool.cc:224] Handling call
0709 13:10:09.690928 (+1264188us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:09.691070 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819954048}
I20260709 13:10:09.680857 22997 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.706626 22942 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:09.702847 23027 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.571s	user 0.001s	sys 0.009s
I20260709 13:10:09.711262 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:09.667094 22994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.274s	user 0.009s	sys 0.010s
I20260709 13:10:09.739490 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:09.747326 23054 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.748602 22702 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.699051 19218 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:10:09.765070 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 227116us
W20260709 13:10:09.777377 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 313831us
I20260709 13:10:09.779484 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2023) took 1068 ms. Trace:
W20260709 13:10:09.766633 22994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.009s	sys 0.010s
I20260709 13:10:09.779876 19372 rpcz_store.cc:276] 0709 13:10:08.710871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.987143 (+276272us) service_pool.cc:224] Handling call
0709 13:10:08.989037 (+  1894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.989446 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.989478 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.464295 (+474817us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.740740 (+276445us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.778777 (+ 38037us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.779025 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.779259 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.779315 (+    56us) raft_consensus.cc:1685] finished
0709 13:10:09.779327 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.779433 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31652,"raft.queue_time_us":412,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":215002,"threads_started":1,"wal-append.queue_time_us":245570}
I20260709 13:10:09.802089 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:09.711494 23034 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.755766 22942 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.756130 22906 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.781894 22997 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.783074 23021 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:10:09.824049 22997 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.824539 22997 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.770552 22832 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:09.826174 22832 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.830941 23034 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:09.803808 22872 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:09.834475 19373 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:09.806130 19224 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:09.818563 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.782618 23071 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:10:09.819707 22838 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:09.837596 23071 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:09.837633 22838 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.824322 22951 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.818935 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:09.838176 23071 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:09.836416 19371 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:09.844964 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:09.804561 22965 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.874818 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 163701us
W20260709 13:10:09.831004 23019 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.000s
I20260709 13:10:09.873677 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:09.848440 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.839988 22838 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:09.882354 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.883500 19371 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:09.777798 22980 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:10:09.878021 19370 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:10:09.894555 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:09.895332 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.824412 23021 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:09.895797 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:09.906323 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.846551 22951 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:09.877215 23080 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:10:09.915256 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 127755us
I20260709 13:10:09.917191 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.905700 23019 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:09.912307 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 226272us
I20260709 13:10:09.914574 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.840750 22872 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.915083 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.920595 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:09.934486 19370 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:10:09.944654 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.948971 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.902112 23021 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:09.940599 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:09.915968 22951 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.911394 23077 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:09.963207 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.966353 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.908139 22985 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:09.911553 23008 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:09.884256 22965 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.982050 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:09.983361 23054 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:09.928382 23019 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:09.923249 23079 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:10:09.989868 22990 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.974193 23071 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.996244 23077 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:09.968081 23088 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:10.000581 22980 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.973816 22702 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.021541 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2144) took 1952 ms. Trace:
I20260709 13:10:10.016036 19370 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:09.969309 22952 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:10.056973 19225 rpcz_store.cc:276] 0709 13:10:08.069337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.615694 (+1546357us) service_pool.cc:224] Handling call
0709 13:10:09.621355 (+  5661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.621579 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:09.755178 (+133599us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.020468 (+265290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.020529 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.020581 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.021256 (+   675us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.021478 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":305127,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":73419,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":218,"thread_start_us":397142,"threads_started":3}
I20260709 13:10:10.059571 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:10.042512 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 146773us
I20260709 13:10:10.036412 22562 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.065745 19372 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:10.071491 19868 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.868s (SENT)
I20260709 13:10:10.072068 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:10.083899 23054 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:10.084717 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2151) took 1876 ms. Trace:
I20260709 13:10:10.085119 19225 rpcz_store.cc:276] 0709 13:10:08.208552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.083827 (+1875275us) service_pool.cc:224] Handling call
0709 13:10:10.084136 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.084333 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.084370 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.084425 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.084472 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.084549 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.084664 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.085682 23054 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:10.086495 19225 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:10.087159 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1811) took 1686 ms. Trace:
I20260709 13:10:10.087471 19225 rpcz_store.cc:276] 0709 13:10:08.400994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.086044 (+1685050us) service_pool.cc:224] Handling call
0709 13:10:10.086320 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.086885 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.087108 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.088917 22906 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:10.089700 19225 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:10.089465 22906 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.090353 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1816) took 1688 ms. Trace:
I20260709 13:10:10.090696 19225 rpcz_store.cc:276] 0709 13:10:08.402434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.088563 (+1686129us) service_pool.cc:224] Handling call
0709 13:10:10.089534 (+   971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.090132 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.090302 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.091874 19225 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:10.091982 22906 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:10.092463 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1819) took 1689 ms. Trace:
I20260709 13:10:10.092929 19225 rpcz_store.cc:276] 0709 13:10:08.403191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.091451 (+1688260us) service_pool.cc:224] Handling call
0709 13:10:10.091719 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.092259 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.092418 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.085633 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2148) took 1989 ms. Trace:
I20260709 13:10:10.115506 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1820) took 1695 ms. Trace:
I20260709 13:10:10.045652 23088 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.124011 23088 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:10.116449 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2024) took 1402 ms. Trace:
I20260709 13:10:10.055523 22995 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.010946 22985 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.116052 19225 rpcz_store.cc:276] 0709 13:10:08.403473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.093692 (+1690219us) service_pool.cc:224] Handling call
0709 13:10:10.098570 (+  4878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.098750 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.098779 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.098821 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.098860 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.098921 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.099023 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:10.127458 19191 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.555s (SENT)
I20260709 13:10:10.077265 22562 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.125946 19366 rpcz_store.cc:276] 0709 13:10:08.714014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.540276 (+826262us) service_pool.cc:224] Handling call
0709 13:10:09.540770 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:09.542245 (+  1475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.542276 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:09.548737 (+  6461us) log.cc:844] Serialized 52 byte log entry
0709 13:10:09.763076 (+214339us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.763142 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.763240 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.116214 (+352974us) raft_consensus.cc:1685] finished
0709 13:10:10.116233 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.116381 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4229,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7375,"thread_start_us":139213,"threads_started":1,"wal-append.queue_time_us":285448}
I20260709 13:10:10.097270 19222 rpcz_store.cc:276] 0709 13:10:08.096084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.660154 (+1564070us) service_pool.cc:224] Handling call
0709 13:10:09.662148 (+  1994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.662498 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.662524 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.669404 (+  6880us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.774392 (+104988us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.774462 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.774561 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.085438 (+310877us) raft_consensus.cc:1685] finished
0709 13:10:10.085458 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.085579 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14199,"thread_start_us":103355,"threads_started":1,"wal-append.queue_time_us":414485}
I20260709 13:10:10.140635 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:10.150719 19225 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:10.046356 22990 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.165934 22990 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.167570 22981 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:10.168022 22981 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:10.168840 22981 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.170068 22981 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.170346 22906 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:10.171028 22906 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.173866 22906 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:10.180717 19265 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:10.182521 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:10.184423 22920 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.184873 22985 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.186800 22876 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.110348 22951 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.189518 23077 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.189924 22951 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:10.191671 22872 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:10.192260 23055 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.772s	user 0.015s	sys 0.003s
I20260709 13:10:10.194451 19225 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:10:10.075928 22702 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.198326 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 633) took 3040 ms. Trace:
I20260709 13:10:10.199725 19219 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:10.194819 19225 pending_rounds.cc:85] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 7
I20260709 13:10:10.200591 19225 pending_rounds.cc:107] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:10:10.200934 19225 raft_consensus.cc:2889] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:10.198719 19368 rpcz_store.cc:276] 0709 13:10:07.153039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.153348 (+   309us) service_pool.cc:224] Handling call
0709 13:10:07.170256 (+ 16908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.405463 (+1235207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.179983 (+1774520us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400197154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:10.193448 (+ 13465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737362304}
I20260709 13:10:10.038621 22942 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.151355 23071 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.207655 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 442) took 1710 ms. Trace:
I20260709 13:10:10.208046 19225 rpcz_store.cc:276] 0709 13:10:08.497314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.193866 (+1696552us) service_pool.cc:224] Handling call
0709 13:10:10.194143 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.205798 (+ 11655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.207598 (+  1800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.144927 22995 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.232772 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2149) took 2125 ms. Trace:
I20260709 13:10:10.234095 19897 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:10.233203 19218 rpcz_store.cc:276] 0709 13:10:08.107184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.767964 (+1660780us) service_pool.cc:224] Handling call
0709 13:10:09.801885 (+ 33921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.802083 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:10.008924 (+206841us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.232403 (+223479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.232465 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.232521 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.232592 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.232713 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186114,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"thread_start_us":386147,"threads_started":2}
I20260709 13:10:10.203805 22970 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.192687 23055 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.239063 19222 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:10.239099 22970 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.232653 23019 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:10.191699 22997 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.240785 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2154) took 1827 ms. Trace:
I20260709 13:10:10.241182 19222 rpcz_store.cc:276] 0709 13:10:08.413742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.157918 (+1744176us) service_pool.cc:224] Handling call
0709 13:10:10.158379 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.239478 (+ 81099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.240529 (+  1051us) spinlock_profiling.cc:243] Waited 80.4 ms on lock 0x7b540039b7d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:10.240720 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184950656}
W20260709 13:10:10.242272 22939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.845s	user 0.014s	sys 0.024s
W20260709 13:10:10.245261 22939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.848s	user 0.014s	sys 0.024s
I20260709 13:10:10.212858 22965 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.239969 23055 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.247196 22997 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.250228 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:10.251358 22995 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.253157 19218 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:10.254110 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2157) took 1557 ms. Trace:
I20260709 13:10:10.253762 23055 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:10.254505 19218 rpcz_store.cc:276] 0709 13:10:08.705751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.243588 (+1537837us) service_pool.cc:224] Handling call
0709 13:10:10.253002 (+  9414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.253576 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.254051 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.257258 22970 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.256405 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1825) took 1565 ms. Trace:
I20260709 13:10:10.258458 19225 rpcz_store.cc:276] 0709 13:10:08.690869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.208825 (+1517956us) service_pool.cc:224] Handling call
0709 13:10:10.209576 (+   751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.209793 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:10.237304 (+ 27511us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.255921 (+ 18617us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.256088 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.256132 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.256190 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.256255 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.256353 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":641,"prepare.queue_time_us":31190,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":158,"thread_start_us":18008,"threads_started":1}
I20260709 13:10:10.261109 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:10.261227 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:10.253999 23077 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.263792 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:10.265553 22776 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.267119 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:10.268066 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1809) took 1840 ms (client timeout 2047 ms). Trace:
W20260709 13:10:10.268491 19374 rpcz_store.cc:269] 0709 13:10:08.427999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.428207 (+   208us) service_pool.cc:224] Handling call
0709 13:10:10.267879 (+1839672us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54004263d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:10.268012 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712412800}
I20260709 13:10:10.260674 22878 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.325734 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.352962 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.263548 23022 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:10.529215 23108 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:10:10.529929 22791 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.347312 23093 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:10:10.533028 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.635092 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 811780us
W20260709 13:10:10.364777 23009 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.640s	user 0.002s	sys 0.009s
I20260709 13:10:10.627717 22706 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.632897 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 494948us
W20260709 13:10:10.632974 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 561484us
I20260709 13:10:10.633514 22997 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:10.634567 23118 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 13:10:10.636020 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:10.643079 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2026) took 1822 ms. Trace:
I20260709 13:10:10.658004 22951 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.656769 19365 rpcz_store.cc:276] 0709 13:10:08.820686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.562028 (+741342us) service_pool.cc:224] Handling call
0709 13:10:09.562313 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.562510 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:09.562794 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.642596 (+1079802us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.642669 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.642736 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.642844 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.643003 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":793279,"prepare.queue_time_us":11781,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":805243,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":283291,"threads_started":1,"wal-append.queue_time_us":394723}
I20260709 13:10:10.658649 22951 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.659196 22832 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:10.659039 23093 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.659721 22832 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:10.660337 22872 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.660959 22872 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.662611 22924 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:10.655057 22706 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.645978 23019 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.660725 22832 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.646956 22994 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:10:10.437873 22878 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.685603 23081 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.685804 23037 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.686116 22952 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.686280 22939 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.686643 22838 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:10.644209 22791 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.694284 22706 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.724606 22994 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:10.725193 22994 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:10.726246 22994 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.727815 22994 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.683612 22924 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.698107 23037 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.737488 22985 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.694711 22939 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.694955 22952 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.689702 23019 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:10.753309 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 486217us
I20260709 13:10:10.792088 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:10.794018 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:10.795504 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:10.695052 23081 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.765795 22706 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:10.766570 22942 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.825352 22640 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.826161 22791 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.826121 22640 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.826952 22791 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.796690 23009 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.830401 22924 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:10.832019 23088 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 13:10:10.832635 23088 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:10.833657 22952 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.835557 23088 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.839509 23022 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:10.842351 22920 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.657s	user 0.006s	sys 0.004s
I20260709 13:10:10.842872 22920 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.805420 22706 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:10.844061 22706 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.845671 22939 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.846954 22872 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.856670 19297 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:10.795795 23033 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:10.863961 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 206815us
I20260709 13:10:10.770789 22985 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.862095 22878 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.861333 22951 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:10.870257 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:10.870885 19298 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:10.871061 19225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.055s	sys 0.107s
W20260709 13:10:10.871366 19225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.055s	sys 0.107s
I20260709 13:10:10.875119 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:10.872073 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2158) took 2070 ms. Trace:
I20260709 13:10:10.875761 19291 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.875689 19225 rpcz_store.cc:276] 0709 13:10:08.801221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.260250 (+1459029us) service_pool.cc:224] Handling call
0709 13:10:10.260530 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.260709 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:10.267833 (+  7124us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.871749 (+603916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.871799 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:10.871853 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.871914 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.872023 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6461,"prepare.run_cpu_time_us":812,"prepare.run_wall_time_us":20363,"raft.queue_time_us":1356,"thread_start_us":603553,"threads_started":1}
I20260709 13:10:10.878031 19365 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:10.880206 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:10.881042 19300 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:10.867600 23033 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:10.882908 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.886103 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:10.886695 19225 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:10.886651 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.887766 19298 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:10:10.887866 19370 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:10.888722 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.889310 19371 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:10:10.890261 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.890803 19371 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:10.880195 22924 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.891645 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 245553us
I20260709 13:10:10.889171 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:10.893036 19371 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:10.893137 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.895108 19368 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
W20260709 13:10:10.895619 19340 connection.cc:256] RPC call timeout handler was delayed by -1.1990611910000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 13:10:10.893633 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.893301 19225 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:10.899581 19291 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:10:10.899586 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 243002us
W20260709 13:10:10.894385 19868 leader_election.cc:336] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.929s (SENT)
I20260709 13:10:10.901834 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:10.877431 22952 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.900276 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1830) took 1121 ms. Trace:
I20260709 13:10:10.902258 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:10.902683 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:10.905467 19225 rpcz_store.cc:276] 0709 13:10:09.779037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.892610 (+1113573us) service_pool.cc:224] Handling call
0709 13:10:10.892942 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.899858 (+  6916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.900114 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:10.902841 19365 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.903563 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:10.908082 19372 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:10.913728 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:10.917412 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:10.898010 23088 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:10.924448 19868 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.942s (SENT)
I20260709 13:10:10.926946 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:10.905536 22872 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.935273 19300 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:10:10.889930 23033 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.912604 23001 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:10.919745 23104 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:10.898700 22924 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:10.937528 23068 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.402s	user 0.003s	sys 0.010s
I20260709 13:10:10.938133 22939 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:10.910662 22952 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:10.933099 23037 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:11.004634 19365 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:10.940055 22942 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:10.945480 22951 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.952275 23088 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:10.954778 22985 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:10.940712 22872 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:11.028980 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.019145 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 221038us
I20260709 13:10:11.012769 23122 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.011590 23081 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:11.032888 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.037557 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1827) took 2218 ms. Trace:
W20260709 13:10:11.042209 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 133844us
I20260709 13:10:11.020401 23048 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:11.044826 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 120423us
I20260709 13:10:11.038043 19295 rpcz_store.cc:276] 0709 13:10:08.819368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.835519 (+ 16151us) service_pool.cc:224] Handling call
0709 13:10:08.835815 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.836138 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.836198 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.839917 (+  3719us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.963001 (+123084us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:08.963061 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.963163 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.867981 (+1904818us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:11.033775 (+165794us) raft_consensus.cc:1685] finished
0709 13:10:11.033802 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.037475 (+  3673us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2388,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3054,"spinlock_wait_cycles":7303040,"thread_start_us":108025,"threads_started":1,"wal-append.queue_time_us":638207}
I20260709 13:10:11.011046 22939 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.014225 23037 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:10:11.055728 19868 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.013s (SENT)
W20260709 13:10:11.043910 22776 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.001s
I20260709 13:10:11.019063 22832 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.058401 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.014700 22951 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.035380 23126 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:11.066604 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 144937us
I20260709 13:10:11.067775 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:11.048898 22985 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:11.072854 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:11.073920 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.070542 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:11.075834 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:11.064234 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 148145us
I20260709 13:10:11.080570 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.081197 19367 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:11.042706 23122 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.063757 22776 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.074275 22742 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:11.077168 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:11.062093 23081 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:10:11.090610 19370 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:11.086401 19367 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:10:11.085615 19868 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.082s (SENT)
I20260709 13:10:11.063064 23129 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.069201 23001 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:11.074416 23109 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.078614 23055 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:11.092509 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.080753 23126 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:11.096338 19368 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:11.105916 19368 pending_rounds.cc:85] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 4
I20260709 13:10:11.106248 19368 pending_rounds.cc:107] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:11.106530 19368 raft_consensus.cc:2889] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.096939 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.107257 19367 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:11.066773 22878 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:10:11.070822 23009 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:11.069988 23128 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:11.078289 22832 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:11.076017 23104 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:11.083611 23132 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:11.096091 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.098150 23071 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 13:10:11.065583 23088 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.087142 22742 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:11.082283 22970 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:10:11.124356 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:11.126576 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57575.9us
I20260709 13:10:11.077553 22985 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:11.135694 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55847.4us
I20260709 13:10:11.103411 23001 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.114566 23055 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:11.128031 22924 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:11.140583 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 63479.9us
I20260709 13:10:11.141980 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.142732 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.148898 19367 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:11.130909 23033 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.127276 23135 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.135566 22742 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:11.161336 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:11.143288 23109 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.112658 23131 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:10:11.144447 22952 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:11.169950 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.171196 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:11.140499 23137 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:11.174039 23137 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:11.175034 23137 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.176333 23126 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:11.151650 23120 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:11.169049 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1831) took 1389 ms. Trace:
I20260709 13:10:11.169340 23135 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.173313 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.180338 19367 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:11.133378 23132 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.181006 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:11.143671 23071 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:10:11.165509 23109 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.184711 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:11.180102 19225 rpcz_store.cc:276] 0709 13:10:09.779802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.906917 (+1127115us) service_pool.cc:224] Handling call
0709 13:10:10.907250 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.907487 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:10.931896 (+ 24409us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.168684 (+236788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.168735 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:11.168797 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.168867 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.168993 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28105,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7139,"raft.queue_time_us":18880,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5204,"thread_start_us":236346,"threads_started":2,"wal-append.queue_time_us":208557}
I20260709 13:10:11.195106 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.196136 19367 raft_consensus.cc:2368] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:11.197549 19291 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.198342 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.198650 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:11.199224 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.199745 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:11.200348 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.200512 19292 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:11.182672 23130 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:10:11.175716 22706 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.200562 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.206825 19298 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:11.179630 23121 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.208274 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.181512 23135 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:11.191066 22981 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.021s	user 0.014s	sys 0.001s
I20260709 13:10:11.217898 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.181514 22776 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.170699 23128 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:10:11.206163 23001 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.206321 22878 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:11.255265 19291 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:11.257613 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.255908 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:11.218005 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2125) took 4797 ms. Trace:
I20260709 13:10:11.192472 23022 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.263731 19295 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:11.264669 23143 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.265125 23143 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:11.255766 23122 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.265496 23143 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.206594 23145 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:11.267987 19294 raft_consensus.cc:1217] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Deduplicated request from leader. Original: 6.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 13:10:11.217208 19292 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:11.268723 19294 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:11.215818 23033 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.251102 23071 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.271616 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.272929 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.274258 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.271414 19291 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:11.194808 23109 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.276014 19292 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:11.278304 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.282611 19291 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:10:11.257827 23135 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.259579 19216 rpcz_store.cc:276] 0709 13:10:06.409812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.415335 (+  5523us) service_pool.cc:224] Handling call
0709 13:10:06.415808 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.416498 (+   690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.416539 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.437314 (+ 20775us) log.cc:844] Serialized 52 byte log entry
0709 13:10:06.552333 (+115019us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:06.552385 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.552458 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.855613 (+2303155us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:11.205674 (+2350061us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b2400129368. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e06fb0 00007fe8d7a7d488 00007fe8d7a7dbe8 00007fe8d7a55398 00007fe8d7a5076a 00007fe8d7a4fbb6
0709 13:10:11.206579 (+   905us) raft_consensus.cc:1685] finished
0709 13:10:11.206600 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.206747 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2742,"raft.queue_time_us":868,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":14548,"spinlock_wait_cycles":13687296,"thread_start_us":83831,"threads_started":1,"wal-append.queue_time_us":224039}
I20260709 13:10:11.261948 23121 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:11.218667 23133 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:10:11.171196 23104 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.269675 23145 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:11.219520 22970 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:10:11.215415 23055 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.364238 19367 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:11.365054 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.300480 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.366261 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.266950 23001 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:11.367002 19294 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:11.327627 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:11.339880 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 158937us
I20260709 13:10:11.371914 19292 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:11.339242 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.369002 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:11.375398 22742 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.377069 23143 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.379410 22742 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:11.379657 23143 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.273452 23033 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:11.380539 22932 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.380864 23033 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.380952 22932 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:11.280648 23071 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.381923 22932 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.383076 22932 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.383728 23071 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.384428 23132 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:11.391120 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.391811 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:11.392424 19291 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.392825 19293 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:11.392622 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:11.397043 19216 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.398183 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:11.400010 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.400776 19294 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:11.299734 23146 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.400071 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:11.391440 23017 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 3.430s	user 0.012s	sys 0.016s
I20260709 13:10:11.388967 22985 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:11.340354 23149 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.368702 23121 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.424050 19368 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:10:11.437244 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.395056 22970 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:11.454124 23145 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.396535 23001 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.474700 19216 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:10:11.476042 19868 connection.cc:256] RPC call timeout handler was delayed by -3.3218630150000763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:10:11.478384 19291 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:11.479357 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:11.477738 19868 connection.cc:256] RPC call timeout handler was delayed by -3.2595233490000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
I20260709 13:10:11.479941 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.481035 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.481662 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:11.482194 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.482407 23132 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:11.482810 19294 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 2.
I20260709 13:10:11.482980 23132 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:11.482465 19291 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:10:11.481115 19868 leader_election.cc:336] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.113s (SENT)
I20260709 13:10:11.484194 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:11.485338 23000 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:11.485642 19868 leader_election.cc:336] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.120s (SENT)
W20260709 13:10:11.487216 19868 connection.cc:256] RPC call timeout handler was delayed by -2.5390223950000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2706s for a response
W20260709 13:10:11.487896 19868 connection.cc:256] RPC call timeout handler was delayed by -2.4438565149999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:10:11.489497 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.492206 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.491093 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.486215 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.481887 23109 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.472393 22985 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.492725 19294 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:11.496888 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.483865 23132 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.499881 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.494365 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.498639 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.502823 19370 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:11.503643 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.504848 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.508889 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:11.509470 19368 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.510109 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.511623 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.518182 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.517557 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.521363 19216 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:11.522778 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:11.524072 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.525660 19370 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:11.519644 23088 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.520011 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:11.533821 23109 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.534116 19369 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:11.534762 22920 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:11.535176 22920 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:11.536032 22920 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.537276 22920 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.542929 23001 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:11.546011 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.547091 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.548507 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.516499 22742 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.422968 23146 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.549284 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 564) took 1879 ms. Trace:
I20260709 13:10:11.549789 22706 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:11.573276 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.561594 19368 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:11.565425 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:11.557300 23042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.004s	user 0.018s	sys 0.036s
W20260709 13:10:11.585634 23042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.069s	user 0.023s	sys 0.038s
I20260709 13:10:11.581694 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.426642 23149 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.570173 19299 rpcz_store.cc:276] 0709 13:10:09.669613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.669737 (+   124us) service_pool.cc:224] Handling call
0709 13:10:09.705770 (+ 36033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.706215 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.706252 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.732582 (+ 26330us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.905986 (+173404us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:09.906044 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.907625 (+  1581us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.093844 (+186219us) raft_consensus.cc:1685] finished
0709 13:10:10.093862 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.544953 (+1451091us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5400346550. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:11.549208 (+  4255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":385,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13547,"spinlock_wait_cycles":82057600,"thread_start_us":87043,"threads_started":1,"wal-append.queue_time_us":314835,"wal-append.run_cpu_time_us":1607,"wal-append.run_wall_time_us":1005349}
I20260709 13:10:11.590235 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.591332 19901 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:10:11.591727 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.521813 23071 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.516827 23154 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.511736 22970 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:10:11.593127 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.593863 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:11.596910 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.601713 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:11.601974 19299 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:11.602849 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:11.603291 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.568269 22969 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.604478 22553 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.604382 22969 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:11.605657 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.606727 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.563030 23088 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.562618 23082 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.596836 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.574012 23143 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:11.642063 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.599423 19902 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:11.606892 22969 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.607432 23081 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:11.508893 22985 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.597072 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.579432 22742 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.608764 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:11.551448 23001 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:10:11.632768 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49418.5us
I20260709 13:10:11.657763 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.581194 23000 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.637488 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.639501 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:11.640661 19896 raft_consensus.cc:2410] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:11.574255 23033 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.647785 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.660993 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:11.648666 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.652931 23150 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
W20260709 13:10:11.655459 23153 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:10:11.655817 23141 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.608119 22952 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:11.656385 23156 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:11.687307 23156 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:11.687225 23082 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.586217 23148 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:10:11.662708 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.662902 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.663972 22985 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.645439 23071 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:11.664337 23157 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:11.664383 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.651139 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:11.665031 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.701720 19899 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:11.665865 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:11.666893 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.666568 19894 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:11.683080 19291 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:11.659569 23132 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:11.685322 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:11.706347 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55268.6us
I20260709 13:10:11.706652 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:11.707988 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:11.648698 23055 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.4, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:10:11.661228 23143 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:11.688288 23082 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.682621 22742 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:11.702996 19299 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:11.703917 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.714672 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:11.716990 23166 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:11.717422 22985 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.717872 23055 consensus_queue.cc:1243] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:11.718572 23143 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.688452 23156 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.702912 23135 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.705947 23132 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:11.741449 23055 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:10:11.714807 23150 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:11.661582 23121 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:11.757556 22702 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.733839 22985 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.702632 23071 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.775174 22965 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:11.779168 19902 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:11.781387 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.743124 22742 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:11.820698 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.755542 23132 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.705502 23021 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.782735 22965 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:11.820861 23161 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 13:10:11.820724 23082 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.834328 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.788226 19294 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:11.779665 22985 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:11.913165 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 217579us
I20260709 13:10:11.869230 23154 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.965605 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.882512 23082 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.979557 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2143) took 3910 ms. Trace:
I20260709 13:10:11.982185 19224 rpcz_store.cc:276] 0709 13:10:08.069039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.605460 (+1536421us) service_pool.cc:224] Handling call
0709 13:10:09.605744 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.835753 (+230009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.979316 (+2143563us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001c3754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:11.979494 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460388224}
I20260709 13:10:11.983541 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.983796 23135 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:11.981400 23033 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:11.911253 23021 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:11.984961 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1808) took 4959 ms (client timeout 1985 ms). Trace:
W20260709 13:10:11.985392 19217 rpcz_store.cc:269] 0709 13:10:07.004817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.011031 (+  6214us) service_pool.cc:224] Handling call
0709 13:10:11.964485 (+4953454us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001c4154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:11.964637 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323494656}
I20260709 13:10:11.986536 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:11.987546 19299 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:11.989923 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:11.980844 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:11.987571 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:11.993394 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:11.983064 19223 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:11.995097 19223 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.996666 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:11.997367 19217 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:12.000082 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.000660 19896 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.001313 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.002070 19300 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:10:12.002012 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.003717 19295 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:11.989114 23082 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.013737 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.016309 19298 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.019093 19298 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:12.021790 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.025939 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.026768 19224 raft_consensus.cc:2410] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:12.027426 19896 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:12.027504 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.029033 19217 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:11.887461 22965 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:12.031319 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 316701us
I20260709 13:10:12.032414 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:12.010289 23121 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:12.034837 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.035007 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:12.034776 23150 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.036484 23150 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:12.036841 23163 log.cc:927] Time spent T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:10:12.036875 23150 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.037453 23150 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.042266 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.043478 19224 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:10:12.044129 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 452976us
I20260709 13:10:11.997314 22742 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.044911 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.045125 23180 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:10:12.045742 23162 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:12.045619 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.066754 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:12.067035 19224 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
W20260709 13:10:12.068573 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.071970 23171 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:12.072933 23168 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:10:12.074723 23182 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.075157 23170 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:10:12.075596 23182 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:12.074690 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.074680 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:12.081853 19191 leader_election.cc:400] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:12.084707 19191 leader_election.cc:403] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.086292 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:12.091533 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.093695 19901 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:12.095470 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.080271 22553 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:12.100772 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.089023 23074 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.074807 23033 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:12.095633 23029 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 3.770s	user 0.014s	sys 0.016s
I20260709 13:10:12.077672 23166 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.103654 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:12.104254 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.089210 23154 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:12.103914 22832 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:12.128386 19217 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:10:12.133164 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 555) took 4463 ms. Trace:
I20260709 13:10:12.133677 19296 rpcz_store.cc:276] 0709 13:10:07.670107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.673130 (+  3023us) service_pool.cc:224] Handling call
0709 13:10:07.673541 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.710680 (+ 37139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.710707 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.759726 (+ 49019us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.038243 (+278517us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:08.038296 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.038403 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.050422 (+4012019us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:12.132805 (+ 82383us) raft_consensus.cc:1685] finished
0709 13:10:12.132828 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.133057 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49611,"raft.queue_time_us":334199,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6205,"spinlock_wait_cycles":30747392,"thread_start_us":164604,"threads_started":1,"wal-append.queue_time_us":230947}
I20260709 13:10:12.104121 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:12.136747 23177 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:12.109534 22970 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:10:12.139966 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.146481 19296 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:12.148325 22991 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.148525 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.150210 19296 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:12.151906 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.110249 19223 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:12.156198 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2138) took 4835 ms. Trace:
I20260709 13:10:12.156409 22977 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.080881 23071 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.157019 22977 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.156553 19223 rpcz_store.cc:276] 0709 13:10:07.320536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.323715 (+  3179us) service_pool.cc:224] Handling call
0709 13:10:07.324069 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.110018 (+785949us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4c00077540. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d6181a20 00007fe8d6192a29 00007fe8d6158644 00007fe8d617ff2d 00007fe8d617fb93 00007fe8d7eb018b 00007fe8d7eb0cb5 00007fe8d7eabf30 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416
0709 13:10:11.965442 (+3855424us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002c63a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e3306f 00007fe8d7eabf60 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62
0709 13:10:12.155830 (+190388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.156094 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833812096}
I20260709 13:10:12.158490 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.159646 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.117419 23033 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:12.161840 23173 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:10:12.162477 23033 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:12.165691 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:12.096081 19901 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:12.166839 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.168087 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.168689 19367 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:12.154080 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.172260 19299 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:12.158492 23132 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.182126 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2141) took 4860 ms. Trace:
I20260709 13:10:12.182629 19219 rpcz_store.cc:276] 0709 13:10:07.321459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.508582 (+187123us) service_pool.cc:224] Handling call
0709 13:10:07.508882 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.200069 (+2691187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.181822 (+1981753us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b54000771d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:12.182046 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6187555200}
W20260709 13:10:12.184393 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1820) took 3423 ms (client timeout 2133 ms). Trace:
W20260709 13:10:12.184847 19297 rpcz_store.cc:269] 0709 13:10:08.760685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.761259 (+   574us) service_pool.cc:224] Handling call
0709 13:10:12.184186 (+3422927us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54002e9354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:12.184312 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4656699264}
I20260709 13:10:12.183290 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:12.186671 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:12.188128 22991 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:12.188654 22991 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.189594 22991 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:12.192234 23111 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.946s	user 0.007s	sys 0.009s
W20260709 13:10:12.194345 23066 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 2.663s	user 0.013s	sys 0.008s
I20260709 13:10:12.198455 23071 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:12.198868 23021 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.199172 23071 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.199430 23021 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.194242 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.201648 23071 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:12.294879 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 108356us
I20260709 13:10:12.202419 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:12.500707 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:12.501111 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 447) took 1415 ms. Trace:
I20260709 13:10:12.501657 23126 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:12.501602 19223 rpcz_store.cc:276] 0709 13:10:11.086449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.202108 (+1115659us) service_pool.cc:224] Handling call
0709 13:10:12.501050 (+298942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.502297 23126 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:12.502782 23126 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.188905 23082 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.219708 19901 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.504357 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2040) took 1015 ms. Trace:
I20260709 13:10:12.201800 23021 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.504840 23082 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.505551 23132 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:12.505986 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 439292us
I20260709 13:10:12.528865 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:12.529592 19219 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:12.521549 19372 rpcz_store.cc:276] 0709 13:10:11.488456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.539204 (+ 50748us) service_pool.cc:224] Handling call
0709 13:10:11.539564 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:11.560449 (+ 20885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.560495 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:11.578831 (+ 18336us) log.cc:844] Serialized 52 byte log entry
0709 13:10:11.673489 (+ 94658us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:11.673544 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.673640 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.161252 (+487612us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:12.164225 (+  2973us) raft_consensus.cc:1685] finished
0709 13:10:12.164244 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.224368 (+ 60124us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4800042858. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:10:12.504293 (+279925us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20419,"raft.queue_time_us":21149,"raft.run_cpu_time_us":5271,"raft.run_wall_time_us":661814,"spinlock_wait_cycles":36144384,"thread_start_us":34386,"threads_started":1,"wal-append.queue_time_us":269971}
I20260709 13:10:12.531095 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:12.421285 23136 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:12.351948 22985 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.339583 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.210966 19374 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:12.508749 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.218011 19899 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.212112 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1830) took 2414 ms. Trace:
I20260709 13:10:12.542665 19373 rpcz_store.cc:276] 0709 13:10:09.797843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.800287 (+  2444us) service_pool.cc:224] Handling call
0709 13:10:09.800553 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.835117 (+ 34564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.211805 (+2376688us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54000d34d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:12.212036 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77398784}
I20260709 13:10:12.216591 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 628) took 4750 ms. Trace:
I20260709 13:10:12.215103 23134 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:12.498852 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.427075 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:12.496299 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 644) took 1617 ms. Trace:
I20260709 13:10:12.520728 19296 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:12.520871 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:12.426481 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 344571us
I20260709 13:10:12.131307 22832 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.212953 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.525375 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2047) took 1025 ms. Trace:
I20260709 13:10:12.545868 23136 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.573501 19369 rpcz_store.cc:276] 0709 13:10:11.499699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.719010 (+219311us) service_pool.cc:224] Handling call
0709 13:10:11.720674 (+  1664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.721718 (+  1044us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:12.046449 (+324731us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.524899 (+478450us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.525073 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.525114 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:12.525160 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.525220 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.525325 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39389,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":72077,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":25824640,"thread_start_us":775031,"threads_started":3,"wal-append.queue_time_us":184728}
I20260709 13:10:12.498991 23182 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.519912 19225 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:12.518707 23010 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:12.228422 23151 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.868s	user 0.005s	sys 0.002s
I20260709 13:10:12.533289 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:12.536477 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 448481us
I20260709 13:10:12.523308 22933 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:12.543888 19898 rpcz_store.cc:276] 0709 13:10:07.465868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.466027 (+   159us) service_pool.cc:224] Handling call
0709 13:10:08.873501 (+1407474us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:10:08.873695 (+   194us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:08.874087 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.874116 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:08.874659 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 13:10:09.011684 (+137025us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:09.082458 (+ 70774us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.082892 (+   434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.083004 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.193701 (+3110697us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:12.216258 (+ 22557us) raft_consensus.cc:1685] finished
0709 13:10:12.216289 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.216488 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39756,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":1449,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":11269,"spinlock_wait_cycles":7159296,"thread_start_us":136566,"threads_started":1,"wal-append.queue_time_us":618518}
I20260709 13:10:12.597618 22933 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:12.598327 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.598949 19898 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:12.599012 22991 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.332525 23150 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:12.202426 19897 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 628) took 2541 ms (client timeout 2229 ms). Trace:
W20260709 13:10:12.600447 19897 rpcz_store.cc:269] 0709 13:10:09.661496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.671589 (+ 10093us) service_pool.cc:224] Handling call
0709 13:10:12.202156 (+2530567us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54006a68d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:12.202334 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097755520}
I20260709 13:10:12.601331 22562 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.601656 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.217686 23166 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:12.552678 19366 rpcz_store.cc:276] 0709 13:10:10.878420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.881121 (+  2701us) service_pool.cc:224] Handling call
0709 13:10:10.881537 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.881823 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:10.896960 (+ 15137us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.204595 (+1307635us) spinlock_profiling.cc:243] Waited 895 us on lock 0x7b18004859e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:10:12.495837 (+291242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.495898 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.495945 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.496020 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.496217 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14087,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":142,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":2059136,"thread_start_us":290881,"threads_started":1,"wal-append.queue_time_us":1632262}
W20260709 13:10:12.575515 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.606242 19299 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:12.203949 23081 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:12.588657 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67871.3us
I20260709 13:10:12.589692 23132 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.589838 23136 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:12.576027 22832 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:12.593173 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59964.4us
I20260709 13:10:12.611482 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.594705 22872 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:12.597048 19372 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:12.598734 22933 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.609820 23010 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.625234 22933 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.626389 23010 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:12.627079 22977 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.627149 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.602422 19897 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:12.611205 23166 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.627849 19372 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:12.602969 19222 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:12.545804 23021 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:12.600034 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.628958 23021 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:12.629462 23166 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:12.604213 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 67398.6us
I20260709 13:10:12.629876 23021 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.631263 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1846) took 1551 ms. Trace:
I20260709 13:10:12.633513 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.607060 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1792) took 1137 ms. Trace:
W20260709 13:10:12.608870 19263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.196:38805 timed out after 1.661s (SENT) [suppressed 24 similar messages]
I20260709 13:10:12.527715 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.601943 23150 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.540918 23071 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:12.607560 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:12.619930 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:12.620922 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:12.571604 23134 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:12.635622 19295 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:12.541394 23133 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.669271 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.631639 19365 rpcz_store.cc:276] 0709 13:10:11.079805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.079943 (+   138us) service_pool.cc:224] Handling call
0709 13:10:11.080252 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.171999 (+ 91747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.172031 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.187924 (+ 15893us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.269804 (+ 81880us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:11.269837 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.269911 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.227584 (+957673us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:12.630987 (+403403us) raft_consensus.cc:1685] finished
0709 13:10:12.631005 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.631204 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17322,"raft.queue_time_us":36702,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":4941,"spinlock_wait_cycles":92613376,"thread_start_us":149536,"threads_started":2,"wal-append.queue_time_us":172395}
I20260709 13:10:12.636091 19299 rpcz_store.cc:276] 0709 13:10:11.469394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.527472 (+1058078us) service_pool.cc:224] Handling call
0709 13:10:12.574310 (+ 46838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.606738 (+ 32428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.606991 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.657608 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:12.676952 19898 raft_consensus.cc:2376] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13. Re-sending same reply.
I20260709 13:10:12.677824 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.663754 22991 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:12.665169 22985 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.666275 23126 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.578250 23188 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.603972 22743 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.667323 23193 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.623950 23081 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.667781 23010 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.679077 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59240.4us
I20260709 13:10:12.680017 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.697011 19897 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:12.681176 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:12.699038 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.679275 22977 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:12.701145 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.701930 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.702028 19902 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 2.
W20260709 13:10:12.683161 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75712.4us
I20260709 13:10:12.683943 19295 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:12.691103 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.712381 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:12.716075 19295 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:12.718155 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:12.719048 19299 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:12.719355 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.688853 22991 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:12.690491 23132 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:12.741981 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.696367 23081 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.681818 22872 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:10:12.753224 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1813) took 4316 ms (client timeout 2162 ms). Trace:
W20260709 13:10:12.758617 19220 rpcz_store.cc:269] 0709 13:10:08.401612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.802002 (+400390us) service_pool.cc:224] Handling call
0709 13:10:12.718172 (+3916170us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b540039a8d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:12.718330 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26287360}
I20260709 13:10:12.761337 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:12.679641 23071 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.764310 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1786) took 1374 ms. Trace:
W20260709 13:10:12.766371 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54095.7us
I20260709 13:10:12.678861 23133 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.764752 19294 rpcz_store.cc:276] 0709 13:10:11.390316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.498783 (+108467us) service_pool.cc:224] Handling call
0709 13:10:12.764095 (+1265312us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002a9254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:12.764250 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660363648}
I20260709 13:10:12.704102 23193 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.774796 19220 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.776916 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2170) took 2037 ms. Trace:
I20260709 13:10:12.722813 22991 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.777352 19220 rpcz_store.cc:276] 0709 13:10:10.739049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.767475 (+2028426us) service_pool.cc:224] Handling call
0709 13:10:12.774376 (+  6901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.776496 (+  2120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.776846 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:12.778465 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.752370 22977 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:12.780354 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66331.3us
W20260709 13:10:12.781365 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.781477 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.753041 23132 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:12.785216 22876 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:12.786331 22876 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:12.786695 22876 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:12.788793 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.790844 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:12.791946 19220 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:12.763892 23182 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.796895 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2168) took 2584 ms. Trace:
I20260709 13:10:12.758229 23033 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:12.845088 19225 rpcz_store.cc:276] 0709 13:10:10.212862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.612360 (+2399498us) service_pool.cc:224] Handling call
0709 13:10:12.639833 (+ 27473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.640095 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:12.640435 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.796546 (+156111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.796599 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:12.796649 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.796711 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.796836 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82634,"prepare.queue_time_us":482,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":103326,"thread_start_us":73041,"threads_started":1}
I20260709 13:10:12.846912 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2171) took 2107 ms. Trace:
I20260709 13:10:12.849645 19220 rpcz_store.cc:276] 0709 13:10:10.739340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.845963 (+2106623us) service_pool.cc:224] Handling call
0709 13:10:12.846385 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.846604 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.846626 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.846664 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:12.846701 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.846751 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.846859 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.850808 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1841) took 1765 ms. Trace:
I20260709 13:10:12.851039 19220 rpcz_store.cc:276] 0709 13:10:11.085061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.850278 (+1765217us) service_pool.cc:224] Handling call
0709 13:10:12.850480 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.850604 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.850619 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.850647 (+    28us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:12.850670 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.850701 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.850770 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.851958 19220 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:12.775620 23015 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:12.852574 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1843) took 1722 ms. Trace:
I20260709 13:10:12.787531 22876 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.704331 23010 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.777594 23012 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:12.855079 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.856361 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:12.859728 19220 rpcz_store.cc:276] 0709 13:10:11.130242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.851574 (+1721332us) service_pool.cc:224] Handling call
0709 13:10:12.851750 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.852157 (+   407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.852516 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:12.853147 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63566us
I20260709 13:10:12.862293 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.783672 22991 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.781729 23156 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.867215 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:12.866770 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 168412us
I20260709 13:10:12.912380 19365 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:12.866385 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:12.913389 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:12.914100 19294 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:12.790831 23132 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.914824 19366 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
W20260709 13:10:12.920310 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54013.1us
I20260709 13:10:12.923574 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:12.925544 19220 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:12.925155 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:12.927001 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.927804 19368 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:12.854100 23190 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.926286 19369 pending_rounds.cc:85] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 8
I20260709 13:10:12.930653 19369 pending_rounds.cc:107] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:10:12.931000 19369 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.933028 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1848) took 1367 ms. Trace:
I20260709 13:10:12.934085 19220 rpcz_store.cc:276] 0709 13:10:11.565163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.921467 (+1356304us) service_pool.cc:224] Handling call
0709 13:10:12.921819 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.932681 (+ 10862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.932915 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.935793 19220 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.937541 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1851) took 1358 ms. Trace:
I20260709 13:10:12.937361 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.938340 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:12.938092 19220 rpcz_store.cc:276] 0709 13:10:11.578680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.935171 (+1356491us) service_pool.cc:224] Handling call
0709 13:10:12.935577 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.936259 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.937487 (+  1228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:12.861830 23015 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.938791 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.858898 23166 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:10:12.938714 23012 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.942229 23015 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.929308 23183 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.943902 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:12.921820 23156 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.944463 23183 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:12.945058 23050 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:12.945446 23183 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:12.945885 23183 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:12.945552 23050 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.946238 23156 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.946717 23183 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.944510 19294 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.756194 23134 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:12.857478 23082 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:10:12.957983 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:12.860854 23076 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.861598 23182 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.933025 22876 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.987677 23050 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:12.987959 22872 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.949107 23190 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:12.945654 23010 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:12.993410 23196 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:10:12.994969 19294 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:12.981348 23082 consensus_queue.cc:1243] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:12.982510 23183 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.050501 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.051033 19225 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:12.996898 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.052336 19902 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:13.053061 19902 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:12.857705 23033 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.009419 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:13.054966 19374 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.013823 19299 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 3.
W20260709 13:10:13.052973 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 139408us
W20260709 13:10:13.014369 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 393475us
I20260709 13:10:13.056102 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:13.056676 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:12.990283 22832 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:13.026479 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.046276 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.058944 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:13.063753 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:13.061856 23010 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:13.065009 23010 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.065352 23010 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.066076 23093 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:13.066211 22832 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.066864 22832 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.068418 19372 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:13.069890 23033 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:13.012217 22977 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.072414 22939 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.078768 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.079439 19294 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
W20260709 13:10:13.080858 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.089304 19374 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:13.099112 19294 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:13.107643 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.116338 19224 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:13.058194 23126 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:13.117115 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1836) took 2042 ms (client timeout 1901 ms). Trace:
W20260709 13:10:13.120136 19216 rpcz_store.cc:269] 0709 13:10:11.073411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.482890 (+409479us) service_pool.cc:224] Handling call
0709 13:10:13.115423 (+1632533us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54003d1b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:13.115848 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62210816}
I20260709 13:10:13.010820 23076 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:13.126636 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62959.1us
W20260709 13:10:13.118033 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56782.5us
I20260709 13:10:13.129876 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:13.128887 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:13.137126 23071 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:13.137151 23202 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:10:13.125982 23166 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.132432 22706 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:10:13.144459 23166 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.144857 23166 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.149860 23010 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.152917 23182 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:13.154771 23076 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:13.155965 23012 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:13.157115 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.118942 22939 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:13.160259 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:13.162604 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:13.118367 23209 raft_consensus.cc:2764] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:13.164546 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2048) took 1651 ms. Trace:
I20260709 13:10:13.176652 19370 rpcz_store.cc:276] 0709 13:10:11.513130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.108633 (+595503us) service_pool.cc:224] Handling call
0709 13:10:12.109010 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:12.109378 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.109421 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:12.109948 (+   527us) log.cc:844] Serialized 52 byte log entry
0709 13:10:12.537171 (+427223us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:12.538951 (+  1780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.539126 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.164245 (+625119us) raft_consensus.cc:1685] finished
0709 13:10:13.164274 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.164470 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41534,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":305650,"threads_started":1,"wal-append.queue_time_us":577746}
I20260709 13:10:13.158324 23010 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:13.143754 22872 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.175745 23071 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:13.180454 19220 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:13.180750 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2167) took 2976 ms. Trace:
I20260709 13:10:13.127605 23126 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:10:13.188331 19220 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:13.192708 19220 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.193682 19220 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.188648 19219 rpcz_store.cc:276] 0709 13:10:10.204146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.541441 (+2337295us) service_pool.cc:224] Handling call
0709 13:10:12.604390 (+ 62949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.604673 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:12.753063 (+148390us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.168233 (+415170us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.180407 (+ 12174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:13.180456 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:13.180503 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.180569 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.180698 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31391,"prepare.queue_time_us":26540,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":41572,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3716,"thread_start_us":512775,"threads_started":2}
I20260709 13:10:13.166631 23082 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.128441 23213 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:10:13.189217 23071 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.181326 23215 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:13.187891 22939 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.225761 23193 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:13.236959 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.239943 23132 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.259308 23215 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.300828 23215 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.301715 23132 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.302470 19220 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:10:13.249348 23081 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.302862 19220 pending_rounds.cc:85] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 8
I20260709 13:10:13.303118 19220 pending_rounds.cc:107] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:10:13.303344 19220 raft_consensus.cc:2889] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.251216 23190 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:13.304436 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:13.304714 23081 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.305073 19220 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 2.
W20260709 13:10:13.306008 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.306226 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:13.252588 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.201797 23071 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.193904 23204 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:10:13.224666 23199 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:13.262825 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:13.296543 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.315260 19220 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:13.199342 22743 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 13:10:13.311065 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.308445 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:13.315781 19220 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:13.322077 19220 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.323364 19220 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:13.325610 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.327497 19372 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:13.305120 22951 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:13.331815 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.334036 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.318720 23216 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:10:13.313812 23081 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.337038 22984 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.347538 22984 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.328852 23001 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.349399 23001 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:13.349848 23001 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.354054 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:13.375691 22743 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:13.334412 23203 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:13.378880 22743 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.380573 23133 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.381114 22743 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:13.387074 23149 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:13.389649 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1835) took 2316 ms. Trace:
I20260709 13:10:13.390146 19225 rpcz_store.cc:276] 0709 13:10:11.073143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.849810 (+1776667us) service_pool.cc:224] Handling call
0709 13:10:12.850125 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.051656 (+201531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.389334 (+337678us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400018bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:13.389568 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452465408}
W20260709 13:10:13.335078 23219 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:10:13.392320 23146 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.393680 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 744) took 1806 ms. Trace:
I20260709 13:10:13.341653 23081 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.331549 23199 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.394225 19895 rpcz_store.cc:276] 0709 13:10:11.587482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.587769 (+   287us) service_pool.cc:224] Handling call
0709 13:10:11.608357 (+ 20588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.658185 (+ 49828us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:11.663405 (+  5220us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.967612 (+304207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.967661 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:11.967722 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.393388 (+1425666us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b54004f0954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:13.393448 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.393607 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74149,"prepare.queue_time_us":5490,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":63219,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5378,"spinlock_wait_cycles":114092928,"thread_start_us":252044,"threads_started":1,"wal-append.queue_time_us":359279,"wal-append.run_cpu_time_us":1813,"wal-append.run_wall_time_us":1111723}
I20260709 13:10:13.411056 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1860) took 1348 ms. Trace:
W20260709 13:10:13.424430 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70478.1us
I20260709 13:10:13.403319 23082 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.425530 23190 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.427870 23190 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.430476 19898 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:10:13.433692 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 304850us
W20260709 13:10:13.401273 23208 log.cc:927] Time spent T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:10:13.436640 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 513089us
I20260709 13:10:13.441334 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:13.445174 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:13.446461 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:13.449489 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:13.424917 19296 rpcz_store.cc:276] 0709 13:10:12.062639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.590777 (+528138us) service_pool.cc:224] Handling call
0709 13:10:12.591253 (+   476us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:12.606927 (+ 15674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.606954 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:12.607634 (+   680us) log.cc:844] Serialized 78 byte log entry
0709 13:10:12.694524 (+ 86890us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:12.703899 (+  9375us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.753659 (+ 49760us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.753874 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.753955 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.407919 (+653964us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b18003ae820. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:13.410713 (+  2794us) raft_consensus.cc:1685] finished
0709 13:10:13.410752 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.410972 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15228,"prepare.queue_time_us":23049,"prepare.run_wall_time_us":2704,"raft.queue_time_us":39067,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":28165,"spinlock_wait_cycles":55955456,"thread_start_us":69902,"threads_started":1,"wal-append.queue_time_us":139297}
I20260709 13:10:13.427420 23082 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:13.463937 23048 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:13.465255 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:13.468546 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.469195 19369 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:13.471251 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:13.471498 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.471896 19296 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.459990 23214 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:13.461423 23147 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.461760 23149 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.472273 22742 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:10:13.490352 19894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 750) took 1893 ms (client timeout 1577 ms). Trace:
W20260709 13:10:13.490852 19894 rpcz_store.cc:269] 0709 13:10:11.596756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.596867 (+   111us) service_pool.cc:224] Handling call
0709 13:10:13.490135 (+1893268us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54001eee54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:13.490273 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39885696}
I20260709 13:10:13.493055 23019 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:13.465117 22553 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:13.493909 22553 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.471119 23048 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.479172 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.497860 19902 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:13.467759 23082 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.496486 23169 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:13.476130 23190 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:13.505596 19296 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:10:13.506057 23015 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.007s
I20260709 13:10:13.508807 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.510264 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.508355 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.514072 19294 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:13.514397 19296 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:13.515414 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:13.517810 23215 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.510218 23077 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:10:13.510285 22742 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:13.522294 22742 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:13.523082 22742 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.524228 22742 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.479501 23147 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:13.629318 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.645766 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:13.506464 23214 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:13.672089 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 160839us
I20260709 13:10:13.497480 23149 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.673442 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:13.689271 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:13.507936 23222 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.510016 23081 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.671605 23169 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:13.520056 23215 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:13.752677 19903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 746) took 2160 ms (client timeout 1562 ms). Trace:
I20260709 13:10:13.740721 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 639) took 1612 ms. Trace:
W20260709 13:10:13.752053 19222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1837) took 2678 ms (client timeout 3364 ms). Trace:
I20260709 13:10:13.740403 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.758249 19296 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:13.748508 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.758499 19901 rpcz_store.cc:276] 0709 13:10:12.128038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.166713 (+ 38675us) service_pool.cc:224] Handling call
0709 13:10:12.219548 (+ 52835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.504484 (+284936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.740516 (+1236032us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54006a5c50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:13.740659 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120854272}
W20260709 13:10:13.757886 19222 rpcz_store.cc:269] 0709 13:10:11.073664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.212693 (+1139029us) service_pool.cc:224] Handling call
0709 13:10:13.751850 (+1539157us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:13.751994 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68433664}
I20260709 13:10:13.749783 19218 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:13.763027 19218 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:13.703089 23228 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:10:13.509961 23015 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.763753 19218 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.772835 19218 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.773646 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:13.761936 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:13.757717 19903 rpcz_store.cc:269] 0709 13:10:11.592756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.592889 (+   133us) service_pool.cc:224] Handling call
0709 13:10:13.752376 (+2159487us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400750154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:13.752587 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167025920}
I20260709 13:10:13.653136 23147 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:13.741523 23166 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.010s
I20260709 13:10:13.672911 23048 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:13.718065 23183 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.005s
I20260709 13:10:13.779135 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:13.785416 19296 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.708112 23214 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.786161 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:13.711484 23149 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.789433 23199 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:13.789573 23229 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:10:13.794935 19296 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:13.791201 19216 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:10:13.794930 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.788376 22991 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.004s
I20260709 13:10:13.720315 22553 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.753821 23222 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.810050 23001 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:13.811354 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.812809 22969 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:10:13.813546 22965 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.802601 23125 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:13.823450 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:13.830870 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.831660 19373 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:13.832751 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.833560 19365 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:13.829319 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:13.785120 23166 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.827140 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.834434 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:13.834481 19371 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:13.835117 23054 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:13.835391 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:13.885769 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 200331us
I20260709 13:10:13.835489 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:13.836246 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.836802 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:13.887305 19369 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:13.831089 23125 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:13.838119 19370 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:13.836820 22702 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:10:13.852828 19219 raft_consensus.cc:2368] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9.
I20260709 13:10:13.821419 22991 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:13.838637 23008 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.859234 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.828063 23169 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:13.872969 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.918674 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.879765 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.886662 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.921522 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.888329 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53963.5us
I20260709 13:10:13.925310 19901 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:13.925809 19901 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:10:13.884979 23223 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:10:13.931454 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:13.934015 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:13.938376 19902 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:13.926688 19901 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:13.906538 23020 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:13.928316 23008 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.948103 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.956902 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.967212 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:13.968787 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.939488 23054 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:13.957238 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.972146 19897 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:13.972344 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.973563 19902 raft_consensus.cc:2410] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:13.944048 23183 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:10:13.977672 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.980630 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.956342 19901 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.937325 23199 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:13.991110 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:13.991204 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.992640 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.993901 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:13.964715 23008 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.953107 23015 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:13.998962 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.964495 22932 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:14.006598 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:14.007440 19902 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:13.970340 23020 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:14.009871 23020 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:13.985973 23215 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.013715 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:14.017485 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:14.018267 19894 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.019690 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:14.021174 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:14.006994 22932 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:14.025970 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.024556 22932 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.012010 23222 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:13.988780 23183 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:14.024080 22939 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.713s	user 0.019s	sys 0.000s
I20260709 13:10:14.013739 23001 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:14.015483 23126 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:14.020586 22920 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.045236 19901 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:14.001737 23199 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:14.029850 23188 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:14.048859 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.052028 19897 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:14.055922 23199 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.021577 23215 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:14.057585 19366 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:14.059181 23215 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:14.060827 23071 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.743s	user 0.018s	sys 0.006s
I20260709 13:10:14.044108 23054 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.061234 23071 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.061597 23188 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.063164 23071 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.068121 19894 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:14.072886 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:14.074131 19901 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:14.068269 23204 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.082218 22991 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:14.082923 23166 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.084290 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:14.049901 22939 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:14.091141 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:14.093061 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.093535 19300 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:14.097920 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:14.099560 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:14.110148 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:14.112365 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:14.050899 23222 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:14.115656 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.117714 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:14.103745 23109 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:14.117199 19220 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:14.119385 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:14.121659 19300 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:14.101600 22965 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:14.109701 23188 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:14.113631 23126 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:14.120131 23082 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.006s
I20260709 13:10:14.133371 19300 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:14.135799 19300 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:14.118549 23222 consensus_queue.cc:1243] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:14.123945 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.123320 22869 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:14.077174 23204 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:14.145390 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 153742us
I20260709 13:10:14.127414 23209 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:14.147425 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:14.140940 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.150599 19220 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:14.129981 23126 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.152071 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.152868 19300 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:13.964188 23125 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:14.166976 23125 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.169986 22932 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.171348 23008 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.173036 22932 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.173214 19299 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:14.148043 22869 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.144865 23188 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:14.155719 23126 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.137957 23082 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.196924 19300 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:14.156021 23209 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:14.198623 19300 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:14.174196 23037 consensus_queue.cc:1175] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d50eb2dab6754df8bcbed1445f2e8430" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 13:10:14.192062 22869 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.195281 22932 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.194175 22939 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:14.217463 19222 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:14.196146 23190 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.216140 19300 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.225534 19300 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.215407 23183 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.249776 22640 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:14.250525 22742 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.726s	user 0.005s	sys 0.007s
I20260709 13:10:14.224234 22939 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.254839 19902 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:14.255137 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:14.256501 23237 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:10:14.256737 19370 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:14.258085 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:14.258962 19225 raft_consensus.cc:2410] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:14.259116 19368 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:14.260183 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:14.260890 22939 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:14.259809 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:14.262022 19225 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:14.262553 19188 leader_election.cc:336] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Timed out: RequestConsensusVote RPC to 127.17.171.196:38805 timed out after 1.520s (SENT)
I20260709 13:10:14.263007 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:14.263445 19367 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.261034 19365 raft_consensus.cc:2410] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:14.258200 19370 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:14.221190 23236 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.278960 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:14.279395 19300 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:14.281677 19365 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:14.272017 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 124674us
I20260709 13:10:14.218961 23147 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.237819 23054 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:14.286953 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:14.222270 22932 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.292554 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:14.289620 19225 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:14.271076 22742 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:14.301016 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:14.301640 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:14.305085 23252 raft_consensus.cc:2764] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:14.304942 23239 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:14.280433 23222 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:14.310169 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:14.310515 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.311424 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:14.311892 19225 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.304518 23048 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:14.316054 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:14.324339 19293 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:14.285619 23183 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:10:14.317711 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 122543us
I20260709 13:10:14.321492 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:14.325470 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:14.317426 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:14.327327 23193 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:14.282192 23236 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.329903 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:14.340204 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:14.335939 19293 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:14.336079 19300 raft_consensus.cc:2410] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:14.336354 19903 pending_rounds.cc:85] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 7
I20260709 13:10:14.341820 19903 pending_rounds.cc:107] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:10:14.342206 19903 raft_consensus.cc:2889] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.337419 19902 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:10:14.338860 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.327827 19225 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:10:14.271584 23188 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.346578 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.302549 22942 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:10:14.348519 19225 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:14.351125 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.300594 23054 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.356953 19225 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:14.358021 23054 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.353092 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:14.358212 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.354803 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:14.359527 19368 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:14.360014 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.361058 19225 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:14.362581 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.364084 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:14.364923 19225 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.313381 23222 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:14.303664 23209 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:14.369867 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1834) took 3298 ms (client timeout 2824 ms). Trace:
W20260709 13:10:15.173202 19217 rpcz_store.cc:269] 0709 13:10:11.071792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.084186 (+1012394us) service_pool.cc:224] Handling call
0709 13:10:14.369653 (+2285467us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b54000776d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:14.369790 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51598080}
I20260709 13:10:15.177028 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1829) took 5641 ms. Trace:
W20260709 13:10:15.178653 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1855) took 1431 ms (client timeout 1655 ms). Trace:
I20260709 13:10:15.177734 19218 rpcz_store.cc:276] 0709 13:10:09.535475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.265677 (+730202us) service_pool.cc:224] Handling call
0709 13:10:11.964725 (+1699048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.749678 (+1784953us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b5400138920. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb71c0 00007fe8d7eb8231 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c
0709 13:10:13.798319 (+ 48641us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:13.798348 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:13.798387 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:13.798418 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.798484 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.176367 (+1377883us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54001c4150. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.176698 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2995,"raft.queue_time_us":5244,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10712,"spinlock_wait_cycles":4005230592}
W20260709 13:10:15.179167 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.179204 19216 rpcz_store.cc:269] 0709 13:10:13.747556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.777489 (+ 29933us) service_pool.cc:224] Handling call
0709 13:10:15.178119 (+1400630us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b54001c3754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.178419 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4907776}
I20260709 13:10:15.181227 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:15.182032 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:15.183233 19218 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:14.372861 19223 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:14.510978 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.190399 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2166) took 4999 ms. Trace:
I20260709 13:10:15.190953 19223 rpcz_store.cc:276] 0709 13:10:10.192348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.527135 (+2334787us) service_pool.cc:224] Handling call
0709 13:10:14.372640 (+1845505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.188479 (+815839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.189934 (+  1455us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54000776d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.190174 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4243626240}
W20260709 13:10:14.510706 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 225617us
W20260709 13:10:15.193473 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2175) took 1750 ms (client timeout 1503 ms). Trace:
W20260709 13:10:14.646010 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1787) took 3255 ms (client timeout 1838 ms). Trace:
W20260709 13:10:15.194064 19219 rpcz_store.cc:269] 0709 13:10:13.442587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.449234 (+  6647us) service_pool.cc:224] Handling call
0709 13:10:15.192915 (+1743681us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54000e4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.193217 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925504384}
W20260709 13:10:15.194865 19291 rpcz_store.cc:269] 0709 13:10:11.390594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.491894 (+101300us) service_pool.cc:224] Handling call
0709 13:10:14.645738 (+3153844us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540004ced4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:14.645930 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436326272}
I20260709 13:10:14.408031 19225 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:14.484288 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 134042us
I20260709 13:10:15.196965 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1862) took 1447 ms. Trace:
I20260709 13:10:14.534538 19365 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:15.197638 19225 rpcz_store.cc:276] 0709 13:10:13.749324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.363796 (+614472us) service_pool.cc:224] Handling call
0709 13:10:15.196737 (+832941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:15.198194 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2165) took 5040 ms. Trace:
I20260709 13:10:15.199193 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:15.201493 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:15.201701 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 884128us
I20260709 13:10:15.198717 19224 rpcz_store.cc:276] 0709 13:10:10.157592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.523917 (+2366325us) service_pool.cc:224] Handling call
0709 13:10:13.115547 (+591630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.116816 (+  1269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.197718 (+2080902us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54003d1b50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.198025 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251069184}
I20260709 13:10:14.406353 19299 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:15.203471 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:15.183851 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2189) took 1357 ms. Trace:
I20260709 13:10:15.205276 19218 rpcz_store.cc:276] 0709 13:10:13.825972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.180575 (+1354603us) service_pool.cc:224] Handling call
0709 13:10:15.183756 (+  3181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:15.206509 19225 raft_consensus.cc:2410] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:15.183133 19216 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
W20260709 13:10:15.068252 23190 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.004s
W20260709 13:10:14.683161 19898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 644) took 2166 ms (client timeout 2067 ms). Trace:
W20260709 13:10:14.503057 23250 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:10:14.490264 23233 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
W20260709 13:10:14.878093 23201 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.127s	user 0.000s	sys 0.002s
W20260709 13:10:14.416895 23244 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 13:10:14.473963 23251 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:10:14.535676 23149 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.001s
I20260709 13:10:14.661748 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1883) took 1704 ms. Trace:
I20260709 13:10:15.508497 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 641) took 3438 ms. Trace:
I20260709 13:10:16.266462 19899 rpcz_store.cc:276] 0709 13:10:12.043697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.043870 (+   173us) service_pool.cc:224] Handling call
0709 13:10:12.217831 (+173961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.542413 (+324582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.893881 (+2351468us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54006a68d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.478005 (+584124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399433984}
I20260709 13:10:15.675639 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:16.268896 19223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2194) took 2332 ms (client timeout 3010 ms). Trace:
W20260709 13:10:16.269310 19223 rpcz_store.cc:269] 0709 13:10:13.936108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.675090 (+1738982us) service_pool.cc:224] Handling call
0709 13:10:16.268837 (+593747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.270772 19223 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.271390 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2181) took 2811 ms. Trace:
W20260709 13:10:15.671327 19898 rpcz_store.cc:269] 0709 13:10:12.517034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.690792 (+173758us) service_pool.cc:224] Handling call
0709 13:10:14.682833 (+1992041us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54006801d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:14.683046 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665695104}
W20260709 13:10:15.506459 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50054.6us
I20260709 13:10:16.273550 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:15.765069 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.780121 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1864) took 2922 ms. Trace:
I20260709 13:10:16.275823 19295 rpcz_store.cc:276] 0709 13:10:12.857729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.857912 (+   183us) service_pool.cc:224] Handling call
0709 13:10:12.858218 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.332593 (+1474375us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b18003fe9e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7eadbfb 00007fe8d7eb864b
0709 13:10:14.332746 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.332773 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.333291 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.440924 (+107633us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:14.440968 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.441062 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.779411 (+1338349us) raft_consensus.cc:1685] finished
0709 13:10:15.779457 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.779829 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4323,"raft.queue_time_us":60406,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10828,"spinlock_wait_cycles":16387456,"thread_start_us":186789,"threads_started":2,"wal-append.queue_time_us":1219710}
I20260709 13:10:15.196655 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2145) took 7127 ms. Trace:
I20260709 13:10:16.278234 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.279292 19217 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:16.278136 19221 rpcz_store.cc:276] 0709 13:10:08.069622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.639688 (+1570066us) service_pool.cc:224] Handling call
0709 13:10:12.718452 (+3078764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.718643 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:12.752111 (+ 33468us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.915103 (+162992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:12.915171 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:12.915252 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.915339 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:13.348103 (+432764us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b180040bd00. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:15.196215 (+1848112us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b540039a8d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.196472 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48300,"prepare.queue_time_us":33837,"prepare.run_cpu_time_us":1648,"prepare.run_wall_time_us":6612,"raft.queue_time_us":48950,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10869,"spinlock_wait_cycles":7110516352,"thread_start_us":114245,"threads_started":1,"wal-append.queue_time_us":191681,"wal-append.run_cpu_time_us":964,"wal-append.run_wall_time_us":1001151}
I20260709 13:10:16.281308 19221 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:16.281889 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2182) took 2820 ms. Trace:
I20260709 13:10:16.282181 19221 rpcz_store.cc:276] 0709 13:10:13.461772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.280724 (+2818952us) service_pool.cc:224] Handling call
0709 13:10:16.281085 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.281672 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.281839 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.283623 19221 pending_rounds.cc:85] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 7
I20260709 13:10:16.283869 19221 pending_rounds.cc:107] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 9.8
W20260709 13:10:15.810070 19191 connection.cc:256] RPC call timeout handler was delayed by -1.3788286000000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:10:14.546409 19297 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:15.827442 19903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.033s	sys 0.036s
W20260709 13:10:15.840889 19188 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.577s	user 0.017s	sys 0.031s
W20260709 13:10:15.834159 19339 connection.cc:256] RPC call timeout handler was delayed by -2.2221493349999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2824s for a response
I20260709 13:10:15.852118 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1864) took 2102 ms. Trace:
I20260709 13:10:15.868000 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:15.889779 19294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.450s	user 0.000s	sys 0.026s
I20260709 13:10:15.907733 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:14.673357 22553 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:14.665616 22869 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:16.324302 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50926.5us
I20260709 13:10:16.325361 22869 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:15.535390 22990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.528s	user 0.068s	sys 0.094s
W20260709 13:10:16.328763 22990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.361s	user 0.072s	sys 0.094s
I20260709 13:10:14.441733 23008 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.560684 22932 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:15.540025 22939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.017s	sys 0.052s
W20260709 13:10:16.345377 22939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.942s	user 0.019s	sys 0.053s
I20260709 13:10:14.665405 23126 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.346407 19120 catalog_manager.cc:5697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 9, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 9 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:16.348979 23126 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:14.892764 22984 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.796103 23183 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.352523 23183 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.355060 23183 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:14.441423 23082 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:15.531567 23137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.006s	sys 0.019s
W20260709 13:10:15.557814 23199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.023s	sys 0.013s
I20260709 13:10:15.548520 23145 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:14.670122 22942 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:15.484494 22969 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:16.375031 22969 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:15.553146 23134 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.530200 23050 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.369985 23048 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.535988 23147 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:16.412814 19339 connection.cc:256] RPC call timeout handler was delayed by -1.8708919769999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260709 13:10:15.571583 23149 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.415203 22952 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.415665 23149 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:15.802718 23144 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.417140 23144 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.419406 23144 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:15.507758 23169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.223s	user 0.031s	sys 0.027s
W20260709 13:10:16.421248 23169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.175s	user 0.033s	sys 0.027s
I20260709 13:10:15.508469 23188 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.422994 23188 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:15.538858 23190 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.896636 23204 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:15.579497 23222 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:14.549727 23236 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:15.538432 23239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.185s	user 0.020s	sys 0.040s
W20260709 13:10:16.432121 23239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.126s	user 0.021s	sys 0.041s
I20260709 13:10:16.432632 23239 consensus_queue.cc:1243] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:10:14.870846 23246 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.621s	user 0.003s	sys 0.000s
I20260709 13:10:15.926926 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 652) took 2042 ms. Trace:
I20260709 13:10:16.451704 19895 rpcz_store.cc:276] 0709 13:10:13.467100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.467217 (+   117us) service_pool.cc:224] Handling call
0709 13:10:13.477895 (+ 10678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.505749 (+ 27854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.505769 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:13.505797 (+    28us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:13.505821 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.939392 (+1433571us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b5400780354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:15.446213 (+506821us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.504609 (+ 58396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63638784}
I20260709 13:10:15.524137 23255 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:16.454784 23255 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:15.806594 23264 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:15.803750 23270 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.460851 23264 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.461678 23270 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:15.808305 23274 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.929849 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 662) took 1643 ms (client timeout 1511 ms). Trace:
W20260709 13:10:16.465206 19365 rpcz_store.cc:269] 0709 13:10:14.286606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.286729 (+   123us) service_pool.cc:224] Handling call
0709 13:10:15.929382 (+1642653us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400197654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.929564 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568039296}
I20260709 13:10:16.465824 23188 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.465371 23274 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:15.903329 23263 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.410s	user 0.002s	sys 0.000s
W20260709 13:10:15.941653 19263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.617s	user 0.002s	sys 0.010s
W20260709 13:10:16.472014 19263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.148s	user 0.003s	sys 0.011s
W20260709 13:10:15.066880 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.004s
W20260709 13:10:15.947783 19222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2178) took 2496 ms (client timeout 1819 ms). Trace:
I20260709 13:10:15.228427 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2180) took 1758 ms. Trace:
I20260709 13:10:16.473662 19216 rpcz_store.cc:276] 0709 13:10:13.459923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.181459 (+1721536us) service_pool.cc:224] Handling call
0709 13:10:15.218410 (+ 36951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.009496 23166 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.010367 23150 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.017989 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.029417 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 835227us
I20260709 13:10:14.646137 19298 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:16.187512 22562 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:16.482059 23166 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.483100 22562 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.485463 22920 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.486184 22920 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.216706 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 656) took 2112 ms. Trace:
I20260709 13:10:16.220789 23143 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:16.501853 23143 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.502750 23166 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.224295 19219 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.226101 23283 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.227415 23275 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.236230 19366 rpcz_store.cc:276] 0709 13:10:12.957519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.959170 (+  1651us) service_pool.cc:224] Handling call
0709 13:10:13.012476 (+ 53306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:14.058029 (+1045553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.661457 (+603428us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:14.661678 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2402648960}
W20260709 13:10:16.279840 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 463) took 2222 ms (client timeout 2133 ms). Trace:
W20260709 13:10:15.855432 19299 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.004s
I20260709 13:10:16.271708 19223 rpcz_store.cc:276] 0709 13:10:13.460239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.270176 (+2809937us) service_pool.cc:224] Handling call
0709 13:10:16.270546 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.271128 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.271308 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.507160 19299 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:10:16.284585 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.285336 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1793) took 4807 ms. Trace:
W20260709 13:10:16.285513 19903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.933s	user 0.035s	sys 0.039s
W20260709 13:10:16.285567 19188 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.021s	user 0.018s	sys 0.032s
I20260709 13:10:16.284149 19221 raft_consensus.cc:2889] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.286218 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 464) took 2120 ms. Trace:
I20260709 13:10:16.509771 19224 rpcz_store.cc:276] 0709 13:10:14.165730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.867485 (+1701755us) service_pool.cc:224] Handling call
0709 13:10:16.286141 (+418656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.286923 19218 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:16.511317 19218 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:10:16.286499 19294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.856s	user 0.000s	sys 0.028s
W20260709 13:10:16.289121 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.297276 23037 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.513715 23283 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.514143 23275 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.514382 23037 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.516494 23037 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.516613 23283 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.516494 23275 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.517858 22920 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:16.518595 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 2.25438e+06us
I20260709 13:10:16.285692 19225 rpcz_store.cc:276] 0709 13:10:13.749787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.198731 (+1448944us) service_pool.cc:224] Handling call
0709 13:10:15.852031 (+653300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.316207 23285 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.317054 23247 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:16.535630 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2183) took 3068 ms. Trace:
W20260709 13:10:16.326783 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51741us
W20260709 13:10:16.358496 23137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.106s	user 0.006s	sys 0.019s
I20260709 13:10:16.359402 23271 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.360826 22879 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.360600 19120 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 10, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:10:16.365485 23199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.500s	user 0.023s	sys 0.016s
I20260709 13:10:16.374042 22942 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:16.382606 22932 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:16.386786 22969 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:16.387042 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.405396 23284 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.406332 23125 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.408092 23262 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.408733 23193 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.410316 23081 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:16.411036 22553 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.413334 19339 connection.cc:256] RPC call timeout handler was delayed by -1.7361493349999364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33640000000000003s for a response
W20260709 13:10:16.556264 19339 connection.cc:256] RPC call timeout handler was delayed by -1.6432065059999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:10:16.415907 22952 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.420354 19220 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:10:16.420311 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.445729 23136 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:16.457636 23255 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.464699 23264 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:16.472668 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 2.1484e+06us
W20260709 13:10:16.473199 19222 rpcz_store.cc:269] 0709 13:10:13.451145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.761699 (+310554us) service_pool.cc:224] Handling call
0709 13:10:15.947308 (+2185609us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54001b2954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:15.947555 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018380672}
W20260709 13:10:16.478289 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.968s	user 0.009s	sys 0.004s
I20260709 13:10:16.479204 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:16.479929 23270 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.480793 23150 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.482290 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1851) took 5078 ms. Trace:
I20260709 13:10:16.488363 19901 rpcz_store.cc:276] 0709 13:10:14.104676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.112768 (+  8092us) service_pool.cc:224] Handling call
0709 13:10:15.446185 (+1333417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.214165 (+767980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.214202 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.214283 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:16.214355 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.214418 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.216363 (+  1945us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54006801d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:16.216529 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314935552}
I20260709 13:10:16.498519 22965 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.500902 19367 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:10:16.506904 19217 rpcz_store.cc:269] 0709 13:10:14.057267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.175823 (+1118556us) service_pool.cc:224] Handling call
0709 13:10:16.279767 (+1103944us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.508363 19297 rpcz_store.cc:276] 0709 13:10:11.477639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.545793 (+3068154us) service_pool.cc:224] Handling call
0709 13:10:14.546181 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.284858 (+1738677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.285153 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.536262 19218 rpcz_store.cc:276] 0709 13:10:13.467343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.907327 (+2439984us) service_pool.cc:224] Handling call
0709 13:10:16.535534 (+628207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.533602 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2176) took 3058 ms. Trace:
W20260709 13:10:16.546748 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.545205 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.516963 23274 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:16.581730 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 62238.5us
I20260709 13:10:16.585306 22969 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.585493 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:16.552284 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.533022 23285 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:16.560542 23125 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:16.561506 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 1856) took 2813 ms (client timeout 1800 ms). Trace:
I20260709 13:10:16.562036 22553 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.587281 19367 pending_rounds.cc:85] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 6
I20260709 13:10:16.601568 19367 pending_rounds.cc:107] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:10:16.601887 19367 raft_consensus.cc:2889] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.564455 22562 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.564785 19896 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:16.617851 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:16.618484 19898 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:10:16.619503 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 640) took 4587 ms. Trace:
I20260709 13:10:16.565011 23193 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.566082 23081 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.568359 22932 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.627529 23284 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.553244 22879 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.570446 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.577647 23037 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:10:16.570664 19122 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 249) took 28754 ms (client timeout 15000 ms). Trace:
I20260709 13:10:16.586016 22969 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.586798 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:16.581141 19298 rpcz_store.cc:276] 0709 13:10:11.403455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.028355 (+624900us) service_pool.cc:224] Handling call
0709 13:10:14.645884 (+2617529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.479864 (+1833980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.481870 (+  2006us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b540004ced0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:16.482064 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6018891520}
W20260709 13:10:16.599491 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0629286000000775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 13:10:16.638398 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0314286000000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:10:16.583357 19219 rpcz_store.cc:276] 0709 13:10:13.450525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.223491 (+2772966us) service_pool.cc:224] Handling call
0709 13:10:16.224060 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.506582 (+282522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.509025 (+  2443us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:16.599618 19299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1819) took 2235 ms (client timeout 2851 ms). Trace:
I20260709 13:10:16.603313 23247 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.606684 23150 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.607173 22965 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.582746 23145 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.609359 22553 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.611414 23125 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.611719 19292 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:16.649675 22562 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.650486 22562 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:16.612310 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 133275us
I20260709 13:10:16.612922 19296 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:16.613160 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:16.613508 22920 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.660593 22920 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:16.661245 22920 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.663735 23288 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.664445 23288 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.664883 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:16.665901 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63845.3us
I20260709 13:10:16.614611 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:16.666396 22879 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.667166 23204 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.667014 23145 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.667377 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.668057 19217 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:16.668519 23265 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:16.669019 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.669642 19217 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:16.670575 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:16.671126 19217 raft_consensus.cc:2376] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3. Re-sending same reply.
W20260709 13:10:16.599006 19220 rpcz_store.cc:269] 0709 13:10:13.747834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.151757 (+403923us) service_pool.cc:224] Handling call
0709 13:10:16.561248 (+2409491us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54001d5454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:16.561426 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5209964928}
I20260709 13:10:16.672796 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.672977 19223 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.673516 19220 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:16.617169 22952 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.599074 23271 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.623070 23134 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:16.672117 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.613847 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.626714 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:16.627934 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2186) took 2924 ms. Trace:
I20260709 13:10:16.558346 23136 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:16.581432 23143 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.617106 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:16.639824 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1815) took 3170 ms. Trace:
W20260709 13:10:16.639803 19299 rpcz_store.cc:269] 0709 13:10:14.320482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.329629 (+  9147us) service_pool.cc:224] Handling call
0709 13:10:16.547604 (+2217975us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b540008fa54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:16.556303 (+  8699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150749568}
I20260709 13:10:16.626464 23019 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:16.646960 19225 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:16.658195 22932 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.658627 23284 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.659226 22991 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.601702 23270 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:16.659979 22969 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.666009 19222 raft_consensus.cc:2368] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9.
I20260709 13:10:16.667788 23204 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.668619 22553 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:16.619859 19896 rpcz_store.cc:276] 0709 13:10:12.032491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.032615 (+   124us) service_pool.cc:224] Handling call
0709 13:10:12.032896 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.618067 (+4585171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.619242 (+  1175us) spinlock_profiling.cc:243] Waited 4.53 s on lock 0x7b54004d0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:16.619434 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10420881664}
W20260709 13:10:16.621209 19337 connection.cc:256] RPC call timeout handler was delayed by -1.1625246820000257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 13:10:16.598881 23285 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.628916 23255 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.642560 19120 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 4 to 7, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 7 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:16.581221 23262 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.674455 22942 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.756033 22942 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:16.673887 19188 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Timed out: RequestConsensusVote RPC to 127.17.171.196:38805 timed out after 1.759s (SENT)
I20260709 13:10:16.761379 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:16.680522 19224 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.762523 22969 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.763669 22920 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.680655 19216 rpcz_store.cc:276] 0709 13:10:13.703655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.499488 (+2795833us) service_pool.cc:224] Handling call
0709 13:10:16.501866 (+  2378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.502181 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:16.568243 (+ 66062us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.627179 (+ 58936us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.627595 (+   416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.627640 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:16.627695 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.627756 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.627867 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57733,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":3151,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":186,"thread_start_us":110413,"threads_started":2}
I20260709 13:10:16.765833 22920 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.766548 19216 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.767277 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1860) took 3018 ms. Trace:
I20260709 13:10:16.767583 19216 rpcz_store.cc:276] 0709 13:10:13.748829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.765906 (+3017077us) service_pool.cc:224] Handling call
0709 13:10:16.766310 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.767041 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.767226 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.768510 19293 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:16.681193 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.769730 19218 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:16.771071 19218 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:16.771579 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1863) took 3022 ms. Trace:
I20260709 13:10:16.680497 23037 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.674444 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.677197 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.677847 23271 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.726127 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:16.724100 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:16.774296 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 151381us
I20260709 13:10:16.741314 19295 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:16.743894 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49951.4us
I20260709 13:10:16.748466 19223 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:10:16.728859 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:16.686731 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:16.702023 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.706346 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:16.753795 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:16.733484 19291 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:16.675683 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:16.771924 19218 rpcz_store.cc:276] 0709 13:10:13.749553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.770391 (+3020838us) service_pool.cc:224] Handling call
0709 13:10:16.770757 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.771387 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.771533 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.702169 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.737538 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:16.735049 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:16.715922 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75489.9us
I20260709 13:10:16.708597 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 661) took 2427 ms. Trace:
I20260709 13:10:16.685732 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:16.686234 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:16.739166 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:16.740474 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:16.705760 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:16.740756 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:16.687281 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:16.721240 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:16.813771 19897 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:16.738381 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:16.814870 19369 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:10:16.809980 19372 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:16.810875 19370 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:16.807931 19298 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:16.706393 23125 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:10:16.682063 22952 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:16.772089 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 98250.6us
I20260709 13:10:16.682699 23188 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.811322 19367 rpcz_store.cc:276] 0709 13:10:14.281526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.283746 (+  2220us) service_pool.cc:224] Handling call
0709 13:10:14.283983 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.638881 (+2354898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.708309 (+ 69428us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b5400094cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:16.708530 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5096809728}
I20260709 13:10:16.705552 19364 tablet_service.cc:1558] Processing DeleteTablet for tablet 78d1dbf9a24f4b489920281c72245ab4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:53982
I20260709 13:10:16.696254 23145 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.685179 19294 rpcz_store.cc:276] 0709 13:10:13.460059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.111385 (+651326us) service_pool.cc:224] Handling call
0709 13:10:14.126544 (+ 15159us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:14.317170 (+190626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.317201 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:14.325582 (+  8381us) log.cc:844] Serialized 52 byte log entry
0709 13:10:16.558815 (+2233233us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:16.567226 (+  8411us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.580375 (+ 13149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.601109 (+ 20734us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.601169 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:16.601187 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.630313 (+ 29126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7690,"prepare.queue_time_us":457,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":118972,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":74857,"thread_start_us":2271781,"threads_started":2,"wal-append.queue_time_us":1222293}
I20260709 13:10:16.727221 19120 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.695132 22562 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.819401 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:16.725519 22965 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.728142 23288 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.705269 23081 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.703920 23204 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.689581 23247 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.821548 19373 raft_consensus.cc:2410] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:16.726835 23193 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.696928 22932 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:16.704382 22553 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:16.884984 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 209463us
I20260709 13:10:16.701395 23270 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.724467 23284 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:10:16.734627 23293 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.681529 23136 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.890899 19293 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:10:16.754480 23262 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:16.693073 23134 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.875875 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2191) took 3002 ms. Trace:
I20260709 13:10:16.876036 19894 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 3: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:16.876555 22932 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:16.877065 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.877539 23037 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.879400 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2196) took 2882 ms. Trace:
W20260709 13:10:16.879922 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.701120 22991 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:16.880517 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 156629us
I20260709 13:10:16.892418 23264 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.880901 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:16.882016 19120 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 9 to 10, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 10 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:10:16.883409 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 157395us
I20260709 13:10:16.884001 23081 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.694269 23019 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:16.843303 19188 connection.cc:256] RPC call timeout handler was delayed by -2.3473667319999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 13:10:16.948626 19188 connection.cc:256] RPC call timeout handler was delayed by -2.3275667320000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:10:16.846011 22952 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.724973 23285 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.892763 19223 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:16.845844 23255 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:16.903457 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56575.1us
I20260709 13:10:16.905361 19220 rpcz_store.cc:276] 0709 13:10:13.857523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.813379 (+2955856us) service_pool.cc:224] Handling call
0709 13:10:16.823874 (+ 10495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.845816 (+ 21942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.845848 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.845898 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:16.859842 (+ 13944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.859909 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.860032 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.930979 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:16.932677 19217 rpcz_store.cc:276] 0709 13:10:13.997392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.840492 (+2843100us) service_pool.cc:224] Handling call
0709 13:10:16.878665 (+ 38173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.878949 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.878989 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.879047 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:16.879095 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.879172 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.879328 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:16.957541 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.936378 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:16.897662 22920 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.884656 22553 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:16.944823 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2193) took 3032 ms. Trace:
W20260709 13:10:16.949011 19188 connection.cc:256] RPC call timeout handler was delayed by -2.3122667320000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:10:16.813344 22969 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:16.972533 19120 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 8, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.973675 22969 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.974578 19120 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:16.975946 22969 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.850416 23188 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.979421 23188 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:16.980000 19365 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:16.963219 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2197) took 2957 ms. Trace:
I20260709 13:10:16.981556 19222 rpcz_store.cc:276] 0709 13:10:14.005648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.841234 (+2835586us) service_pool.cc:224] Handling call
0709 13:10:16.901199 (+ 59965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.962755 (+ 61556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.962811 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.962869 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:16.962923 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.963007 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.963155 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.983019 19222 pending_rounds.cc:85] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:16.983250 19222 pending_rounds.cc:107] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:16.983457 19222 raft_consensus.cc:2889] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.964901 19225 rpcz_store.cc:276] 0709 13:10:13.905104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.817913 (+2912809us) service_pool.cc:224] Handling call
0709 13:10:16.892260 (+ 74347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.937258 (+ 44998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.937305 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.937360 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:16.937410 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.937489 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.937637 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.968745 19373 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
W20260709 13:10:16.984429 19924 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc180 after lost signal to thread 18098
I20260709 13:10:16.985440 23247 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:16.985999 19924 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1360 after lost signal to thread 19157
I20260709 13:10:16.987466 23236 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:16.972294 19217 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:16.973207 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.943303 23264 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:16.987767 19924 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1f40 after lost signal to thread 19249
I20260709 13:10:17.009696 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.007894 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.017637 19220 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:17.069592 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2184) took 3549 ms. Trace:
W20260709 13:10:16.631904 19122 rpcz_store.cc:269] 0709 13:09:47.816148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.816366 (+   218us) service_pool.cc:224] Handling call
0709 13:10:16.570382 (+28754016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:06.103478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:06.104183 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:06.104238 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:10:06.104256 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:06.142011 (+ 37755us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:06.167493 (+ 25482us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:06.168997 (+  1504us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:10:06.195628 (+ 26631us) tablet.cc:701] Row locks acquired
0709 13:10:06.195680 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:10:06.195837 (+   157us) write_op.cc:270] Start()
0709 13:10:06.195983 (+   146us) write_op.cc:276] Timestamp: P: 1783602606195778 usec, L: 0
0709 13:10:06.196000 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:10:06.267845 (+ 71845us) log.cc:844] Serialized 8756 byte log entry
0709 13:10:07.629931 (+1362086us) op_driver.cc:464] REPLICATION: finished
0709 13:10:08.315916 (+685985us) write_op.cc:301] APPLY: starting
0709 13:10:08.339816 (+ 23900us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:08.340539 (+   723us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:08.340718 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:08.389907 (+ 49189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:08.390354 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:10:08.390413 (+    59us) write_op.cc:312] APPLY: finished
0709 13:10:08.390940 (+   527us) log.cc:844] Serialized 152 byte log entry
0709 13:10:08.407999 (+ 17059us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:08.428894 (+ 20895us) write_op.cc:454] Released schema lock
0709 13:10:08.444595 (+ 15701us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:08.445129 (+   534us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:08.445164 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3251766,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":518891,"apply.run_cpu_time_us":7128,"apply.run_wall_time_us":227038,"num_ops":22,"prepare.queue_time_us":135111,"prepare.run_cpu_time_us":24319,"prepare.run_wall_time_us":1043070,"raft.queue_time_us":231792,"raft.run_cpu_time_us":14821,"raft.run_wall_time_us":454099,"replication_time_us":1422011,"spinlock_wait_cycles":1206528,"thread_start_us":1153033,"threads_started":4,"wal-append.queue_time_us":805511,"wal-append.run_cpu_time_us":12428,"wal-append.run_wall_time_us":2265722}]]}
W20260709 13:10:17.070880 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116622us
I20260709 13:10:17.071370 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.071453 19224 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:17.071765 19924 debug-util.cc:398] Leaking SignalData structure 0x7b080039b3c0 after lost signal to thread 19324
W20260709 13:10:17.074100 19924 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6040 after lost signal to thread 19398
I20260709 13:10:16.991166 23252 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:10:16.989915 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 283706us
W20260709 13:10:16.990830 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46591.8us
I20260709 13:10:17.009217 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.072041 19221 rpcz_store.cc:276] 0709 13:10:13.485388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.282930 (+2797542us) service_pool.cc:224] Handling call
0709 13:10:16.283337 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.578869 (+295532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.578916 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:16.588044 (+  9128us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.898911 (+310867us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:16.898947 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.899078 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.033980 (+134902us) raft_consensus.cc:1685] finished
0709 13:10:17.034002 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.034149 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":255744,"threads_started":1,"wal-append.queue_time_us":402322}
W20260709 13:10:17.076216 19924 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbf00 after lost signal to thread 19927
W20260709 13:10:16.965571 19340 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.838s (SENT)
W20260709 13:10:17.082432 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 123737us
I20260709 13:10:17.083390 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.022576 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:17.093057 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.025007 19120 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.964284 22920 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:17.112145 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:16.965755 23239 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:17.092221 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:16.987907 23236 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:17.121259 19188 connection.cc:256] RPC call timeout handler was delayed by -1.81037285900004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 13:10:16.992427 23134 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:17.030102 22952 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:17.075984 23264 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.997515 22932 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:16.961089 23293 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:16.995826 23019 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.130775 23137 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:17.137746 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.090813 23143 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.153550 23143 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:16.997097 22879 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:10:17.126026 23275 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.146847 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 186799us
W20260709 13:10:17.147632 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 125258us
I20260709 13:10:17.148300 23001 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:17.150311 23293 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.124364 22942 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:17.143518 22991 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:17.152940 22969 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.157158 19897 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:17.146625 22553 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.125679 23239 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.127306 22920 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:17.164763 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.142180 23125 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:17.164746 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 79499us
I20260709 13:10:17.177430 19120 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 5 to 7, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 7 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:17.162972 19110 catalog_manager.cc:5028] TS c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): tablet 78d1dbf9a24f4b489920281c72245ab4 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:10:17.195050 19266 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.171368 23239 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.156128 23143 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:17.198846 19263 connection.cc:256] RPC call timeout handler was delayed by -2.46553799600008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:10:17.196058 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.169602 22942 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:17.201408 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.201954 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.173161 23125 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.209654 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.156389 22952 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.211956 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.211803 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:17.187980 23284 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:17.181934 22969 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.217370 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.203986 22942 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.218056 22553 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.220619 19899 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:17.194701 23252 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.213255 23125 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.192435 23001 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:17.223220 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 342364us
I20260709 13:10:17.222518 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:17.226401 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.229888 19900 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:17.190815 23275 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.224287 19894 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:17.223574 19263 leader_election.cc:336] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Timed out: RequestConsensusVote RPC to 127.17.171.196:38805 timed out after 1.661s (SENT)
I20260709 13:10:17.214577 23271 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.233269 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:17.236121 22969 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:17.220736 23270 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.232584 19120 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 8, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.223256 22991 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:17.245712 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56917.2us
I20260709 13:10:17.226895 23284 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:17.263095 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.265631 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.193529 23236 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.270030 19120 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 6 to 8, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.279060 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.279968 19894 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:17.244716 22879 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.284685 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.284686 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:17.229147 23252 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:17.294231 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 156038us
I20260709 13:10:17.294657 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:17.276873 23270 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:17.297464 19217 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:17.296525 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 465) took 3122 ms. Trace:
I20260709 13:10:17.299005 19218 rpcz_store.cc:276] 0709 13:10:14.174241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.850736 (+2676495us) service_pool.cc:224] Handling call
0709 13:10:16.937498 (+ 86762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.966465 (+ 28967us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:17.091563 (+125098us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.296132 (+204569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.296212 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:17.296272 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.296347 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.296471 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3608,"prepare.queue_time_us":25009,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":3344,"raft.queue_time_us":4428,"thread_start_us":151145,"threads_started":1}
I20260709 13:10:17.299136 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.284319 22879 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.305462 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:17.313915 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 99762.3us
I20260709 13:10:17.298615 23270 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.317342 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.318374 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:17.303182 22991 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.322119 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.323019 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.329336 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.308673 22879 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.335282 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:17.336374 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57774.3us
W20260709 13:10:17.340113 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.317850 22952 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:10:17.312723 23137 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:17.336815 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:17.354391 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.322235 23270 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.364660 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.334583 23284 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.329047 23081 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.367547 19120 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 1 to 2, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 2 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.333634 23134 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:17.364580 22969 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.369831 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:17.387697 19263 leader_election.cc:336] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Timed out: RequestConsensusVote RPC to 127.17.171.196:38805 timed out after 1.739s (SENT)
W20260709 13:10:17.379352 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 74400.4us
W20260709 13:10:17.373293 23307 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:10:17.344348 23293 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:17.392779 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.392431 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:17.367172 23255 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.371644 23315 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.395234 23247 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:17.395637 23304 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:10:17.372429 23310 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:10:17.384372 23262 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.461666 23262 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:17.462118 23262 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.396631 23019 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:17.463554 23019 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:17.464465 23019 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:17.465380 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 130554us
I20260709 13:10:17.465623 23019 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:17.465941 19263 connection.cc:256] RPC call timeout handler was delayed by -2.2713248210001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 13:10:17.466562 23271 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.371735 23134 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:17.468421 23134 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.377070 19120 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 4 to 6, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 6 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:10:17.470144 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.470608 19120 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 5, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.367172 23236 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:17.449662 23312 log.cc:927] Time spent T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:17.449846 22879 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.372821 23137 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:17.452294 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 68544.3us
I20260709 13:10:17.370477 23081 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:17.456382 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47233.8us
I20260709 13:10:17.457614 23315 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:17.410387 23255 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.458137 23247 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:17.373031 23314 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:17.377969 22952 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:17.455811 23125 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.499501 23081 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.503100 23255 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.502537 19120 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 5, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 5 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:17.507077 23313 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:10:17.532876 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.526716 22920 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.512329 22952 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:17.547500 23311 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:10:17.548982 23305 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:10:17.550784 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 775) took 3215 ms. Trace:
I20260709 13:10:17.551132 19903 rpcz_store.cc:276] 0709 13:10:14.335212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.335772 (+   560us) service_pool.cc:224] Handling call
0709 13:10:14.336103 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:16.553012 (+2216909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.557150 (+  4138us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:16.631302 (+ 74152us) log.cc:844] Serialized 52 byte log entry
0709 13:10:17.081748 (+450446us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:17.081792 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.102277 (+ 20485us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.550559 (+448282us) raft_consensus.cc:1685] finished
0709 13:10:17.550577 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.550727 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9240,"raft.queue_time_us":88111,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":35168,"thread_start_us":2548837,"threads_started":2,"wal-append.queue_time_us":596631}
I20260709 13:10:17.557819 23125 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:17.523316 23134 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.501557 23315 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.566210 23285 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.566941 23285 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.567314 23285 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:17.567656 23285 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.574956 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2192) took 3705 ms. Trace:
I20260709 13:10:17.575481 19219 rpcz_store.cc:276] 0709 13:10:13.869964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.822569 (+2952605us) service_pool.cc:224] Handling call
0709 13:10:16.895628 (+ 73059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.941461 (+ 45833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.941500 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.070428 (+128928us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.304031 (+233603us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:17.304069 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.304137 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.574723 (+270586us) raft_consensus.cc:1685] finished
0709 13:10:17.574741 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.574899 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4430,"raft.queue_time_us":16310,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":24523,"thread_start_us":159121,"threads_started":1,"wal-append.queue_time_us":369784}
W20260709 13:10:17.577368 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 73742.1us
I20260709 13:10:17.578375 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:17.580667 22952 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.584452 23321 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:17.584957 23321 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:17.585332 23321 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.586400 23001 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.579932 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.543241 23275 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:17.597282 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 263851us
I20260709 13:10:17.608129 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:17.594195 23306 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.296s	user 0.000s	sys 0.008s
W20260709 13:10:17.623345 19263 connection.cc:256] RPC call timeout handler was delayed by -2.1555618349999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:10:17.530179 22942 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.630370 23134 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:17.631438 23318 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:10:17.637022 22920 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:17.637663 23136 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.640547 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.640792 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2187) took 3864 ms. Trace:
W20260709 13:10:17.627315 23316 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:10:17.641652 22952 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.642230 23275 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.641263 19216 rpcz_store.cc:276] 0709 13:10:13.776794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.806355 (+3029561us) service_pool.cc:224] Handling call
0709 13:10:16.881632 (+ 75277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.882098 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:16.882128 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.149785 (+267657us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b2c00000f48. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:10:17.150232 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.298462 (+148230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.298520 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.300573 (+  2053us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.640422 (+339849us) raft_consensus.cc:1685] finished
0709 13:10:17.640453 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.640712 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8998,"raft.queue_time_us":10203,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":26131,"spinlock_wait_cycles":20999424,"thread_start_us":147361,"threads_started":1,"wal-append.queue_time_us":218271}
W20260709 13:10:17.646273 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.646683 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.648342 19263 connection.cc:256] RPC call timeout handler was delayed by -1.9766920040000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:10:17.656317 19263 connection.cc:256] RPC call timeout handler was delayed by -1.4796137120000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3205s for a response
W20260709 13:10:17.656774 19263 connection.cc:256] RPC call timeout handler was delayed by -1.2550752010000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 13:10:17.609453 23317 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:17.668031 19297 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:17.668182 22991 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.669051 22991 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:17.669449 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.669710 22991 consensus_queue.cc:1243] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:17.670038 19897 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.658842 23271 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.672600 23271 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.674703 23271 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.677336 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.677946 19299 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.678876 19897 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:17.679323 23315 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.681435 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.682678 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.683395 19296 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:17.685465 23315 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.689881 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.690546 19291 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.692561 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.693272 19298 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.693523 22942 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:17.697013 19295 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:17.698518 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.699252 19295 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:17.702878 19292 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:17.703902 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.704514 19292 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:10:17.705343 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.706574 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.707243 19293 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:17.644760 23188 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:17.653542 23134 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:10:17.653925 22920 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.609477 23239 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.661319 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.601907 23125 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:10:17.665827 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 86022.9us
I20260709 13:10:17.744673 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.708349 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:17.726315 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.739812 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 370017us
I20260709 13:10:17.735450 19902 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:10:17.732316 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:17.732676 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45523us
I20260709 13:10:17.727226 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.728655 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.668078 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.747772 19293 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:17.749020 19296 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:17.762256 19366 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:17.763600 19365 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:17.666927 23317 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:17.708124 23264 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 13:10:17.765491 19299 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:17.713567 22879 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.769707 19291 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:17.735103 23239 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.724591 23188 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:17.787599 19291 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:17.791539 19265 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.503s (SENT)
I20260709 13:10:17.739480 23270 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.794396 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.774338 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:17.775923 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130447us
I20260709 13:10:17.783234 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.730067 22920 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.795058 19295 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:17.806560 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.772604 23317 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.801652 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.773939 23019 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.732589 23143 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:10:17.726676 23285 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.822728 23285 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.792033 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.823774 22879 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:17.793393 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.824692 23193 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:17.801451 19292 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:17.825235 23193 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:17.807142 19369 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.807823 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.807965 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.808820 23188 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.827049 19299 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:17.813072 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.827797 19374 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.793081 23321 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.724891 23247 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.831733 19901 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:17.832001 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.832082 23247 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:17.832778 19297 raft_consensus.cc:2368] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:17.838009 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.839601 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.840794 19294 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:17.840706 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.841583 19292 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.841830 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.802134 23255 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.843071 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.844058 23255 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:17.844362 19366 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 13. Ops: []
I20260709 13:10:17.848253 22969 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:17.849017 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.850353 22969 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:17.850729 22969 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:17.851171 23252 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.812268 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.819885 23019 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.790887 23320 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:17.852867 23320 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.853266 23199 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:17.854379 23019 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.854954 23320 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:17.783456 23264 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.856810 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.857378 19371 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.857860 23264 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.859251 23262 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.819401 19368 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:17.774627 22562 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:10:17.861385 23262 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:17.831751 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.862792 19372 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:17.862486 23193 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.863471 23193 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.852329 23136 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.864147 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.865320 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.866408 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.867071 19372 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:17.867550 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.828796 23239 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:10:17.868851 23270 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.848578 19898 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:17.869190 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.793151 23275 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:10:17.870572 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.871215 19299 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
W20260709 13:10:17.872617 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 44152.4us
W20260709 13:10:17.873486 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.874191 19370 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:10:17.825824 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.979s (SENT) [suppressed 54 similar messages]
I20260709 13:10:17.852494 19296 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.867826 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.880856 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.882241 19299 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:17.884208 19298 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:17.888523 19368 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:17.889555 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 63770.8us
I20260709 13:10:17.827220 19291 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.893648 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.894997 19188 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:17.896227 23275 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:17.847643 23081 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.904968 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.905725 19297 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:17.905445 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.906522 19298 raft_consensus.cc:2376] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9. Re-sending same reply.
I20260709 13:10:17.903753 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.851553 22969 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:17.909283 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.909447 19374 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:17.909472 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.909940 19898 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:17.909308 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:17.911828 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.914044 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.841588 22920 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:17.915153 19369 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:17.917145 19371 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:17.921321 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:17.920621 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.918197 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.920751 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.917637 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.934265 19897 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.934388 19296 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:17.918774 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:17.935197 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.931762 19295 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:10:17.924718 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:17.935400 19222 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:17.888139 23143 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:17.936527 19298 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:17.932842 19368 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:17.938326 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 777) took 1325 ms. Trace:
W20260709 13:10:17.993076 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.993242 19901 rpcz_store.cc:276] 0709 13:10:16.613360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.616535 (+  3175us) service_pool.cc:224] Handling call
0709 13:10:16.695226 (+ 78691us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:10:16.695423 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.832142 (+1136719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.931084 (+ 98942us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540049f054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:17.938250 (+  7166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2607113984}
I20260709 13:10:17.942085 19373 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:17.945886 22969 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.940987 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:17.994843 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:17.912555 23315 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:17.958856 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.024487 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.947518 23317 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:17.971459 19897 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:17.945212 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:17.944438 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:17.946180 23081 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:18.026567 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:17.947111 23136 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.939163 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:18.032505 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:18.032914 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 93830.9us
I20260709 13:10:18.033064 19223 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.034132 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.987016 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:17.941463 19374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "0316f581086f40549fea44a772fc2dec"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:18.039019 19374 raft_consensus.cc:606] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Received request to transfer leadership to TS 0316f581086f40549fea44a772fc2dec
I20260709 13:10:18.039275 19372 raft_consensus.cc:2410] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:18.039500 19374 raft_consensus.cc:614] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.991317 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:17.987738 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:17.994004 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:17.995213 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.041939 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.042193 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.043430 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.043689 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.044387 19297 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:10:18.045410 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.045770 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.046517 19293 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:18.046779 19297 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:17.996050 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.002123 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.048146 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.048765 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.049891 19299 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:18.050907 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.051899 19299 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:17.948417 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 57734.9us
I20260709 13:10:18.025337 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.053839 19294 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:18.055029 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.055953 19294 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:18.028079 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.030936 19219 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.030858 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:18.057513 19902 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:18.031477 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.058171 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.059458 19294 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:18.061214 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.062336 19294 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.063395 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.051214 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.058502 19368 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.064682 19294 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:17.922574 23236 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.066548 19369 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.049628 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.068540 19297 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.068478 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.070464 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:18.070696 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83063.6us
I20260709 13:10:18.070493 19296 raft_consensus.cc:2376] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6. Re-sending same reply.
I20260709 13:10:18.070863 19297 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:17.992617 22942 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:18.080760 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.074491 23310 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:18.085325 19894 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:18.089265 19295 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
W20260709 13:10:18.106492 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.070322 23199 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:18.102114 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:18.084266 22920 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:18.096575 23255 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:18.118637 19901 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:18.107160 23310 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:18.123811 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:18.124056 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 178892us
I20260709 13:10:18.105687 22942 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:18.134106 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.135224 19296 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:18.084801 23262 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:18.130115 23310 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.146662 23330 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:18.123594 23326 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:18.152494 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.117384 22920 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:18.158234 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.166373 23252 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.171375 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.172370 22942 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.173305 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.176251 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.177232 19299 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:18.115950 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.181119 19297 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:18.182699 19223 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:18.193435 23317 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:18.200105 19365 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:18.201398 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:18.203596 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.121426 23199 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.162127 22920 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.207213 19291 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:18.214744 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.194779 23137 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:18.200495 23264 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.253949 23264 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:18.254405 23264 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.228631 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.230763 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.257732 19223 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
W20260709 13:10:18.229967 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 100495us
I20260709 13:10:18.238739 19292 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:18.240495 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:18.243780 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.208406 23270 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:18.163899 23326 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.251791 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:18.259215 19222 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:18.251963 23321 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:18.252628 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.263518 23320 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.290787 19367 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.229936 23150 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.223765 23143 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:10:18.321259 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.314468 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:18.262300 22562 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:10:18.358877 22952 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.294569 23270 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:18.359429 22952 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:18.360471 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46087us
I20260709 13:10:18.360373 23270 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.361709 22952 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:18.362197 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:18.330247 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.343889 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.335547 23326 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:18.315058 23255 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:18.337126 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.312501 23321 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:18.340272 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.340476 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.341740 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:18.342705 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:18.373648 19217 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.346853 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.354718 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.376317 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.295544 23330 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:18.329067 23136 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.364382 19374 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.365545 19367 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:18.339501 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:18.369208 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.370455 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.399398 19371 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:18.358175 23199 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:18.379278 19217 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.373018 19216 raft_consensus.cc:2376] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10. Re-sending same reply.
W20260709 13:10:18.384091 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.383845 23255 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.371378 22879 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:10:18.367815 23323 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.374692 23252 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:18.428265 19903 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:18.428514 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.298640 23320 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.306838 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.402525 19219 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.429204 19222 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:18.407325 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.437559 19365 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:18.410528 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.410851 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.440795 19372 raft_consensus.cc:2410] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:18.412004 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.414994 19373 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:18.417174 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.424971 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.431397 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.395619 23264 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:18.442479 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 213867us
I20260709 13:10:18.444139 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.444353 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.445024 19365 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.448844 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.414633 23323 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:18.465818 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.473138 19869 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.592s (SENT)
I20260709 13:10:18.483174 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.446687 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.483915 19368 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:18.484515 19373 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.484928 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.485347 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.485662 19368 raft_consensus.cc:2368] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:18.486552 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.487386 19373 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:18.488796 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.490217 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.491834 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.492324 22932 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.493062 22932 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.476581 19374 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:18.477492 19371 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:18.479334 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.500501 19372 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:18.448873 19222 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:18.520982 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.521984 19374 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:18.493533 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.544590 19895 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:18.557382 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52959.5us
I20260709 13:10:18.557935 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:18.561554 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.561609 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.566044 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.448186 23252 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:18.571528 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.574506 19373 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:18.569425 19366 raft_consensus.cc:2376] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9. Re-sending same reply.
I20260709 13:10:18.575948 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.578220 19222 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:18.568408 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 143503us
I20260709 13:10:18.568912 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.580928 19365 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:18.582172 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.560772 22932 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:18.516345 23323 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.583370 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:18.586725 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 142643us
I20260709 13:10:18.571271 23275 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.588662 19372 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:18.583827 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.589335 19374 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.590024 19372 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.590834 23320 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:18.592514 23264 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:18.593564 22562 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:18.593981 22562 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:18.594986 22562 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.599216 19374 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:18.600461 19374 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.587594 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.587635 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.605149 19366 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:18.612519 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.613410 19217 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:18.615567 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63983.8us
W20260709 13:10:18.617270 19265 leader_election.cc:336] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.501s (SENT)
I20260709 13:10:18.617903 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.619396 19365 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.620517 19373 raft_consensus.cc:2410] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:10:18.620538 19869 leader_election.cc:336] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.740s (SENT)
I20260709 13:10:18.622258 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:18.619287 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.582424 23348 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:18.624238 19374 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:10:18.626847 19374 pending_rounds.cc:85] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 4
I20260709 13:10:18.627177 19374 pending_rounds.cc:107] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:10:18.627506 19374 raft_consensus.cc:2889] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:18.624960 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:18.615658 22969 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.005s
I20260709 13:10:18.570478 22920 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.620716 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.621223 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.624575 19372 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:18.629457 19216 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.605186 23317 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.628453 19222 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:18.627069 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.625682 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:18.631553 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43983.5us
I20260709 13:10:18.634068 19219 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.635349 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.634933 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.619781 23354 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:18.621869 22562 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.619829 22932 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:18.639287 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.665336 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:18.666210 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.666651 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:18.667346 19899 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.667676 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:18.668543 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.669225 19371 raft_consensus.cc:2368] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:18.669632 19902 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:18.669663 19900 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.671566 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.672529 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.674305 19263 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.675431 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.676553 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:18.677310 19223 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.636991 19222 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:18.635955 19373 raft_consensus.cc:2376] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10. Re-sending same reply.
I20260709 13:10:18.677655 19219 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:18.639966 23252 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.641209 23247 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:18.641878 23354 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:18.642751 23353 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:18.650156 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:18.684154 19897 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:18.650429 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:18.656908 23344 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:10:18.586789 23330 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.633469 23348 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.629971 23264 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.678381 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.677660 22969 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.704885 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:18.709151 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58800.6us
I20260709 13:10:18.716619 19220 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.709321 19222 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:18.718385 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.718660 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.672538 23345 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:18.713589 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 93072.1us
I20260709 13:10:18.683743 23019 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.703217 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.684015 22932 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:18.735850 19367 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:18.720815 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:18.721815 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47586.5us
I20260709 13:10:18.719318 19222 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:18.738144 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.739491 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.740559 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:18.742532 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59267us
I20260709 13:10:18.744663 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.747001 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.754626 19899 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:18.719719 22969 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.756428 22969 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.757872 23348 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:18.759647 22932 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:18.754959 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.761102 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.760942 22932 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:18.762285 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.763108 19222 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.734324 23275 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:18.766665 19263 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
W20260709 13:10:18.768747 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 406606us
I20260709 13:10:18.769029 19263 leader_election.cc:403] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:10:18.769352 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50764.1us
I20260709 13:10:18.770378 19219 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:18.770601 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.740244 23321 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.721313 23356 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.772255 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:18.746133 22920 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:18.768949 23275 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.765004 23150 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.782287 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:18.781517 19224 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:18.763756 23353 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.777650 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:18.789924 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45393.9us
I20260709 13:10:18.791074 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:18.790012 19219 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:18.796173 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.802580 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:18.784726 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.805645 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:18.806658 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 84604.3us
I20260709 13:10:18.808672 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:18.775974 23356 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:18.812594 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.813261 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.817348 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:18.780284 23351 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:18.816149 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:18.821594 19224 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:18.825942 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:18.826507 19224 pending_rounds.cc:85] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 7
I20260709 13:10:18.826850 19224 pending_rounds.cc:107] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:10:18.789021 23275 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:18.822889 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 85153.9us
I20260709 13:10:18.829305 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.830356 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.830601 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:18.827875 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.827160 19224 raft_consensus.cc:2889] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:18.837137 19300 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:18.838584 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:18.839097 23341 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:10:18.820241 23355 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:18.783591 23019 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.790071 23150 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:18.797420 23247 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.798162 23348 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:18.847811 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:18.778609 23321 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.850234 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:18.811887 23288 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:18.854190 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d825739f94b747959f93597edca9200a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:18.808495 23236 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:18.886420 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.884038 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.888854 23362 raft_consensus.cc:2764] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:18.820406 23356 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.885571 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:18.911389 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.894868 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:18.915243 19370 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:18.849200 23247 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:18.918030 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:18.924695 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.853756 23255 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.863632 23348 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:18.893368 19373 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:10:18.931445 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 124819us
W20260709 13:10:18.867429 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.848632 23150 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.928453 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:18.890076 23019 raft_consensus.cc:2764] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:18.863116 22879 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:18.955456 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.956250 19340 leader_election.cc:336] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.514s (SENT)
I20260709 13:10:18.914901 23317 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.960809 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:18.960973 23323 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.962319 22969 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.914992 23288 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:18.923149 23353 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.924377 23247 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:18.980403 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.891069 19298 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:10:18.964453 19291 raft_consensus.cc:606] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:18.982580 19291 raft_consensus.cc:614] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:18.984587 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:18.985460 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 159568us
I20260709 13:10:18.950030 23348 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.993546 19222 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:18.994042 19221 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:18.978793 23236 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:18.931005 23255 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:18.987236 22991 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:19.017153 19340 leader_election.cc:336] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.798s (SENT)
I20260709 13:10:18.966424 23324 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:19.021406 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.021831 19299 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:19.022045 19295 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 3.
I20260709 13:10:19.023097 19296 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.962283 23275 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:19.028939 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.029124 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45212.7us
I20260709 13:10:19.017650 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:18.999961 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:18.989111 23361 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.027114 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:18.969508 23270 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:10:19.034883 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 102086us
I20260709 13:10:19.034847 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:19.035794 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:19.041687 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.042436 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:19.044014 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:19.043195 19897 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:19.012267 23236 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:19.036976 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:19.043190 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:19.036334 23357 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:10:19.017750 23373 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:19.064730 19299 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:19.046100 22952 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:19.067566 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:19.067713 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:19.066411 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:19.066725 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:19.038656 22879 raft_consensus.cc:2764] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:19.072777 19296 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:19.073134 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:19.051788 23081 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:19.052115 23236 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:19.082435 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.083498 19221 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:19.080771 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:19.097050 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.067426 23373 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.038800 23239 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:19.066533 23143 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.118057 19220 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:19.072857 22991 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.064822 23371 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:19.115998 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 307356us
I20260709 13:10:19.118805 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:19.119062 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77711.5us
I20260709 13:10:19.051605 23262 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:19.125732 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:19.126421 19298 raft_consensus.cc:2376] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10. Re-sending same reply.
I20260709 13:10:19.127533 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.122550 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.128876 19296 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:19.076737 23353 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.139036 19366 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.080804 23136 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.083609 23081 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:19.093442 23137 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:19.147260 23081 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.147893 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.149143 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.142639 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.153043 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.145228 19298 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:19.070775 23193 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:19.154268 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:19.094627 23264 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:19.157469 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 140253us
I20260709 13:10:19.158175 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:19.160910 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.055385 23288 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.120501 23373 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.159685 19295 raft_consensus.cc:2376] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10. Re-sending same reply.
W20260709 13:10:19.170264 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 89492.6us
I20260709 13:10:19.161983 23361 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.140959 23019 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:10:19.173506 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 126224us
I20260709 13:10:19.213244 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:19.187306 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 102298us
I20260709 13:10:19.211498 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:19.244344 19299 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:19.131738 23371 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.159930 23353 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:19.259392 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:19.261863 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 667) took 1263 ms. Trace:
I20260709 13:10:19.262396 19895 rpcz_store.cc:276] 0709 13:10:17.998800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.998946 (+   146us) service_pool.cc:224] Handling call
0709 13:10:17.999335 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.545090 (+545755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.261519 (+716429us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:19.261792 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253371776}
I20260709 13:10:19.160099 23330 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:19.183881 23375 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:19.248044 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:19.194109 22932 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:10:19.171442 23323 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.271749 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:19.269801 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:19.277305 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:19.278959 19374 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.212779 23321 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.278072 19372 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:19.284332 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62907.8us
W20260709 13:10:19.302502 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 144441us
I20260709 13:10:19.305680 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:19.302385 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:19.309500 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 145082us
I20260709 13:10:19.267728 23389 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.257985 23371 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.184345 23345 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:10:19.235208 22952 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:10:19.267107 23330 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:19.432799 23330 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.433857 23330 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:19.330619 19374 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:19.285450 23270 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:19.276762 23355 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.245215 23262 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:10:19.394395 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 88770.8us
I20260709 13:10:19.408710 23398 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.317976 23376 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
W20260709 13:10:19.410597 23387 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:10:19.411188 23368 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:10:19.393868 23255 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:19.266477 23264 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:10:19.414970 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 84248.6us
I20260709 13:10:19.477559 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:19.422812 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:19.428917 23150 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.268270 23378 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:10:19.248231 23361 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.456704 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:19.460695 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 249259us
W20260709 13:10:19.466431 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.505611 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:19.471630 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 194372us
I20260709 13:10:19.478173 19217 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:19.479822 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:19.482373 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:19.509722 19895 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:19.492936 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:19.441402 23270 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:19.449443 23275 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.508028 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:19.322678 23393 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 13:10:19.513293 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:19.519491 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:19.520156 19217 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:19.511247 23270 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.534458 19218 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:19.402199 23389 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:19.533043 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:19.527887 23335 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.044s	user 0.006s	sys 0.002s
I20260709 13:10:19.575798 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:19.520224 23137 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:19.549734 23368 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:19.532357 23390 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.595110 19217 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:19.528365 23402 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.465319 23355 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:19.595122 23356 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.004s
W20260709 13:10:19.656450 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.668469 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.518921 23391 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260709 13:10:19.684330 19374 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:19.631335 23364 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:10:19.662262 23387 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:19.603961 23390 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:19.709097 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 199679us
I20260709 13:10:19.666440 23255 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:19.733493 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 220250us
I20260709 13:10:19.706354 23390 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.740892 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:19.749027 19300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.088s	sys 0.144s
W20260709 13:10:19.750380 19300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.088s	sys 0.145s
I20260709 13:10:19.685077 23356 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:19.739950 23019 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:19.735113 22952 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:19.788748 23372 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 13:10:19.788789 23388 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.789636 23388 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:19.790196 23395 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:10:19.791432 23394 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.792150 23388 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:19.791993 23394 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:19.794883 23394 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:19.796411 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55596.9us
I20260709 13:10:19.796615 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1894) took 1033 ms. Trace:
I20260709 13:10:19.797138 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:19.796975 19224 rpcz_store.cc:276] 0709 13:10:18.762829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.826006 (+ 63177us) service_pool.cc:224] Handling call
0709 13:10:18.826331 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.837445 (+ 11114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.837491 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.838038 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.028274 (+190236us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:19.054162 (+ 25888us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.054386 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.054484 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.796403 (+741919us) raft_consensus.cc:1685] finished
0709 13:10:19.796425 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.796559 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15361,"prepare.queue_time_us":26735,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":132652,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":40756,"thread_start_us":189706,"threads_started":1,"wal-append.queue_time_us":292748}
I20260709 13:10:19.798107 23388 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:19.798739 23388 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:19.798887 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:19.799333 23388 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:19.773470 23019 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.774920 23255 raft_consensus.cc:2764] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:19.767618 23404 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:19.800159 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:19.940708 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:19.949460 19895 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:19.821184 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1916) took 1429 ms. Trace:
I20260709 13:10:19.680660 23402 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:19.958868 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 239941us
W20260709 13:10:19.960342 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 160230us
I20260709 13:10:19.778929 22952 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.817924 23348 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.000s
I20260709 13:10:19.975515 23348 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.975978 23293 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.976580 23293 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:19.977283 23373 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.004s
I20260709 13:10:19.977792 23348 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:19.796092 22991 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.000s
I20260709 13:10:19.977744 23373 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.978559 22991 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.978835 23293 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.979565 19368 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:19.816874 23356 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.980257 23412 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:19.980628 22952 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:19.981050 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1918) took 1564 ms. Trace:
I20260709 13:10:19.980854 23412 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:19.981423 19368 rpcz_store.cc:276] 0709 13:10:18.416895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.486265 (+ 69370us) service_pool.cc:224] Handling call
0709 13:10:19.259237 (+772972us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:10:19.980843 (+721606us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400197b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:19.980997 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661600640}
I20260709 13:10:19.983067 23412 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:19.811517 23247 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.818s	user 0.007s	sys 0.001s
I20260709 13:10:19.984448 23247 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:19.985308 19298 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:19.986655 23247 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.824227 23355 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.989807 19297 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:10:19.993680 23330 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.002s
I20260709 13:10:19.979875 23373 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:19.995450 23406 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:19.996032 23406 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:19.995959 22952 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.997048 23406 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.999398 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1891) took 1237 ms. Trace:
I20260709 13:10:19.999948 19222 rpcz_store.cc:276] 0709 13:10:18.761914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.794115 (+ 32201us) service_pool.cc:224] Handling call
0709 13:10:18.794476 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.002758 (+208282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.999056 (+996298us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400156dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:19.999280 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457237760}
I20260709 13:10:20.000900 22952 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:20.003029 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 30) took 1181 ms. Trace:
I20260709 13:10:20.005195 19298 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:20.003540 19291 rpcz_store.cc:276] 0709 13:10:18.842935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.843090 (+   155us) service_pool.cc:224] Handling call
0709 13:10:20.002746 (+1159656us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b54001db854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:20.002900 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180045056}
I20260709 13:10:20.011905 23255 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:19.979995 23293 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:20.013736 23293 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:20.016276 22879 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:20.016861 22879 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:20.017932 22879 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.018836 23293 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:20.025359 23351 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.160s	user 0.010s	sys 0.002s
W20260709 13:10:20.027453 23371 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
W20260709 13:10:19.824414 23081 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.001s
W20260709 13:10:19.815557 23236 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.000s
I20260709 13:10:19.818980 23019 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.800310 23403 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.811471 23389 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:19.823464 23404 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:20.042840 19373 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:19.812389 23361 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:19.983673 23270 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:19.817008 23150 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:20.023382 23390 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:20.047859 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 415178us
W20260709 13:10:20.048611 19371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.000s	sys 0.013s
W20260709 13:10:20.048987 19371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.000s	sys 0.014s
I20260709 13:10:19.955554 19366 rpcz_store.cc:276] 0709 13:10:18.391975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.621589 (+229614us) service_pool.cc:224] Handling call
0709 13:10:18.633561 (+ 11972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.158216 (+524655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.820917 (+662701us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54002d00d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:19.821095 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161904896}
W20260709 13:10:20.050921 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.057595 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 96247.1us
I20260709 13:10:20.059734 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:20.065970 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:20.066618 19365 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:20.067200 19365 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:10:20.038482 23351 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 5. Current term is 6.
I20260709 13:10:19.975883 23388 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:20.071157 19368 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:20.074092 19372 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 13. Ops: []
I20260709 13:10:20.074934 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:20.076504 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.004s	sys 0.010s
W20260709 13:10:20.076962 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.004s	sys 0.010s
I20260709 13:10:20.060592 23255 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.047219 22879 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:20.048210 23353 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.005s
I20260709 13:10:20.042114 23236 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.042258 23081 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.041930 23371 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.078080 23255 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.201341 23255 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:20.201998 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:20.202898 22932 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:20.203166 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:20.203307 22932 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.204218 22932 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.208065 23362 raft_consensus.cc:2764] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:20.208412 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:20.209450 23252 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:20.083389 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.081465 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:20.210363 19369 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:20.078437 23270 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:20.214484 22932 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.083516 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:20.085037 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:20.217368 23255 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:20.218321 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 134894us
W20260709 13:10:20.158018 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.162494 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:20.155987 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 699307us
I20260709 13:10:20.173604 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.429584 19218 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:22.430016 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2244) took 2271 ms. Trace:
I20260709 13:10:22.430260 19218 rpcz_store.cc:276] 0709 13:10:20.159203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.159402 (+   199us) service_pool.cc:224] Handling call
0709 13:10:22.429968 (+2270566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.173127 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:20.172657 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:20.160775 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:22.432157 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2249) took 2270 ms (client timeout 1665 ms). Trace:
I20260709 13:10:22.432457 19222 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
W20260709 13:10:22.432555 19221 rpcz_store.cc:269] 0709 13:10:20.161962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.162102 (+   140us) service_pool.cc:224] Handling call
0709 13:10:22.432087 (+2269985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.433027 19222 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:10:22.433439 19222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2246) took 2273 ms (client timeout 1914 ms). Trace:
W20260709 13:10:22.433722 19222 rpcz_store.cc:269] 0709 13:10:20.160303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.160462 (+   159us) service_pool.cc:224] Handling call
0709 13:10:22.433370 (+2272908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.158671 19223 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:20.161078 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:20.170034 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:20.122356 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.093030 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:20.109450 19293 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:20.150609 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1858) took 1105 ms. Trace:
I20260709 13:10:20.195874 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 602) took 1228 ms. Trace:
I20260709 13:10:22.446131 19295 rpcz_store.cc:276] 0709 13:10:19.044937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.045085 (+   148us) service_pool.cc:224] Handling call
0709 13:10:20.150335 (+1105250us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b54002b7fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:20.150493 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201070848}
I20260709 13:10:22.446946 19300 rpcz_store.cc:276] 0709 13:10:18.967960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.968101 (+   141us) service_pool.cc:224] Handling call
0709 13:10:18.995063 (+ 26962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.996771 (+  1708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.996811 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.997362 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.095635 (+ 98273us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:19.758265 (+662630us) log.cc:844] Serialized 14 byte log entry
0709 13:10:20.034807 (+276542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.034874 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.195527 (+160653us) raft_consensus.cc:1685] finished
0709 13:10:20.195558 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.195783 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24549,"prepare.queue_time_us":739487,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":44536,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":1341,"thread_start_us":1026242,"threads_started":3,"wal-append.queue_time_us":1188453,"wal-append.run_cpu_time_us":15254,"wal-append.run_wall_time_us":1163705}
W20260709 13:10:20.077236 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 778075us
I20260709 13:10:22.451443 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:20.083683 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:22.453135 19365 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.453310 23436 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:22.454636 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 2.36143e+06us
I20260709 13:10:20.084148 19367 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:20.814982 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.456732 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2105) took 2393 ms. Trace:
I20260709 13:10:22.457058 19367 rpcz_store.cc:276] 0709 13:10:20.063264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.063376 (+   112us) service_pool.cc:224] Handling call
0709 13:10:20.082192 (+ 18816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.456438 (+2374246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.456672 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.585966 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:22.454099 23436 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:20.537073 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 696) took 1276 ms. Trace:
I20260709 13:10:20.104408 19374 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.459681 19371 rpcz_store.cc:276] 0709 13:10:19.260839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.264771 (+  3932us) service_pool.cc:224] Handling call
0709 13:10:19.265236 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.049381 (+784145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.049408 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.067520 (+ 18112us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.536684 (+469164us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:20.536732 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.536809 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.536858 (+    49us) raft_consensus.cc:1685] finished
0709 13:10:20.536873 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.537010 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":329487,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":27052,"thread_start_us":1221065,"threads_started":2,"wal-append.queue_time_us":183623,"wal-append.run_cpu_time_us":30430,"wal-append.run_wall_time_us":2160430}
I20260709 13:10:22.460373 23441 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.462141 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2101) took 2416 ms. Trace:
I20260709 13:10:22.461926 23441 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.462524 19374 rpcz_store.cc:276] 0709 13:10:20.045336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.045481 (+   145us) service_pool.cc:224] Handling call
0709 13:10:20.045821 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.461026 (+2415205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.461919 (+   893us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b5400313154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:22.462088 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134217984}
W20260709 13:10:20.091763 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 148098us
W20260709 13:10:20.232712 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 268611us
I20260709 13:10:20.151224 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:22.466300 19899 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:20.122745 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 797) took 1806 ms. Trace:
I20260709 13:10:22.464000 23441 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:21.417171 19395 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ce0 after lost signal to thread 18095
W20260709 13:10:22.469960 19395 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa780 after lost signal to thread 18098
W20260709 13:10:22.470575 19868 connection.cc:256] RPC call timeout handler was delayed by -2.1839736699998866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:10:20.172214 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:22.471964 19894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 676) took 2307 ms (client timeout 1674 ms). Trace:
I20260709 13:10:22.467828 19901 rpcz_store.cc:276] 0709 13:10:18.316435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.329509 (+ 13074us) service_pool.cc:224] Handling call
0709 13:10:18.329883 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.565713 (+235830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.565748 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.582756 (+ 17008us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.798905 (+216149us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:18.798947 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.122345 (+1323398us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540049f054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:20.122394 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.122442 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:20.122453 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.122679 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6654,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7026,"spinlock_wait_cycles":280087296,"thread_start_us":177552,"threads_started":1,"wal-append.queue_time_us":283013,"wal-append.run_cpu_time_us":2292,"wal-append.run_wall_time_us":1108729}
W20260709 13:10:22.472337 19894 rpcz_store.cc:269] 0709 13:10:20.164777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.164943 (+   166us) service_pool.cc:224] Handling call
0709 13:10:22.471868 (+2306925us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.168813 19895 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:22.473543 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 1.88747e+06us
I20260709 13:10:22.473917 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 667) took 2322 ms. Trace:
I20260709 13:10:22.474236 19895 rpcz_store.cc:276] 0709 13:10:20.151575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.167987 (+ 16412us) service_pool.cc:224] Handling call
0709 13:10:20.168333 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.473652 (+2305319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.473853 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.169257 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:22.470966 19395 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6c60 after lost signal to thread 19157
I20260709 13:10:22.476696 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 677) took 2311 ms. Trace:
I20260709 13:10:22.477039 19898 rpcz_store.cc:276] 0709 13:10:20.165279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.165415 (+   136us) service_pool.cc:224] Handling call
0709 13:10:22.476640 (+2311225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.171892 19902 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 13. Ops: [11.10-11.10]
I20260709 13:10:22.478845 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 668) took 2316 ms. Trace:
I20260709 13:10:22.479254 19902 rpcz_store.cc:276] 0709 13:10:20.162970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.163117 (+   147us) service_pool.cc:224] Handling call
0709 13:10:20.171547 (+  8430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.478507 (+2306960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.478780 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.164433 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:20.263024 22932 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:20.133536 22969 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:20.156852 23019 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.485384 23441 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.486634 23019 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:20.102275 23081 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:22.489234 23081 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:20.150686 23137 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:22.492983 23137 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:20.586553 23255 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:20.157330 23275 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:20.196683 23288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.004s	sys 0.008s
I20260709 13:10:20.149525 23321 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.097860 23236 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:20.136889 23323 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:22.506305 23323 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:20.544150 23330 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:20.166426 23348 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.518990 23348 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:20.088719 23353 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.007s	sys 0.005s
I20260709 13:10:22.522573 23353 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:20.115324 23354 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.526038 23354 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:10:20.156603 23359 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 1.400s	user 0.004s	sys 0.009s
I20260709 13:10:21.170915 23356 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.538120 23356 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:20.154910 22920 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:22.541069 22920 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:20.112386 23371 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:20.097124 23374 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:10:20.149822 23376 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:10:22.545593 23376 consensus_queue.cc:1243] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:22.546182 23376 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:22.546576 23376 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:20.155596 23378 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:22.548583 23378 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.551524 23378 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:20.180878 23379 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:10:20.126159 23385 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.607s	user 0.001s	sys 0.000s
I20260709 13:10:20.101353 23388 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:20.113636 23390 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:20.138527 23396 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.393s	user 0.000s	sys 0.000s
I20260709 13:10:20.157161 23397 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:22.562737 23397 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:20.152706 23398 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:20.196630 23402 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:20.101979 23404 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:21.170686 22952 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.406241 23406 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.375753 23375 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:21.175935 23425 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.414608 23421 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:21.410683 23418 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.428160 23415 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.349203 23373 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:22.355257 23377 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:22.366298 23407 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.367835 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 2.20524e+06us
I20260709 13:10:22.392985 22879 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.404335 23382 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:22.414705 23381 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:22.415524 23389 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:22.426992 23143 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:22.428313 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:22.431488 19220 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:22.435801 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2243) took 2280 ms. Trace:
I20260709 13:10:22.436385 19224 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.436910 19225 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:22.442093 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 2.23236e+06us
I20260709 13:10:22.442230 23416 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.442122 23423 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:22.443706 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080019e180 after lost signal to thread 18095
I20260709 13:10:22.444532 19897 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:22.444670 19293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 601) took 3520 ms (client timeout 1844 ms). Trace:
I20260709 13:10:22.445513 19294 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:22.563911 23397 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:22.604095 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2245) took 2444 ms (client timeout 1838 ms). Trace:
I20260709 13:10:22.603843 22879 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:22.604547 19220 rpcz_store.cc:269] 0709 13:10:20.159766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.159901 (+   135us) service_pool.cc:224] Handling call
0709 13:10:22.604014 (+2444113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.605093 23397 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:22.603865 23423 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.605476 23373 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.607484 23423 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.607601 23373 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.567997 19112 maintenance_manager.cc:419] P 2d55bdccad9c419a8710b6e2897c2f38: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033343
I20260709 13:10:20.091365 19366 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:22.612778 23406 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.613476 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2102) took 2555 ms. Trace:
I20260709 13:10:22.613332 23415 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.613867 19366 rpcz_store.cc:276] 0709 13:10:20.058382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.058593 (+   211us) service_pool.cc:224] Handling call
0709 13:10:20.091111 (+ 32518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.613215 (+2522104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.613423 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.460999 19365 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:22.459645 23436 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.466969 19899 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:10:22.614917 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2110) took 2532 ms (client timeout 1665 ms). Trace:
I20260709 13:10:22.614967 23406 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:22.615170 19899 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 666) took 2471 ms (client timeout 1914 ms). Trace:
I20260709 13:10:20.094280 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 668) took 2095 ms. Trace:
I20260709 13:10:22.617117 19900 rpcz_store.cc:276] 0709 13:10:17.999217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.999579 (+   362us) service_pool.cc:224] Handling call
0709 13:10:18.669483 (+669904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.670439 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.094080 (+1423641us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54006c98d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:20.094220 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465717120}
W20260709 13:10:22.615375 19365 rpcz_store.cc:269] 0709 13:10:20.082645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.083466 (+   821us) service_pool.cc:224] Handling call
0709 13:10:22.614836 (+2531370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.618499 23415 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.619149 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 609) took 3597 ms. Trace:
I20260709 13:10:22.619269 23377 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.620275 23382 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:22.621721 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 193486us
I20260709 13:10:22.480998 19903 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.622617 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:22.573094 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1897) took 3755 ms. Trace:
I20260709 13:10:22.623425 23382 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:22.477618 19395 debug-util.cc:398] Leaking SignalData structure 0x7b08000dbb20 after lost signal to thread 19249
I20260709 13:10:22.512564 23193 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:22.483528 22932 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:22.517655 23288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.083s	user 0.007s	sys 0.008s
I20260709 13:10:22.562114 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1898) took 3672 ms. Trace:
I20260709 13:10:22.608788 23398 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:22.470959 19868 connection.cc:256] RPC call timeout handler was delayed by -1.9829070859999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:10:22.608640 23416 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.609274 23375 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.632977 19900 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:22.615844 22952 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.609552 23389 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.610194 23371 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:22.638041 19219 rpcz_store.cc:276] 0709 13:10:18.890023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.890212 (+   189us) service_pool.cc:224] Handling call
0709 13:10:18.925029 (+ 34817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.052693 (+127664us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:19.052724 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.070286 (+ 17562us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.272512 (+202226us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:19.272549 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.272624 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.820415 (+547791us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4800080058. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:10:20.137760 (+317345us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:22.561834 (+2424074us) raft_consensus.cc:1685] finished
0709 13:10:22.561877 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.562040 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":356183,"raft.queue_time_us":214839,"raft.run_cpu_time_us":6080,"raft.run_wall_time_us":662693,"spinlock_wait_cycles":12579968,"thread_start_us":252063,"threads_started":2,"wal-append.queue_time_us":569771}
I20260709 13:10:22.639941 22952 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:22.608659 19225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2248) took 2447 ms (client timeout 1756 ms). Trace:
W20260709 13:10:22.640825 19225 rpcz_store.cc:269] 0709 13:10:20.161570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.161722 (+   152us) service_pool.cc:224] Handling call
0709 13:10:22.608585 (+2446863us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.636081 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:22.642604 23421 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.610364 23381 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.611438 23236 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:22.643173 23398 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.644229 23236 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:22.615592 19899 rpcz_store.cc:269] 0709 13:10:20.144141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.150926 (+  6785us) service_pool.cc:224] Handling call
0709 13:10:22.615084 (+2464158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.644788 23236 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:22.608156 19223 rpcz_store.cc:276] 0709 13:10:20.155222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.158194 (+  2972us) service_pool.cc:224] Handling call
0709 13:10:20.158480 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.435557 (+2277077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.435751 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.645833 23236 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.646133 22920 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.647187 23236 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.647360 22920 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.641924 23416 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:22.612038 19293 rpcz_store.cc:269] 0709 13:10:18.924308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.924525 (+   217us) service_pool.cc:224] Handling call
0709 13:10:22.444484 (+3519959us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001d3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:22.444603 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2629244288}
I20260709 13:10:22.616393 23425 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.649262 23440 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:22.649976 23440 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.651116 23425 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.651234 23371 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.651814 23371 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:22.652783 19265 connection.cc:256] RPC call timeout handler was delayed by -1.0626525189999256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:10:22.654855 23440 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.641786 23418 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.655567 23440 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.656040 23440 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.657135 23418 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.626093 23373 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:10:22.658015 23440 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.658551 23440 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:22.659009 23275 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:22.659406 22932 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:10:22.659757 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800319440 after lost signal to thread 18098
I20260709 13:10:22.660009 22932 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.660625 23371 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:22.660796 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800267100 after lost signal to thread 19157
I20260709 13:10:22.661164 23371 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.661602 23371 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.661908 22932 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.662544 22932 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:22.663022 22932 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.663551 23371 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.659510 23275 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:22.644286 23398 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.664779 23275 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.665807 23275 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.620507 23407 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.668265 23407 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.624904 23379 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:22.668974 23379 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:22.668900 23376 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.670426 23376 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.626873 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:22.621760 23377 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.671576 22969 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:22.659068 23440 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:22.672724 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45923.9us
I20260709 13:10:22.673709 23375 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.674357 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:22.654824 23381 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:22.624033 19395 debug-util.cc:398] Leaking SignalData structure 0x7b08001db0e0 after lost signal to thread 19250
I20260709 13:10:22.675623 23348 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.670965 19903 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
W20260709 13:10:22.676635 19903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 675) took 2512 ms (client timeout 2092 ms). Trace:
I20260709 13:10:22.507526 23323 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.677690 23323 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.678153 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:22.626403 23321 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.670038 23379 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:22.642091 19868 connection.cc:256] RPC call timeout handler was delayed by -1.8964873599999237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2449s for a response
I20260709 13:10:22.681427 23407 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:22.681560 23418 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:22.681934 23407 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.682159 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:22.682137 23418 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.682933 19899 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:22.684024 23407 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:22.684312 23418 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:22.675774 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:22.685343 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:22.518184 23330 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.623711 19216 rpcz_store.cc:276] 0709 13:10:18.817979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.854043 (+ 36064us) service_pool.cc:224] Handling call
0709 13:10:18.891295 (+ 37252us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:18.949541 (+ 58246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:18.995307 (+ 45766us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.214066 (+218759us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:19.214992 (+   926us) log.cc:844] Serialized 78 byte log entry
0709 13:10:19.215509 (+   517us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:19.215768 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.216073 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.216423 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.216579 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.216674 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.114007 (+897333us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b18004a58a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:20.125548 (+ 11541us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:20.149095 (+ 23547us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b18004a58a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8dbd8958f 00007fe8d4dc8571 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd
0709 13:10:22.572817 (+2423722us) raft_consensus.cc:1685] finished
0709 13:10:22.572841 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.573030 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102052,"prepare.queue_time_us":47388,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":113,"raft.queue_time_us":1672441,"raft.run_cpu_time_us":591,"raft.run_wall_time_us":83720,"spinlock_wait_cycles":65005824,"thread_start_us":215907,"threads_started":3,"wal-append.queue_time_us":430383}
I20260709 13:10:22.686884 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:22.686182 23375 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.687551 23375 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.688081 23375 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.676656 22969 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.688315 23137 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.689502 23137 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.690735 19899 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:22.687592 23330 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.641743 23389 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.693540 22969 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:22.693643 23321 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:22.694187 22969 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.694479 23321 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.695716 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:22.693658 23356 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.696332 23321 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.696853 23321 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:22.696372 22969 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.696698 23356 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:22.697685 23356 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.697392 23321 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.698079 23356 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.699536 23321 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.699879 19296 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:22.523902 23353 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.700893 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:22.701597 19216 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
W20260709 13:10:22.702080 19296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1868) took 3554 ms (client timeout 1837 ms). Trace:
W20260709 13:10:22.676280 19395 debug-util.cc:398] Leaking SignalData structure 0x7b080036a320 after lost signal to thread 19324
W20260709 13:10:22.707350 19395 debug-util.cc:398] Leaking SignalData structure 0x7b080036a180 after lost signal to thread 19325
W20260709 13:10:22.708431 19395 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0220 after lost signal to thread 19398
W20260709 13:10:22.708695 19395 debug-util.cc:398] Leaking SignalData structure 0x7b080037c000 after lost signal to thread 19399
W20260709 13:10:22.709775 19395 debug-util.cc:398] Leaking SignalData structure 0x7b080030c660 after lost signal to thread 19927
W20260709 13:10:22.710026 19395 debug-util.cc:398] Leaking SignalData structure 0x7b08003e91c0 after lost signal to thread 19928
I20260709 13:10:22.710700 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:22.711308 19218 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.710712 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.712790 19217 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:22.705282 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.714267 19222 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:22.619681 19294 rpcz_store.cc:276] 0709 13:10:19.021311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.024227 (+  2916us) service_pool.cc:224] Handling call
0709 13:10:22.445056 (+3420829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.617074 (+172018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.618971 (+  1897us) spinlock_profiling.cc:243] Waited 3.42 s on lock 0x7b54001d3650. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:22.619097 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7866353408}
W20260709 13:10:22.702474 19296 rpcz_store.cc:269] 0709 13:10:19.147941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.148871 (+   930us) service_pool.cc:224] Handling call
0709 13:10:22.701913 (+3553042us) spinlock_profiling.cc:243] Waited 3.55 s on lock 0x7b54001d2254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:22.702015 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8164494080}
W20260709 13:10:22.661747 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002db600 after lost signal to thread 19220
W20260709 13:10:22.715801 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002db4c0 after lost signal to thread 19221
W20260709 13:10:22.716140 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002db580 after lost signal to thread 19222
I20260709 13:10:22.619323 23143 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:22.644819 23421 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.719147 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.719244 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:22.703045 23417 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.724858 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002db460 after lost signal to thread 19223
I20260709 13:10:22.727306 23356 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.730017 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.754626 19221 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:22.755501 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.755692 23356 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.756223 19221 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:22.738797 23143 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.730845 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.759512 19217 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:22.731678 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.760394 19222 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:22.734426 19218 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:22.735067 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:22.735795 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:22.739516 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002db6a0 after lost signal to thread 19224
I20260709 13:10:22.737807 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.739440 19216 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:22.761752 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002cef00 after lost signal to thread 19225
I20260709 13:10:22.608997 22879 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:22.755541 23417 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:22.762337 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003959c0 after lost signal to thread 19249
I20260709 13:10:22.751533 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:22.784469 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080033c860 after lost signal to thread 19250
W20260709 13:10:22.784806 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800084aa0 after lost signal to thread 19263
I20260709 13:10:22.784783 19225 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
W20260709 13:10:22.785270 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4fa0 after lost signal to thread 19266
W20260709 13:10:22.677134 19903 rpcz_store.cc:269] 0709 13:10:20.163921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.164074 (+   153us) service_pool.cc:224] Handling call
0709 13:10:22.676567 (+2512493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.674504 23440 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.794812 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.783335 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:10:22.783423 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 105323us
W20260709 13:10:22.796669 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2247) took 2636 ms (client timeout 2009 ms). Trace:
W20260709 13:10:22.797009 19224 rpcz_store.cc:269] 0709 13:10:20.160670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.160782 (+   112us) service_pool.cc:224] Handling call
0709 13:10:22.796606 (+2635824us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:22.785867 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080034d0a0 after lost signal to thread 19293
W20260709 13:10:22.798861 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080035c960 after lost signal to thread 19295
W20260709 13:10:22.799240 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080019aa20 after lost signal to thread 19300
W20260709 13:10:22.799862 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800395b60 after lost signal to thread 19324
W20260709 13:10:22.790387 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.454869 23438 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:22.801477 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003d14c0 after lost signal to thread 19325
W20260709 13:10:22.802399 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800387c80 after lost signal to thread 19365
W20260709 13:10:22.802685 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08000cac60 after lost signal to thread 19366
W20260709 13:10:22.802953 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800302080 after lost signal to thread 19367
W20260709 13:10:22.803288 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4e60 after lost signal to thread 19374
W20260709 13:10:22.804071 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 329760us
I20260709 13:10:22.804937 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:22.805850 23444 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:22.806632 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 340136us
I20260709 13:10:22.813201 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.813898 19217 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:22.816931 19216 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:22.818614 22932 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.782829 23381 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.822556 19220 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.823133 19191 leader_election.cc:400] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
I20260709 13:10:22.823450 19191 leader_election.cc:403] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:10:22.824388 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080032d7e0 after lost signal to thread 19398
W20260709 13:10:22.824733 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800265b20 after lost signal to thread 19399
W20260709 13:10:22.825922 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2a20 after lost signal to thread 19868
W20260709 13:10:22.826170 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800316d40 after lost signal to thread 19869
W20260709 13:10:22.826627 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003241e0 after lost signal to thread 19894
I20260709 13:10:22.826517 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:22.827080 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7740 after lost signal to thread 19895
W20260709 13:10:22.827526 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080037a240 after lost signal to thread 19898
W20260709 13:10:22.827911 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6da0 after lost signal to thread 19900
W20260709 13:10:22.828300 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003363c0 after lost signal to thread 19901
W20260709 13:10:22.828640 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800261e00 after lost signal to thread 19902
W20260709 13:10:22.829178 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080032b820 after lost signal to thread 19903
W20260709 13:10:22.829955 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080034cbe0 after lost signal to thread 19927
W20260709 13:10:22.830368 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080034ff40 after lost signal to thread 19928
W20260709 13:10:22.830808 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccfc0 after lost signal to thread 22920
W20260709 13:10:22.831202 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080034f200 after lost signal to thread 22969
W20260709 13:10:22.831569 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800234560 after lost signal to thread 23019
W20260709 13:10:22.828565 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 144749us
W20260709 13:10:22.832320 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.140s (SENT) [suppressed 21 similar messages]
I20260709 13:10:22.830089 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:22.833321 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800366e80 after lost signal to thread 23081
I20260709 13:10:22.834661 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:22.835433 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.835469 19223 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.836321 19224 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 3.
W20260709 13:10:22.833693 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd1e0 after lost signal to thread 23137
W20260709 13:10:22.841439 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080025bf20 after lost signal to thread 23236
I20260709 13:10:22.841415 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:22.842214 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800342280 after lost signal to thread 23275
W20260709 13:10:22.848131 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003299e0 after lost signal to thread 23288
W20260709 13:10:22.848579 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003eaf40 after lost signal to thread 23321
W20260709 13:10:22.848941 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800336420 after lost signal to thread 23323
W20260709 13:10:22.849362 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003ede00 after lost signal to thread 23348
W20260709 13:10:22.849723 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002da560 after lost signal to thread 23353
W20260709 13:10:22.850060 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003acc40 after lost signal to thread 23354
W20260709 13:10:22.850426 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080033f360 after lost signal to thread 23359
W20260709 13:10:22.850795 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1e20 after lost signal to thread 23371
W20260709 13:10:22.851166 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003349e0 after lost signal to thread 23374
W20260709 13:10:22.851519 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd5e0 after lost signal to thread 23376
W20260709 13:10:22.851890 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1a60 after lost signal to thread 23378
W20260709 13:10:22.852247 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08001bcc00 after lost signal to thread 23379
W20260709 13:10:22.852672 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003977e0 after lost signal to thread 23385
W20260709 13:10:22.853072 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca2c0 after lost signal to thread 23388
W20260709 13:10:22.853440 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003c75e0 after lost signal to thread 23390
W20260709 13:10:22.853854 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf9e0 after lost signal to thread 23396
W20260709 13:10:22.854244 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800375340 after lost signal to thread 23397
W20260709 13:10:22.854596 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080026d600 after lost signal to thread 23398
W20260709 13:10:22.854979 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3740 after lost signal to thread 23402
W20260709 13:10:22.855363 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080031da60 after lost signal to thread 23404
I20260709 13:10:22.857463 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:22.856902 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:22.859884 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:22.860689 19365 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:22.899019 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57880.5us
W20260709 13:10:22.898936 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57624.3us
I20260709 13:10:22.866178 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:22.906821 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:22.899492 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:22.839363 23438 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:22.867421 23378 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:22.856853 23398 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
W20260709 13:10:22.907747 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 68625.9us
W20260709 13:10:22.928457 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 466211us
I20260709 13:10:22.929184 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:22.907370 23376 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:22.911396 23436 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:22.965500 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:22.833637 23397 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:10:22.834700 23382 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:10:22.992674 19216 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:22.994494 19368 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:22.864853 23404 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.916795 23081 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:22.916915 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:22.918756 23417 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:22.838717 23443 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:10:22.921962 19263 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:23.043371 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 121459us
I20260709 13:10:22.833487 23375 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:22.992849 23275 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.899333 23418 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.903774 23406 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.925410 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 157464us
I20260709 13:10:22.925694 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:22.996023 23376 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:22.925859 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 441170us
I20260709 13:10:22.905095 23330 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:22.926530 19220 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:22.926782 19223 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:22.927304 19900 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:22.967010 19371 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:22.983104 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.063162 19224 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:22.984975 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.063663 19222 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:22.983160 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:22.996521 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:22.960583 23143 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:22.999439 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.038347 19368 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:23.067373 19368 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:23.037619 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.067632 19216 raft_consensus.cc:2410] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:22.930260 23378 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:23.042533 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 125682us
I20260709 13:10:23.049871 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:22.924412 19365 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:23.070582 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.057160 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.071725 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.072019 19217 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:23.073316 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.073948 19369 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:10:23.071599 19897 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:10:23.058363 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 158952us
I20260709 13:10:23.066447 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.064675 19225 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:23.075459 19903 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:10:23.067065 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.069434 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.080219 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:23.082162 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 245777us
I20260709 13:10:23.083233 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.084205 23356 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:23.084342 23421 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:23.085240 23356 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:23.085865 23356 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:23.088461 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.089041 19223 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:23.089129 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.089717 19292 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:23.085193 23421 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:23.078312 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.058162 23417 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.048102 22952 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.091190 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:22.992993 23439 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:10:23.092410 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.097074 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:23.103207 19225 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:23.038404 23404 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.099903 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.100132 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.106204 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:23.100481 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.101487 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.106947 19223 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:23.107231 19218 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:23.102316 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.099056 19294 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.097771 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.087945 19368 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.107205 19295 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:23.085886 23389 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:23.105273 23354 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.103794 23452 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:23.110379 23376 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.110879 19218 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:23.121670 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.111364 23439 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.069832 23418 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.108929 19217 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:23.114838 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.108270 19300 raft_consensus.cc:2376] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6. Re-sending same reply.
W20260709 13:10:23.126528 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48323.2us
I20260709 13:10:23.127983 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.121234 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.086802 23356 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.083638 23437 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:23.070348 23406 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.112823 23389 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:23.105451 23330 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.185542 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.191039 19218 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
W20260709 13:10:23.185695 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 70974.6us
I20260709 13:10:23.120621 22952 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:23.117036 22879 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:23.211989 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.212721 19217 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:23.197255 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.215503 19296 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:23.216624 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.217366 19296 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.188422 19219 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:23.204342 19292 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:23.196262 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.219884 19298 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:23.220870 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.221524 19298 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:23.222113 23323 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.222256 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.222640 23323 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.223301 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.224377 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.224829 23323 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:23.226102 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 98225.5us
I20260709 13:10:23.228152 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.230916 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.232767 23323 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:23.189103 23423 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:23.234689 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.197525 23416 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.247203 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.165132 23371 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.164794 23421 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:23.240495 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.242455 19366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de803894748b488d81cb5c7007c78cce"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:23.238047 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.214493 22932 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.233817 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.281374 19366 raft_consensus.cc:606] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:23.283373 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49876.9us
I20260709 13:10:23.244758 23143 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:23.245625 23449 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:10:23.238613 19225 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:23.188023 23081 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:23.252238 19217 raft_consensus.cc:2410] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:23.127224 23354 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.196660 23415 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:23.279290 19296 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:23.286970 19366 raft_consensus.cc:614] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.287724 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.288471 19219 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:23.289866 19294 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 4.
I20260709 13:10:23.242427 23423 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:23.303675 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 227400us
I20260709 13:10:23.300410 19291 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:23.301403 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.293125 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.282068 23356 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.281023 23442 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.238986 22879 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.312759 19300 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:23.288334 22932 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.187827 23378 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.105533 23438 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.313895 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:23.314548 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 230735us
I20260709 13:10:23.281384 23460 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:23.284969 23371 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.281903 23416 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.294557 23389 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.282363 23323 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:23.380378 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.380424 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:23.353397 19300 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:23.353010 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:23.374382 19218 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:23.397408 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.344004 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:23.469978 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 89650.2us
I20260709 13:10:23.488358 19222 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:10:23.492686 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 205025us
I20260709 13:10:23.509002 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.509294 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.510221 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:23.510393 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.510448 19366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
W20260709 13:10:23.511477 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 167536us
I20260709 13:10:23.468273 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:23.511116 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:23.388422 23461 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:10:23.512737 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.509999 19898 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:23.396389 23193 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:23.531184 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.336812 23472 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:23.529246 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:23.508846 23143 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.465524 23460 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.396317 23469 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.310554 23423 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:23.533653 19191 connection.cc:256] RPC call timeout handler was delayed by -4.175351059000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:10:23.357936 23330 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.534862 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.534925 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.539300 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.539539 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:23.449026 23476 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.397115 23406 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.394868 23404 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:23.350445 23353 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:23.612654 23353 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:23.613229 23353 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.393121 23375 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.465587 22932 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:23.533707 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 65528.5us
I20260709 13:10:23.617120 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:23.597837 23330 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.621129 23330 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:23.596596 23469 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.535193 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.527451 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.624979 19901 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
W20260709 13:10:23.625322 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 97937.4us
I20260709 13:10:23.625977 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.626477 19366 raft_consensus.cc:606] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.626561 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.627058 19366 raft_consensus.cc:614] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.627646 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.540604 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.626573 19299 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.628592 19300 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:10:23.629527 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.629490 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.549844 19225 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:23.535776 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.630661 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.630868 19895 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:23.631225 19300 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.471374 23323 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.555356 19297 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:23.634526 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:23.635033 19297 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.556694 23416 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.546834 23193 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:23.636955 23193 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.638115 23193 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.624055 23469 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:23.639150 23456 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:23.639570 23456 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:23.569447 23477 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:23.539944 23354 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.512104 23389 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.640442 19366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:23.641799 19366 raft_consensus.cc:606] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.642258 19366 raft_consensus.cc:614] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.643839 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:23.560945 19896 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:23.644289 19221 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:23.561156 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.309639 23415 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.645815 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:23.531909 23457 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:23.646636 23415 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:23.511694 23418 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.350069 23470 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.212s
I20260709 13:10:23.647322 23418 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:23.647686 23418 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:23.339481 23442 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.648566 23418 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.649751 23418 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.534337 23471 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:23.569928 19191 connection.cc:256] RPC call timeout handler was delayed by -4.1708167769999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:10:23.650902 19191 connection.cc:256] RPC call timeout handler was delayed by -4.0439167769999358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:10:23.651300 19191 connection.cc:256] RPC call timeout handler was delayed by -3.5760204829999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:10:23.651626 19191 connection.cc:256] RPC call timeout handler was delayed by -2.9046132320000879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:10:23.651960 19191 connection.cc:256] RPC call timeout handler was delayed by -2.8667167769999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2967s for a response
W20260709 13:10:23.652298 19191 connection.cc:256] RPC call timeout handler was delayed by -2.5995132320000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:10:23.652634 19191 connection.cc:256] RPC call timeout handler was delayed by -2.1990982160000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4989s for a response
I20260709 13:10:23.654115 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:23.536734 23137 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:23.655031 23137 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.655491 23137 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.596516 19903 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:23.609248 23466 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:23.431965 23081 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.564664 23143 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:23.566584 23460 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.381875 23421 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.569315 23465 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:23.661006 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43971.3us
I20260709 13:10:23.667614 19299 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:10:23.707881 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 146799us
I20260709 13:10:23.714342 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.715097 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:23.716631 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.717967 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:23.649827 23442 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:23.719496 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:23.721299 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58418.8us
I20260709 13:10:23.722092 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:23.611861 23371 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.696748 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:23.601125 23476 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.661679 23406 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:23.685065 23288 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:23.719219 23482 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.699780 23143 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.684976 23416 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:23.596266 23474 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 13:10:23.685971 23398 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.753448 19299 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:23.816359 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.757067 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:23.707311 23465 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.757414 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.757815 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:23.751754 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.758128 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:23.759341 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56277us
I20260709 13:10:23.829102 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:23.829278 19373 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:23.761904 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.566308 23463 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:23.740399 22879 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.755716 23330 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.730680 23436 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:23.802703 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 258431us
I20260709 13:10:23.814222 19903 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:23.820227 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:23.819767 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:23.818365 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 61393.3us
I20260709 13:10:23.830255 19374 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:23.868829 19369 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.831049 19371 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.761554 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:23.869676 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.870293 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.834223 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.834718 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.818804 23236 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.722579 23404 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:10:23.871538 19299 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:23.872385 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.873461 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:23.834975 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76925us
I20260709 13:10:23.761431 23473 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:23.812593 19367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.010s
W20260709 13:10:23.882699 19367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.001s	sys 0.011s
I20260709 13:10:23.838874 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.883646 19373 raft_consensus.cc:2410] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:23.755038 23482 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.886510 23482 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.887555 23480 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.887702 23236 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.888231 23480 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.888370 23236 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.890586 23480 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:23.890986 23236 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:23.838975 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.820041 23382 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.830224 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.837914 23465 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.760782 23416 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:23.761572 23354 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:23.877400 19297 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:23.761991 23415 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.564896 23472 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.915261 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.916718 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:23.877548 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.918833 19374 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:23.920032 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.878755 19366 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:23.879143 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:23.921875 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:23.751691 23388 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:23.757385 23288 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.900066 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.754855 23471 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:23.863507 23389 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:23.968387 22920 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.969350 19897 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:23.969554 22920 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:23.970041 22920 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.971122 19897 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:23.973196 19898 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:23.911742 23416 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.975529 23288 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.900835 19369 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:23.980489 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.978858 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:23.837513 23463 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.907464 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:23.902895 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 166638us
I20260709 13:10:23.994949 19373 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.751091 23469 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:10:23.896781 23470 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:10:23.945925 23388 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.943190 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:23.943665 19895 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:23.943888 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:23.876633 23436 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:23.949992 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:23.953027 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:23.959133 23482 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.023336 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.023607 19221 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.023697 19369 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:24.001369 23480 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.959525 19300 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:23.962522 23476 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:23.720855 23456 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:23.963910 19372 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:24.029417 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.034821 19219 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:10:23.966778 23477 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:23.944222 23415 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:23.986835 19901 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:23.897811 23440 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:23.978847 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 704) took 1045 ms. Trace:
I20260709 13:10:23.875454 23441 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:10:24.005867 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.046663 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.047382 19224 raft_consensus.cc:2376] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11. Re-sending same reply.
W20260709 13:10:24.011425 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 181264us
I20260709 13:10:24.050033 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:23.909065 23479 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:24.012184 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.051054 19216 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.014266 19222 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:23.944157 23472 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.896533 23443 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
W20260709 13:10:23.838713 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 285343us
I20260709 13:10:24.063098 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:24.019204 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:24.064361 23494 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.065192 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:24.017114 19902 raft_consensus.cc:2376] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8. Re-sending same reply.
I20260709 13:10:24.066461 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:24.021243 23388 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.024070 19220 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:24.024037 19221 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:24.078168 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:24.025727 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:23.994221 22879 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.959002 23143 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.034746 19372 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:23.964282 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:24.079962 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:24.039840 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.081234 19291 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:24.042878 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:24.081765 19218 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:24.064941 23494 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.065485 23482 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:24.066823 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 370156us
I20260709 13:10:24.019874 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.021354 19371 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:24.068635 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.036664 19367 rpcz_store.cc:276] 0709 13:10:22.933468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.966536 (+ 33068us) service_pool.cc:224] Handling call
0709 13:10:22.966851 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.967063 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:23.125496 (+158433us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.897475 (+771979us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.978543 (+ 81068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.978590 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:23.978634 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.978693 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.978799 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80809,"prepare.queue_time_us":273797,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":1953,"raft.queue_time_us":167511,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":37051,"thread_start_us":915440,"threads_started":3,"wal-append.queue_time_us":242696}
I20260709 13:10:24.087200 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:24.000020 23330 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:23.971163 23423 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.026410 23436 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.046841 23477 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.077240 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.005416 23463 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.082496 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.083303 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.078704 19221 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.086952 19291 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:24.036085 23480 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.087913 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.088070 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:24.108078 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.036238 23473 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:24.094281 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.060252 23479 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.098261 19216 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:24.115078 19372 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:24.103050 19224 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:24.115921 19221 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.103621 19293 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.081290 22879 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.108294 19371 raft_consensus.cc:2410] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:24.087060 19223 raft_consensus.cc:2376] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12. Re-sending same reply.
I20260709 13:10:24.108773 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:24.107669 19217 raft_consensus.cc:2410] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:24.115532 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.090611 23402 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.107669 19291 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:24.124228 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44329us
W20260709 13:10:24.147806 23493 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:24.080282 23418 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:24.148595 23484 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.172221 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:24.148808 23379 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.150396 23442 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:24.151245 23491 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:24.154626 23443 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:24.129405 22879 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:24.158571 23356 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.001s
I20260709 13:10:24.067720 23440 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.162817 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:24.166639 19221 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:24.147650 23490 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.117548 23480 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.128703 23476 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:24.191934 19265 leader_election.cc:400] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:10:24.243544 19265 leader_election.cc:403] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:10:24.244220 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58563.1us
I20260709 13:10:24.245116 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:24.192497 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.247290 19217 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:24.247424 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 160274us
I20260709 13:10:24.158721 23330 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:10:24.156737 23143 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:24.193667 23492 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:24.194191 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.194953 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.183100 23442 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:24.206061 19292 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:24.239692 19221 pending_rounds.cc:85] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:10:24.248286 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:24.248615 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.255795 19221 pending_rounds.cc:107] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:24.256049 19371 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:24.253484 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 90753.8us
I20260709 13:10:24.117415 23479 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.255468 19369 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:24.249555 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:24.260950 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:24.190733 23418 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:24.264142 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:24.256101 19221 raft_consensus.cc:2889] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.262840 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:24.240003 23356 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.265259 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 195540us
I20260709 13:10:24.274051 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:24.243213 23476 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:24.250424 23482 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:10:24.255028 23193 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.100502 23471 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.259409 23504 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:24.254799 23389 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.171815 22952 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:10:24.288970 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.260416 23442 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.263828 23418 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:24.281997 23489 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:24.256878 23236 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:10:24.274307 23143 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.292438 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:24.248723 23490 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.280422 23019 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:24.298466 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:24.291034 23495 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:24.285110 23437 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:24.287758 23391 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:24.305578 23501 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.287822 23504 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:24.277455 23470 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:10:24.277702 23354 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.300871 23445 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:24.303958 23323 consensus_meta.cc:287] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.002s
I20260709 13:10:24.314266 19216 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:24.308399 23498 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.277177 23356 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.374109 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:24.312975 23391 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.315891 23476 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.299153 23193 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:10:24.312795 23415 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:24.382171 23489 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:24.314546 23437 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.311211 22952 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.314608 23504 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.275482 23473 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:24.380293 23137 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.724s	user 0.005s	sys 0.005s
I20260709 13:10:24.407473 23391 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.384277 23445 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.406924 23356 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.378839 23323 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:24.439067 23496 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:10:24.448484 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 102042us
I20260709 13:10:24.417276 22952 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:24.418465 23330 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:10:24.451671 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:24.452093 19297 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:24.379614 23418 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.317762 23501 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.409112 23389 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:24.462446 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 199678us
I20260709 13:10:24.463581 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:24.425422 23137 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.468195 19373 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:24.468897 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:24.472105 22932 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.000s
I20260709 13:10:24.475167 22879 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.475404 23477 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.476728 23415 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:24.478026 23137 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:24.467748 23356 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:24.472555 22932 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.479579 19298 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:24.479295 23404 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:24.478425 23423 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.480121 19217 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:24.482829 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1880) took 1280 ms. Trace:
I20260709 13:10:24.527124 19298 rpcz_store.cc:276] 0709 13:10:23.202632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.224076 (+ 21444us) service_pool.cc:224] Handling call
0709 13:10:24.482632 (+1258556us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000492d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:24.482771 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2885018368}
I20260709 13:10:24.430579 23354 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.468844 23439 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:24.570519 23416 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.012s
I20260709 13:10:24.485945 23255 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:24.480813 23500 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 13:10:24.581972 23353 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.968s	user 0.011s	sys 0.000s
I20260709 13:10:24.582031 23255 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:24.582584 23353 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.583197 23255 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.481220 23323 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:24.483772 23356 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.584412 23255 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:24.585731 23417 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.485s	user 0.012s	sys 0.000s
I20260709 13:10:24.585319 23356 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.586167 23417 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:24.480804 23404 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.584470 19299 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:24.481343 23418 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:24.588615 22920 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.005s
I20260709 13:10:24.589061 22920 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.591223 22920 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:24.568497 23445 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:24.592913 23288 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.003s
I20260709 13:10:24.593277 23501 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:24.593356 23288 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.595536 23288 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.469584 23437 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.596247 23480 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.465453 23330 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:10:24.480434 22932 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:24.578155 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 126865us
I20260709 13:10:24.580641 23490 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:24.580359 23416 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.601750 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:24.606424 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:24.488812 23503 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:24.482298 22879 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.611672 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.612435 19217 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.469597 23505 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:24.613797 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.612462 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.614440 19219 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:24.627346 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 370442us
I20260709 13:10:24.598294 23480 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.632515 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:24.634523 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.637022 19218 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.482050 23506 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 13:10:24.638353 19300 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 4: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:24.640094 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:24.640810 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 342376us
W20260709 13:10:24.630501 23478 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.014s	sys 0.003s
I20260709 13:10:24.607151 23288 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.647753 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.648550 19218 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:24.646066 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.649341 19220 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:24.650653 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:24.645287 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:24.655040 19217 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:24.570111 22952 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.628615 23404 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:24.658165 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:24.637506 22932 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:24.647207 23478 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.015s	sys 0.003s
W20260709 13:10:24.646574 23472 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.002s
I20260709 13:10:24.660813 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:24.666488 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:24.669889 23463 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.005s
I20260709 13:10:24.670346 23463 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.672559 23463 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.674937 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:24.677744 19219 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:24.657974 23501 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:24.680845 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:24.683192 19220 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.683204 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1927) took 1314 ms. Trace:
I20260709 13:10:24.683960 19295 rpcz_store.cc:276] 0709 13:10:23.368722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.113116 (+744394us) service_pool.cc:224] Handling call
0709 13:10:24.152956 (+ 39840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.153215 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.153241 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.153711 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.264729 (+111018us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.264777 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.264847 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.682983 (+418136us) raft_consensus.cc:1685] finished
0709 13:10:24.683006 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.683143 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":110613,"threads_started":1,"wal-append.queue_time_us":160306}
W20260709 13:10:24.686326 23509 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:10:24.662288 23397 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:24.708902 22952 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.709131 23416 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.661376 23353 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:24.711617 23436 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.009s
I20260709 13:10:24.712312 23501 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:24.712073 23436 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.713248 23501 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.714218 23436 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.715559 19220 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:24.679803 22932 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.716249 23391 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.716923 22932 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.657433 23288 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.651023 23490 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:10:24.690145 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:24.693454 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.695780 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:24.699534 23460 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.968s	user 0.006s	sys 0.005s
I20260709 13:10:24.700855 23477 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:24.661967 23480 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.570688 23489 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.679601 23354 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:24.728696 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.734587 19220 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:10:24.737210 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.744271 23397 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:24.745395 23479 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.747550 23479 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:24.747728 23480 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.749877 23480 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:24.750439 23513 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:24.751024 23513 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:24.751868 23513 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.753441 23379 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.753875 23379 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:24.754731 23522 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:10:24.754669 23379 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.725001 23391 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:24.687276 23404 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:24.756328 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:24.757454 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67894.2us
I20260709 13:10:24.719491 23288 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:24.720477 23505 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:24.764040 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:24.679026 23472 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.769176 23511 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.769590 23511 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:24.770375 23511 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.771582 23511 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.773458 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.774449 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:24.777314 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.778080 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.779784 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:24.780310 19371 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.781584 19366 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:24.762676 23498 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:24.762771 23354 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:24.765069 23379 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.804060 19366 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:24.767421 23479 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:24.733824 23460 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:24.812932 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:24.813592 19369 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:24.816433 23442 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.513s	user 0.002s	sys 0.007s
I20260709 13:10:24.821412 19369 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:24.823511 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:24.824569 19369 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:24.745385 23397 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.801258 23143 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:24.829349 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.831777 19371 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:24.808400 23490 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.834755 19365 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:24.810388 23425 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:24.833909 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.811394 23498 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:24.839766 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.840376 19371 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
W20260709 13:10:24.850226 23523 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:24.852762 23404 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.857916 19366 raft_consensus.cc:2368] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:24.876737 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.878737 19372 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:24.880973 19367 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:24.828678 23143 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:24.889206 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:24.891400 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.896255 19367 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:24.825081 23442 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.822687 23479 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.925172 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:24.892658 23143 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.838718 23490 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.854138 23425 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.932384 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1891) took 1176 ms. Trace:
I20260709 13:10:24.936555 19297 rpcz_store.cc:276] 0709 13:10:23.756085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.916421 (+160336us) service_pool.cc:224] Handling call
0709 13:10:24.932086 (+1015665us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54003f20d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:24.932302 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229265152}
I20260709 13:10:24.938910 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:24.946455 19222 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:24.966519 23143 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.894111 23354 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:24.985376 23521 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 13:10:24.985920 23406 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:24.991811 23529 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:24.994292 23518 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.948734 23519 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:25.000065 23472 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.005514 19368 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.062704 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:25.067803 19291 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:25.068878 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:25.070761 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:25.071527 19291 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:25.072536 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:25.073342 19291 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:25.082643 23519 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.041531 23406 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:25.086992 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:24.943428 23498 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.177999 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2120) took 1341 ms. Trace:
I20260709 13:10:25.178301 19297 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.178819 19295 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:25.180047 19223 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:25.180794 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2287) took 1166 ms. Trace:
I20260709 13:10:25.191972 19224 rpcz_store.cc:276] 0709 13:10:24.025599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.048259 (+ 22660us) service_pool.cc:224] Handling call
0709 13:10:24.048604 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.116107 (+ 67503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.093550 (+977443us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b54000190d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:25.180746 (+ 87196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124703616}
I20260709 13:10:25.062453 23375 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.181231 19292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1878) took 1979 ms (client timeout 1979 ms). Trace:
I20260709 13:10:25.178066 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1932) took 1807 ms. Trace:
I20260709 13:10:25.195688 19299 rpcz_store.cc:276] 0709 13:10:23.370166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.873234 (+503068us) service_pool.cc:224] Handling call
0709 13:10:25.098256 (+1225022us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400048dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.178004 (+ 79748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633428224}
I20260709 13:10:25.178274 19293 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:25.183298 19291 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.183859 19366 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:10:25.184612 23081 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:25.184744 23479 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.193492 19368 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:25.323616 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 707) took 2324 ms. Trace:
I20260709 13:10:25.324034 19368 rpcz_store.cc:276] 0709 13:10:22.999348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.999507 (+   159us) service_pool.cc:224] Handling call
0709 13:10:23.038228 (+ 38721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.638489 (+600261us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b58005eacd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:10:25.005058 (+1366569us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b58005eb2d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:10:25.323331 (+318273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.323555 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205892864}
I20260709 13:10:25.193320 19365 rpcz_store.cc:276] 0709 13:10:23.836366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.870066 (+ 33700us) service_pool.cc:224] Handling call
0709 13:10:25.102556 (+1232490us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400189a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.177926 (+ 75370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216289536}
W20260709 13:10:25.274377 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.230412 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:25.195041 19292 rpcz_store.cc:269] 0709 13:10:23.202032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.219257 (+ 17225us) service_pool.cc:224] Handling call
0709 13:10:25.097933 (+1878676us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54001d2754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.181176 (+ 83243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195748224}
I20260709 13:10:25.307026 19220 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.308439 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:25.327975 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:25.239974 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.190116 23504 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.004s
I20260709 13:10:25.329931 23485 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.329881 23504 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.330456 23485 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.330828 23485 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:25.312294 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.012s	sys 0.025s
W20260709 13:10:25.229940 23388 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.141s	user 0.014s	sys 0.000s
W20260709 13:10:25.312754 23531 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.273s	user 0.000s	sys 0.005s
W20260709 13:10:25.333308 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.012s	sys 0.025s
I20260709 13:10:25.337692 19295 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:10:25.312307 23465 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.368s	user 0.007s	sys 0.011s
W20260709 13:10:25.312011 23421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.418s	user 0.009s	sys 0.041s
I20260709 13:10:25.185410 23441 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:25.344336 19291 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:25.354024 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:25.354815 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:25.366581 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.367511 19368 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:25.356045 19367 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:25.365514 19365 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:25.316939 23081 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:25.332144 23504 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.386303 19295 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:25.370992 23522 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.389364 23522 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.358875 23501 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:25.391656 23501 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:25.392047 23501 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:25.356598 23391 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:25.359282 23421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.465s	user 0.009s	sys 0.042s
I20260709 13:10:25.344135 23460 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.311851 23375 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.403328 19295 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.391834 23522 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.359107 23255 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.407392 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.363188 23441 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:25.359238 23407 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:10:25.422247 23536 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:25.427096 23519 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.354473 23388 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.349849 23406 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.429430 23388 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.429952 23406 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.430131 23442 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.432628 19370 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:25.433840 23441 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.435282 23441 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:25.437793 22952 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.728s	user 0.013s	sys 0.001s
W20260709 13:10:25.439189 23379 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.001s
I20260709 13:10:25.419525 23255 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:25.407781 23445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.014s	sys 0.021s
W20260709 13:10:25.441286 23445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.014s	sys 0.021s
I20260709 13:10:25.429440 23375 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.442521 23255 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.443532 23425 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:25.423943 23511 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 13:10:25.365495 23465 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.407793 23391 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.462486 19293 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:10:25.420848 23488 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.404s	user 0.015s	sys 0.015s
I20260709 13:10:25.471668 19897 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:25.465111 23501 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.463402 23391 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:25.487707 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 132404us
I20260709 13:10:25.472641 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:25.474398 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:25.467741 23471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.020s	sys 0.050s
I20260709 13:10:25.491336 19371 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:25.474010 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.474500 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.493568 19365 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.495919 19368 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:25.444348 23081 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:25.500207 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.500275 23081 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.501899 23288 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:25.502460 23288 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.502694 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:25.504773 23288 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:25.505146 23533 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.547s	user 0.001s	sys 0.003s
I20260709 13:10:25.507387 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:25.508073 19291 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:25.509086 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:25.509234 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.509125 19300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1936) took 2028 ms (client timeout 2619 ms). Trace:
W20260709 13:10:25.509733 19300 rpcz_store.cc:269] 0709 13:10:23.480846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.033805 (+552959us) service_pool.cc:224] Handling call
0709 13:10:25.508917 (+1475112us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001d3154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.509072 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278803328}
I20260709 13:10:25.510324 23455 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.510838 19291 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.510805 23455 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.511685 19298 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:25.512431 19291 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:25.512528 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.514076 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:25.514269 23421 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.514521 23455 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.514833 23421 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.515506 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.516328 19899 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:25.517180 23537 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 13:10:25.517951 23421 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.516366 23371 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.518563 23371 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.518951 23371 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.519408 23465 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.512007 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.521364 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.521797 19895 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.523098 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:25.524742 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:25.525359 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:25.525589 19298 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:25.511046 19300 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:25.533914 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.536100 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.537997 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:25.468230 23143 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.543457 19899 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:25.492835 23471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.023s	sys 0.053s
I20260709 13:10:25.546386 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.547246 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.554271 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.553606 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:25.550243 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.497205 23501 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.557327 19899 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:25.544760 23375 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.557576 19900 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:25.570228 19901 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.574752 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.578495 19902 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.567688 23375 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.585180 23375 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.601943 23495 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:25.602505 23495 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.612558 23495 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.613338 23391 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.620405 23490 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.621258 23391 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.622512 23494 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.499527 23440 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.545859 23465 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.624526 23465 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.625303 23456 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.627295 23465 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.378188 23443 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:10:25.548404 23421 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.628394 23421 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:25.628942 23421 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.629665 23484 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:25.630218 23484 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:25.631314 23484 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.633163 23484 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.640837 23421 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.617412 23476 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:25.589053 23485 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.643576 23485 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.650601 23375 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:24.663571 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.910560 23375 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:25.740145 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:25.912819 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 173013us
I20260709 13:10:25.745895 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1884) took 2536 ms. Trace:
W20260709 13:10:25.747413 19340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.018s	sys 0.041s
W20260709 13:10:25.915310 19340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.018s	sys 0.041s
W20260709 13:10:25.915961 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 731647us
I20260709 13:10:25.915091 19294 rpcz_store.cc:276] 0709 13:10:23.210081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.299266 (+ 89185us) service_pool.cc:224] Handling call
0709 13:10:23.299613 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.543743 (+244130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.543785 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.544336 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.810418 (+266082us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:23.810474 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.810571 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.101308 (+1290737us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:25.745153 (+643845us) raft_consensus.cc:1685] finished
0709 13:10:25.745197 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.745617 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93197,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":9497856,"thread_start_us":440345,"threads_started":2,"wal-append.queue_time_us":326308}
I20260709 13:10:25.749432 19365 raft_consensus.cc:2410] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:25.750628 19367 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:25.751816 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:25.922988 19368 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:25.753554 19369 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:25.756942 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.926725 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.926828 23356 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:25.927510 23356 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:25.757337 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:25.929407 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 174156us
I20260709 13:10:25.929951 23504 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.930418 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:25.931087 23456 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.932051 23456 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.935001 23456 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.757460 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.936436 23402 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:25.937139 19372 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:25.937337 23402 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.554975 19373 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:10:25.759208 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2290) took 1643 ms (client timeout 2171 ms). Trace:
I20260709 13:10:25.765401 19219 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:25.771606 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1929) took 1137 ms. Trace:
I20260709 13:10:25.772761 19896 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:25.942680 19896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 680) took 2230 ms (client timeout 2491 ms). Trace:
I20260709 13:10:25.941810 19222 rpcz_store.cc:276] 0709 13:10:24.633692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.815550 (+181858us) service_pool.cc:224] Handling call
0709 13:10:24.815817 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.946955 (+131138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.770830 (+823875us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003610d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:25.771278 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299968384}
W20260709 13:10:25.757819 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2117) took 2000 ms (client timeout 2128 ms). Trace:
W20260709 13:10:25.773626 19868 connection.cc:256] RPC call timeout handler was delayed by -1.108912671999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 13:10:25.945024 19896 rpcz_store.cc:269] 0709 13:10:23.711970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.712262 (+   292us) service_pool.cc:224] Handling call
0709 13:10:25.942402 (+2230140us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.942573 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4465020160}
W20260709 13:10:25.945900 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.946574 23379 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.947409 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:25.947374 23379 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:25.785493 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.787760 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:25.789618 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:25.790809 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:25.790832 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:25.793895 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:25.803143 19894 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:25.951501 19372 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.809508 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:25.807610 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.815336 19295 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:25.824039 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:25.826965 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:25.837081 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 813) took 1875 ms. Trace:
I20260709 13:10:25.838158 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:25.838771 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:25.840246 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1925) took 1208 ms. Trace:
W20260709 13:10:25.844957 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.852043 19902 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
W20260709 13:10:25.849589 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0674172859999089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:10:25.961313 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0422172859999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:10:25.854519 22932 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:25.857345 23081 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.858228 23143 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.858330 23378 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.655763 23421 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:25.984107 23081 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:25.985726 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:25.986546 23081 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.987035 19217 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:10:25.989905 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 202631us
I20260709 13:10:25.991080 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:25.614794 23495 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:26.004607 23143 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.005888 23495 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.006778 23495 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.008030 19367 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:25.894073 23439 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:26.008944 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.009272 23439 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.011145 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:25.896057 23382 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:26.012439 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:26.012732 23382 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:26.012646 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.015354 23382 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.015851 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.016305 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:26.016556 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.017108 19896 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:26.017256 19901 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:26.018404 19373 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:26.018512 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.019448 19899 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:26.012008 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:25.902642 23469 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.904398 23489 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:25.924222 19895 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:25.941035 23375 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.782891 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:25.941751 19216 rpcz_store.cc:269] 0709 13:10:24.115187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.115307 (+   120us) service_pool.cc:224] Handling call
0709 13:10:25.758593 (+1643286us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400019ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.758844 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434111360}
W20260709 13:10:25.945531 19370 rpcz_store.cc:269] 0709 13:10:23.759019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.759470 (+   451us) service_pool.cc:224] Handling call
0709 13:10:25.757337 (+1997867us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400314a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.757598 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3590363392}
I20260709 13:10:25.921293 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:25.950953 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1930) took 1317 ms. Trace:
I20260709 13:10:25.949437 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:25.962437 19225 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:25.960899 19220 rpcz_store.cc:276] 0709 13:10:24.631320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.741419 (+110099us) service_pool.cc:224] Handling call
0709 13:10:24.765882 (+ 24463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.327360 (+561478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.839684 (+512324us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54001b1f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:25.840020 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244023680}
I20260709 13:10:25.960265 19897 rpcz_store.cc:276] 0709 13:10:23.961241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.008298 (+ 47057us) service_pool.cc:224] Handling call
0709 13:10:24.011098 (+  2800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.487205 (+1476107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.836502 (+349297us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54006c98d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:25.836863 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3358359936}
I20260709 13:10:25.979609 23443 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:25.981005 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 171923us
I20260709 13:10:25.981335 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:25.981588 23504 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.982118 19224 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:25.983044 19366 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.983615 19900 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:25.950438 23490 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:10:25.994050 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:25.997053 23378 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:25.978048 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:25.998099 19191 leader_election.cc:336] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.500s (SENT)
I20260709 13:10:25.925156 23389 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:10:26.003772 23376 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.967777 23456 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.023247 23498 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:26.029642 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 54465.4us
I20260709 13:10:26.026151 19219 rpcz_store.cc:276] 0709 13:10:24.633907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.094970 (+461063us) service_pool.cc:224] Handling call
0709 13:10:25.764439 (+669469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.941971 (+177532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.949083 (+  7112us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400019ad0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:25.950873 (+  1790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1538425216}
I20260709 13:10:26.011945 23439 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:25.976284 23402 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:26.032464 19371 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:26.040951 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.040781 23469 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.041883 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:26.042454 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.043174 19216 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:26.046433 23484 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.047225 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:26.042634 19295 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.024883 23143 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:26.047319 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.045730 23455 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.062381 19218 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.058720 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.063464 19894 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:26.056157 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:26.071439 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 96664us
I20260709 13:10:26.075249 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:26.076315 19299 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:26.076750 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.080273 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:26.081162 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51882.1us
I20260709 13:10:26.083262 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:26.085670 23378 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:26.085945 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.086541 23378 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:26.087815 23504 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.088378 23504 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.088857 23504 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.073637 23376 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.092311 23443 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.093312 23421 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.093875 23421 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:26.094074 23376 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.051643 23469 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:26.094775 23443 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.095088 23421 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.095361 23498 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.096012 23379 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.097208 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:26.097579 23498 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.098040 19294 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:26.098279 23501 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:26.099342 19291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.023s
W20260709 13:10:26.099723 19291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.020s	sys 0.023s
I20260709 13:10:26.100517 23465 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.100443 23391 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:26.101042 23465 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.101445 23465 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.102101 19223 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.069764 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.096903 23406 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:26.107035 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.112927 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.113811 19224 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:26.114818 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.115095 23382 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:26.115536 23382 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:26.112605 23356 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.116552 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:26.117420 23549 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:10:26.117681 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.118620 23485 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.119235 23485 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:26.116020 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.120343 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:26.120501 23485 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.121994 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.121343 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.123199 19224 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:26.126817 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 135928us
I20260709 13:10:26.127758 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.128473 19900 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:26.129349 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:26.131536 19224 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:26.131867 19295 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:26.136109 19366 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
W20260709 13:10:26.140269 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52413.5us
I20260709 13:10:26.141144 19223 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:26.142760 19225 raft_consensus.cc:2410] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:26.072710 23489 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.080307 19121 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 6 to 8, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 8 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.144244 19294 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:10:26.145095 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 134126us
W20260709 13:10:26.146956 23371 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.009s
I20260709 13:10:26.147367 23371 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.106588 23378 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:26.148345 23501 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:26.148670 19293 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:26.148747 23378 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.149492 23371 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:26.150903 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.151364 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.152474 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.150923 23440 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:10:26.155012 23469 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:26.146811 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:26.145155 23489 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.146030 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.158489 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.158872 19218 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:26.159454 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.134783 23402 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.134492 22932 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.165789 23081 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.166518 23441 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:26.167636 23376 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.168046 23469 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.168853 19895 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:26.169150 23469 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.170825 23456 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.172086 23193 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:26.173398 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:26.173674 23330 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:26.174080 19894 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.175160 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:26.175967 19897 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:26.176648 19299 raft_consensus.cc:2410] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:26.176867 23455 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.176980 23476 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:26.177345 23455 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:26.162004 23439 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:26.178355 23439 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.178602 23455 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.177449 23487 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.181890 23487 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:26.183235 23553 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:10:26.184651 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 192217us
W20260709 13:10:26.185405 19191 leader_election.cc:336] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.533s (SENT)
I20260709 13:10:26.161093 19223 raft_consensus.cc:2410] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:26.162425 19216 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 4.
I20260709 13:10:26.156651 23143 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.165849 22932 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:26.155023 23354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.026s	sys 0.051s
I20260709 13:10:26.190789 19225 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:26.162091 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.191236 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:26.191754 19224 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.148758 23501 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:26.191457 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.192452 23487 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:26.177486 23476 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.204737 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:26.197860 23354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.026s	sys 0.052s
I20260709 13:10:26.192545 22932 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.209035 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:26.194610 23455 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.192407 23465 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.212639 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.214964 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:26.208060 23484 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.197062 23456 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.216965 23476 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.220613 23402 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:26.221467 19899 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:10:26.208527 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:26.237457 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.224521 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.195251 23143 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.225100 19216 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:26.193468 23375 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:26.236727 19894 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:26.238418 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.235278 19220 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:26.247551 19901 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:26.233315 23443 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.249750 19222 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:26.251279 19220 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:26.251519 23143 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.251813 23354 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:26.252225 23473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.487s	user 0.014s	sys 0.024s
I20260709 13:10:26.252393 19895 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:26.252869 19216 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:26.242966 23375 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:26.235983 23484 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.256524 19897 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:26.264653 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49808.9us
I20260709 13:10:26.268006 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:26.251235 23465 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:26.272621 23375 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:26.252264 23404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.001s	sys 0.031s
W20260709 13:10:26.266379 23473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.556s	user 0.014s	sys 0.025s
I20260709 13:10:26.234587 23489 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.259241 23354 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.256907 23443 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:26.264464 23484 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:26.278926 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 85226.2us
W20260709 13:10:26.284477 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 76362.2us
I20260709 13:10:26.267668 23439 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:26.270810 23440 raft_consensus.cc:2764] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:26.285272 19224 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:26.288791 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:26.280550 23404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.001s	sys 0.032s
I20260709 13:10:26.227041 23382 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.279210 23406 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.297502 19219 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:10:26.306085 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 95851.2us
I20260709 13:10:26.289955 23354 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.308532 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.322569 19219 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:26.369359 19901 raft_consensus.cc:2368] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11.
I20260709 13:10:26.375306 19223 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 13:10:26.376241 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.377743 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 107838us
I20260709 13:10:26.267110 23501 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.334681 23476 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.309054 23406 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:26.388752 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:26.391902 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.389010 23375 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.381067 23143 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:26.405524 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 224722us
I20260709 13:10:26.384130 23504 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.430414 23356 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:26.430756 23406 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.431527 23356 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:26.433743 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.432855 23356 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.435387 23421 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:26.440464 23421 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:26.441957 23421 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:26.442780 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62048.9us
I20260709 13:10:26.443418 23504 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.443670 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:26.436327 23501 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:26.415865 23378 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:26.447564 19216 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:26.447809 23378 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:26.448354 23378 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:26.448966 23443 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.449462 23378 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.450557 23443 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.451294 23378 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:26.452010 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.452647 23379 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.452823 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.436632 23143 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.453487 23379 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.447803 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.456156 23504 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.458070 23504 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:26.459543 23504 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:26.466840 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.489774 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 180762us
I20260709 13:10:26.491113 19263 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:26.492129 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:26.496104 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71196.6us
W20260709 13:10:26.498019 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.497545 23404 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.499243 23404 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.500360 23480 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:26.501538 23404 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:26.501927 23379 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.504087 23402 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:26.505499 23404 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:26.505995 23404 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.505924 22932 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.507045 19218 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:26.507351 23404 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.523051 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:26.524401 19895 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:26.497853 23440 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.528868 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.501683 23143 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:26.538506 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 324651us
I20260709 13:10:26.541221 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:26.527848 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 354886us
I20260709 13:10:26.561604 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:26.564108 19901 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:26.530479 23440 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.517700 23379 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:10:26.576967 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.577291 23480 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:26.577844 23480 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.579193 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.581889 23469 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.582620 23404 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.584105 23567 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:26.562531 23330 consensus_queue.cc:1243] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:26.588406 22932 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.589480 23382 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.588876 19121 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:26.592672 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:26.593367 23565 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.565896 23440 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.607000 22932 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.607815 22932 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:26.608314 22932 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:26.609294 22932 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:26.614010 23554 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.335s	user 0.000s	sys 0.003s
I20260709 13:10:26.615907 23081 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:26.591954 19121 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 6 to 8, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:26.582677 23469 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:26.627800 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.595086 23495 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:26.616524 23330 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.600059 23565 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:26.651103 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:26.657341 23565 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.660744 19901 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:26.662858 23489 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:26.620296 23081 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.681301 23565 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.683593 23565 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:26.687048 23561 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
I20260709 13:10:26.687242 19121 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:26.677377 23354 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:26.690254 23574 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:10:26.690400 23354 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:26.692808 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.702582 23480 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.704844 23480 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:26.707144 19217 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:10:26.708473 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:26.709827 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:26.710752 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:26.654246 23330 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:26.712378 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2125) took 2767 ms (client timeout 2124 ms). Trace:
I20260709 13:10:26.712296 23567 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:26.689870 19121 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:10:26.713042 19374 rpcz_store.cc:269] 0709 13:10:23.909415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.919755 (+ 10340us) service_pool.cc:224] Handling call
0709 13:10:26.666516 (+2746761us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b5400094cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:26.676559 (+ 10043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5642984192}
W20260709 13:10:26.719920 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48275.2us
W20260709 13:10:26.721035 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 175721us
I20260709 13:10:26.712816 23330 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:26.724370 19120 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 263) took 31528 ms (client timeout 15000 ms). Trace:
W20260709 13:10:26.714790 23485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.020s
W20260709 13:10:26.740224 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 213621us
W20260709 13:10:26.731906 23485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.013s	sys 0.020s
I20260709 13:10:26.729343 23469 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.744261 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:26.730641 23473 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:26.757145 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 210570us
I20260709 13:10:26.727882 23480 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:26.741673 23565 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.773628 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:26.774744 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.752775 23469 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:26.768805 23143 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.777055 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:26.794776 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.783614 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:26.801793 19291 raft_consensus.cc:2368] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10.
W20260709 13:10:26.803448 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.785302 23469 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.805090 23568 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:26.808116 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.808736 23436 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:10:26.809351 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:26.810288 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43866.7us
I20260709 13:10:26.811292 19293 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:26.811560 23439 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.812506 23568 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.813496 23568 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:26.814165 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 190047us
I20260709 13:10:26.815403 19337 leader_election.cc:400] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11.
I20260709 13:10:26.815698 19337 leader_election.cc:403] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.816190 23439 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.817246 23439 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.819787 23567 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:26.820401 23567 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:26.816006 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87374.6us
I20260709 13:10:26.796257 23473 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:26.776727 23565 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.850696 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:26.830981 23402 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11.
I20260709 13:10:26.792902 23484 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:26.871441 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.873214 19221 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:26.873788 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.887706 19220 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:26.874794 19218 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:10:26.874939 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.875398 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.875701 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:26.876329 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67048.3us
I20260709 13:10:26.876675 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.876842 23436 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.877691 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.893265 19293 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:26.893505 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.878583 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:26.894430 19219 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:26.889765 19222 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:26.881057 23577 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:26.884917 23473 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:26.896245 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 71592.3us
I20260709 13:10:26.896906 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.902366 19220 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.903139 19895 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.903378 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:26.903745 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:26.904057 23402 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:26.904692 23402 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.906597 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:26.909569 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.912883 23489 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:26.913879 23489 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.914206 23489 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:26.914875 19369 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:26.911134 19223 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:26.927222 23081 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:26.931308 23440 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.932693 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:26.934743 23437 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:26.935318 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:26.728071 19120 rpcz_store.cc:269] 0709 13:09:55.141125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.141414 (+   289us) service_pool.cc:224] Handling call
0709 13:09:55.209695 (+ 68281us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b5400002490. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d910b2 00007fe8ddd0aa89 00007fe8ddca2da6 00007fe8ddc74088 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc
0709 13:09:55.398107 (+188412us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5400002490. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d91640 00007fe8ddc68b76 00007fe8ddd72c3e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:26.655719 (+31257612us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:18.351121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:18.352053 (+   932us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:18.352119 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:10:18.352147 (+    28us) tablet.cc:662] Decoding operations
0709 13:10:18.393599 (+ 41452us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:18.393695 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:18.393720 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:18.394948 (+  1228us) tablet.cc:701] Row locks acquired
0709 13:10:18.394993 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:10:18.395190 (+   197us) write_op.cc:270] Start()
0709 13:10:18.395344 (+   154us) write_op.cc:276] Timestamp: P: 1783602618395100 usec, L: 0
0709 13:10:18.395363 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:18.396087 (+   724us) log.cc:844] Serialized 5979 byte log entry
0709 13:10:20.154997 (+1758910us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:22.807924 (+2652927us) op_driver.cc:464] REPLICATION: finished
0709 13:10:23.117146 (+309222us) write_op.cc:301] APPLY: starting
0709 13:10:23.164887 (+ 47741us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:23.540826 (+375939us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:23.540865 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:23.720400 (+179535us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:23.951322 (+230922us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 13:10:23.998583 (+ 47261us) write_op.cc:312] APPLY: finished
0709 13:10:24.159335 (+160752us) log.cc:844] Serialized 107 byte log entry
0709 13:10:24.424665 (+265330us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.440518 (+ 15853us) write_op.cc:454] Released schema lock
0709 13:10:24.454012 (+ 13494us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:24.525739 (+ 71727us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:24.553641 (+ 27902us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":98661,"reported_tablets":48,"spinlock_wait_cycles":14025984,"child_traces":[["op",{"apply.queue_time_us":295441,"apply.run_cpu_time_us":36079,"apply.run_wall_time_us":1363516,"num_ops":15,"prepare.queue_time_us":532370,"prepare.run_cpu_time_us":25332,"prepare.run_wall_time_us":319377,"raft.queue_time_us":275669,"raft.run_cpu_time_us":71626,"raft.run_wall_time_us":233769,"replication_time_us":4412377,"spinlock_wait_cycles":55554304,"thread_start_us":1247193,"threads_started":5,"wal-append.queue_time_us":593800,"wal-append.run_cpu_time_us":29618,"wal-append.run_wall_time_us":6600329}]]}
I20260709 13:10:26.957257 19220 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:26.957705 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:26.959601 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:26.961048 19223 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:26.961498 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:26.908492 22932 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:26.919667 23404 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.963555 19294 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
W20260709 13:10:26.963505 23476 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.003s
I20260709 13:10:26.971990 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:26.981382 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:26.985462 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130738us
I20260709 13:10:26.965384 23378 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.979656 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:26.990315 19369 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:26.968153 23193 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:26.996410 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 89879.7us
I20260709 13:10:26.968511 23437 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.977864 23081 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.982414 23479 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:26.979743 23585 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:26.963030 23475 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:26.918939 23489 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:26.998883 23193 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:27.029459 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.011446 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:27.008342 19294 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:27.006732 23465 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.016613 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 163310us
I20260709 13:10:27.016923 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.017108 23371 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.977387 23494 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:27.032258 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:26.982913 23404 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.035349 19895 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:27.031600 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:27.039389 23587 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:27.039079 23494 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.041625 23494 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.041690 23404 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.042295 19293 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:27.042897 23465 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.045563 23465 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.046195 23603 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:27.046686 23603 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.047039 23603 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.982100 22932 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.048672 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:27.034233 23585 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:27.050314 23487 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:27.049664 23599 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.033196 23193 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.003187 23439 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:27.042472 23489 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.054836 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.048568 23479 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:27.038057 23504 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.001s
I20260709 13:10:27.065765 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:27.070644 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:27.077400 23402 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.078487 23484 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.079558 23565 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.051782 23476 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:10:27.081619 23567 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.082327 23143 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.083063 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.101946 19365 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.036934 23371 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.084758 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:27.084614 23439 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.057097 23487 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.091454 19291 raft_consensus.cc:2376] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11. Re-sending same reply.
I20260709 13:10:27.090982 23504 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.085026 23479 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.093706 23440 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.094404 23330 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.094892 19896 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:27.096386 23378 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:27.124928 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.126410 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.127457 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.128410 19299 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:27.096663 23476 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:27.093716 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:27.143769 23476 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:27.144260 19294 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:27.114665 23469 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.144845 23476 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.146155 23476 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.147018 23469 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.149204 23567 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.150169 22932 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.152209 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:27.153012 19899 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:27.154412 19366 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
W20260709 13:10:27.154691 23580 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
W20260709 13:10:27.155504 23591 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.341s	user 0.001s	sys 0.002s
I20260709 13:10:27.155998 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:27.097433 23585 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.097919 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:27.099900 23593 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
W20260709 13:10:27.105806 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126264us
I20260709 13:10:27.162652 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:27.109656 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.110208 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.113463 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 514) took 1301 ms. Trace:
I20260709 13:10:27.059594 23568 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:27.163791 19217 rpcz_store.cc:276] 0709 13:10:25.812247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.065215 (+252968us) service_pool.cc:224] Handling call
0709 13:10:27.113239 (+1048024us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54000785d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:27.113383 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268126208}
I20260709 13:10:27.123317 19365 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:27.130610 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.114014 23479 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.067523 23599 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.131170 19291 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.106279 23371 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.111214 23487 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:27.143281 23579 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 13:10:27.164049 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:27.179924 19300 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:10:27.176846 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 80652.5us
I20260709 13:10:27.170516 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:27.179992 19216 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:27.131086 23378 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:27.170823 23605 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:10:27.195133 19222 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:27.168411 23494 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:27.200861 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.162616 23484 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.186911 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.203702 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.200588 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.206386 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:27.207019 19224 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.217080 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:27.217803 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:27.169029 23567 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:27.267364 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:27.196985 23475 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:27.206331 23439 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.199126 23469 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:27.279050 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:27.279441 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.203104 23484 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.280517 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:27.283481 19223 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:27.284639 23599 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.285954 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:27.287108 23378 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.291716 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:27.292428 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73134.3us
I20260709 13:10:27.292812 23475 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:27.293479 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:27.295011 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75623.6us
I20260709 13:10:27.295732 19365 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:27.296530 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.294091 23475 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.302070 23603 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.302807 23485 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:27.303437 23485 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:27.303676 23456 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:27.221217 23565 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:10:27.304437 23485 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.305554 23456 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:27.280351 23469 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:27.294085 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.312741 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:27.308892 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:27.315320 19899 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.312650 19340 leader_election.cc:400] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10.
I20260709 13:10:27.315793 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.317116 19902 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:10:27.315029 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.320735 19222 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:27.325135 23402 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:27.325794 23402 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:27.326807 23402 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.340301 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:27.340930 19292 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:27.346948 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.307871 23484 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.210886 23193 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:27.339756 23582 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:10:27.347613 19221 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:27.275082 23571 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:10:27.315191 23356 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.349890 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:27.276438 23495 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:10:27.352823 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74984.4us
I20260709 13:10:27.352483 19894 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:27.346423 23504 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:10:27.382165 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.307379 23469 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.343676 23465 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:27.380077 23565 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:27.415259 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 205805us
I20260709 13:10:27.420428 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:27.420256 19291 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:27.428643 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50657.2us
I20260709 13:10:27.392637 23603 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.436743 19899 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:27.438390 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:27.396526 23443 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.406404 23613 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:10:27.450069 23615 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:27.443362 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:27.352602 23586 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:10:27.417757 23612 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:10:27.445442 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 121561us
I20260709 13:10:27.449059 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:27.405210 23610 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:10:27.413589 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:27.468113 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.475346 19299 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:27.451644 19292 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:27.444792 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100188us
I20260709 13:10:27.451399 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:27.415539 23489 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:27.489578 23489 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:27.490093 23489 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.450989 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.476807 19300 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.413363 23193 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.482836 19894 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:27.394682 23356 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.499787 23356 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.500339 23599 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.501107 23599 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.503655 23599 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.504356 23379 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.506317 23479 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.441759 22932 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:10:27.487520 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:27.482856 23330 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:27.489089 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49305.6us
I20260709 13:10:27.450702 23469 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.443365 23354 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:27.475716 23443 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.441890 23437 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:10:27.484203 23603 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.476671 23465 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:10:27.533901 19111 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:10:27.538136 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:27.538744 19895 raft_consensus.cc:2368] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10.
I20260709 13:10:27.527951 23371 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.533052 23391 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.526479 23495 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:27.545724 19901 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:10:27.513103 23456 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:27.552556 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:27.553092 19337 leader_election.cc:400] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10.
I20260709 13:10:27.553454 19337 leader_election.cc:403] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:27.555617 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:27.553450 19896 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:27.561297 23626 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:27.564610 23479 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.549115 23391 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.566514 23371 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.567469 23391 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.572928 23487 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.549510 23495 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:27.583148 23495 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:27.585431 23484 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.586624 23603 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:27.589887 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102472us
I20260709 13:10:27.594769 19292 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:27.595516 23501 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:27.612677 19365 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:27.596364 23402 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:27.597883 23379 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:27.575865 23487 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.582309 23489 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.602711 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:27.608513 19369 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:27.611352 19300 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:27.616990 19901 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.613065 19365 pending_rounds.cc:85] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 6
I20260709 13:10:27.558377 23081 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.624488 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 95955.6us
I20260709 13:10:27.624712 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.625875 19367 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.620625 19365 pending_rounds.cc:107] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:27.641312 19365 raft_consensus.cc:2889] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:27.642422 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.625931 19366 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:10:27.649037 19294 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:27.645280 19366 pending_rounds.cc:85] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 7
I20260709 13:10:27.650468 19366 pending_rounds.cc:107] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:10:27.651152 19366 raft_consensus.cc:2889] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.624033 23391 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.625725 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:27.619396 23501 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:27.653374 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:27.653028 23567 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:27.654490 23567 consensus_queue.cc:1243] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:27.655285 23567 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:27.655892 23567 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:27.657040 23567 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.701695 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.643779 23568 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.663349 23193 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.756383 23443 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.680420 23391 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.757875 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:27.758396 23391 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.759385 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:27.759773 19366 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.759868 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.760546 19373 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.760821 23568 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.763236 23568 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.763804 23568 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:27.764112 23479 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:27.765192 23479 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:27.765558 23479 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.765888 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.766721 23354 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:27.767330 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 211781us
I20260709 13:10:27.767674 23354 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.769176 23484 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:27.744387 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.642277 23081 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.782104 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:27.784067 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.787741 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.787870 19372 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:27.787957 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:27.789306 19366 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:27.790292 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.784864 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:27.791597 19369 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:27.737345 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:27.792665 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.793537 19374 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.750715 23559 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
W20260709 13:10:27.751149 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 256383us
I20260709 13:10:27.785969 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:27.732156 23330 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.808655 19365 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:27.805267 19370 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:27.806417 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.807744 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:27.765923 23479 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.817229 19300 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:27.782217 23375 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.823053 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.846549 19366 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.848784 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 111540us
I20260709 13:10:27.850364 19901 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:27.820933 19373 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:27.819583 23495 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:27.832492 23568 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:27.836527 19369 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:27.837517 19218 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:27.838065 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:27.839737 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:27.833843 19111 maintenance_manager.cc:643] P 2d55bdccad9c419a8710b6e2897c2f38: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.222s	user 0.184s	sys 0.074s Metrics: {"bytes_written":30381,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":633999,"dirs.run_cpu_time_us":631,"dirs.run_wall_time_us":34521,"drs_written":1,"lbm_read_time_us":416,"lbm_reads_lt_1ms":4,"lbm_write_time_us":39067,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":297441,"threads_started":1,"update_count":15}
I20260709 13:10:27.840749 19219 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:10:27.887008 19216 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.841719 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 57036.4us
W20260709 13:10:27.842271 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45293.7us
I20260709 13:10:27.854982 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:27.890312 19223 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.893958 19216 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:27.882205 23568 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.896320 23568 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:27.896481 23631 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:10:27.897686 23495 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:27.903426 23081 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:27.866469 23629 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:27.821179 23476 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.926565 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:27.856263 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74255.1us
I20260709 13:10:27.927965 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:27.932579 19223 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:27.863576 19370 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:27.816766 23599 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.756443 23193 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:27.885236 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.943174 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53231.8us
I20260709 13:10:27.784662 23402 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:27.852207 23625 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:27.937094 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:27.859117 23379 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:27.950014 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.866717 23626 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.926733 23489 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:27.952929 19222 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:27.855764 23330 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:27.963740 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:27.934422 19366 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:27.852372 23436 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:10:27.949856 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 163992us
I20260709 13:10:28.032956 19222 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:10:28.040195 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:27.960350 23484 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:27.950407 23402 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:28.032554 19369 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16.
I20260709 13:10:27.956836 23567 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:27.950475 23391 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.971236 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:28.044381 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.046666 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:28.052711 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:28.058256 19366 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.950335 23599 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.059350 19222 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.061941 19112 maintenance_manager.cc:419] P 2d55bdccad9c419a8710b6e2897c2f38: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9022 bytes on disk
I20260709 13:10:28.092236 19374 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:28.063297 23568 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.071251 19366 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:28.073120 23489 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:28.076560 23501 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.051049 23485 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:28.081863 19300 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:28.081977 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:28.103411 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:28.042309 23476 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.961151 23626 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.099342 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:28.080003 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:27.960816 23625 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.084785 23484 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:28.031854 23379 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.142102 19373 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:28.139356 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 203383us
I20260709 13:10:28.181571 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:28.182060 23379 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:28.183228 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:28.103767 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.971s (SENT) [suppressed 14 similar messages]
I20260709 13:10:28.141844 23489 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.184799 19224 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:28.185714 23489 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:28.187153 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.188561 19368 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:10:28.177668 19371 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:10:28.189399 19371 pending_rounds.cc:85] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 5
I20260709 13:10:28.189630 19371 pending_rounds.cc:107] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:28.189862 19371 raft_consensus.cc:2889] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.192279 19300 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:28.188903 19368 pending_rounds.cc:85] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 10
I20260709 13:10:28.193861 19368 pending_rounds.cc:107] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:28.194108 19368 raft_consensus.cc:2889] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:28.194499 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 160563us
I20260709 13:10:28.102712 23485 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.197018 19216 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:28.193325 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:28.091166 23391 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.190131 23439 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:28.212492 23439 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:28.213114 23626 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:28.213537 23439 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.214183 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:28.214680 23439 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:28.196465 23501 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.218814 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:28.219416 19374 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.219276 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:28.221603 23633 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:10:28.224507 23638 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:10:28.225342 19216 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:28.225713 19216 pending_rounds.cc:85] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:10:28.225935 19216 pending_rounds.cc:107] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:28.226156 19216 raft_consensus.cc:2889] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.228669 19216 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.182449 23567 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:28.226092 19374 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:28.245503 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52253.8us
I20260709 13:10:28.246392 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:28.200877 23495 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:28.206395 23485 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.166108 23476 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.253970 19216 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:28.259816 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.280714 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:28.280951 19372 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:28.286037 23441 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:28.290987 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:28.294225 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:28.293001 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:28.293298 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:28.290331 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 186566us
I20260709 13:10:28.295547 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:28.296557 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.292121 19111 maintenance_manager.cc:643] P 2d55bdccad9c419a8710b6e2897c2f38: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.190s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":421,"lbm_reads_lt_1ms":4}
I20260709 13:10:28.298352 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:28.299711 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 231559us
I20260709 13:10:28.286453 23487 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:28.282955 23081 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:28.206714 23402 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.315393 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:28.313117 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:28.314540 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:28.316413 19293 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:28.317675 19299 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:28.289907 23441 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:28.318681 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:28.320955 19300 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:28.287254 23626 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:10:28.322913 19216 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.326758 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:28.328523 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47907.2us
I20260709 13:10:28.312229 23494 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:28.336758 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:28.335233 19299 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:28.335799 23646 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:28.290031 23643 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:28.366909 19298 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:28.375808 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:28.376822 19291 raft_consensus.cc:2410] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:28.376833 19293 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:28.377952 23661 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:28.368371 23494 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.380599 23391 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:28.380688 23494 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.383059 23494 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:28.383819 23330 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:28.384320 23476 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:28.384750 23603 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.762s	user 0.008s	sys 0.004s
I20260709 13:10:28.315716 23504 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:28.317803 23354 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:10:28.386183 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 97572us
W20260709 13:10:28.398728 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64523.5us
I20260709 13:10:28.400136 23603 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10.
I20260709 13:10:28.402776 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:28.420228 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 90407.3us
I20260709 13:10:28.313917 23484 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.406940 19220 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:28.348795 23646 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:28.386731 23375 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 13:10:28.430410 19216 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:28.401551 23402 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.346943 23437 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:10:28.387642 23599 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:28.438809 23647 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:10:28.447413 23632 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.552s	user 0.002s	sys 0.000s
I20260709 13:10:28.443830 19222 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:28.462101 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.494107 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.495246 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 60617us
W20260709 13:10:28.495635 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.465490 19370 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:28.467881 23657 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:28.385396 23441 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.473264 23648 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:28.474030 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:28.474785 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:28.475387 23621 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:28.476519 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:28.478168 19216 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:28.479001 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:28.449276 23586 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.485822 23625 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:28.500432 23479 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.007s
I20260709 13:10:28.456789 23487 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.471650 23603 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.505062 23663 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:10:28.505201 19222 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:28.434542 23646 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:28.507507 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 122334us
W20260709 13:10:28.511125 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.518029 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:28.542431 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.604480 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.435901 23375 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:28.637099 19299 raft_consensus.cc:606] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:28.470084 23564 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:28.656560 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 253862us
W20260709 13:10:28.672557 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.675614 19295 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:28.473968 23658 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.241s
W20260709 13:10:28.713795 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.663898 23625 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.670183 23441 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:28.677335 23330 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.658420 23479 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.651890 23586 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.813110 23625 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.874148 23675 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.876924 23354 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:28.877398 23658 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:28.664192 23487 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:28.661468 23603 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:28.681432 23648 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:28.794101 23626 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.898527 23663 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:10:28.904776 23356 raft_consensus.cc:993] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:28.869340 23379 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.898151 23489 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.960492 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 293803us
I20260709 13:10:28.900029 23330 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:28.985973 23662 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
W20260709 13:10:28.988924 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 321726us
I20260709 13:10:28.991344 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:29.000818 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.961079 23667 raft_consensus.cc:1081] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:28.913933 23675 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.011066 23673 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:28.957914 23626 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.036852 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:28.966403 23489 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:29.098021 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.040856 19896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.001s	sys 0.009s
I20260709 13:10:29.085080 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.100966 19217 raft_consensus.cc:2410] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:29.084677 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.074994 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.066581 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.104373 19222 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:29.103715 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66983.9us
I20260709 13:10:29.114436 19266 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16.
I20260709 13:10:29.114805 19266 leader_election.cc:403] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:10:29.115654 23484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.009s	sys 0.001s
I20260709 13:10:29.116915 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.117744 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.118238 19374 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:29.118992 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.119645 19371 raft_consensus.cc:2368] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
W20260709 13:10:29.120077 23484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.010s	sys 0.001s
I20260709 13:10:29.120458 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.121424 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:29.122077 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 320819us
W20260709 13:10:29.122471 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.124831 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.119371 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:29.125030 19191 connection.cc:256] RPC call timeout handler was delayed by -1.8707108679999465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
I20260709 13:10:29.121814 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.127494 19294 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:29.125448 19191 connection.cc:256] RPC call timeout handler was delayed by -1.7078108680000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:10:29.120838 23660 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.052928 23504 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:29.127125 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.074769 23676 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:29.131945 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:29.132617 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.094856 23479 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.126770 23667 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:29.140372 23626 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.141269 23603 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.074410 23648 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.104265 23402 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:29.144616 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:29.145156 23439 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.930s	user 0.012s	sys 0.001s
I20260709 13:10:29.144901 23402 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.145936 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.146342 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.147042 23402 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.147101 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.147621 23586 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.136642 19372 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:29.149523 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.150167 19372 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:29.150574 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 648) took 1380 ms. Trace:
I20260709 13:10:29.150874 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.148501 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.151583 23676 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.152460 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.152518 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:28.964222 23379 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.155529 19294 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
W20260709 13:10:29.156730 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 157922us
I20260709 13:10:29.153898 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.144627 23487 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.150955 19292 rpcz_store.cc:276] 0709 13:10:27.770042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.771378 (+  1336us) service_pool.cc:224] Handling call
0709 13:10:27.784903 (+ 13525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.851646 (+ 66743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.851688 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.905722 (+ 54034us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.149950 (+1244228us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18004a74c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1
0709 13:10:29.150121 (+   171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:29.150158 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.150243 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.150285 (+    42us) raft_consensus.cc:1685] finished
0709 13:10:29.150296 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.150496 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124878,"raft.queue_time_us":103148,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":22825,"spinlock_wait_cycles":28495488,"thread_start_us":135750,"threads_started":1,"wal-append.queue_time_us":236152}
I20260709 13:10:29.148123 19225 raft_consensus.cc:2410] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:29.152845 23676 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.158340 19371 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:29.159125 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.160804 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.160099 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.180433 19222 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:29.180617 19217 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:29.160274 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.161351 19369 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:29.181574 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.180491 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.182382 19225 raft_consensus.cc:2410] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:29.183557 19222 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:29.185175 19372 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:29.184530 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.186030 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:29.159770 23678 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:10:29.186553 19222 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:29.180439 19368 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:29.190845 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.193470 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.194689 19225 raft_consensus.cc:2410] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:29.113296 23654 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.300s
I20260709 13:10:29.156303 23679 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:29.197199 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.195755 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.183099 23402 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:29.185961 23662 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:29.157832 23653 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:29.181897 23504 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:29.189724 23646 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.009s
I20260709 13:10:29.127363 23670 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:10:29.187498 23379 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.183164 23673 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16.
I20260709 13:10:29.158841 23487 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:10:29.201870 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.202179 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:29.224553 19368 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:29.203085 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.187548 23479 raft_consensus.cc:2764] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:29.191689 23441 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:29.134567 23660 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.224413 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.198160 19217 raft_consensus.cc:2410] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:29.225550 19225 raft_consensus.cc:2376] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9. Re-sending same reply.
I20260709 13:10:29.181653 23439 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:10:29.210549 23625 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.229396 19368 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [7.4-9.5]
W20260709 13:10:29.231513 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74010.5us
I20260709 13:10:29.230726 23379 raft_consensus.cc:2764] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:29.235810 19217 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:29.236447 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.237694 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.249060 19216 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:29.252661 19368 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.253602 19225 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:29.254057 19225 pending_rounds.cc:85] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:10:29.220374 23402 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.254443 19225 pending_rounds.cc:107] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:29.254834 19225 raft_consensus.cc:2889] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.256450 23504 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:29.257591 23683 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:10:29.257972 23686 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:29.258565 23686 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.258880 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.257632 23402 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.261575 23660 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.262490 19368 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.263239 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:29.266903 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.245434 23441 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:29.269088 19368 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.249778 23675 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.268639 23670 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:10:29.272948 23625 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:29.273931 23585 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:29.271929 23688 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:10:29.277077 23485 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.991s	user 0.011s	sys 0.000s
I20260709 13:10:29.277783 19896 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:29.278728 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.278617 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.293045 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.279407 23665 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:29.280428 23629 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:29.259522 23686 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.227696 23646 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.293815 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.270006 23694 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.306015 23441 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.301112 23487 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:29.309748 23375 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.310315 23375 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.314416 23653 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:29.288751 23489 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.315052 23653 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.270922 23679 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:29.324033 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 196983us
I20260709 13:10:29.324877 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.328814 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.346894 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.347127 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.301772 23694 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.316258 23675 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.316123 23670 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:29.349766 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.350075 19191 leader_election.cc:400] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:29.356367 19191 leader_election.cc:403] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:29.356948 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:29.357565 19292 raft_consensus.cc:606] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.358160 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.340646 23439 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:29.296324 23485 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.361974 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.349148 23626 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:29.363513 23402 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:29.383000 23402 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:29.384068 23402 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.350620 23629 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.355454 23697 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:29.352377 23670 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.359812 23686 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:29.358682 23469 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.394443 23659 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:29.395692 23693 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:10:29.396649 23636 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.362s	user 0.007s	sys 0.006s
I20260709 13:10:29.348832 23487 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:10:29.351440 23694 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.345554 23660 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:10:29.363381 23421 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:29.362346 23375 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.380759 23625 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
W20260709 13:10:29.404708 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54806.7us
I20260709 13:10:29.392417 23626 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:29.406883 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.407498 23479 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.399561 23688 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:29.412921 23646 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.414552 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.417520 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.415628 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.409394 23686 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.411443 23688 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.426116 23701 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:10:29.426318 23675 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:29.427244 23489 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:29.428280 23675 consensus_queue.cc:1243] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:29.428366 23489 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:29.428944 23489 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:29.429019 23675 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:29.429577 23675 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:29.429965 23489 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.430052 23626 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.430429 23675 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.431247 23489 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.431494 23626 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.431600 23675 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:29.432524 23379 consensus_queue.cc:1175] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 10 status { last_received { term: 6 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: [7.4-9.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:29.436673 23686 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.437256 23382 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:29.437698 23382 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:29.438495 23382 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.439653 23382 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.417763 23625 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.399358 23679 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.443042 23421 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:29.449354 23654 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:29.451303 23653 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.453105 23485 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.419651 23665 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.414665 23479 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.456648 23479 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.425495 23688 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.457522 23440 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:29.460443 19366 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:29.420902 23629 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.465021 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2186) took 1243 ms. Trace:
W20260709 13:10:29.467944 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2171) took 1708 ms (client timeout 2206 ms). Trace:
I20260709 13:10:29.465751 19366 rpcz_store.cc:276] 0709 13:10:28.218070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.220678 (+  2608us) service_pool.cc:224] Handling call
0709 13:10:29.447667 (+1226989us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:10:29.447950 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.461022 (+ 13072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.461298 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38538624}
W20260709 13:10:29.468526 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.468400 19365 rpcz_store.cc:269] 0709 13:10:27.759823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.765626 (+  5803us) service_pool.cc:224] Handling call
0709 13:10:29.467732 (+1702106us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:29.467868 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96370432}
I20260709 13:10:29.464895 23421 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.471381 19371 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:29.422641 23378 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:10:29.465636 23629 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.416579 23670 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.475924 23421 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.482573 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.470453 23504 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.487069 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.488121 19365 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:29.464769 23675 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:10:29.482302 23629 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.511376 23625 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:29.511952 23625 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:29.489744 23504 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.513116 23625 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.514233 23504 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.514485 23625 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.518146 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 844) took 1211 ms. Trace:
I20260709 13:10:29.525848 19903 rpcz_store.cc:276] 0709 13:10:28.307010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.307458 (+   448us) service_pool.cc:224] Handling call
0709 13:10:28.307751 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.307941 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:28.318595 (+ 10654us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.517420 (+1198825us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b18002c67a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:10:29.517613 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.517726 (+   113us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:29.517795 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.517908 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.518071 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2574,"prepare.queue_time_us":11866,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1200997,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":10772352}
I20260709 13:10:29.527243 19219 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:29.529083 19222 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:29.532840 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.533305 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.533798 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.538009 23484 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:29.544832 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 1.02684e+06us
I20260709 13:10:29.545100 23501 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.547066 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:29.549489 23501 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:29.550594 23501 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:29.551098 23501 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:29.551990 23501 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.552701 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 654) took 1009 ms. Trace:
I20260709 13:10:29.555881 19374 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:29.560434 23391 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:29.560927 23391 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:29.562027 23391 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.563362 23391 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:29.567204 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.567970 19899 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:29.569926 23717 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:29.570560 19372 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:10:29.570760 19369 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:29.570523 23717 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.572124 19369 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:29.525139 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.574726 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2185) took 1357 ms. Trace:
I20260709 13:10:29.573784 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2351) took 1169 ms. Trace:
I20260709 13:10:29.576052 19365 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:29.576012 19220 rpcz_store.cc:276] 0709 13:10:28.404439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.434854 (+ 30415us) service_pool.cc:224] Handling call
0709 13:10:28.435244 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.435483 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:28.670338 (+234855us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.066715 (+396377us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.549983 (+483268us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b18003aaaa0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:10:29.573466 (+ 23483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.573518 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:29.573561 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.573625 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.573728 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36199,"prepare.queue_time_us":560111,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":77,"raft.queue_time_us":29100,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":45195,"spinlock_wait_cycles":72761600,"thread_start_us":591240,"threads_started":3,"wal-append.queue_time_us":490669}
I20260709 13:10:29.575198 19373 rpcz_store.cc:276] 0709 13:10:28.217695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.220385 (+  2690us) service_pool.cc:224] Handling call
0709 13:10:29.524994 (+1304609us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:10:29.574653 (+ 49659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23115648}
I20260709 13:10:29.580039 19369 pending_rounds.cc:85] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 5
I20260709 13:10:29.580668 19369 pending_rounds.cc:107] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:29.581259 19369 raft_consensus.cc:2889] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.581427 19296 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:29.582373 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.583043 19294 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.577412 19365 pending_rounds.cc:85] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 5
I20260709 13:10:29.584353 19365 pending_rounds.cc:107] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:29.584583 19365 raft_consensus.cc:2889] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.518566 23629 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.553083 19300 rpcz_store.cc:276] 0709 13:10:28.543223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.543437 (+   214us) service_pool.cc:224] Handling call
0709 13:10:28.543931 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.961515 (+417584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.961564 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.970056 (+  8492us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.124029 (+153973us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:29.124076 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.552289 (+428213us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54002b7ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:29.552337 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.552384 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:29.552398 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.552630 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23281,"raft.queue_time_us":52822,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":31651,"spinlock_wait_cycles":905368960,"thread_start_us":151713,"threads_started":1,"wal-append.queue_time_us":159718}
I20260709 13:10:29.572911 23717 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.554636 23694 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.625171 23193 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.638230 23676 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.640259 19294 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:29.621948 23485 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:10:29.641362 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.641659 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:29.621196 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 73032us
I20260709 13:10:29.621670 23143 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:29.641856 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.619626 23571 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:29.646001 23485 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:29.628626 23688 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.646327 23330 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.662050 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:29.666669 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:29.671576 23443 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:29.672307 23484 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:29.672768 23484 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:29.673148 23484 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.652657 23143 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.665095 23485 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:29.672045 23443 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:29.685783 23443 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.689433 23694 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.700606 23143 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.702620 23330 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:29.703238 23330 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.703712 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:29.704891 19371 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:29.705158 23688 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.705644 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.707154 19373 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:29.706847 23485 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.709501 23565 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.709602 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.710012 23565 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.710247 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.710901 19293 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:29.711400 19297 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:29.712035 23565 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.712359 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.773932 19297 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:29.712575 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.774057 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.712598 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.709100 23330 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:29.713712 23643 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:29.715494 23465 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:29.715654 23670 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.716224 23645 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:29.711817 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.838140 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.838987 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:29.839358 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.840200 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:29.717784 23356 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.840765 19373 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.840909 23356 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.843410 23628 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:29.843830 23628 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:29.844739 23628 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.846099 23628 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:29.721033 23629 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.725663 23437 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:29.848953 23437 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.767607 23669 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:29.840931 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.852290 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.713168 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:29.732088 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.853668 23193 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:29.732126 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2175) took 1776 ms. Trace:
I20260709 13:10:29.854341 19370 rpcz_store.cc:276] 0709 13:10:27.955852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.970928 (+ 15076us) service_pool.cc:224] Handling call
0709 13:10:29.731926 (+1760998us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400298954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:29.732058 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838837120}
I20260709 13:10:29.855266 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.855466 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.855963 23565 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:29.856521 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.733664 23489 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.734737 19374 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:29.736220 23661 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:29.737092 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 649) took 1964 ms. Trace:
I20260709 13:10:29.742103 23443 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:29.746026 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.747745 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.749782 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.751194 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.752344 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.869392 19224 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:29.869547 19220 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:29.752872 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.753044 23660 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:29.753585 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.757031 23634 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.759632 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 705) took 1682 ms. Trace:
I20260709 13:10:29.760399 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:29.764943 19218 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.765303 23568 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.768289 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.774639 19217 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:29.883294 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.874825 19894 rpcz_store.cc:276] 0709 13:10:28.077480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.079387 (+  1907us) service_pool.cc:224] Handling call
0709 13:10:28.079735 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.107787 (+ 28052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.141388 (+ 33601us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.683793 (+1542405us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b2c000474b8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:10:29.684215 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.756734 (+ 72519us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:29.756774 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.756858 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.759063 (+  2205us) raft_consensus.cc:1685] finished
0709 13:10:29.759085 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.759566 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21222,"raft.queue_time_us":22520,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":81130,"spinlock_wait_cycles":57207168,"thread_start_us":72190,"threads_started":1,"wal-append.queue_time_us":72445}
I20260709 13:10:29.885526 23661 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:29.886274 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 182445us
I20260709 13:10:29.815904 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:29.860512 23484 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.885543 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.889559 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.889796 23356 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.881727 23660 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.890792 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.812384 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.887156 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:29.898694 19900 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:29.898904 23443 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.826807 19225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:10:29.899684 19225 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.831009 23643 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:29.848452 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:29.849869 23437 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.726938 23564 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:29.853104 19292 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:29.857681 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.857342 23143 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:29.902918 19298 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:29.865044 19295 rpcz_store.cc:276] 0709 13:10:27.773090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.783249 (+ 10159us) service_pool.cc:224] Handling call
0709 13:10:27.783581 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.676121 (+892540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.736802 (+1060681us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400346554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:29.737024 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050996480}
I20260709 13:10:29.870983 19223 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:29.905067 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.905387 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.868721 19221 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:29.905836 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.906103 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.906702 19223 raft_consensus.cc:2410] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:10:29.815738 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.890821 19903 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:29.818379 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:29.891376 23484 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.817440 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.907644 19902 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:29.888317 19299 raft_consensus.cc:606] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:29.870942 23599 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.900137 19225 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.878803 23193 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:29.812366 23378 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:29.902091 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:29.859891 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:29.866340 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93946.6us
I20260709 13:10:29.917187 23588 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.901024 23629 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:29.925815 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65985.2us
I20260709 13:10:29.926419 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.902518 19293 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:29.928459 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:29.877183 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 116882us
I20260709 13:10:29.909323 19299 raft_consensus.cc:614] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:29.872609 23688 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:29.893079 23660 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:29.809393 23501 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:29.911568 23568 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:29.899809 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:29.911616 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.913995 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:29.963676 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63907.3us
I20260709 13:10:29.920140 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.904804 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.922595 19218 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:29.969777 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:29.888020 23661 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.919180 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:29.930398 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:29.899701 23443 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:29.931188 19373 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:10:29.942194 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.945262 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:29.972661 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.973244 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.873049 23489 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:29.904377 23564 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:29.910980 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.908993 23494 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:29.908905 23436 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.989573 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70507.2us
I20260709 13:10:29.974291 19224 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:29.977101 19292 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 4.
I20260709 13:10:29.981565 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.985001 19293 raft_consensus.cc:2368] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:29.977288 19291 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:29.992902 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.995518 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:29.995532 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.997519 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:30.000504 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:29.940706 23487 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:30.009334 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:29.911435 23143 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.021108 23629 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:30.006410 23443 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:30.029480 23629 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:30.030201 23629 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.030350 23443 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.031566 23659 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:30.032007 23659 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:30.021687 23382 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:30.032429 23659 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:30.032706 23382 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:30.033658 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 51125.6us
I20260709 13:10:30.035614 23382 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:30.021943 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:30.036339 23655 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.037165 23655 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:30.038053 19295 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:10:30.038244 23634 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:30.038836 23634 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.024706 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:30.040575 19221 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:30.041764 19220 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:30.026607 23564 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.044725 23564 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.021246 19291 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:29.968753 23501 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.054172 23501 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.054579 19293 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.962893 23568 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.055301 23568 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.011790 23436 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.917716 23588 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.027570 23494 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.959021 23479 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:10:30.074899 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:30.030953 23143 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.065580 19298 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.967471 23465 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.987049 23625 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:30.189141 19225 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.077215 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:30.077728 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:30.079031 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:30.077734 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:30.198824 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 121168us
I20260709 13:10:30.199209 19222 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:30.080684 19299 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:30.082393 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.082955 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:30.202111 19292 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:29.932749 23378 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:29.994972 23437 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.184787 23664 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.014568 23673 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.014179 23487 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:30.186431 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:29.956148 23441 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:10:30.090296 19368 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:10:30.231491 19217 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.231668 19368 pending_rounds.cc:85] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 10
W20260709 13:10:30.192718 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.232134 19368 pending_rounds.cc:107] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:10:30.233481 19368 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:30.234090 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.199819 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:29.999248 23660 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.173s
I20260709 13:10:29.987026 23717 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:10:30.013382 23661 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 13:10:30.091095 23456 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:30.248481 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 156758us
I20260709 13:10:30.249459 19222 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:30.213071 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:30.196110 23625 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:30.257432 19901 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:30.236922 23487 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.233238 23143 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.237879 23441 consensus_queue.cc:1243] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:30.241747 23382 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:30.242066 23489 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:30.312561 19217 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:30.257259 23625 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:30.324484 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 397161us
I20260709 13:10:30.084190 23645 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.335325 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:30.293386 23378 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.345068 19225 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.329838 23673 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:30.303186 23143 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.308871 23382 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:30.364491 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 300029us
I20260709 13:10:30.256291 23456 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.335426 23193 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:30.303824 23676 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:30.362259 23673 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.367714 23382 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.364410 23143 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.360838 23378 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:30.426570 23729 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:30.427611 23698 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:30.432744 23730 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:10:30.433858 23733 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:10:30.435289 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2172) took 2675 ms. Trace:
I20260709 13:10:30.435635 19367 rpcz_store.cc:276] 0709 13:10:27.760124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.783386 (+ 23262us) service_pool.cc:224] Handling call
0709 13:10:27.789232 (+  5846us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:28.064268 (+275036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.064308 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:28.064901 (+   593us) log.cc:844] Serialized 52 byte log entry
0709 13:10:29.750097 (+1685196us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b1800487fc0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:10:29.870699 (+120602us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:29.870739 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.997093 (+126354us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400297f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:29.997171 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.434988 (+437817us) raft_consensus.cc:1685] finished
0709 13:10:30.435021 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.435204 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5842,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":628142592,"thread_start_us":120416,"threads_started":1,"wal-append.queue_time_us":2151492}
I20260709 13:10:30.354446 23645 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.208335 23664 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.459940 23742 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:30.460637 23742 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.461127 23742 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.461720 23645 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:30.462949 23723 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:10:30.464092 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2192) took 1002 ms. Trace:
I20260709 13:10:30.464473 19366 rpcz_store.cc:276] 0709 13:10:29.461749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.488924 (+ 27175us) service_pool.cc:224] Handling call
0709 13:10:29.489705 (+   781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.499790 (+ 10085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.499865 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.500447 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.861489 (+361042us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:29.861549 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.861641 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.463892 (+602251us) raft_consensus.cc:1685] finished
0709 13:10:30.463911 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.464037 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4325,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":12427,"thread_start_us":253635,"threads_started":1,"wal-append.queue_time_us":424045}
I20260709 13:10:30.465660 23441 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:30.466392 23441 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.468675 23193 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:30.471216 23727 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.448s	user 0.003s	sys 0.000s
I20260709 13:10:30.456015 23494 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.457815 23479 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:30.487782 19266 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.012s	sys 0.004s
W20260709 13:10:30.488142 19266 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.012s	sys 0.004s
W20260709 13:10:30.488517 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 727822us
W20260709 13:10:30.482198 23628 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.007s
I20260709 13:10:30.461714 23664 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:29.994661 23643 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.483903 23588 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.475539 23378 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.487056 23330 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:30.531801 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:30.539042 19371 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:30.560842 19371 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:30.563125 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:30.564812 19366 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:30.563433 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:30.566344 19298 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:30.566186 23700 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:30.567680 23565 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.568065 23565 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:30.568478 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:30.569330 19372 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:30.569020 23565 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:30.570781 23565 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:30.557466 23634 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
I20260709 13:10:30.573143 19293 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.573267 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:30.584548 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:30.589402 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 401452us
W20260709 13:10:30.590832 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.573876 23735 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:10:30.559015 23655 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:30.574895 23494 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.597977 19900 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:30.610152 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.610750 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.587076 23688 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:30.549497 23330 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:30.619028 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 406040us
I20260709 13:10:30.574857 23634 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:30.594691 23564 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.001s
I20260709 13:10:30.626713 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:30.597852 23588 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:30.579543 23698 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:30.597591 23441 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:30.611837 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:30.638725 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:30.623018 23746 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:30.644583 19894 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.638764 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:30.645888 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:30.619167 23655 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:30.659461 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 324389us
I20260709 13:10:30.660490 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:30.620784 23494 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:30.661453 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.646778 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:30.641935 23441 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.665712 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:30.665853 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:30.667115 19900 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:30.639955 23456 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.649183 23698 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:30.661279 23740 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:10:30.644917 23746 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:30.640043 23564 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:10:30.688803 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.723311 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:30.687309 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:30.752482 19219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.007s	sys 0.027s
I20260709 13:10:30.682021 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:30.756682 19219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.007s	sys 0.027s
I20260709 13:10:30.716540 23741 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:30.680572 23738 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:10:30.716256 23743 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:10:30.673619 23480 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:30.762275 19263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.033s
I20260709 13:10:30.677266 23661 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:30.760288 19217 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:30.791147 19263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.040s
W20260709 13:10:30.791814 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 542597us
I20260709 13:10:30.681306 23698 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:30.799947 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.800273 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 120157us
I20260709 13:10:30.805508 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:30.808427 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.810236 19900 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:30.759068 23754 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.676977 23625 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:30.827853 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.829650 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.677791 23441 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.831866 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:30.832571 19298 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:10:30.832952 19298 pending_rounds.cc:85] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 6
I20260709 13:10:30.762084 23741 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:30.833160 19298 pending_rounds.cc:107] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:10:30.841823 19298 raft_consensus.cc:2889] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:30.763823 23378 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.810981 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:30.839226 19292 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:30.850654 19293 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:30.797731 23480 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:30.810341 23748 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:30.742337 23382 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.825157 23754 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.863538 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2357) took 1089 ms. Trace:
W20260709 13:10:30.833448 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 216304us
I20260709 13:10:30.872483 19216 rpcz_store.cc:276] 0709 13:10:29.774547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.774830 (+   283us) service_pool.cc:224] Handling call
0709 13:10:29.849229 (+ 74399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.849580 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.849613 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.850078 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.116785 (+266707us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:30.116849 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.116954 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.863298 (+746344us) raft_consensus.cc:1685] finished
0709 13:10:30.863323 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.863469 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5391,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":266232,"threads_started":1,"wal-append.queue_time_us":678105}
I20260709 13:10:30.869108 19372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
W20260709 13:10:30.877120 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 238444us
I20260709 13:10:30.877547 19372 raft_consensus.cc:606] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:30.797140 23437 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:30.849893 23741 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.842943 23717 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.760291 23673 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:30.864001 23480 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:30.891698 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 80824.7us
W20260709 13:10:30.892707 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 192030us
I20260709 13:10:30.896060 19897 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:30.878212 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:30.901017 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:30.893457 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:30.890129 23568 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.830s	user 0.008s	sys 0.004s
I20260709 13:10:30.881239 23763 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.933490 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1995) took 1124 ms. Trace:
I20260709 13:10:30.884338 23754 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.891664 23634 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.855324 23758 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:10:30.933987 19221 rpcz_store.cc:276] 0709 13:10:29.809452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.041458 (+232006us) service_pool.cc:224] Handling call
0709 13:10:30.041937 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.042411 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.042453 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.043261 (+   808us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.403341 (+360080us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:30.763909 (+360568us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.874052 (+110143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.874248 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.933247 (+ 58999us) raft_consensus.cc:1685] finished
0709 13:10:30.933275 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.933435 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312523,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1591,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":816623,"threads_started":3,"wal-append.queue_time_us":549224}
W20260709 13:10:30.928956 23670 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.095s	user 0.010s	sys 0.003s
W20260709 13:10:30.957465 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 62009.9us
I20260709 13:10:30.891728 23564 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.960472 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:30.937847 23659 consensus_meta.cc:287] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.901s	user 0.012s	sys 0.000s
I20260709 13:10:30.896499 23193 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:30.893316 23748 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:10:30.947867 23655 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:30.979105 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2373) took 1052 ms. Trace:
W20260709 13:10:30.987933 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 114062us
I20260709 13:10:30.990435 19222 rpcz_store.cc:276] 0709 13:10:29.926906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.250438 (+323532us) service_pool.cc:224] Handling call
0709 13:10:30.250738 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.250984 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:30.584098 (+333114us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.978317 (+394219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.978501 (+   184us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:30.978629 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.978764 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.979012 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":464680,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":131365,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5048,"thread_start_us":680083,"threads_started":3,"wal-append.queue_time_us":361538}
I20260709 13:10:30.861039 23746 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.004321 19221 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:31.007037 19221 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:30.966056 23749 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:30.965701 23564 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:31.008845 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 115456us
I20260709 13:10:30.953708 23758 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:10:30.934195 23568 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.018338 19300 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:31.002272 23717 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.005271 23634 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.027594 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f43f1e515be64813bb797fabd579621f"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:30.946966 23763 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.032392 19297 raft_consensus.cc:606] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:31.005138 23494 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.037484 19369 raft_consensus.cc:2368] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10.
I20260709 13:10:30.975876 23659 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.009344 23749 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:31.039199 19373 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:30.948277 23698 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:31.040386 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 80079us
I20260709 13:10:31.036275 23634 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.009974 23479 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:10:31.044960 23479 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.045457 23634 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.045956 23673 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.046584 23673 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:31.048936 23770 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:10:31.052371 23768 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:10:31.053375 23753 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:10:31.054255 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.055166 23634 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:31.055413 23744 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:10:31.055622 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:31.057061 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2362) took 1272 ms. Trace:
I20260709 13:10:31.040758 23749 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.061923 23763 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:31.063078 23734 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.040s	user 0.000s	sys 0.002s
I20260709 13:10:31.064342 23564 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.066200 23675 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:31.069095 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2359) took 1293 ms. Trace:
I20260709 13:10:31.068913 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:31.069832 23750 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:10:31.070273 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:31.071115 23748 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:31.072809 23765 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:10:31.075860 23739 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.581s	user 0.000s	sys 0.006s
W20260709 13:10:31.073577 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.074476 23771 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:31.018383 23779 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.083586 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.108672 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.028117 23688 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.080044 19224 rpcz_store.cc:276] 0709 13:10:29.785222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.990763 (+205541us) service_pool.cc:224] Handling call
0709 13:10:30.070958 (+ 80195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.088197 (+ 17239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.088228 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.196547 (+108319us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.589727 (+393180us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:30.589769 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.589847 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.056779 (+466932us) raft_consensus.cc:1685] finished
0709 13:10:31.056805 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.056991 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1975,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":341950,"threads_started":1,"wal-append.queue_time_us":469762}
I20260709 13:10:31.077044 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.099519 19223 rpcz_store.cc:276] 0709 13:10:29.775518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.907336 (+131818us) service_pool.cc:224] Handling call
0709 13:10:29.907658 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.208566 (+300908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.208628 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.208695 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:30.208743 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.068869 (+860126us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540039add4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:31.068912 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.069037 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691324160}
W20260709 13:10:31.091626 23143 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.649s	user 0.000s	sys 0.011s
I20260709 13:10:31.073608 23659 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.087033 23783 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.118906 23688 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.107329 23748 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.112973 23382 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.090704 23634 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:31.111050 23698 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.128830 23568 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.132218 23754 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.132112 19221 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.045432 23479 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.123934 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2364) took 1259 ms. Trace:
I20260709 13:10:31.139550 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.143119 19900 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:31.143842 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:31.100571 23763 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.157680 19297 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.095999 23675 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:31.155804 19220 rpcz_store.cc:276] 0709 13:10:29.864234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.043663 (+179429us) service_pool.cc:224] Handling call
0709 13:10:30.043967 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.090403 (+ 46436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.189777 (+ 99374us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.222130 (+ 32353us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.730808 (+508678us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:30.730846 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.730927 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.123714 (+392787us) raft_consensus.cc:1685] finished
0709 13:10:31.123735 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.123877 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3427,"raft.queue_time_us":76998,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":3713,"thread_start_us":389814,"threads_started":1,"wal-append.queue_time_us":595198}
I20260709 13:10:31.110471 23794 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.168985 19221 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:31.147686 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 136233us
W20260709 13:10:31.151922 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 250965us
I20260709 13:10:31.154032 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 711) took 1057 ms. Trace:
I20260709 13:10:31.175540 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:31.177289 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.177210 19901 rpcz_store.cc:276] 0709 13:10:30.078099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.078798 (+   699us) service_pool.cc:224] Handling call
0709 13:10:31.135118 (+1056320us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b54001eee54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:31.135285 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135188352}
I20260709 13:10:31.176718 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 1993) took 1422 ms. Trace:
I20260709 13:10:31.183398 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1947) took 1308 ms. Trace:
I20260709 13:10:31.149506 23748 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.144773 23441 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:31.168962 23742 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.000s
I20260709 13:10:31.183887 19295 rpcz_store.cc:276] 0709 13:10:29.874904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.039247 (+164343us) service_pool.cc:224] Handling call
0709 13:10:30.039690 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.048782 (+  9092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.048833 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.049666 (+   833us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.525335 (+475669us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:30.559128 (+ 33793us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.565626 (+  6498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.565754 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.054795 (+489041us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:31.176547 (+121752us) raft_consensus.cc:1685] finished
0709 13:10:31.183166 (+  6619us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.183340 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1766,"prepare.queue_time_us":33400,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":10679,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"spinlock_wait_cycles":6179584,"thread_start_us":475057,"threads_started":1,"wal-append.queue_time_us":697622}
I20260709 13:10:31.180665 19220 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:31.188622 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:31.183817 19219 rpcz_store.cc:276] 0709 13:10:29.754212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.754358 (+   146us) service_pool.cc:224] Handling call
0709 13:10:29.754831 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:29.755388 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.755432 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:29.756018 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 13:10:29.949331 (+193313us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:30.757774 (+808443us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.930940 (+173166us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.950411 (+ 19471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.950488 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.062485 (+111997us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:31.130218 (+ 67733us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b18004a5360. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:31.176458 (+ 46240us) raft_consensus.cc:1685] finished
0709 13:10:31.176487 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.176647 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97202,"prepare.queue_time_us":805415,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":285453,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":8904,"spinlock_wait_cycles":17555584,"thread_start_us":1094318,"threads_started":4,"wal-append.queue_time_us":266345}
W20260709 13:10:31.191129 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 181507us
I20260709 13:10:31.215540 19220 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:31.189266 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:31.192334 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.216872 19901 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.190677 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:31.180258 23568 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.136790 23143 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:31.232391 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44072.7us
I20260709 13:10:31.234727 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:31.235600 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.185002 23772 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.155005 23783 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:31.237636 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45399.3us
I20260709 13:10:31.238775 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:31.239136 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48492.5us
W20260709 13:10:31.229251 23629 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.198s	user 0.015s	sys 0.000s
I20260709 13:10:31.241451 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 744) took 1399 ms. Trace:
I20260709 13:10:31.246181 19370 rpcz_store.cc:276] 0709 13:10:29.842405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.855331 (+ 12926us) service_pool.cc:224] Handling call
0709 13:10:29.855679 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.856053 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.856088 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.856649 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.300001 (+443352us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:30.300805 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.325430 (+ 24625us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.075123 (+749693us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:31.233178 (+158055us) raft_consensus.cc:1685] finished
0709 13:10:31.233209 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.241385 (+  8176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8170,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6292,"spinlock_wait_cycles":69771136,"thread_start_us":441185,"threads_started":1,"wal-append.queue_time_us":597793}
W20260709 13:10:31.249308 19300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1962) took 1513 ms (client timeout 1868 ms). Trace:
W20260709 13:10:31.249816 19300 rpcz_store.cc:269] 0709 13:10:29.725201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.854988 (+129787us) service_pool.cc:224] Handling call
0709 13:10:31.238762 (+1383774us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003f2ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:31.238869 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559388032}
I20260709 13:10:31.168632 23193 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:10:31.202844 23795 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.253990 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.202790 23791 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.244385 19220 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.256881 19366 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:10:31.183647 23794 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.264870 19223 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:31.265949 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.266287 23773 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.266453 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.267077 23778 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:31.267540 23778 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.268024 23780 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:10:31.270262 23774 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:31.272320 19191 leader_election.cc:400] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:31.272699 19191 leader_election.cc:403] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:31.273880 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.266036 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.274760 23494 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:31.275578 23494 consensus_queue.cc:1243] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:31.275693 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.276350 23779 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.276906 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.277498 19367 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:31.277990 23143 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.278268 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.278645 23143 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:31.279410 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.240808 23675 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.281173 23675 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.288638 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.289197 23479 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.289399 19366 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:31.290568 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.291103 19366 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.267845 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.292088 19374 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:31.292212 19365 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:10:31.294266 23793 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:31.293191 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.276094 23494 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:31.256697 23629 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:31.298940 23734 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:31.241110 23764 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.214025 23763 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:10:31.251883 23772 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.307286 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:31.237407 23758 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.309758 19372 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:31.329464 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.351158 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:31.243587 23673 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:31.344666 23798 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.352335 23758 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.360047 23758 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.359603 23798 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.323083 19371 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:31.362046 23798 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:31.360188 23725 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.128s	user 0.000s	sys 0.009s
I20260709 13:10:31.373963 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.353125 19220 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.358975 19219 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:31.353806 19370 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [8.6-10.7]
W20260709 13:10:31.355147 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 91434.4us
W20260709 13:10:31.375983 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.375993 19219 pending_rounds.cc:85] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:10:31.377089 19219 pending_rounds.cc:107] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:31.344521 23786 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.377377 19219 raft_consensus.cc:2889] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:31.377694 23786 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.378526 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:31.358234 23732 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.337s	user 0.005s	sys 0.000s
I20260709 13:10:31.379144 19219 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:31.379952 19901 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:31.301433 23754 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.389508 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 661) took 1746 ms. Trace:
I20260709 13:10:31.389427 23748 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.390196 19296 rpcz_store.cc:276] 0709 13:10:29.642953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.643091 (+   138us) service_pool.cc:224] Handling call
0709 13:10:29.643403 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.643718 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.643746 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.644208 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.858797 (+214589us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:29.858860 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.858960 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.359458 (+1500498us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:31.389144 (+ 29686us) raft_consensus.cc:1685] finished
0709 13:10:31.389172 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.389433 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1042,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":2079,"spinlock_wait_cycles":24010496,"thread_start_us":214191,"threads_started":1,"wal-append.queue_time_us":363433}
W20260709 13:10:31.360054 23588 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.002s
I20260709 13:10:31.392421 23588 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:31.392526 19294 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:31.392880 23783 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:31.300127 23629 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.393698 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 714) took 1646 ms. Trace:
I20260709 13:10:31.394200 19896 rpcz_store.cc:276] 0709 13:10:29.747031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.747310 (+   279us) service_pool.cc:224] Handling call
0709 13:10:29.747580 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.747966 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.747992 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:29.748462 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.873364 (+124902us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:29.873421 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.873514 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.351598 (+1478084us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:31.393363 (+ 41765us) raft_consensus.cc:1685] finished
0709 13:10:31.393388 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.393627 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8107,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":74,"spinlock_wait_cycles":6580608,"thread_start_us":124513,"threads_started":1,"wal-append.queue_time_us":272572}
I20260709 13:10:31.374763 19365 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:31.397060 23794 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.397292 23717 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:31.397531 23565 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.001s
I20260709 13:10:31.397985 19224 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:31.307003 23487 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.991s	user 0.010s	sys 0.000s
I20260709 13:10:31.315424 23772 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.343847 23193 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.417547 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.418025 23193 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.267887 23778 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:31.425091 23717 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.428093 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:31.429942 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.432106 23759 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:31.432675 23759 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:31.433147 23759 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.434046 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 746) took 1382 ms. Trace:
I20260709 13:10:31.434468 19373 rpcz_store.cc:276] 0709 13:10:30.051857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.056254 (+  4397us) service_pool.cc:224] Handling call
0709 13:10:30.056544 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.039609 (+983065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.433779 (+394170us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400424ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:31.433980 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259412736}
I20260709 13:10:31.435609 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:31.234021 23742 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.440991 23786 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.367767 19221 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:31.358619 23673 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:31.304749 23764 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.398875 23779 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:31.403679 23437 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:31.408565 19366 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:31.410627 23487 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.416847 23749 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.381157 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.401324 19297 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:31.467242 19371 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:31.391965 23748 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.443754 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:31.452574 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.448127 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.446914 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:31.452842 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.458781 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.460263 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.460497 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.461019 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.463802 19220 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:31.448385 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.466554 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.442667 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:31.467973 19368 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:31.473637 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.526602 19220 pending_rounds.cc:85] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:10:31.528066 19220 pending_rounds.cc:107] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:31.525887 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.474553 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.529295 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.527978 19371 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.529723 19219 raft_consensus.cc:2410] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:31.529812 19297 raft_consensus.cc:2376] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10. Re-sending same reply.
I20260709 13:10:31.530983 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.531389 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.531586 19292 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:31.532562 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.531960 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.534240 19297 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:31.534417 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.535267 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:31.535619 19220 raft_consensus.cc:2889] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:31.527202 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83544.4us
I20260709 13:10:31.536885 19372 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:31.537616 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.538798 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.539486 19221 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:31.536037 19220 pending_rounds.cc:107] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:31.540625 19220 raft_consensus.cc:2889] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:31.525466 23479 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:31.542237 23794 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.542666 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.542569 23479 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.543151 19373 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:31.544066 19219 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:31.544883 23790 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:31.545442 23790 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.545717 23673 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.547533 23790 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:31.548206 23796 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.548578 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.548713 23796 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.549201 19368 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:31.548069 19219 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:31.550227 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.550793 23796 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:31.551263 19219 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:31.553330 23789 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.450114 23441 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.544731 23479 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:31.557979 23805 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:31.557708 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.558543 23805 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.563197 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 708) took 1795 ms. Trace:
I20260709 13:10:31.566285 19374 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:31.544082 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.569100 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:31.570101 19295 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 7: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:31.575455 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.448698 23717 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:31.555442 23441 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.563868 23794 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.581707 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.614985 19370 raft_consensus.cc:2368] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11.
I20260709 13:10:31.581735 19216 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:31.436044 23754 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:10:31.465056 23437 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:31.444569 23660 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.466593 23655 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:31.591382 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:31.632283 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:31.599619 19297 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:31.636255 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.449411 23504 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:31.563575 19897 rpcz_store.cc:276] 0709 13:10:29.767883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.813597 (+ 45714us) service_pool.cc:224] Handling call
0709 13:10:29.827661 (+ 14064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.910905 (+1083244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.562972 (+652067us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540049fcd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:31.563140 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456532352}
I20260709 13:10:31.609722 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:31.620815 23798 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:31.644222 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:31.616518 19292 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:31.533315 23625 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.619911 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 717) took 1581 ms. Trace:
I20260709 13:10:31.530617 23779 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:31.621160 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.671222 19372 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:31.625488 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:31.672382 19216 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.565312 23763 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.530766 23193 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:31.642777 23792 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.449843 23776 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:10:31.635347 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:31.600643 23717 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:31.623132 23585 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:31.669442 23480 consensus_meta.cc:287] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.002s
I20260709 13:10:31.590041 19220 pending_rounds.cc:85] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 4
I20260709 13:10:31.669384 19894 rpcz_store.cc:276] 0709 13:10:30.038323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.040876 (+  2553us) service_pool.cc:224] Handling call
0709 13:10:30.041186 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.645026 (+603840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.619574 (+974548us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54004b19d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:31.619833 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387252608}
I20260709 13:10:31.591959 23661 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:10:31.693764 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58522.9us
I20260709 13:10:31.695854 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:31.643599 23773 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:31.692195 19220 pending_rounds.cc:107] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:31.699857 19220 raft_consensus.cc:2889] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:31.700763 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.644620 23629 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:31.692574 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.697600 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.642261 23504 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:31.642901 23798 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.667567 23634 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:31.671001 23779 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:31.736290 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.763859 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.771019 19372 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:31.776329 19216 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:31.777405 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:31.779157 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.780951 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.781690 19216 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:31.777529 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:31.687928 23741 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.792s	user 0.001s	sys 0.010s
I20260709 13:10:31.787504 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:31.791115 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.698297 23675 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.679133 23479 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:10:31.789389 23773 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:31.702904 23625 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.678905 23748 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:10:31.796509 23804 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.796916 23781 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:31.798189 23800 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:10:31.668395 23660 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.690053 23585 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:31.688125 23790 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:10:31.693181 23701 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:31.804291 19337 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.764773 23588 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:31.785944 23779 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:31.831316 23625 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.782099 23629 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:31.814018 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.692978 23717 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.689105 23763 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.822118 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.699434 23480 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.890353 23480 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.785594 23634 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.819278 23795 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:31.828485 23143 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.856670 19368 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:10:31.891345 23795 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:31.892401 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:31.892292 23795 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.892789 23634 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:31.893359 23634 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:31.893796 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.857481 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:31.894804 19225 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:31.895752 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.898046 23763 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:31.858796 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 54614.2us
I20260709 13:10:31.899242 19337 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.641093 23655 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.902096 23655 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:31.833324 23748 consensus_queue.cc:1243] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:31.903873 23748 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.865365 19372 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:31.893383 19368 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:31.909257 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:31.910506 23568 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:31.911119 23568 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:31.912214 23568 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:31.917042 19225 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:31.918310 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.918390 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:31.918927 19225 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:31.811919 23193 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:10:31.854895 23487 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:31.886490 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 72548.1us
I20260709 13:10:31.767107 23437 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.994305 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:31.919970 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:31.954346 23793 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:31.962723 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 266268us
I20260709 13:10:32.006193 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:32.007222 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:31.999178 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.829705 23675 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.000593 19371 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:31.880029 23625 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.919999 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:31.975772 23585 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.970424 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2381) took 1247 ms. Trace:
I20260709 13:10:31.828297 23741 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:31.863183 23796 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:32.036199 19224 rpcz_store.cc:276] 0709 13:10:30.723209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.110417 (+387208us) service_pool.cc:224] Handling call
0709 13:10:31.150481 (+ 40064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.398345 (+247864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.970169 (+571824us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540039b7d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:31.970357 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568768256}
I20260709 13:10:31.886713 23629 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:32.033839 19371 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:31.853078 23781 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.034848 19293 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:31.963953 23748 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:32.035828 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 115882us
I20260709 13:10:31.921578 23764 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:32.001554 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:31.862496 23588 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.033206 23437 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:32.067188 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.067188 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65721.6us
I20260709 13:10:32.074373 19367 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:32.017839 23793 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:32.067586 19225 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:32.012151 23655 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:32.081012 19224 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:31.860585 23701 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.080925 23660 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:32.082981 19224 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:32.079228 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:32.088721 19366 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:32.089517 23701 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:32.081173 23655 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:32.090559 23655 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:32.091135 23756 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.267s	user 0.003s	sys 0.003s
I20260709 13:10:32.093032 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2384) took 1351 ms. Trace:
I20260709 13:10:32.093457 19223 rpcz_store.cc:276] 0709 13:10:30.741384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.163899 (+422515us) service_pool.cc:224] Handling call
0709 13:10:31.164255 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.265259 (+101004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.092772 (+827513us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:32.092972 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230572928}
I20260709 13:10:32.095142 19223 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:32.098744 23655 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.099499 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2380) took 1376 ms. Trace:
I20260709 13:10:32.100004 19222 rpcz_store.cc:276] 0709 13:10:30.722933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.995015 (+272082us) service_pool.cc:224] Handling call
0709 13:10:30.995443 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.558260 (+562817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.558296 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:31.558340 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:31.558377 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.099240 (+540863us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54001c4154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:32.099296 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.099437 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293678464}
I20260709 13:10:32.101116 23655 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.103317 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 1954) took 2392 ms. Trace:
I20260709 13:10:32.103703 19294 rpcz_store.cc:276] 0709 13:10:29.710507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.713477 (+  2970us) service_pool.cc:224] Handling call
0709 13:10:31.392291 (+1678814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.393108 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.103124 (+710016us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540034f150. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:32.103262 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3860160384}
I20260709 13:10:32.104298 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:32.105868 23599 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:32.106285 23746 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.107971 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1949) took 2232 ms. Trace:
W20260709 13:10:32.109123 23489 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:10:32.105093 19223 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:32.109347 23809 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:32.112660 19223 pending_rounds.cc:85] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:32.113018 19223 pending_rounds.cc:107] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:10:32.113032 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:32.114159 23599 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:32.114771 23599 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.117360 23494 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:32.117369 23741 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:32.117851 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:32.108441 19291 rpcz_store.cc:276] 0709 13:10:29.875608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.051010 (+175402us) service_pool.cc:224] Handling call
0709 13:10:30.051405 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.051850 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:30.093498 (+ 41648us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.583560 (+490062us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.584973 (+  1413us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.585138 (+   165us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:30.585184 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.585274 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.090503 (+1505229us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:32.107631 (+ 17128us) raft_consensus.cc:1685] finished
0709 13:10:32.107779 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.107911 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69322,"prepare.queue_time_us":115002,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":9008,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":2625,"spinlock_wait_cycles":5382912,"thread_start_us":282751,"threads_started":1,"wal-append.queue_time_us":507032}
I20260709 13:10:32.115310 23599 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.120091 23489 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.120572 23489 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:32.120942 23489 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:32.121892 23758 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.000s
I20260709 13:10:32.119491 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:32.122341 23758 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.123912 23494 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:32.074874 23764 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:32.124925 23494 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:32.125876 23494 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.126577 23330 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:32.124927 23764 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.127959 23764 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.130717 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2360) took 2354 ms. Trace:
W20260709 13:10:32.131114 23778 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.000s
I20260709 13:10:32.132753 23660 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.068722 23585 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.136823 23781 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.137230 23749 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:32.137743 19369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 747) took 2060 ms (client timeout 1565 ms). Trace:
I20260709 13:10:32.138211 23798 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:32.071692 23794 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:32.131146 19218 rpcz_store.cc:276] 0709 13:10:29.775820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.988339 (+212519us) service_pool.cc:224] Handling call
0709 13:10:29.988757 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.195828 (+207071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.195866 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.195911 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:30.195952 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.130441 (+1934489us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001b2954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:32.130494 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.130624 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475710208}
I20260709 13:10:32.149371 23717 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.122720 23742 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:32.155967 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:32.153210 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.155052 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.164729 19297 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:32.155350 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:32.138134 19369 rpcz_store.cc:269] 0709 13:10:30.077279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.077483 (+   204us) service_pool.cc:224] Handling call
0709 13:10:32.137529 (+2060046us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54004268d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:32.137670 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929604480}
I20260709 13:10:32.153834 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.043603 23748 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:32.081110 23807 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:10:32.163213 19293 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:32.170071 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.173107 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:32.174906 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.176491 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.177018 19300 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:10:32.179229 19300 pending_rounds.cc:85] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:10:31.870936 23504 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.179347 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:32.181021 19300 pending_rounds.cc:107] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:10:32.181360 19300 raft_consensus.cc:2889] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:32.113804 19223 raft_consensus.cc:2889] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:32.131673 23778 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:32.183980 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 175576us
I20260709 13:10:32.194648 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.118610 23436 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.202000 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.205355 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:32.206173 19225 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.210884 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.175704 23814 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.212855 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.152148 23717 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.217207 19292 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:32.178290 23748 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:32.189096 23781 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:32.221199 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.222162 19224 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:32.213265 23643 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:10:32.228804 23759 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.000s
I20260709 13:10:32.229228 23759 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.231006 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 860) took 1089 ms. Trace:
I20260709 13:10:32.197067 23484 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:32.233078 23484 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.219381 23634 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:10:32.235905 23634 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:32.236281 23634 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:32.237022 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:32.236815 23793 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.237591 19220 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.237771 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:32.238412 19219 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:32.239480 19219 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:32.240656 19898 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:32.237098 23634 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:32.241850 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62594.3us
I20260709 13:10:32.231415 19902 rpcz_store.cc:276] 0709 13:10:31.141426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.360408 (+218982us) service_pool.cc:224] Handling call
0709 13:10:31.362916 (+  2508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.363293 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.363335 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.363915 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:10:31.684945 (+321030us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:31.685004 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.685105 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.230792 (+545687us) raft_consensus.cc:1685] finished
0709 13:10:32.230818 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.230950 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":736,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3755,"thread_start_us":320375,"threads_started":1,"wal-append.queue_time_us":485231}
I20260709 13:10:32.179939 23485 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:10:32.245930 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:32.245378 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.245270 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:32.033555 23773 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.218982 23143 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.261785 19220 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:32.258419 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:32.239914 23742 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.220357 23814 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:32.271590 19225 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:32.275283 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:32.274427 23792 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.260075 23758 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.237120 23441 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:32.281773 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:32.282728 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:32.273970 23717 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:32.285632 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.263517 23781 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.268643 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:32.280720 23778 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.272146 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:32.280786 23792 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:32.287519 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.274708 23742 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.290138 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:32.308121 19894 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:32.310869 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:32.311543 19220 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:32.312314 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.313689 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:32.274909 23634 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.315131 23790 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.317212 23798 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.274899 23749 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:10:32.278745 23814 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.343011 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.343699 19899 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:32.345332 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:32.276643 23143 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.307400 23675 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.309762 23792 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:32.350080 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.315716 23742 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.278417 23480 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:32.361900 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.317804 23741 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:32.317975 23441 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:32.380633 23778 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:32.287750 23489 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.317701 23798 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:32.374769 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:32.486833 19225 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.316792 23781 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.309231 23717 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:32.431928 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.373545 23759 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.462772 19898 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:32.340723 23796 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:32.394930 23487 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:32.543522 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 139241us
I20260709 13:10:32.548913 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:32.395478 23749 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
W20260709 13:10:32.551373 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.482407 23568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.021s
I20260709 13:10:32.497048 23798 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:32.565438 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 347801us
I20260709 13:10:32.501350 23741 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:32.574787 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.575627 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.576498 19225 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:32.576664 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 848) took 2017 ms. Trace:
I20260709 13:10:32.577576 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:32.582290 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.584218 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.585007 19295 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:10:32.587096 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.587560 19293 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.577000 19895 rpcz_store.cc:276] 0709 13:10:30.559430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.586614 (+ 27184us) service_pool.cc:224] Handling call
0709 13:10:30.586923 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.680933 (+ 94010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.680965 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.681011 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:30.681056 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.576449 (+1895393us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54006b3354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:32.576493 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.576611 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215711616}
I20260709 13:10:32.588953 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:32.554334 23675 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.595482 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:32.604226 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:32.566764 23568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.013s	sys 0.021s
I20260709 13:10:32.500453 23778 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.614833 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.497205 23824 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
I20260709 13:10:32.562801 23822 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.630024 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.622478 23804 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:32.565903 23796 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:32.588104 23676 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.633467 19295 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:32.591902 23758 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:32.634716 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:32.635164 19895 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:32.601861 23670 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:32.637565 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:32.690057 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.634889 23822 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.692518 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.694103 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.694372 23822 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:32.694620 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.633229 23804 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:32.647454 23670 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.701943 23670 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.703226 23504 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:32.704692 23815 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:10:32.708447 23796 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.715255 19297 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:10:32.644635 23568 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.618187 23675 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.645057 23794 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:32.642283 23676 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.724895 23717 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:32.725647 23676 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:32.728546 23629 consensus_meta.cc:287] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.002s
I20260709 13:10:32.729079 23629 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.736590 23489 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:32.732462 23764 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.001s
I20260709 13:10:32.732342 23742 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.738569 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2224) took 1270 ms. Trace:
W20260709 13:10:32.731606 23746 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.625s	user 0.013s	sys 0.001s
I20260709 13:10:32.741060 19266 leader_election.cc:400] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11.
I20260709 13:10:32.746974 23670 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.747951 23676 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:32.751472 23585 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.000s
W20260709 13:10:32.754035 23748 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:10:32.758642 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.759403 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:32.738036 23675 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.762578 19368 rpcz_store.cc:276] 0709 13:10:31.467880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.906892 (+439012us) service_pool.cc:224] Handling call
0709 13:10:31.907247 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.907647 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.907686 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.951261 (+ 43575us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.383440 (+432179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:32.385672 (+  2232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.386278 (+   606us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.738341 (+352063us) raft_consensus.cc:1685] finished
0709 13:10:32.738361 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.738504 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2615,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":344704,"threads_started":1,"wal-append.queue_time_us":608005}
W20260709 13:10:32.786279 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.767195 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:32.645013 23758 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.721589 23568 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.792248 19365 raft_consensus.cc:2410] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:32.793440 19222 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:32.850817 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83724.3us
W20260709 13:10:32.846788 23659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.020s
I20260709 13:10:32.851596 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:32.790706 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:32.814476 19374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.041s	sys 0.082s
W20260709 13:10:32.859237 19374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.041s	sys 0.082s
I20260709 13:10:32.859259 19372 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.863042 19294 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:32.864283 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:32.761807 23679 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:10:32.869783 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.008s
I20260709 13:10:32.822523 23489 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.868579 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:32.873229 19293 raft_consensus.cc:2368] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:32.758215 23764 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.719398 23741 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.850891 23441 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:32.868846 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 523568us
I20260709 13:10:32.882145 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:32.870167 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.008s	sys 0.008s
W20260709 13:10:32.868078 19223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.016s	sys 0.006s
I20260709 13:10:32.850173 23568 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:32.884456 19223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.016s	sys 0.007s
I20260709 13:10:32.861119 23675 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:32.865989 23670 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:32.889631 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 335390us
I20260709 13:10:32.863791 23680 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:32.877751 23779 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.991s	user 0.005s	sys 0.006s
I20260709 13:10:32.830657 23748 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.911263 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:32.887355 23781 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:32.925457 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:32.912372 23670 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.880198 23489 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:32.854648 23804 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.940004 23484 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:32.950263 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:32.951079 19220 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:32.954035 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2004) took 1553 ms. Trace:
I20260709 13:10:32.954546 19224 rpcz_store.cc:276] 0709 13:10:31.400869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.083870 (+683001us) service_pool.cc:224] Handling call
0709 13:10:32.084209 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.226803 (+142594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.953720 (+726917us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000e3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:32.953965 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313079552}
W20260709 13:10:32.967589 23828 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:32.989434 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:32.990170 19218 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.972446 23588 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:32.963840 23485 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:32.993705 23485 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.996982 23485 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:33.005900 19250 heartbeater.cc:646] Failed to heartbeat to 127.17.171.254:34425 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.171.254:34425 timed out after 15.000s (SENT)
I20260709 13:10:33.006958 23783 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:33.022329 23783 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:33.022701 19225 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.023177 23783 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.024237 23783 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.026183 23778 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.027498 23805 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.023945 19225 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:33.030154 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:33.032626 23564 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.007863 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:33.008751 23484 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:33.010736 23436 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:33.011574 23813 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.439s	user 0.000s	sys 0.002s
I20260709 13:10:33.042448 23436 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:33.043685 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 542) took 1686 ms. Trace:
I20260709 13:10:33.043375 23436 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:32.955942 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:33.045413 19224 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:33.044070 19221 rpcz_store.cc:276] 0709 13:10:31.357679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.576809 (+219130us) service_pool.cc:224] Handling call
0709 13:10:31.587186 (+ 10377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.587651 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.587692 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.588329 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.161528 (+573199us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:32.183269 (+ 21741us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.197245 (+ 13976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.197370 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.233327 (+ 35957us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b1800430de0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:33.010894 (+777567us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:33.043467 (+ 32573us) raft_consensus.cc:1685] finished
0709 13:10:33.043490 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.043619 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20335,"prepare.queue_time_us":27441,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":20673,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":28630,"spinlock_wait_cycles":26925568,"thread_start_us":477027,"threads_started":1,"wal-append.queue_time_us":839912}
W20260709 13:10:33.049278 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.049328 19300 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:33.044438 23436 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.051963 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2216) took 1586 ms. Trace:
I20260709 13:10:33.052341 19366 rpcz_store.cc:276] 0709 13:10:31.465694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.465833 (+   139us) service_pool.cc:224] Handling call
0709 13:10:32.088517 (+622684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.089177 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.051774 (+962597us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400313b50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:33.051908 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431173888}
I20260709 13:10:33.053539 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.054885 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.021593 19218 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:33.055913 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.057433 23494 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:33.059338 23494 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.060189 19366 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:33.061846 23494 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.062410 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:33.062052 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.063896 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.064507 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.064445 19218 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:33.066012 23485 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:33.066183 23494 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.066594 23485 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:33.066821 23494 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.067619 23485 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:33.065528 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.063097 19366 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:10:33.069665 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.070786 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.069046 23494 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.071803 23787 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.072252 23356 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.903561 23675 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.073312 23766 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.074149 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.129676 19300 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
W20260709 13:10:33.132030 19867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.009s	sys 0.008s
I20260709 13:10:33.075819 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:33.135622 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 59844.9us
W20260709 13:10:33.078639 19370 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.006s	sys 0.006s
I20260709 13:10:32.885948 23441 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.082954 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.083082 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:33.140785 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57776us
I20260709 13:10:32.904469 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:33.085732 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.916229 23676 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:10:33.107970 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:32.937872 23670 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.164069 23841 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.164621 23820 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:33.164722 23841 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:33.166113 23829 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 13:10:33.167052 23841 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:32.934499 23143 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.170720 23629 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.171811 23824 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:33.174157 23437 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.030s	user 0.008s	sys 0.003s
I20260709 13:10:33.173992 23670 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:33.175658 23634 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.857s	user 0.002s	sys 0.007s
W20260709 13:10:33.175926 23814 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.003s
I20260709 13:10:33.176448 23670 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.176333 23814 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.177393 19899 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:33.178452 23814 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.133092 23766 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:33.180733 23625 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.000s
I20260709 13:10:33.181257 23625 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.182585 23766 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.183475 23494 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.073129 23805 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:33.194571 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.197657 19372 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:33.198302 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2000) took 1010 ms. Trace:
W20260709 13:10:33.136346 19370 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.006s	sys 0.006s
I20260709 13:10:33.153780 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.139146 23588 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.205475 19367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 1981) took 1951 ms (client timeout 2207 ms). Trace:
W20260709 13:10:33.205875 19367 rpcz_store.cc:269] 0709 13:10:31.254439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.279133 (+ 24694us) service_pool.cc:224] Handling call
0709 13:10:33.205290 (+1926157us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b5400426dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:33.205426 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705093888}
I20260709 13:10:33.207204 19373 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.152431 23701 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:33.158238 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:33.159551 19895 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.162429 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:33.163501 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:33.167874 23661 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:33.180594 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.916586 23779 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:33.223043 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 59680.1us
I20260709 13:10:33.224246 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:33.182617 19216 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:10:33.189417 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 328630us
I20260709 13:10:33.208932 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2223) took 1736 ms. Trace:
W20260709 13:10:33.153414 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 248976us
I20260709 13:10:33.209949 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.183974 23494 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:33.239076 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.232556 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:33.244726 23758 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.245687 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:33.125500 23787 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.246833 23688 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.248718 23717 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:33.248901 23787 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:33.249318 23792 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.000s
I20260709 13:10:33.249548 23629 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:33.249977 19296 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:33.250080 23629 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.249787 23792 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.252341 23143 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:33.254758 23599 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.134s	user 0.009s	sys 0.000s
I20260709 13:10:33.255200 23599 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.256284 23773 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.236066 19370 rpcz_store.cc:276] 0709 13:10:31.467655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.645708 (+178053us) service_pool.cc:224] Handling call
0709 13:10:31.682741 (+ 37033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.683176 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.683215 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.683768 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.198030 (+514262us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:33.200288 (+1002258us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.203990 (+  3702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.204117 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.204213 (+    96us) raft_consensus.cc:1685] finished
0709 13:10:33.204224 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.204457 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3191,"prepare.queue_time_us":86730,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":6449,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5867,"thread_start_us":1424563,"threads_started":2,"wal-append.queue_time_us":808589}
I20260709 13:10:33.244747 19220 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:33.234127 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.260118 19367 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.261240 19903 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:33.262279 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.258601 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.267055 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:33.276358 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.125337 23356 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.296212 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:33.297876 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65433.7us
I20260709 13:10:33.298640 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:33.300580 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.296882 19368 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:33.198786 19372 rpcz_store.cc:276] 0709 13:10:32.187914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.746400 (+558486us) service_pool.cc:224] Handling call
0709 13:10:33.198233 (+451833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.293763 19903 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:33.198984 23330 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:33.308584 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.308604 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:33.313094 19894 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:10:33.255677 23568 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.311349 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:33.311349 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:33.356688 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55235.1us
I20260709 13:10:33.357559 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:33.359402 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46658us
I20260709 13:10:33.365262 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.229010 23701 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.380306 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:33.389976 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.257066 23494 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.406608 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.407214 19296 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:33.200822 23805 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.409039 19292 raft_consensus.cc:2410] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:10:33.365921 23815 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:10:33.310892 23629 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.356739 23143 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:33.297011 23742 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:33.389698 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:33.417961 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:33.390880 23837 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:10:33.385463 23701 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:33.438309 19295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.050s	sys 0.105s
W20260709 13:10:33.389622 23853 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:10:33.249289 23717 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.423820 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.367632 23759 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:33.434990 19291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.029s
W20260709 13:10:33.449965 19291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.017s	sys 0.029s
I20260709 13:10:33.450696 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1969) took 1297 ms. Trace:
I20260709 13:10:33.408998 23787 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:33.437857 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.455853 19370 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 5: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:33.258556 23588 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:33.438757 19295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.050s	sys 0.105s
I20260709 13:10:33.296829 23818 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:10:33.405349 23764 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:33.417308 19219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.023s
W20260709 13:10:33.459115 19219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.023s
I20260709 13:10:33.452526 23143 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:33.451808 19291 rpcz_store.cc:276] 0709 13:10:32.153215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.153333 (+   118us) service_pool.cc:224] Handling call
0709 13:10:32.153596 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.153781 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:32.556154 (+402373us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.450322 (+894168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.450376 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:33.450447 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.450511 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.450637 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":390749,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":139998,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":1295811,"threads_started":3}
I20260709 13:10:33.364992 23330 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:33.465524 19374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.007s	sys 0.017s
W20260709 13:10:33.466722 19374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.007s	sys 0.017s
W20260709 13:10:33.467355 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.007s
W20260709 13:10:33.467916 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.011s	sys 0.007s
W20260709 13:10:33.468331 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 549455us
W20260709 13:10:33.469381 19371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.013s	sys 0.005s
W20260709 13:10:33.469755 19371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.013s	sys 0.005s
I20260709 13:10:33.440429 23193 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.472277 19366 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:33.474220 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.475304 19366 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:33.487567 19869 leader_election.cc:400] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10.
I20260709 13:10:33.488189 19869 leader_election.cc:403] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:33.489207 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2028) took 1292 ms. Trace:
I20260709 13:10:33.489604 19219 rpcz_store.cc:276] 0709 13:10:32.196744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.240141 (+ 43397us) service_pool.cc:224] Handling call
0709 13:10:32.242733 (+  2592us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:32.256768 (+ 14035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.256811 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:32.275630 (+ 18819us) log.cc:844] Serialized 52 byte log entry
0709 13:10:32.693568 (+417938us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18004a4e80. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:10:32.869528 (+175960us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:33.459574 (+590046us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.466399 (+  6825us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.466568 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.466643 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.488957 (+ 22314us) raft_consensus.cc:1685] finished
0709 13:10:33.488985 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.489131 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6413,"raft.queue_time_us":17651,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10129,"spinlock_wait_cycles":4424576,"thread_start_us":751589,"threads_started":2,"wal-append.queue_time_us":852152}
I20260709 13:10:33.491647 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:33.441218 23781 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:33.492388 19299 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.017s	sys 0.025s
I20260709 13:10:33.492547 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:33.502735 19299 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.017s	sys 0.025s
I20260709 13:10:33.503737 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.503764 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1974) took 1349 ms. Trace:
I20260709 13:10:33.505322 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.506274 19370 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:33.508986 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:33.492238 23798 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.001s
I20260709 13:10:33.501221 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:33.499557 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.472977 23759 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:33.492833 23655 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.009s	sys 0.009s
I20260709 13:10:33.516218 19894 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:10:33.518177 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:33.492619 23793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.003s	sys 0.009s
I20260709 13:10:33.517549 19366 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:33.520510 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2385) took 1254 ms. Trace:
I20260709 13:10:33.530639 19222 rpcz_store.cc:276] 0709 13:10:32.265795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.481629 (+215834us) service_pool.cc:224] Handling call
0709 13:10:32.481980 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.850440 (+368460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.520243 (+669803us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54003d1b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:33.520442 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715753344}
I20260709 13:10:33.531808 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:33.532390 19222 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.507115 23489 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.504820 19299 rpcz_store.cc:276] 0709 13:10:32.154624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.154753 (+   129us) service_pool.cc:224] Handling call
0709 13:10:32.155149 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.155379 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:32.556613 (+401234us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.503189 (+946576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.503263 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:33.503350 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.503433 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.503695 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":411944,"prepare.run_cpu_time_us":186,"prepare.run_wall_time_us":10451,"raft.queue_time_us":179272,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":8322688,"thread_start_us":1346058,"threads_started":3,"wal-append.queue_time_us":738714}
W20260709 13:10:33.504539 23836 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
W20260709 13:10:33.511377 23680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.001s	sys 0.015s
W20260709 13:10:33.526311 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2217) took 2060 ms (client timeout 2095 ms). Trace:
W20260709 13:10:33.537986 19365 rpcz_store.cc:269] 0709 13:10:31.465977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.466300 (+   323us) service_pool.cc:224] Handling call
0709 13:10:33.519436 (+2053136us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400313154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:33.526239 (+  6803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2871598976}
I20260709 13:10:33.527285 19894 pending_rounds.cc:85] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 10
I20260709 13:10:33.527631 19219 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.514292 23846 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:33.513124 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.542634 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.489162 23193 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.463264 23787 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.539091 19894 pending_rounds.cc:107] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 11.11
W20260709 13:10:33.516955 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47752.6us
W20260709 13:10:33.539325 19266 leader_election.cc:336] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.095s (SENT)
I20260709 13:10:33.554469 19894 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.517339 23758 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:33.530416 23793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.004s	sys 0.009s
I20260709 13:10:33.543818 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.556277 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:33.559269 19370 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:33.556491 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.523001 23848 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:33.561157 19224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.013s
W20260709 13:10:33.563089 19224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.004s	sys 0.014s
I20260709 13:10:33.560851 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:33.510001 23802 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:10:33.539418 23655 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.009s	sys 0.009s
I20260709 13:10:33.562578 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.525482 23625 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.509817 23781 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.524746 23850 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10.
I20260709 13:10:33.577632 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.578157 19869 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:33.539491 23680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.001s	sys 0.015s
I20260709 13:10:33.578904 23680 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:33.579192 23843 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:33.579648 23843 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.579981 23843 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:33.584544 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.524096 23798 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.553153 23193 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.563581 23848 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:33.578400 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 214370us
W20260709 13:10:33.590041 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.573129 19366 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:33.557835 23599 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:33.598975 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.601620 19366 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:33.563956 23851 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.605274 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:33.598515 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:33.609807 19191 leader_election.cc:400] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:33.610096 19191 leader_election.cc:403] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:33.610140 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.597299 19222 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:33.605370 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.606326 19367 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
W20260709 13:10:33.592252 23479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.013s	sys 0.009s
I20260709 13:10:33.611825 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.602725 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.607318 23842 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:33.557552 23143 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:33.595312 23700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.008s	sys 0.013s
I20260709 13:10:33.619184 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 549) took 1043 ms. Trace:
I20260709 13:10:33.627990 19221 rpcz_store.cc:276] 0709 13:10:32.575651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.046905 (+471254us) service_pool.cc:224] Handling call
0709 13:10:33.047271 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.047644 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.047693 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.049442 (+  1749us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.470461 (+421019us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:33.470517 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.470606 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.618975 (+148369us) raft_consensus.cc:1685] finished
0709 13:10:33.618996 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.619126 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":950,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":420570,"threads_started":1,"wal-append.queue_time_us":567787}
W20260709 13:10:33.631968 19294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.010s
W20260709 13:10:33.632481 19294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.010s
I20260709 13:10:33.632926 19221 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:33.636976 19221 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:33.618889 19367 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:33.599820 23634 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.625026 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.609244 23779 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:33.617861 23856 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:33.643064 23489 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:33.630693 23568 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:33.689237 23489 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.689611 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 1997) took 1502 ms. Trace:
W20260709 13:10:33.627434 23479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.014s	sys 0.009s
I20260709 13:10:33.692309 19225 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:33.630156 23839 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:10:33.683964 19216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2018) took 1874 ms (client timeout 1559 ms). Trace:
I20260709 13:10:33.614207 23356 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.617719 23805 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.685218 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2222) took 2217 ms. Trace:
I20260709 13:10:33.662997 19298 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:33.643231 19222 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:33.705627 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.690223 19369 rpcz_store.cc:276] 0709 13:10:32.187112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.187657 (+   545us) service_pool.cc:224] Handling call
0709 13:10:32.187975 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.200143 (+ 12168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.200269 (+   126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:32.201122 (+   853us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.566543 (+365421us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:32.593284 (+ 26741us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.028892 (+435608us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4800042858. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:10:33.086944 (+ 58052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.087014 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.689220 (+602206us) raft_consensus.cc:1685] finished
0709 13:10:33.689356 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.689539 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86835,"prepare.queue_time_us":35156,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":130434,"raft.run_cpu_time_us":2512,"raft.run_wall_time_us":342853,"spinlock_wait_cycles":3785472,"thread_start_us":806744,"threads_started":2,"wal-append.queue_time_us":676652}
I20260709 13:10:33.705552 19366 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:33.705413 19216 rpcz_store.cc:269] 0709 13:10:31.809613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.821862 (+ 12249us) service_pool.cc:224] Handling call
0709 13:10:33.683646 (+1861784us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540039bcd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:33.683841 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2975666944}
I20260709 13:10:33.691309 23489 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.616582 23625 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:33.617283 23845 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:10:33.737298 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.016s	sys 0.028s
I20260709 13:10:33.682941 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2394) took 1414 ms. Trace:
I20260709 13:10:33.737965 19220 rpcz_store.cc:276] 0709 13:10:32.268278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.040821 (+772543us) service_pool.cc:224] Handling call
0709 13:10:33.041119 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.259508 (+218389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.682592 (+423084us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001c3c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:33.682852 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467762944}
I20260709 13:10:33.719216 19369 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:33.740482 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 135284us
I20260709 13:10:33.740657 19369 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:33.741737 19369 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:33.742779 19369 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:33.670914 23675 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:33.663012 23835 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.742s	user 0.007s	sys 0.001s
I20260709 13:10:33.687074 23588 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:33.686509 23504 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.983s	user 0.009s	sys 0.000s
I20260709 13:10:33.731316 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:33.680378 23487 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:33.643891 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.643206 23851 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:33.680202 23847 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 13:10:33.688005 23858 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:33.719611 19373 rpcz_store.cc:276] 0709 13:10:31.467425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.625376 (+157951us) service_pool.cc:224] Handling call
0709 13:10:33.206973 (+1581597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.207637 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.684950 (+477313us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400426dd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:33.685143 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3605306624}
I20260709 13:10:33.687846 23781 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.716518 23779 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.630376 23680 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.626128 23759 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:33.623078 23700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.013s
I20260709 13:10:33.751387 19366 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:33.762288 23717 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:33.753657 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.016s	sys 0.028s
I20260709 13:10:33.683171 23787 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.617184 23848 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.624312 23793 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:33.673413 23643 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:33.797416 23625 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:33.895198 23625 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.774813 19370 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:33.799674 23487 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.898633 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2024) took 1788 ms. Trace:
I20260709 13:10:33.686584 23843 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.899299 23487 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:33.744882 23862 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:33.821225 23779 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.896996 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.900656 23862 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.902141 23779 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.902771 23862 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.902966 23356 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.815935 19373 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.903452 23356 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.817634 19366 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:33.905423 23356 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.753286 19369 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:10:33.625538 23790 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.308s	user 0.011s	sys 0.000s
I20260709 13:10:33.774366 23675 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.756349 23330 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.801146 23758 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:33.773437 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 869) took 1423 ms. Trace:
I20260709 13:10:33.859858 23504 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.866746 23773 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.001s
I20260709 13:10:33.871562 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:33.874679 23857 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:33.916980 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45495.5us
I20260709 13:10:33.876235 23643 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:33.876322 23846 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:33.877089 23676 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:33.876411 23193 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.886550 23798 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.887814 23848 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.817541 23851 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.890177 23494 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.893466 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:33.803031 23861 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.808038 23814 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:10:33.807041 23858 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.907542 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:33.947779 19292 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:33.899014 19217 rpcz_store.cc:276] 0709 13:10:32.110354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.156502 (+ 46148us) service_pool.cc:224] Handling call
0709 13:10:32.156792 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:32.157106 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.157142 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:32.182078 (+ 24936us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.633737 (+451659us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:32.633785 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.633856 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.662445 (+1028589us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:33.898355 (+235910us) raft_consensus.cc:1685] finished
0709 13:10:33.898376 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.898578 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2700,"raft.queue_time_us":722,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9341,"spinlock_wait_cycles":17481088,"thread_start_us":374513,"threads_started":1,"wal-append.queue_time_us":646468}
I20260709 13:10:33.909668 19219 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:33.911484 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2227) took 2376 ms. Trace:
W20260709 13:10:33.912894 19223 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.011s	sys 0.007s
W20260709 13:10:33.949637 19223 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.011s	sys 0.008s
I20260709 13:10:33.949481 19371 rpcz_store.cc:276] 0709 13:10:31.535206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.069040 (+533834us) service_pool.cc:224] Handling call
0709 13:10:32.069336 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.069521 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:32.162063 (+ 92542us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.941238 (+779175us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800390940. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:10:33.661212 (+719974us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4800042858. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:10:33.911165 (+249953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.911220 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:33.911261 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.911335 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.911434 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54513,"prepare.queue_time_us":92392,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7517,"raft.queue_time_us":52895,"raft.run_cpu_time_us":704,"raft.run_wall_time_us":133309,"spinlock_wait_cycles":18992640,"thread_start_us":862186,"threads_started":2,"wal-append.queue_time_us":1390858}
I20260709 13:10:33.913178 19899 rpcz_store.cc:276] 0709 13:10:32.350424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.350584 (+   160us) service_pool.cc:224] Handling call
0709 13:10:32.373203 (+ 22619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.177761 (+804558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.773198 (+595437us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400780fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:33.773378 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849024768}
I20260709 13:10:33.951426 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2020) took 2047 ms. Trace:
I20260709 13:10:33.951481 23877 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:33.952502 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59145.2us
I20260709 13:10:33.926245 19220 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:33.954744 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:33.955405 19369 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:33.910847 23793 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.934223 19300 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:33.932255 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:33.913638 23783 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.913295 23790 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.927699 23698 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:33.942440 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2000) took 1224 ms. Trace:
I20260709 13:10:33.975440 19295 rpcz_store.cc:276] 0709 13:10:32.718290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.845766 (+127476us) service_pool.cc:224] Handling call
0709 13:10:32.867663 (+ 21897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.458422 (+590759us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:33.503769 (+ 45347us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.941877 (+438108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.941959 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:33.942034 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.942146 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.942348 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4404,"prepare.queue_time_us":49313,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":206251,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":12157,"thread_start_us":989156,"threads_started":2}
I20260709 13:10:33.929605 23773 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:33.946087 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.760s (SENT) [suppressed 12 similar messages]
I20260709 13:10:33.962822 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:33.966019 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:33.967242 23679 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.960822 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:33.954227 23814 consensus_queue.cc:1243] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:33.962186 23330 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:33.934361 23504 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.018380 23441 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:33.974682 23643 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.019466 23643 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.018410 23504 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.020481 23857 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.021106 23857 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.023461 23857 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:33.951954 19223 rpcz_store.cc:276] 0709 13:10:31.904406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.112118 (+207712us) service_pool.cc:224] Handling call
0709 13:10:32.112438 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:32.219572 (+107134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.219616 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:32.220347 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:10:32.889235 (+668888us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:33.950308 (+1061073us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.950775 (+   467us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.951011 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.951137 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.951198 (+    61us) raft_consensus.cc:1685] finished
0709 13:10:33.951219 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.951370 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29831,"prepare.queue_time_us":729447,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":30852,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10932,"thread_start_us":1662783,"threads_started":2,"wal-append.queue_time_us":895305}
I20260709 13:10:33.982319 23487 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.987404 19365 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:33.944216 23851 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.989147 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.030998 19295 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:33.989603 23843 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.991008 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:33.991797 23862 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:33.992899 23625 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.994849 23494 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:33.996410 23193 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.000368 23676 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:33.943166 23860 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:10:33.958415 23701 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:33.970984 23793 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:33.970579 23878 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:33.956982 23861 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.004599 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.082657 19219 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:34.004730 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.005916 19217 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:34.083323 19217 pending_rounds.cc:85] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:34.083580 19217 pending_rounds.cc:107] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:34.083695 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:34.083843 19217 raft_consensus.cc:2889] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.084894 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.085316 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.086481 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.086686 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.087121 19217 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:34.006624 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:33.952211 23877 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.014232 23858 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:34.034281 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.026324 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.085932 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.089130 19223 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:34.089421 19219 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:34.056609 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.058629 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:34.059571 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.090924 19895 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 8: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:34.060786 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.091799 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.070776 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:34.092612 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56309.8us
I20260709 13:10:34.072012 19368 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.074175 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.093362 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.030251 23790 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.078886 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.087749 19897 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:34.083945 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.092330 19292 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.069923 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.098282 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.098878 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.099568 19368 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:34.093050 19366 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:34.100423 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:34.101516 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.103183 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.100435 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.107039 19366 raft_consensus.cc:2410] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:34.093974 19217 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:34.109761 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.067498 23763 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:34.113412 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.115594 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.109440 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:34.118178 19221 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:34.118845 19297 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:34.074155 23862 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:34.134394 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.129295 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.148715 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.153425 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:34.123065 23480 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.155333 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:34.122924 23669 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.155864 23793 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:34.156669 19221 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.157783 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:34.158902 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58545.2us
W20260709 13:10:34.157900 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48545.7us
I20260709 13:10:34.159541 19223 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.159883 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.150579 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:34.149298 19366 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:34.163527 19292 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:34.164753 19222 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.164834 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.156353 23669 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:34.166412 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.116751 23664 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.110924 23878 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:34.167955 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:34.169404 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.169684 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.180632 19296 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.181320 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:34.109506 23843 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.198061 23625 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:34.197672 23878 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.198673 23625 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:34.200552 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.151103 23855 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.167032 19368 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:34.172297 19223 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:34.168756 19295 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:34.108865 23484 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:10:34.171432 23669 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.116868 23790 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.166172 23480 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.203162 23867 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:34.203258 23889 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.171700 19222 pending_rounds.cc:85] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 4
I20260709 13:10:34.220469 19299 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.273406 23679 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.274253 19223 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:34.145078 23805 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:34.148772 23763 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:34.308686 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 122163us
I20260709 13:10:34.530652 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:34.531378 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2248) took 1221 ms. Trace:
I20260709 13:10:34.532259 19299 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:34.288793 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 131091us
I20260709 13:10:34.167780 23676 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:34.306068 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 359971us
I20260709 13:10:34.535416 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:34.176705 23588 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.527907 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2247) took 1218 ms. Trace:
W20260709 13:10:34.255661 23888 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:10:34.539283 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.536746 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:34.539788 19223 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.231443 23851 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:34.537377 23676 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.571926 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:34.531860 19373 rpcz_store.cc:276] 0709 13:10:33.310210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.903869 (+593659us) service_pool.cc:224] Handling call
0709 13:10:33.904206 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:33.904577 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.904606 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:33.905188 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:10:34.079515 (+174327us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:34.079578 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.079702 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.224261 (+144559us) raft_consensus.cc:1685] finished
0709 13:10:34.224282 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.531316 (+307034us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1989,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":173982,"threads_started":1,"wal-append.queue_time_us":261928}
W20260709 13:10:34.518340 23896 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:10:34.538717 19299 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.235987 23783 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.584934 19299 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.566893 19370 rpcz_store.cc:276] 0709 13:10:33.309888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.896745 (+586857us) service_pool.cc:224] Handling call
0709 13:10:33.897078 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.897432 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.897463 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.897863 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.067161 (+169298us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.067204 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.067268 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.527643 (+460375us) raft_consensus.cc:1685] finished
0709 13:10:34.527670 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.527832 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2449,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":168900,"threads_started":1,"wal-append.queue_time_us":253348}
W20260709 13:10:34.221266 23880 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:34.330582 23887 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:34.385756 23883 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:10:34.529223 19296 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
W20260709 13:10:34.576485 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.537549 19222 pending_rounds.cc:107] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:34.596328 19222 raft_consensus.cc:2889] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.533748 23877 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.529561 23867 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:34.287407 23655 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.537858 23487 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:34.582877 23850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.002s	sys 0.005s
I20260709 13:10:34.543344 23793 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.534639 23758 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:10:34.537889 23889 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:34.538141 23480 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:34.571009 23643 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.573971 23585 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:34.596550 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:34.598124 23680 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:10:34.641575 23850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.003s	sys 0.006s
I20260709 13:10:34.583971 23741 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:34.578049 23676 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.543152 23855 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:10:34.593102 23892 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:10:34.575634 23679 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:34.418429 23701 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.604491 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.604018 23867 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:34.607484 23841 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.637737 23877 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:34.605640 23655 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:34.633754 23625 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.566607 23857 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:10:34.402904 23862 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:34.652590 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56143us
I20260709 13:10:34.645048 23793 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:34.662441 23789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.006s	sys 0.036s
W20260709 13:10:34.658169 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.647472 23480 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.645311 23889 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.650105 23643 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:34.649351 23585 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:34.652212 23861 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.646967 23356 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:34.693691 23790 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.697013 23676 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.699976 23676 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:34.665853 23841 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.599341 23588 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:34.666873 23655 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.673151 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2228) took 3057 ms. Trace:
I20260709 13:10:34.674355 23568 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:34.709899 23903 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.721987 23568 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.722514 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2393) took 2454 ms. Trace:
I20260709 13:10:34.722985 19225 rpcz_store.cc:276] 0709 13:10:32.267996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.031005 (+763009us) service_pool.cc:224] Handling call
0709 13:10:33.692104 (+661099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.715275 (+ 23171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.722288 (+1007013us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b540039bcd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:34.722452 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519700736}
W20260709 13:10:34.711225 23898 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:34.732259 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:34.732353 23876 raft_consensus.cc:476] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:34.734163 23793 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:34.734290 23907 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:34.734791 19118 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 10, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.722584 23903 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:34.738885 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.675205 19299 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:34.677959 23804 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.658594 23897 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:34.685876 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.660632 23741 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:34.675562 23669 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.666184 23877 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.688259 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:34.667223 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71857.3us
I20260709 13:10:34.709290 23763 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.689810 23643 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.713249 23841 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.757095 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:34.757391 23655 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.738375 23903 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.758459 19292 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:34.759482 23669 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:34.762665 23889 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.763216 23480 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.764468 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:34.687891 23789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.007s	sys 0.037s
I20260709 13:10:34.748668 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:34.750174 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2250) took 1386 ms. Trace:
I20260709 13:10:34.772122 19365 rpcz_store.cc:276] 0709 13:10:33.363685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.575065 (+211380us) service_pool.cc:224] Handling call
0709 13:10:34.749998 (+1174933us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400357354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:34.750119 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865095936}
I20260709 13:10:34.714181 19374 rpcz_store.cc:276] 0709 13:10:31.615438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.085635 (+470197us) service_pool.cc:224] Handling call
0709 13:10:32.085947 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.086157 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:32.859700 (+773543us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.821759 (+962059us) log.cc:844] Serialized 14 byte log entry
0709 13:10:34.672575 (+850816us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002b8340. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d7a6bd70 00007fe8d7a5f293 00007fe8d7a54cea 00007fe8d7a5523a 00007fe8d7ebfa2a 00007fe8d7ecf0bf 00007fe8d7ecf038
0709 13:10:34.672794 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.672845 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.672897 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.672970 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.673089 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133152,"prepare.queue_time_us":182536,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":8847,"raft.queue_time_us":68020,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":9737,"spinlock_wait_cycles":28676864,"thread_start_us":1602736,"threads_started":3,"wal-append.queue_time_us":897468}
I20260709 13:10:34.757781 19370 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:34.737326 19118 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.744617 19291 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:10:34.751502 23877 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.777908 19118 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 6, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 6 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:34.806007 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2007) took 1516 ms. Trace:
I20260709 13:10:34.806080 23679 consensus_queue.cc:1243] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:34.806494 19293 rpcz_store.cc:276] 0709 13:10:33.289719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.458489 (+168770us) service_pool.cc:224] Handling call
0709 13:10:34.803623 (+1345134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.804000 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.804040 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.804095 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:34.804148 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.804248 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.805846 (+  1598us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002b75d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:34.805954 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2995673344}
I20260709 13:10:34.808240 19118 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 3 to 7, term changed from 7 to 8, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194) evicted. New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.809701 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.810339 19902 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:34.811395 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.811630 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.812002 19901 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:34.812465 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.812884 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.813501 19894 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:34.813624 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.814469 19903 raft_consensus.cc:2410] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:34.814374 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.815495 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.816406 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:34.784271 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.818632 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:34.819766 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:34.789287 23748 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.738502 23585 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:34.790207 19121 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 159) took 43158 ms (client timeout 15000 ms). Trace:
I20260709 13:10:34.790251 23793 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:34.790855 23876 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.791328 23661 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:34.791886 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:34.792436 23485 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:34.792514 23741 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.764758 23897 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:34.793277 19217 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:34.794793 23480 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:34.795437 23655 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:34.799453 23869 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.909s	user 0.000s	sys 0.007s
I20260709 13:10:34.802284 23805 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:34.803715 19298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 1981) took 3355 ms (client timeout 2212 ms). Trace:
I20260709 13:10:34.805056 23867 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.829139 23625 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.781978 23792 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.823681 19900 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:34.885893 19900 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11.
I20260709 13:10:34.869683 23851 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.827553 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.829355 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:34.830168 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.832150 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:34.868860 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:34.810376 19118 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.875274 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:34.824559 23822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.293s	user 0.005s	sys 0.014s
I20260709 13:10:34.829523 23903 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:34.805599 23568 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:34.879463 19298 rpcz_store.cc:269] 0709 13:10:31.448002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.448119 (+   117us) service_pool.cc:224] Handling call
0709 13:10:34.803482 (+3355363us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54002b75d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:34.803610 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3812730752}
I20260709 13:10:34.831585 23857 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:34.872408 23585 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.883231 23763 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:34.835863 23842 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.883965 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.917047 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:34.889576 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 140972us
I20260709 13:10:34.890525 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.917838 19374 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:34.894282 19295 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:34.872601 23850 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.894935 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77267.9us
W20260709 13:10:34.898895 23822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.006s	sys 0.014s
I20260709 13:10:34.864802 23838 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:10:34.902539 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:34.825842 19121 rpcz_store.cc:269] 0709 13:09:51.632003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.632380 (+   377us) service_pool.cc:224] Handling call
0709 13:10:34.790051 (+43157671us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:27.020262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:27.020833 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:27.020883 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:10:27.020903 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:27.021587 (+   684us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:27.021689 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:27.021716 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:27.022309 (+   593us) tablet.cc:701] Row locks acquired
0709 13:10:27.022360 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:10:27.022566 (+   206us) write_op.cc:270] Start()
0709 13:10:27.022704 (+   138us) write_op.cc:276] Timestamp: P: 1783602627022480 usec, L: 0
0709 13:10:27.022746 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:10:27.084934 (+ 62188us) log.cc:844] Serialized 2080 byte log entry
0709 13:10:27.572043 (+487109us) op_driver.cc:464] REPLICATION: finished
0709 13:10:27.787262 (+215219us) write_op.cc:301] APPLY: starting
0709 13:10:27.787396 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:27.951944 (+164548us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:27.952082 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:28.971065 (+1018983us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.113652 (+142587us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:10:29.125451 (+ 11799us) write_op.cc:312] APPLY: finished
0709 13:10:29.144474 (+ 19023us) log.cc:844] Serialized 57 byte log entry
0709 13:10:29.354646 (+210172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.354995 (+   349us) write_op.cc:454] Released schema lock
0709 13:10:29.362545 (+  7550us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.382020 (+ 19475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.382049 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2216718,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":211014,"apply.run_cpu_time_us":39943,"apply.run_wall_time_us":1598589,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18792,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":1319,"lbm_reads_lt_1ms":12,"num_ops":5,"prepare.queue_time_us":160490,"prepare.run_cpu_time_us":28218,"prepare.run_wall_time_us":276616,"raft.queue_time_us":121706,"raft.run_cpu_time_us":67537,"raft.run_wall_time_us":202981,"replication_time_us":549080,"spinlock_wait_cycles":12032,"thread_start_us":497458,"threads_started":5,"wal-append.queue_time_us":457531,"wal-append.run_cpu_time_us":62640,"wal-append.run_wall_time_us":2338703}]]}
I20260709 13:10:34.904599 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:34.879289 23805 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:34.909795 23777 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.907209 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:34.884196 23625 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.901618 23792 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:34.836314 23793 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.912855 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.890918 23851 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.895188 23676 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:34.917322 19902 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:34.825861 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:34.891461 19896 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.917968 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:34.894052 23698 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.865710 23876 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.011567 23698 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:35.011670 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 93784.9us
I20260709 13:10:35.012151 23588 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:35.012567 23588 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.013116 23588 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.929474 19296 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.927129 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.018172 19222 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:35.018476 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:35.019115 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.019752 19222 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.927863 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 548) took 2352 ms. Trace:
I20260709 13:10:35.020325 19224 rpcz_store.cc:276] 0709 13:10:32.575331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.046032 (+470701us) service_pool.cc:224] Handling call
0709 13:10:33.046362 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.046696 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.046723 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.047151 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.563530 (+516379us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:33.563570 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.563635 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.798876 (+1235241us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:34.921149 (+122273us) raft_consensus.cc:1685] finished
0709 13:10:34.921172 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.927794 (+  6622us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1655,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":23120640,"thread_start_us":516021,"threads_started":1,"wal-append.queue_time_us":842488}
I20260709 13:10:34.941143 19298 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:34.942462 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.023396 19225 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:35.024415 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.025013 19225 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.950230 19118 catalog_manager.cc:5697] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:34.956688 23889 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:34.957558 23679 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.955991 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:35.035833 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 79913.6us
I20260709 13:10:34.987259 23777 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:34.928613 23850 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:34.917191 23787 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.968722 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:34.970418 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.057292 19221 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:34.907977 23857 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:34.906152 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:34.984670 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.865502 23661 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.012501 23698 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:34.923544 19217 pending_rounds.cc:85] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:10:35.071975 19217 pending_rounds.cc:107] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:35.072404 19217 raft_consensus.cc:2889] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.030453 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.024561 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:34.888302 23897 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.093420 23794 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:35.002184 23625 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.094261 23794 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.097992 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1992) took 1107 ms. Trace:
I20260709 13:10:35.037333 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:34.959179 23867 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.037892 23906 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:35.098546 19292 rpcz_store.cc:276] 0709 13:10:33.990361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.182183 (+191822us) service_pool.cc:224] Handling call
0709 13:10:34.527846 (+345663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.758873 (+231027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.097656 (+338783us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002e9354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:35.097908 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529897216}
I20260709 13:10:35.099568 23906 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.100025 23906 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:35.039865 23900 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.386s	user 0.000s	sys 0.002s
W20260709 13:10:35.042394 23874 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.148s	user 0.001s	sys 0.002s
I20260709 13:10:35.009430 23851 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.046034 23876 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:34.921353 23763 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.048415 23679 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.051527 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:35.051645 19222 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:35.052748 19896 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:35.053284 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:35.066130 19902 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:10:35.117486 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66031.9us
I20260709 13:10:35.117791 19902 pending_rounds.cc:85] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 8
I20260709 13:10:35.118045 19902 pending_rounds.cc:107] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:35.118273 19902 raft_consensus.cc:2889] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.009699 23676 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:34.972527 23877 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.090888 19118 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.054114 23777 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.051959 23193 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.108127 19895 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
W20260709 13:10:35.112187 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74913.6us
W20260709 13:10:35.114549 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 90076.7us
I20260709 13:10:35.115700 19225 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:35.124231 19225 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:10:35.122221 19265 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:35.142987 19293 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:35.145673 19221 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:35.146267 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:35.146994 19292 raft_consensus.cc:2376] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9. Re-sending same reply.
I20260709 13:10:35.148185 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.070384 23787 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.122226 23846 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:35.121552 23698 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.132526 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2254) took 1067 ms. Trace:
I20260709 13:10:35.178421 19369 rpcz_store.cc:276] 0709 13:10:34.065071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.065968 (+   897us) service_pool.cc:224] Handling call
0709 13:10:34.066231 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.066419 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:34.075687 (+  9268us) log.cc:844] Serialized 14 byte log entry
0709 13:10:35.044029 (+968342us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b180045d5a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:10:35.132092 (+ 88063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.132181 (+    89us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:35.132242 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.132316 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.132456 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11177,"prepare.queue_time_us":9133,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":8645,"raft.queue_time_us":11937,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10540,"spinlock_wait_cycles":9097472,"thread_start_us":76596,"threads_started":1}
I20260709 13:10:35.179643 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.123267 23330 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:35.125375 23484 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:35.177791 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:35.180449 19298 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:35.057011 23805 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.143702 23680 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:35.173702 23759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.022s	sys 0.070s
W20260709 13:10:35.191468 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 222860us
I20260709 13:10:35.170502 23921 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:35.151202 23917 raft_consensus.cc:2764] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:35.140929 23193 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:35.208088 23585 consensus_queue.cc:1175] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56df67425e6f45d3b2b42441e3c143ba" responder_term: 13 status { last_received { term: 12 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:35.208724 23923 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:10:35.208846 23916 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:10:35.208093 23759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.025s	sys 0.070s
W20260709 13:10:35.259286 19107 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d50eb2dab6754df8bcbed1445f2e8430 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:35.227535 23588 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.260783 23850 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:35.261816 23865 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.367s	user 0.000s	sys 0.004s
I20260709 13:10:35.263844 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.264549 19221 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:35.209445 23763 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.210023 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:35.219353 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 244679us
W20260709 13:10:35.220719 23872 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.324s	user 0.003s	sys 0.001s
I20260709 13:10:35.221130 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.193632 23676 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.174688 23846 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.289131 23846 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.175557 23867 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.151921 23876 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:35.222059 19118 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 8 to 12, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 12 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.194154 23330 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.245852 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:35.246233 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.245852 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.295617 19895 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:35.296116 19216 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:35.247699 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:35.297041 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49394.3us
I20260709 13:10:35.297168 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:35.295574 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.298834 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:35.262388 23588 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.203397 23814 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.251766 23877 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:35.267812 19295 raft_consensus.cc:2368] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16.
I20260709 13:10:35.269035 19221 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:35.306918 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.307566 19221 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:35.228906 23805 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.278445 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.310329 19299 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:35.240499 23634 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:35.141637 23857 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.341491 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.343775 19298 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:35.305032 23922 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:35.300714 23926 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.280802 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:35.352447 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 71715.1us
I20260709 13:10:35.233613 23787 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.353281 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1984) took 2278 ms. Trace:
I20260709 13:10:35.286269 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.353252 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:35.325978 23634 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:35.288293 23758 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:35.288836 23193 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.190371 23484 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.305445 23876 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.253244 23783 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:35.274376 23746 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:35.301461 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.379432 19216 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:35.295686 19219 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:35.377399 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 127330us
I20260709 13:10:35.228685 23862 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:10:35.361387 23643 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 13:10:35.184785 23655 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.314956 19118 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.317066 23766 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:35.317734 23927 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.317571 23814 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.320644 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.322016 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.323350 23846 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.323973 23330 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.253652 23797 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:10:35.431708 23797 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:35.432067 23797 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:35.432886 23797 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.434087 23797 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.393136 23766 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:35.252969 23778 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:10:35.228513 23921 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.438273 23921 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.306391 23793 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.279696 23860 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:10:35.207573 23680 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:35.439448 23680 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.268428 23625 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.440119 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:35.354481 19373 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:10:35.440985 19902 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:35.358266 19263 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:35.365732 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.282351 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:35.367553 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.324697 23489 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:35.349663 23857 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.352206 23922 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.350824 23777 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:35.450778 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 92637us
W20260709 13:10:35.348042 23669 consensus_queue.cc:1175] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56df67425e6f45d3b2b42441e3c143ba" responder_term: 13 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:35.384516 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.461136 19216 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.462680 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.392601 19219 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:35.373167 23787 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:35.372398 23484 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.353966 19294 rpcz_store.cc:276] 0709 13:10:33.074779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.074903 (+   124us) service_pool.cc:224] Handling call
0709 13:10:33.075202 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.075517 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.075543 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.075963 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:10:33.647773 (+571810us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:33.647844 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.647933 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.220037 (+1572104us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:35.349413 (+129376us) raft_consensus.cc:1685] finished
0709 13:10:35.349447 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.353187 (+  3740us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8580,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":22339,"spinlock_wait_cycles":10104576,"thread_start_us":556557,"threads_started":1,"wal-append.queue_time_us":744770}
I20260709 13:10:35.464108 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.465016 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:35.441720 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.465258 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:35.465934 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.466154 19222 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:35.375217 23933 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.464020 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.393687 23655 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.379089 23746 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:35.448340 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 166093us
I20260709 13:10:35.353992 23906 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.451797 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:35.453809 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.455153 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.471136 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:35.472661 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.473368 19368 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:35.474166 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.456032 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.474675 19368 raft_consensus.cc:2376] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13. Re-sending same reply.
I20260709 13:10:35.475484 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.392402 23643 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.457437 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:35.458233 23855 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:35.458572 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.458772 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.395008 23862 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:35.465201 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.786020 19219 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 14 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:35.381867 23783 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.467785 19224 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:35.442359 19221 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:35.755533 23777 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.423858 23838 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:35.469832 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.793004 19370 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.703843 23643 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:35.704308 23851 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.006s
I20260709 13:10:35.573381 23741 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:35.527791 19900 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:35.554221 23655 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:35.444898 23634 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:35.560544 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2004) took 2301 ms (client timeout 2228 ms). Trace:
I20260709 13:10:35.472034 23489 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.549997 23930 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:35.802604 23489 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.468765 23787 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:35.803514 23787 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:35.804423 19217 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:35.800712 23851 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.806519 19295 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:35.806716 23851 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.807574 19894 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:35.799111 23741 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.809101 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.810070 23741 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:35.810276 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.810890 19374 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.810765 23787 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.463908 23793 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.812422 23793 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.813258 23848 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:35.813649 23848 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:35.785459 23862 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:35.814730 23793 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.592773 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:35.814791 23862 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.816062 23862 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.702759 19216 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:35.461946 23860 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.479369 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.817986 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.819028 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:35.819317 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.819536 19368 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:35.510738 19298 raft_consensus.cc:2368] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10.
W20260709 13:10:35.820151 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.820847 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.484923 23480 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:10:35.549186 23925 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:10:35.550874 23938 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:35.487708 23356 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.851260 19374 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:35.536827 23746 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.568583 23843 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:35.521507 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.553134 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2005) took 2396 ms. Trace:
I20260709 13:10:35.487233 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.477898 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:35.478883 19263 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:35.860312 19368 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:10:35.860570 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 382717us
I20260709 13:10:35.554306 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.527154 19222 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:35.861647 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.545092 19118 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:35.744197 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.773545 19291 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:35.872246 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.879555 19370 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:35.795907 23838 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:35.753940 23913 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.687s	user 0.000s	sys 0.002s
I20260709 13:10:35.740841 23846 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:35.710142 23844 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 2.293s	user 0.026s	sys 0.030s
W20260709 13:10:35.633296 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.743120 23927 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.742650 23193 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:35.784085 19372 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:35.784118 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 326738us
I20260709 13:10:35.915228 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:35.789114 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.441983 19299 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:35.789952 23855 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:35.791579 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.774530 23625 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.923789 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.924654 19221 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.779101 23330 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.930495 23330 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:35.934024 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.786882 23906 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:35.800961 19297 rpcz_store.cc:269] 0709 13:10:33.259314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.300319 (+ 41005us) service_pool.cc:224] Handling call
0709 13:10:35.560341 (+2260022us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400346554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:35.560473 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879784832}
W20260709 13:10:35.938277 19218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2033) took 2661 ms (client timeout 1689 ms). Trace:
I20260709 13:10:35.814455 23848 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.816007 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:35.942675 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:35.943245 19899 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:35.943677 19297 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:35.460348 23922 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:35.485184 23935 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:35.787976 23877 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:35.789474 23676 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.829142 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:35.852564 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.948832 19374 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:35.949065 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 119976us
I20260709 13:10:35.855530 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.859082 19367 rpcz_store.cc:276] 0709 13:10:33.156566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.639602 (+483036us) service_pool.cc:224] Handling call
0709 13:10:34.750161 (+1110559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.885200 (+135039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.885244 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.885295 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:34.885434 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.885602 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.552970 (+667368us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400357350. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:35.553081 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7351,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2553310464,"thread_start_us":134540,"threads_started":1}
I20260709 13:10:35.558791 23679 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.863982 19366 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:35.954316 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:35.955673 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:35.864935 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 386087us
I20260709 13:10:35.956812 19263 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11.
I20260709 13:10:35.885913 19222 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.961319 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.962236 19222 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 8: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:35.963097 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:35.886144 19368 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:35.965159 19368 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.966856 19368 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:35.951946 19216 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.776914 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:35.885716 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.897377 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.846407 23793 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.792897 23680 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.918782 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:35.920359 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.795604 19365 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:35.868935 23805 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.929242 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2417) took 1902 ms. Trace:
W20260709 13:10:35.937332 23941 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:10:35.938215 23940 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:10:35.982852 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:35.987969 19367 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:35.939822 23661 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.940553 23625 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.941385 19897 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:35.999006 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 884) took 1180 ms. Trace:
I20260709 13:10:35.869071 23843 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:35.925943 23846 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.897099 23746 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:35.942878 19218 rpcz_store.cc:269] 0709 13:10:33.277300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.378476 (+101176us) service_pool.cc:224] Handling call
0709 13:10:35.937994 (+2559518us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54001b2954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:35.938166 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4212111104}
I20260709 13:10:35.947937 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.899892 23814 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:35.970800 19370 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:35.971858 19219 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:35.979763 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:35.982175 23778 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.972648 19223 rpcz_store.cc:276] 0709 13:10:34.026951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.568379 (+541428us) service_pool.cc:224] Handling call
0709 13:10:34.568759 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.730861 (+162102us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18002b53a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7eadbfb 00007fe8d7eb864b
0709 13:10:34.731008 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:34.731034 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.731502 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.778047 (+ 46545us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:34.778089 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.778158 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.735228 (+957070us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:35.928934 (+193706us) raft_consensus.cc:1685] finished
0709 13:10:35.928969 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.929151 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77889,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":8147,"spinlock_wait_cycles":79293184,"thread_start_us":136343,"threads_started":2,"wal-append.queue_time_us":255909}
I20260709 13:10:35.989266 19372 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:35.974491 19366 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:36.039309 19372 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:35.976768 19222 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:35.968140 19368 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.913856 23356 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.995214 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.996232 19367 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:10:36.041977 19367 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:36.043320 19367 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.999361 19897 rpcz_store.cc:276] 0709 13:10:34.818357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.821980 (+  3623us) service_pool.cc:224] Handling call
0709 13:10:35.940997 (+1119017us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5400780e28. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dce59ebc 00007fe8dce8f08c 00007fe8dce7993b 00007fe8dce793d2 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c
0709 13:10:35.941155 (+   158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.998745 (+ 57590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.998951 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3988224}
I20260709 13:10:35.943964 19369 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:35.999831 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:35.937422 23879 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:35.885084 23933 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.162609 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:35.942142 23794 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:36.009387 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.027104 19221 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:36.007330 19299 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:36.003000 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:35.974905 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:36.046455 19216 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:10:36.079756 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 79986.9us
I20260709 13:10:36.166882 19899 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:36.168330 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:36.169339 19899 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:10:36.169624 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.992236 23917 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.171029 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:36.171566 23917 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:35.999261 23848 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.174405 23917 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:36.174279 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 259106us
I20260709 13:10:36.159215 19223 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:36.180100 19899 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:36.044952 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:36.181329 19897 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:35.974588 23330 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:35.924602 23193 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.184996 19373 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:36.185937 23193 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:36.004446 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 676) took 2252 ms. Trace:
I20260709 13:10:36.188230 19300 rpcz_store.cc:276] 0709 13:10:33.751639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.902000 (+150361us) service_pool.cc:224] Handling call
0709 13:10:33.902300 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.962464 (+ 60164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.004214 (+2041750us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5400346054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:36.004388 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72730368}
I20260709 13:10:36.190140 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:36.191699 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:36.211632 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:36.212604 19896 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:35.998554 23805 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.218127 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:36.219182 19297 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:36.005016 23935 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:35.990620 23759 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 13:10:36.028439 23679 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.036298 23480 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.004288 23877 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.216s
I20260709 13:10:35.982136 23793 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:36.215473 23485 consensus_meta.cc:287] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.350s	user 0.009s	sys 0.004s
I20260709 13:10:36.004287 23625 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.220675 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:36.241852 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:35.927762 19118 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:36.458125 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.259274 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.332042 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2003) took 1439 ms. Trace:
I20260709 13:10:36.461098 19293 rpcz_store.cc:276] 0709 13:10:34.892351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.892495 (+   144us) service_pool.cc:224] Handling call
0709 13:10:36.331827 (+1439332us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540034fb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.331969 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488355072}
I20260709 13:10:36.462025 19294 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:10:36.303217 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 300290us
I20260709 13:10:36.249306 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:36.334954 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 768) took 1232 ms. Trace:
W20260709 13:10:36.336392 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 159398us
I20260709 13:10:36.465845 19371 rpcz_store.cc:276] 0709 13:10:35.102175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.102330 (+   155us) service_pool.cc:224] Handling call
0709 13:10:35.102632 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.144735 (+ 42103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.144800 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.144859 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:35.144911 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.334675 (+1189764us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54003471d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:36.334745 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.334888 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96256768}
I20260709 13:10:36.337129 19897 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:36.163663 23356 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.481544 19300 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
W20260709 13:10:36.464668 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 226375us
I20260709 13:10:36.483551 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:36.321489 23193 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.485242 23193 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.240020 23935 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:36.331272 23857 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.000s
I20260709 13:10:36.218940 23855 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.494110 23625 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.347136 23843 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.496016 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:36.261397 19903 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 5.
I20260709 13:10:36.497803 19298 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:36.499058 23887 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.306912 23805 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:36.501372 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2427) took 1533 ms (client timeout 1814 ms). Trace:
W20260709 13:10:36.501893 19224 rpcz_store.cc:269] 0709 13:10:34.967578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.022380 (+ 54802us) service_pool.cc:224] Handling call
0709 13:10:36.500839 (+1478459us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540039b7d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.501104 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898104064}
I20260709 13:10:36.499982 23887 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:36.325332 23797 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.003s
W20260709 13:10:36.338946 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.239573 23840 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:36.317519 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:36.508889 23840 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.509691 23840 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:36.510739 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 193176us
I20260709 13:10:36.246534 23933 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.513046 23933 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:36.515075 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46614.7us
I20260709 13:10:36.229907 23489 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.320353 23588 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:36.308547 23838 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:36.516731 23952 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:36.518304 23843 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.237947 23679 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.518879 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2017) took 1065 ms. Trace:
I20260709 13:10:36.213953 23655 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.309768 23700 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:36.226827 23783 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:36.570115 23588 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.391703 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 730) took 1482 ms. Trace:
I20260709 13:10:36.317663 23680 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:36.322494 23862 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:10:36.593426 19300 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:36.233410 23879 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:36.326964 23793 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.595997 23838 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.297111 23867 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.597008 23838 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.597405 23867 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.232082 23948 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:10:36.046133 23846 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.229475 23330 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:10:36.620929 23330 consensus_queue.cc:1243] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:36.241376 23480 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.623099 23846 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.258623 23945 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.624877 23945 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.625905 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:36.627381 23945 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:36.340306 23949 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:10:36.629263 23949 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:36.629673 23949 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:36.630911 23949 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.347770 23876 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.304738 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:36.319483 19296 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:10:36.409385 23922 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.624105 23480 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:36.419974 23897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.007s	sys 0.007s
I20260709 13:10:36.636328 19297 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:36.636729 23897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.542s	user 0.007s	sys 0.007s
I20260709 13:10:36.636793 23949 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.472466 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:36.638854 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2030) took 1181 ms (client timeout 1532 ms). Trace:
I20260709 13:10:36.464454 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:36.478930 23889 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.639245 19373 rpcz_store.cc:269] 0709 13:10:35.456848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.477500 (+ 20652us) service_pool.cc:224] Handling call
0709 13:10:36.638450 (+1160950us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400298454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.638674 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749024640}
W20260709 13:10:36.640301 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 176418us
I20260709 13:10:36.521767 23193 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:36.643132 23922 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:36.643491 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:36.644183 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:36.644666 23892 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:36.644943 19897 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:36.645280 23892 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:36.646514 23892 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:36.648259 23484 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.147s	user 0.013s	sys 0.007s
I20260709 13:10:36.522346 23679 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:36.326401 23698 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.135s	user 0.010s	sys 0.000s
I20260709 13:10:36.524401 23356 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:36.527678 23933 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.527513 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:36.528913 23921 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:36.665904 23921 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:36.531569 19369 rpcz_store.cc:276] 0709 13:10:35.453378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.453515 (+   137us) service_pool.cc:224] Handling call
0709 13:10:36.518350 (+1064835us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b5400357d54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.518658 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085207424}
W20260709 13:10:36.551728 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65198.6us
I20260709 13:10:36.552659 23857 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:36.549140 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 65846.7us
I20260709 13:10:36.529819 23887 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.477000 19118 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.556610 23655 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.571983 19900 rpcz_store.cc:276] 0709 13:10:34.909780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.031855 (+122075us) service_pool.cc:224] Handling call
0709 13:10:35.049607 (+ 17752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.801081 (+751474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.391361 (+590280us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54005d2854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:36.391617 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095627648}
I20260709 13:10:36.574978 23700 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.672796 23700 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.673934 23700 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.668767 23857 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.654038 23855 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:36.576908 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:36.580423 19869 leader_election.cc:400] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16.
I20260709 13:10:36.581293 23766 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.584450 23787 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:36.580054 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.101s	sys 0.145s
I20260709 13:10:36.585525 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:36.571945 23588 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:36.586442 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.323002 23877 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:36.700910 23877 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:36.702301 23877 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.596344 19374 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:36.679488 23857 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.683596 23766 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.613761 23879 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.615500 23948 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:36.617100 19292 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:36.633162 23838 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:36.633313 23867 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:36.469892 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.637610 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2020) took 1183 ms (client timeout 1522 ms). Trace:
W20260709 13:10:36.638291 23968 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:36.677906 23625 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:36.397924 19894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 886) took 1568 ms (client timeout 1837 ms). Trace:
I20260709 13:10:36.649434 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:36.722633 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:36.639245 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 167291us
W20260709 13:10:36.723073 19894 rpcz_store.cc:269] 0709 13:10:34.829238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.829891 (+   653us) service_pool.cc:224] Handling call
0709 13:10:36.397711 (+1567820us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.397864 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106359808}
W20260709 13:10:36.724910 23778 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.015s
I20260709 13:10:36.725469 23778 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:36.726732 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.727253 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.718611 19365 rpcz_store.cc:269] 0709 13:10:35.454211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.454399 (+   188us) service_pool.cc:224] Handling call
0709 13:10:36.637188 (+1182789us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54000d34d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.637417 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26942208}
I20260709 13:10:36.729202 23867 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:36.729887 23867 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.666081 19371 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.732780 19299 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:36.736133 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 885) took 1911 ms. Trace:
I20260709 13:10:36.736521 19903 rpcz_store.cc:276] 0709 13:10:34.825056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.825534 (+   478us) service_pool.cc:224] Handling call
0709 13:10:36.735784 (+1910250us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540049f054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.735952 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877293312}
W20260709 13:10:36.728920 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79685.1us
I20260709 13:10:36.741322 23777 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:36.648872 23484 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.727985 23700 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:36.744633 19901 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:36.669795 23921 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.745692 23921 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:36.744334 23700 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.670354 19118 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.683085 19869 leader_election.cc:403] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:36.666463 23876 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:36.684412 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.102s	sys 0.145s
W20260709 13:10:36.682934 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 106371us
I20260709 13:10:36.682353 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:36.682830 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:36.686313 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2423) took 1719 ms. Trace:
I20260709 13:10:36.678988 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:36.665750 23793 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:36.689778 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2019) took 1537 ms. Trace:
I20260709 13:10:36.678155 23655 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:36.676098 23746 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.010s
I20260709 13:10:36.684276 23599 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:36.683761 23927 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
W20260709 13:10:36.790602 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 236481us
I20260709 13:10:36.679946 23489 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:36.682083 23855 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.704017 23877 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.717116 23480 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:36.639822 23889 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.720781 19897 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
W20260709 13:10:36.728899 19107 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d50eb2dab6754df8bcbed1445f2e8430 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:36.643186 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2272) took 1011 ms. Trace:
I20260709 13:10:36.791823 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:36.714000 23948 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:36.804054 23793 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:36.804636 23793 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:36.805074 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:36.805656 23793 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.760670 23840 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.807649 19903 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:36.807753 23793 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.808658 23840 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:36.811115 23489 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.812383 23889 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:36.814879 23634 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.795953 23643 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16.
W20260709 13:10:36.817123 19107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 88481.3us
I20260709 13:10:36.778292 19220 rpcz_store.cc:276] 0709 13:10:34.966537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.969452 (+  2915us) service_pool.cc:224] Handling call
0709 13:10:34.969890 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.036282 (+ 66392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.036310 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:35.036349 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:35.036390 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.685847 (+1649457us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b540013e054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:36.685906 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.686111 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152193792}
I20260709 13:10:36.822883 23484 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:36.780308 19294 rpcz_store.cc:276] 0709 13:10:35.149291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.464798 (+315507us) service_pool.cc:224] Handling call
0709 13:10:36.686875 (+1222077us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54002e8e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.687056 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285994368}
I20260709 13:10:36.731354 23867 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.824378 23700 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:36.789415 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51572.2us
I20260709 13:10:36.781922 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:36.791817 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51814.9us
W20260709 13:10:36.790791 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 801214us
I20260709 13:10:36.802079 19371 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:36.800422 19372 rpcz_store.cc:276] 0709 13:10:35.631970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.040309 (+408339us) service_pool.cc:224] Handling call
0709 13:10:36.640785 (+600476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.641236 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.641268 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.641344 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:36.641384 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.641470 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.642823 (+  1353us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54000d34d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:36.642987 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995268864}
I20260709 13:10:36.801337 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:36.830093 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 143477us
I20260709 13:10:36.827409 19894 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 5.
I20260709 13:10:36.841873 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:36.844269 23655 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:36.845340 23489 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:36.845495 23855 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.846544 23489 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:36.847085 23489 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:36.847600 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 168758us
I20260709 13:10:36.803644 23948 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.849149 23948 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.851840 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:36.832785 23843 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:36.835582 23588 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:36.835109 23480 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.866770 19299 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:36.793398 23625 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.870584 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:36.871330 23860 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:36.873660 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:36.874522 19118 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 8 to 10, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:36.875355 23494 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:36.875887 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.878727 23655 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:36.883315 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:36.869928 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:36.860880 23843 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:36.863955 23588 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.896202 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:36.901269 23843 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.913196 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:36.916381 19224 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:36.911000 23625 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:36.917352 23946 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:36.917518 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47058.3us
I20260709 13:10:36.918488 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:36.921448 23889 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:36.921892 23889 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.922226 23889 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.924983 23860 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:36.925403 23860 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.926455 23860 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.926918 23887 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:36.927853 23860 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.902936 19223 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
W20260709 13:10:36.928573 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 58719.1us
I20260709 13:10:36.929095 23698 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:36.929338 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:36.909206 23766 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.931111 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:36.946900 19897 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:36.947556 19216 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:36.931850 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:36.948611 19224 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:36.931402 23480 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.935487 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:36.895282 23655 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:36.938386 23700 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:36.954236 23700 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:36.954648 23655 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.955307 23700 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.956352 23655 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:36.890684 23494 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:36.958457 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:36.959323 23494 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.857108 23489 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:36.960597 23494 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.963011 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:36.940366 23625 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:36.965126 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:36.965337 23876 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:36.965750 23887 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:36.965987 19372 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:10:36.966224 23887 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.966650 23887 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.966003 23876 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:36.967965 23876 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:36.969667 23876 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.941744 19118 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:36.946058 23698 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.944051 23857 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:36.972463 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.974965 23698 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.976877 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:36.901448 23588 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.987066 19371 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:36.985281 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:36.992326 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:36.994743 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.003028 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.004518 19366 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:37.005398 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:37.004577 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:37.011591 23484 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.012064 23484 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:37.012480 23484 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.008019 23356 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.016603 23356 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.018885 23356 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.022882 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.024398 23892 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:37.024438 23485 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.024916 23892 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:37.025331 23892 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.002625 23787 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.002223 23643 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.037655 19372 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:37.008104 23777 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.010461 23897 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.048445 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.047227 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:37.049160 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:37.051477 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.051973 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.034355 23679 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.059100 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:37.043522 23897 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.061801 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.085150 19216 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:37.066738 19218 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:37.043330 23356 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.067795 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.067031 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.071676 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:37.072710 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:37.073191 19191 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.532s (SENT)
I20260709 13:10:37.073415 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.073647 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.074117 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.075248 23945 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:37.075802 23846 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.077646 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.079177 19118 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:37.080345 23933 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.078440 23484 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.097200 19221 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.084766 23655 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:37.100834 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.102558 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.086809 23897 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.086243 23676 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.107270 19225 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:37.120196 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 313476us
I20260709 13:10:37.133865 19294 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:37.114344 23655 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.140799 23625 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.084321 23777 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.132462 23599 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:37.065515 23643 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.148224 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.141793 19220 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.093526 23787 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.159528 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2271) took 1574 ms. Trace:
I20260709 13:10:37.159668 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.098742 23679 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:37.162195 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 89132.6us
I20260709 13:10:37.160337 19366 rpcz_store.cc:276] 0709 13:10:35.595092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.039383 (+444291us) service_pool.cc:224] Handling call
0709 13:10:36.039660 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.011521 (+971861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.136069 (+124548us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:37.150355 (+ 14286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184105216}
I20260709 13:10:37.146523 23655 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.171429 19225 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:37.104065 23846 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.174927 19292 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
W20260709 13:10:37.176412 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 103255us
I20260709 13:10:37.123099 23933 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.124941 23356 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:37.199345 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66002.6us
I20260709 13:10:37.197423 19298 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:37.196871 23787 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.136811 23945 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:37.164417 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105415us
I20260709 13:10:37.193492 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:37.193753 19191 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.760s (SENT)
I20260709 13:10:37.209609 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.177313 23485 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.217458 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:37.218416 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.219211 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.228338 19296 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:37.231611 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:37.231369 19118 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 9 to 11, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:37.233922 19118 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:37.239172 23698 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.239431 23992 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:37.240260 23992 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.242615 23992 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.248670 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.250059 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:37.253002 23983 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:37.256760 23991 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:37.257321 23991 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.259444 23991 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.260694 23484 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.269894 23599 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.274510 23843 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:37.276325 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 366964us
I20260709 13:10:37.281380 19337 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:37.227617 19225 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.163556 23676 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:37.283442 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 398788us
W20260709 13:10:37.295686 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.294099 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.286746 23783 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:37.286733 23948 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:37.308964 23783 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.235467 19118 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 7 to 11, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:37.317727 19299 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:37.323212 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.328848 23948 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:37.329295 23948 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:37.329380 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.329888 23698 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:37.330241 23948 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.331256 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.331893 23948 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.322737 23783 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:37.336140 23843 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:37.317636 23778 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:37.337877 23879 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.338294 23949 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.337941 19118 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 7 to 8, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.342151 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.340148 19118 catalog_manager.cc:5697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 10, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.373438 19295 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:10:37.354264 23634 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.000s
I20260709 13:10:37.367251 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.378573 19894 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.384719 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:37.384099 19895 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.347941 23889 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.394548 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.399133 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:37.402649 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:37.404599 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.405309 19370 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.408007 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.408314 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.409217 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.409567 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:37.411806 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 218084us
I20260709 13:10:37.412839 19372 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:37.412432 19118 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 8 to 11, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:37.413877 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.414400 19372 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.414227 19118 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 7 to 9, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 9 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:10:37.416796 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 132624us
I20260709 13:10:37.417452 23889 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.418008 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.418685 19369 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.419691 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.421005 23933 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.422986 23676 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.424657 23838 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.425045 23838 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.425196 23778 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:37.425374 23945 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:37.426048 23778 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.426432 23778 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:37.428336 23922 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.428910 23922 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.429574 23643 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:37.426440 23952 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:10:37.430864 23922 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.432446 23679 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.432723 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.433005 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.433501 19365 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:37.433645 23846 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.434268 23643 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:37.364537 23887 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.434563 23777 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.434756 23857 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:37.425915 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.435796 19218 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:37.434496 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.437705 19374 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:37.427439 23778 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.367384 23330 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:10:37.459055 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:37.425437 23838 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.392668 23991 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.462625 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:37.463378 19216 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.468464 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:37.468631 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:37.469292 19225 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:37.474517 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.484124 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.490298 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.497869 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.510993 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.487888 23778 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.520917 19369 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:37.523893 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.512921 23846 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.528782 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.515872 23867 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:37.494019 23777 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:37.548883 19220 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
W20260709 13:10:37.553928 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 85376.6us
I20260709 13:10:37.483009 23991 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.529067 23698 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.560313 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:37.560943 23822 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:37.562593 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.564276 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.532505 23846 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.555122 23588 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.002s
I20260709 13:10:37.573712 19225 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:37.490643 23879 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:37.571208 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.572256 19374 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:37.548465 23867 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.576341 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.577133 23887 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.416061 19118 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 7 to 10, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 10 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:37.588349 23330 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:37.588852 23330 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:37.589233 23330 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:37.591466 23985 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:10:37.578325 23676 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.592969 23676 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.593353 23676 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.580628 23783 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.597568 23330 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.598779 23783 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:37.599654 23330 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:37.599663 19367 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:37.606668 23655 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:37.607633 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.608052 19118 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 3 to 10, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:37.579663 23588 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:37.610273 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:37.614282 23995 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:10:37.615063 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54959.6us
I20260709 13:10:37.570025 23698 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.619858 19370 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:37.575534 23846 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.624727 19371 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.623564 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.631953 19372 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.579893 23867 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.582098 23949 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.626312 19903 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:37.634627 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.640398 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:37.640955 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.641539 19370 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:37.642467 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.622956 23948 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:37.629684 23698 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.673997 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.659452 19372 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:37.663203 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:37.664819 19366 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.665706 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:37.667035 19895 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:37.668826 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:37.682662 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:37.684228 19900 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:37.685140 19373 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:37.688441 19366 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:37.689054 24000 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:37.689913 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2280) took 1842 ms. Trace:
I20260709 13:10:37.689685 24000 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.690294 19368 rpcz_store.cc:276] 0709 13:10:35.839442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.208090 (+368648us) service_pool.cc:224] Handling call
0709 13:10:36.664951 (+456861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.717108 (+ 52157us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:36.717491 (+   383us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.792812 (+ 75321us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.873808 (+ 80996us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18003a6f60. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:37.105453 (+231645us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b18003a6f60. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:10:37.105610 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.105654 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.105705 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.116738 (+ 11033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.681100 (+564362us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400298450. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:37.681195 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475800,"prepare.queue_time_us":1804,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":315660,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":21830,"spinlock_wait_cycles":1023111552,"thread_start_us":61369,"threads_started":1,"wal-append.queue_time_us":221041}
I20260709 13:10:37.692308 19894 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.672096 23356 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.692024 24000 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.700466 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:37.701606 23860 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.004s
I20260709 13:10:37.701979 23948 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.637950 23838 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:37.707688 19365 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:37.712188 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.752030 19367 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.712265 23655 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.716331 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:37.722296 19895 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:37.726197 19218 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:37.726622 19370 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:37.727224 23991 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:37.673070 23588 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.727402 19118 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:37.734745 19366 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:37.621567 23897 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:37.736835 23494 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.002s
W20260709 13:10:37.739413 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 174908us
W20260709 13:10:37.739976 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 121170us
I20260709 13:10:37.740110 23876 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:37.740221 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.742453 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:37.748989 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 85861.3us
I20260709 13:10:37.753751 19216 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:37.759192 19369 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:37.772753 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.785485 19368 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:37.786819 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.793251 19225 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:37.787890 19220 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:37.795253 23778 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.796825 19903 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:10:37.789119 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 77038.5us
I20260709 13:10:37.758646 23480 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:37.807675 19223 raft_consensus.cc:2410] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:37.801321 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.760823 23857 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.803728 19900 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:37.813676 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.813705 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.808378 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:37.816200 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.813434 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.824031 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.824229 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.820547 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.787968 23897 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:37.828408 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.822041 19221 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:37.831967 19218 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.832456 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.833730 19370 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:37.838621 19300 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.841176 19220 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:37.842911 19298 pending_rounds.cc:85] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:10:37.843231 19298 pending_rounds.cc:107] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:37.843503 19298 raft_consensus.cc:2889] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:37.811367 23857 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.843938 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 198177us
I20260709 13:10:37.795939 23778 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.845058 19894 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:37.833082 19225 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:37.817122 23840 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.846570 23933 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.846838 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:37.817763 23777 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.840215 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:37.853781 19219 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:10:37.857232 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48937us
I20260709 13:10:37.857918 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:37.841255 19216 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:37.850345 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.831300 23946 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.852828 23356 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:37.855316 23838 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:37.850049 23857 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.851199 23787 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:37.868690 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.818533 23480 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:37.833590 23952 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:10:37.880965 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.882787 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:37.855743 23777 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.856856 23643 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:37.892099 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:37.866489 23946 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:37.899942 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 117101us
I20260709 13:10:37.900833 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.908545 19300 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:37.892779 23777 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.912902 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.891307 23787 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:37.896948 23855 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.903501 23946 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.965938 19901 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:37.905413 23193 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:37.976243 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93528.2us
I20260709 13:10:37.909981 23876 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:38.009866 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 110402us
I20260709 13:10:38.021119 19900 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:37.963539 23741 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:37.985220 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:38.027832 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:38.028713 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:38.029381 19365 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:38.030172 19300 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:10:38.032737 24008 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:10:38.033733 23935 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.034240 23935 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:38.035125 23935 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.036782 23945 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:38.038631 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:38.039423 23945 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.039840 23945 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.040241 23945 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.044510 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:38.046074 24014 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.046461 24014 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.046774 24014 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:38.052500 23892 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.027s	user 0.014s	sys 0.000s
I20260709 13:10:38.052326 23787 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.052953 23892 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.013455 23922 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:10:38.058416 23860 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:38.059465 23860 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:38.060423 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.060811 23778 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:38.061163 19365 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:38.062479 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:38.063107 19295 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.974380 23948 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:38.008785 23494 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.073689 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:38.074919 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:37.852154 19118 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 5 to 8, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:38.014353 23193 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:38.016772 23876 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:38.047735 23698 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.081413 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:38.082389 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:38.084790 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:38.080140 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 173072us
I20260709 13:10:38.090065 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:38.086119 19902 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:37.916453 23700 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.097421 19294 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 6: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:38.089308 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:38.098120 19219 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:38.102341 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.103009 19367 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.017729 23356 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:37.975777 23855 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.047999 23676 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.083019 23948 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.123214 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:38.092360 23876 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.031980 23846 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.104602 23679 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:38.104046 23700 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.075675 23838 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:10:38.108378 23778 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:38.078217 23783 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:10:38.101908 19107 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica d50eb2dab6754df8bcbed1445f2e8430 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:38.114339 23855 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.121466 23892 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.123600 23480 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:38.139848 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75109.7us
I20260709 13:10:38.141656 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:38.146073 23356 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:38.147521 23676 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.156183 19292 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:38.127540 23679 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:38.150651 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.151081 19896 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:38.131343 23700 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.102026 23330 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:10:38.155404 23783 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:38.167594 19898 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:38.168669 23840 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:38.170902 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.133240 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:38.187942 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:38.151841 19107 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 54296.6us
I20260709 13:10:38.196991 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:38.204332 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 150817us
W20260709 13:10:38.219748 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 315426us
I20260709 13:10:38.165915 23494 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:38.224685 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:38.246493 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:38.251103 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.271108 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.272047 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:38.275431 24012 log.cc:927] Time spent T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:10:38.243870 23676 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:38.243516 23787 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:10:38.229347 23897 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:38.280411 23897 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:38.280812 23897 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.284430 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.285293 19369 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.285177 23857 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.286598 19291 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:38.288497 23887 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.289256 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:38.292146 23876 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.293504 23857 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:38.296672 23897 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.297801 23876 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:38.298898 23897 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.299628 23897 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.164564 23480 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:10:38.159754 24017 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.170435 23783 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:38.315721 19365 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:10:38.244593 23867 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
W20260709 13:10:38.314981 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53431.2us
I20260709 13:10:38.162464 23945 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.244359 23494 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.274137 23643 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.273445 23655 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.271026 23840 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:38.324607 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 152406us
I20260709 13:10:38.345768 19295 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:38.309520 24000 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:38.348898 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.349900 19297 raft_consensus.cc:606] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:38.350410 19297 raft_consensus.cc:614] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:38.300146 23897 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:38.352953 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:38.305980 23991 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:10:38.325248 23933 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:38.357509 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:38.330467 23494 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.345556 23643 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.230136 23679 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.364039 19367 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:38.358873 24000 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:38.369541 23897 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.370246 24000 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.349987 23655 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:38.372666 24016 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:10:38.374200 23655 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.375861 23330 raft_consensus.cc:2764] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:10:38.358961 23887 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:10:38.377048 24013 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:38.379464 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:38.368860 23356 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:10:38.380573 24009 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:10:38.381280 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:38.381635 23838 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:38.322237 23867 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:38.396271 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 149886us
I20260709 13:10:38.398898 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:38.367125 23643 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.371752 23777 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:38.405632 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 208282us
W20260709 13:10:38.413311 19191 leader_election.cc:336] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.775s (SENT)
I20260709 13:10:38.407567 23655 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.417899 23655 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:38.418895 23655 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:38.420770 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 130680us
I20260709 13:10:38.421882 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:38.421540 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59030.6us
I20260709 13:10:38.427135 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:38.427538 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46356.9us
I20260709 13:10:38.433398 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:38.435470 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:38.440660 19369 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:38.421723 23679 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.424423 23330 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.446506 23857 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:38.448853 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 372319us
I20260709 13:10:38.425587 23945 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.462460 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.463228 19221 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.453728 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:38.456141 24028 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:38.456431 19223 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:38.457019 19224 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:38.431986 23676 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:38.460335 23935 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:38.461637 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.430917 23892 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:38.467975 19222 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.469601 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.472303 19218 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.473929 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.474179 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:38.474761 19219 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.476104 19225 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:38.481163 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:38.481693 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 73826us
I20260709 13:10:38.441993 23840 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:10:38.475028 19220 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:38.448329 23876 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.486670 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:38.488178 19216 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:38.452970 23857 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.489379 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:38.466055 23330 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:38.470218 23676 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.471323 23892 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:38.501744 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.507478 19223 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.481397 24028 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:38.505556 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 899) took 1096 ms. Trace:
I20260709 13:10:38.492650 24018 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.491981 23857 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.546268 23330 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.496536 23877 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.484862 24014 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.548626 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.499866 23778 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.510423 23892 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.491844 23876 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.563489 23877 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:38.571529 23877 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.574084 23949 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:38.574577 23949 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:38.532735 19898 rpcz_store.cc:276] 0709 13:10:37.399375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.399645 (+   270us) service_pool.cc:224] Handling call
0709 13:10:37.403989 (+  4344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.171729 (+767740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.494252 (+322523us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54006bfb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:38.496158 (+  1906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521228032}
I20260709 13:10:38.557914 19220 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.556216 19218 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:38.500699 23676 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:38.580466 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 79293.4us
I20260709 13:10:38.525633 24013 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:38.584443 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:38.596228 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:38.575512 23949 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.564724 23838 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:38.583550 23935 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.561734 23643 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:38.607052 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 171666us
I20260709 13:10:38.600368 23867 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:38.604032 19191 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.522s (SENT)
I20260709 13:10:38.610282 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:38.600883 24020 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:10:38.610854 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.612807 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:38.567569 23778 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.613322 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:38.618273 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:38.602296 23777 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:38.609079 24023 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:10:38.597307 24029 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:38.622552 23991 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.628221 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:38.667887 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 89110.5us
I20260709 13:10:38.628417 23838 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:38.629086 19191 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.527s (SENT)
I20260709 13:10:38.669292 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:38.669559 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.670190 19369 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.631464 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.671375 19225 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.620813 23897 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:38.619410 24028 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.633545 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.674503 19218 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.636037 23193 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.637176 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:38.641484 23643 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:38.676271 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.676854 19373 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.664392 19221 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:38.665066 19219 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:38.623132 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:38.665503 19222 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:38.667896 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 198611us
I20260709 13:10:38.630952 23876 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.625921 23922 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:38.690841 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53765.6us
I20260709 13:10:38.613720 23935 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:38.700471 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116116us
W20260709 13:10:38.703634 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.704653 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:38.711527 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.705333 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.642959 23867 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:38.712455 19219 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.705937 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.713099 19221 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.713934 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.714483 19367 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.716922 19373 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:38.717617 19369 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:38.712074 19368 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.674015 23700 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.720369 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:38.670612 23741 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.720991 19372 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.723047 19222 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:38.729322 19221 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:38.734597 19218 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:38.750273 19367 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:38.752898 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.756592 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.757460 19218 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.748579 23867 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:38.764292 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:38.711055 24013 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:38.772049 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:38.719092 23655 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.789075 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 159999us
I20260709 13:10:38.703424 24038 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:10:38.795928 19219 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:38.770951 23193 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.804939 19218 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:10:38.796759 19191 leader_election.cc:336] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.561s (SENT)
I20260709 13:10:38.774498 24013 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:38.778075 23922 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.806131 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:38.808662 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 184300us
I20260709 13:10:38.809940 19218 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:38.814152 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:38.763711 24031 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:10:38.814823 19219 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.805151 24029 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.809238 24013 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.809932 24014 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.794091 23655 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:38.841713 24030 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260709 13:10:38.844835 24036 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
W20260709 13:10:38.846418 24040 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:10:38.849858 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2296) took 1438 ms. Trace:
I20260709 13:10:38.850286 23892 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:38.850250 19374 rpcz_store.cc:276] 0709 13:10:37.411088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.640324 (+229236us) service_pool.cc:224] Handling call
0709 13:10:37.665378 (+ 25054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.784457 (+119079us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:37.815625 (+ 31168us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.910665 (+ 95040us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.910865 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.910909 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:37.919333 (+  8424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.032582 (+113249us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b180027dea0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:38.045188 (+ 12606us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b180027dea0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f
0709 13:10:38.045629 (+   441us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b4800042858. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:10:38.432145 (+386516us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b180027dea0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419
0709 13:10:38.849642 (+417497us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:38.849692 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.849808 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1841,"prepare.queue_time_us":9274,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":4917,"raft.run_cpu_time_us":1841,"raft.run_wall_time_us":131212,"spinlock_wait_cycles":507148288,"thread_start_us":61667,"threads_started":1,"wal-append.queue_time_us":288667}
I20260709 13:10:38.853121 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:38.853312 23935 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:38.808495 24048 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:10:38.857920 23700 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.859267 19368 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:38.859839 23892 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.860610 23698 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.861654 23846 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:38.862350 23855 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.002s
I20260709 13:10:38.863117 23855 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.861722 19223 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:38.836273 24047 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.871325 19219 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:38.871490 19372 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:38.924374 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 134438us
W20260709 13:10:38.925819 19191 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.684s (SENT)
W20260709 13:10:38.878758 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.797443 23867 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.933679 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:38.886514 23494 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.009s
I20260709 13:10:38.866909 23945 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.865384 23855 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.945062 23494 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:38.962363 23494 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:38.968508 19216 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:38.969070 19216 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:38.969322 19216 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:38.972432 19216 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:38.977051 23933 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:38.977675 23933 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:38.981426 24032 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.526s	user 0.000s	sys 0.001s
I20260709 13:10:39.002784 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:38.975936 24033 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.520s	user 0.002s	sys 0.000s
I20260709 13:10:39.004803 19224 raft_consensus.cc:2368] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12.
I20260709 13:10:38.876037 23857 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:39.010036 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 248175us
I20260709 13:10:39.023733 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:38.835855 24029 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.037739 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:38.995913 23945 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:39.026976 23946 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.006s	user 0.009s	sys 0.005s
W20260709 13:10:39.043107 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 279012us
I20260709 13:10:39.042281 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:38.947592 23922 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.042281 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:39.046895 19898 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.044691 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:39.046269 19901 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:39.023973 24031 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.050947 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:39.052103 19895 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:10:39.053820 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 128040us
I20260709 13:10:39.055784 23935 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:39.056334 23935 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.057196 23935 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.059329 19225 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:39.043745 23783 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.065878 23783 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.068426 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.069394 19225 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.070941 19220 raft_consensus.cc:2410] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:39.072055 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.072708 19220 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.074927 23949 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:39.046562 23946 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.084710 19300 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:39.085179 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.759s (SENT) [suppressed 28 similar messages]
I20260709 13:10:39.095993 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:39.100463 19225 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:39.102849 19191 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.840s (SENT)
I20260709 13:10:39.103307 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:39.084535 23946 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:39.113206 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.112399 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 35) took 1009 ms. Trace:
I20260709 13:10:39.115168 19297 rpcz_store.cc:276] 0709 13:10:38.104834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.116273 (+ 11439us) service_pool.cc:224] Handling call
0709 13:10:39.099440 (+983167us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002e8e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:39.099581 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368747392}
I20260709 13:10:39.122002 23588 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.123438 23655 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:39.123730 23588 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.130757 19220 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:39.132040 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.137266 19220 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:39.141719 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.053886 24031 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.132035 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.120913 24048 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:39.157145 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2028) took 1089 ms. Trace:
I20260709 13:10:39.157569 19300 rpcz_store.cc:276] 0709 13:10:38.061687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.062950 (+  1263us) service_pool.cc:224] Handling call
0709 13:10:38.063243 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.085137 (+1021894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.150526 (+ 65389us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000492d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:39.150705 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331748608}
I20260709 13:10:39.160470 24048 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.160998 23480 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:39.161094 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.161646 23480 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.161528 24048 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.162602 23480 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.165534 24051 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.166035 24051 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.166684 23946 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:39.166869 24051 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.155193 23945 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:39.172883 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.149242 24047 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.167461 23946 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.178066 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.189126 23857 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:39.194294 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.194705 19371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:39.195086 19221 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.195407 19371 raft_consensus.cc:606] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:39.195824 19371 raft_consensus.cc:614] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:39.199944 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.200973 19895 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:39.201740 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.202338 19219 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:39.202986 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100163us
I20260709 13:10:39.205242 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.179314 19216 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:39.209988 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.210140 24014 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:39.210901 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.124652 23588 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.211959 23777 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.213553 23855 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.214107 23855 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.214116 23356 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:39.214797 23356 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.215086 23855 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:39.221460 19107 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:10:39.222492 24046 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 13:10:39.223635 24039 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:39.224604 23840 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:39.225154 23840 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:39.226696 23778 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:39.211071 23676 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.006s
I20260709 13:10:39.227363 19371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:39.228097 19371 raft_consensus.cc:606] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:39.228296 24029 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:39.228472 19371 raft_consensus.cc:614] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:39.226153 23840 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.227414 23676 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:39.235584 24027 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.780s	user 0.003s	sys 0.000s
I20260709 13:10:39.248862 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:39.250005 19898 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:39.256266 19221 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:39.257817 23741 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.258519 23741 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.261413 23741 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.262135 24039 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:39.262841 24039 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.265865 24039 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.267529 19222 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:39.273640 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 73750.4us
I20260709 13:10:39.274937 24029 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:39.275374 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.276769 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.284235 24029 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.284686 24029 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.285040 24029 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.285696 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2322) took 1044 ms. Trace:
I20260709 13:10:39.286093 19366 rpcz_store.cc:276] 0709 13:10:38.241790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.241940 (+   150us) service_pool.cc:224] Handling call
0709 13:10:38.242369 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.246757 (+  4388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.246803 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.247393 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.429239 (+181846us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:38.429298 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.429393 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.234922 (+805529us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:39.285432 (+ 50510us) raft_consensus.cc:1685] finished
0709 13:10:39.285454 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.285639 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":30135,"spinlock_wait_cycles":69859584,"thread_start_us":151370,"threads_started":1,"wal-append.queue_time_us":177363}
I20260709 13:10:39.277875 24014 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:39.288333 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:39.288888 19294 raft_consensus.cc:606] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:39.289269 19294 raft_consensus.cc:614] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:39.282534 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:39.215673 23356 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.301187 19291 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.209931 24031 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.304721 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:39.247984 23777 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.305572 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:39.305701 19903 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:39.319727 19898 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:39.299431 23840 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.314285 24029 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.320379 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:39.298997 24014 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:39.322105 19219 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:39.323307 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.326371 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:39.326793 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.325790 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.329697 19366 raft_consensus.cc:2368] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:39.332122 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.335583 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.337791 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d825739f94b747959f93597edca9200a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:39.325203 24014 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.328025 24039 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.300521 23857 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:10:39.338351 19294 raft_consensus.cc:606] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:39.331188 23935 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:39.372469 23777 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.349452 24014 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.352847 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.583721 23946 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.586427 19372 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 7. Current term is 9. Ops: [7.6-7.6]
W20260709 13:10:39.407435 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.551295 19223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.011s	sys 0.027s
I20260709 13:10:39.582142 23676 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:39.334473 23679 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:10:39.355019 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.590979 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:39.606941 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 249727us
I20260709 13:10:39.615998 19294 raft_consensus.cc:614] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:39.642056 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:39.616851 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.617902 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 317768us
I20260709 13:10:39.643908 19371 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:39.619982 19218 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:39.623479 19223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.012s	sys 0.028s
W20260709 13:10:39.625427 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.588351 24013 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.010s
W20260709 13:10:39.589159 23933 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.016s
W20260709 13:10:39.646610 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.592533 24029 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:39.598299 23741 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:39.632097 23949 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.010s
I20260709 13:10:39.649923 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.617957 23935 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.612232 23787 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:39.686112 19895 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:39.688614 19300 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.614378 24039 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.673382 19368 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:39.677796 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.675218 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.676538 23480 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:39.693320 19897 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:39.694299 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.685925 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.685204 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.701715 19374 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.684350 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.703733 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:39.706274 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:39.721120 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.722141 19367 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:39.725189 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.683832 23935 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:39.728690 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:39.691789 23946 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:39.733626 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.722673 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:39.710528 23480 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.738058 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.742158 19369 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:39.742347 23480 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.743064 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.743597 23480 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.696050 23787 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.744822 19369 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:39.746318 23787 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.747246 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.747884 19370 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:39.749019 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:39.749224 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.736272 19218 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:39.753378 19373 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:39.666543 23933 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:39.661260 24013 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.756449 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.678566 23741 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.765739 19367 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:39.766767 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.775591 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.776539 19365 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 8.
I20260709 13:10:39.779559 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.780367 19370 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.780921 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.784040 19369 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:39.785763 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.786840 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.787794 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.792547 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:39.763881 24075 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:39.823115 19365 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:39.868280 19222 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:39.759044 23887 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:39.768625 23330 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:39.779932 24000 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:39.893093 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:39.894392 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.894958 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.898885 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.899302 19370 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:39.899904 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2031) took 1044 ms. Trace:
W20260709 13:10:39.900588 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 284151us
I20260709 13:10:39.890095 19216 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:39.902958 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:39.892661 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 572442us
I20260709 13:10:39.900530 19291 rpcz_store.cc:276] 0709 13:10:38.855761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.855873 (+   112us) service_pool.cc:224] Handling call
0709 13:10:38.856135 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.303524 (+447389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.896111 (+592587us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54001d3b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:39.899843 (+  3732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019100928}
I20260709 13:10:39.907544 19218 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.912463 23494 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:39.916913 24074 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:10:39.920724 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.921520 19365 raft_consensus.cc:2368] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:39.903739 19216 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:39.925621 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:39.925683 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:39.886837 23840 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.006s
I20260709 13:10:39.929584 19216 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:39.933028 24044 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:39.954723 19292 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:39.934371 23741 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.935689 24013 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:39.936477 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:39.936906 23933 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:39.885847 23330 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:39.894327 24060 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:10:39.923342 23949 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:10:39.940709 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:39.974416 19221 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.928521 23952 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:10:39.943693 19374 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:39.893353 23887 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:39.885944 23193 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.947113 19218 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:39.951138 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:39.933707 19293 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.984759 23741 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.962608 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:40.052325 19219 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:39.965194 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:39.966404 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:39.922366 23946 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:39.922760 24047 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:40.012607 23840 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:39.922583 24055 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:40.084522 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.089956 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:40.090703 19897 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:40.010008 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.091740 19374 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:39.984953 23876 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.005905 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 256959us
I20260709 13:10:39.955500 19216 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:39.983798 23588 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:40.049033 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 66096.3us
I20260709 13:10:40.051007 19368 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:39.906558 23679 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:40.085830 19218 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:40.111256 24070 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:40.111395 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.112046 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.077998 23193 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.149391 19219 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:40.150131 19216 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: [11.7-12.8]
I20260709 13:10:40.150286 19300 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:40.140239 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:40.134514 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 229989us
W20260709 13:10:40.113785 24068 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260709 13:10:40.142974 19370 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:40.142664 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2488) took 1377 ms. Trace:
I20260709 13:10:40.143790 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.154383 19221 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:40.148797 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.086648 23840 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:40.139577 23876 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.114600 24039 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:40.148672 23193 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:40.208833 19216 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:40.176385 19291 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:40.113754 24047 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.176636 23946 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.239727 24047 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.155085 23933 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.151957 19374 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:10:40.141592 24087 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.185506 19223 rpcz_store.cc:276] 0709 13:10:38.764998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.876692 (+111694us) service_pool.cc:224] Handling call
0709 13:10:38.877049 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.881121 (+  4072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.881157 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.882501 (+  1344us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.645927 (+763426us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:39.645966 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.646034 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.142410 (+496376us) raft_consensus.cc:1685] finished
0709 13:10:40.142440 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.142602 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3491,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":87,"thread_start_us":763054,"threads_started":1,"wal-append.queue_time_us":1124657}
I20260709 13:10:40.142899 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:40.149030 23783 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:10:40.119094 24044 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.211772 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.238894 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:40.227007 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.237299 24104 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:40.212906 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2497) took 1155 ms. Trace:
W20260709 13:10:40.211267 24085 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.289s	user 0.007s	sys 0.005s
I20260709 13:10:40.284309 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.282172 19220 rpcz_store.cc:276] 0709 13:10:39.057001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.148710 (+ 91709us) service_pool.cc:224] Handling call
0709 13:10:39.149140 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.174369 (+ 25229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.174398 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.174785 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.325100 (+150315us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:39.325144 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.325207 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.212692 (+887485us) raft_consensus.cc:1685] finished
0709 13:10:40.212714 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.212850 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12259,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7675,"thread_start_us":142718,"threads_started":1,"wal-append.queue_time_us":458801}
I20260709 13:10:40.087199 23741 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.236974 23887 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:40.222522 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2493) took 1170 ms. Trace:
I20260709 13:10:40.082636 23952 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.237231 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:40.237709 24067 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
I20260709 13:10:40.212124 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.253583 19221 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:40.276038 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:40.277837 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.248454 24078 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.169s	user 0.001s	sys 0.003s
I20260709 13:10:40.206171 23356 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.284243 24073 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.336s	user 0.000s	sys 0.005s
I20260709 13:10:40.299516 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.139060 24055 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.333344 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:40.334333 19220 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:40.299837 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:40.280503 23922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.011s	sys 0.015s
I20260709 13:10:40.307543 23783 consensus_queue.cc:1243] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:40.352584 19220 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:10:40.252265 24071 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.076s	user 0.004s	sys 0.000s
I20260709 13:10:40.286384 19224 rpcz_store.cc:276] 0709 13:10:39.051608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.053372 (+  1764us) service_pool.cc:224] Handling call
0709 13:10:39.053705 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:39.093447 (+ 39742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.093479 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:39.102451 (+  8972us) log.cc:844] Serialized 52 byte log entry
0709 13:10:39.339630 (+237179us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.532751 (+193121us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.900363 (+367612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.900440 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.222234 (+321794us) raft_consensus.cc:1685] finished
0709 13:10:40.222258 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.222450 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":316414,"prepare.queue_time_us":207841,"prepare.run_cpu_time_us":7637,"prepare.run_wall_time_us":32210,"raft.queue_time_us":346022,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":7201,"thread_start_us":217833,"threads_started":1,"wal-append.queue_time_us":972564}
I20260709 13:10:40.310784 23876 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.311946 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.154855 23679 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.212489 24039 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:10:40.149103 23588 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.337459 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.369961 19374 raft_consensus.cc:2368] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:40.297873 24044 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.283313 24087 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.373773 19292 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:40.373592 23330 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.374665 23330 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.376456 19369 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:40.376369 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.305274 23952 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.377632 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.378749 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.378962 23952 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.379463 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.314653 23887 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.321069 23356 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.380245 23887 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.381747 23356 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:40.298813 23933 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } attrs { replace: true } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.382174 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 760) took 1182 ms. Trace:
I20260709 13:10:40.382408 23887 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:40.312826 24053 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:40.383061 24053 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.382604 19894 rpcz_store.cc:276] 0709 13:10:39.199874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.220229 (+ 20355us) service_pool.cc:224] Handling call
0709 13:10:39.220538 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.220854 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.220880 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.221347 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.326847 (+105500us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:39.326884 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.326947 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.381977 (+1055030us) raft_consensus.cc:1685] finished
0709 13:10:40.381998 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.382119 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1066,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":105131,"threads_started":1,"wal-append.queue_time_us":555259}
I20260709 13:10:40.385310 24053 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:40.386314 24069 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.502s	user 0.001s	sys 0.000s
I20260709 13:10:40.386440 19374 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:40.387449 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:40.328027 19191 connection.cc:256] RPC call timeout handler was delayed by -1.4816218380000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 13:10:40.388141 19374 raft_consensus.cc:2368] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:40.350751 19223 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
W20260709 13:10:40.363767 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64214.9us
W20260709 13:10:40.348757 23922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.012s	sys 0.015s
I20260709 13:10:40.333334 24091 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:40.437274 24091 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:40.437695 24091 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:40.388343 19191 connection.cc:256] RPC call timeout handler was delayed by -1.4240218380000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 13:10:40.440349 19191 connection.cc:256] RPC call timeout handler was delayed by -1.3800792619999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32930000000000004s for a response
W20260709 13:10:40.440882 19191 leader_election.cc:336] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.950s (SENT)
I20260709 13:10:40.441329 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:40.442242 23494 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:40.442643 19191 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.034s (SENT)
I20260709 13:10:40.443117 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:40.443293 24087 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:40.349079 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 229855us
I20260709 13:10:40.443994 23676 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:40.444573 23676 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.445410 23949 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:40.446439 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.446564 23676 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.389055 19293 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:40.446792 23949 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:40.390468 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 764) took 1074 ms. Trace:
I20260709 13:10:40.447635 24096 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:40.448452 23952 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:40.448974 23952 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.449435 23949 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:40.449954 23949 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.451045 23783 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.451128 23952 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:40.451509 23783 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:40.400022 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.455086 19368 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:40.405022 23193 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:40.405403 23741 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.409837 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.412376 24055 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.447530 19902 rpcz_store.cc:276] 0709 13:10:39.315859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.316039 (+   180us) service_pool.cc:224] Handling call
0709 13:10:39.316479 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.316930 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:39.619886 (+302956us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.013980 (+394094us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.017253 (+  3273us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.017407 (+   154us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.017443 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.017504 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.390253 (+372749us) raft_consensus.cc:1685] finished
0709 13:10:40.390273 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.390397 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":506152,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":824,"raft.queue_time_us":196590,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":645010,"threads_started":2,"wal-append.queue_time_us":749057}
I20260709 13:10:40.469817 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:40.415373 23935 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.002s
W20260709 13:10:40.419778 24037 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.750s	user 0.004s	sys 0.004s
I20260709 13:10:40.369340 23840 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.476763 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.423650 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.424598 23679 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.477629 19369 raft_consensus.cc:2376] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9. Re-sending same reply.
I20260709 13:10:40.379488 19373 raft_consensus.cc:2368] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:40.479363 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.426406 24039 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:40.480098 19368 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:40.480151 24039 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:40.481419 24039 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.482522 24039 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.429962 24044 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.432643 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.433279 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:40.485733 19300 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:40.462286 23330 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:40.436571 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47201.8us
I20260709 13:10:40.452361 23783 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.398092 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2035) took 1049 ms. Trace:
I20260709 13:10:40.492861 19366 rpcz_store.cc:276] 0709 13:10:39.348284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.348447 (+   163us) service_pool.cc:224] Handling call
0709 13:10:39.348923 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.606361 (+257438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.606400 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.632864 (+ 26464us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.015696 (+382832us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:40.015738 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.015807 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.397858 (+382051us) raft_consensus.cc:1685] finished
0709 13:10:40.397880 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.398030 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":319820,"threads_started":1,"wal-append.queue_time_us":677313}
I20260709 13:10:40.460196 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2065) took 1153 ms. Trace:
I20260709 13:10:40.434985 19223 pending_rounds.cc:85] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:40.497345 19223 pending_rounds.cc:107] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:40.497673 19223 raft_consensus.cc:2889] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.494400 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:40.453397 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:40.420032 24014 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.784s	user 0.006s	sys 0.001s
I20260709 13:10:40.466603 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:40.473731 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 337170us
I20260709 13:10:40.500779 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:40.474318 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 195736us
I20260709 13:10:40.422191 23857 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:40.302867 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:40.508406 19216 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:40.489120 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:40.436866 24079 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.425s	user 0.000s	sys 0.002s
I20260709 13:10:40.462757 23193 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:40.503796 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50459.1us
I20260709 13:10:40.510610 19372 raft_consensus.cc:2410] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:40.505393 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.511138 19291 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:10:40.506492 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.507645 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.497273 19222 rpcz_store.cc:276] 0709 13:10:39.307141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.892879 (+585738us) service_pool.cc:224] Handling call
0709 13:10:39.945460 (+ 52581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.945662 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:39.945959 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.459737 (+513778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.459810 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.459878 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.459966 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.460108 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58833,"prepare.queue_time_us":1677,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":230632,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":513253,"threads_started":2,"wal-append.queue_time_us":218268}
I20260709 13:10:40.514384 19365 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:10:40.514643 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.515956 19366 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:40.520748 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:40.522680 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:40.512218 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.507659 23783 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.526126 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:40.527654 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 85042.5us
I20260709 13:10:40.527936 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.475746 23855 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:40.544778 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.499706 24105 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.547266 19902 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:40.547308 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.547914 24048 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.499588 23330 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.550832 23857 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:40.553260 19898 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 6.
I20260709 13:10:40.555454 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:40.512149 23676 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:40.478175 23935 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.559406 24044 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:40.560266 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65980.7us
I20260709 13:10:40.478073 24055 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:10:40.628317 19372 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:10:40.616219 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 60845.6us
W20260709 13:10:40.614287 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.635069 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:40.554461 24107 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:40.556104 24026 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:40.509464 24014 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:40.645432 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 143074us
I20260709 13:10:40.556553 24048 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:40.650169 19367 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:40.563673 24099 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:40.625504 24044 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:40.636916 24094 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:40.657593 24048 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.658123 23676 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:40.639371 24104 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:10:40.713415 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65902.9us
I20260709 13:10:40.684109 24044 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:40.717738 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 174360us
I20260709 13:10:40.556320 24105 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:40.720245 19191 leader_election.cc:336] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.118s (SENT)
I20260709 13:10:40.720716 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:40.727988 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.729169 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.646575 23193 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.738369 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.686372 23698 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:40.719570 23949 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:40.750125 24112 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:10:40.752307 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:40.745965 23494 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:40.753033 19293 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:10:40.753201 24110 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:40.752410 24111 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:10:40.753836 24110 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.754312 24110 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:40.756696 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 282297us
I20260709 13:10:40.758340 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:40.760836 19191 leader_election.cc:336] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.184s (SENT)
I20260709 13:10:40.736660 24094 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:40.768904 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:40.770001 24113 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:10:40.767166 24053 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:40.774163 19374 raft_consensus.cc:2410] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:40.775092 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2333) took 1126 ms. Trace:
I20260709 13:10:40.775640 19371 rpcz_store.cc:276] 0709 13:10:39.648936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.656287 (+  7351us) service_pool.cc:224] Handling call
0709 13:10:39.656706 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:39.984493 (+327787us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:40.297879 (+313386us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.555360 (+257481us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:40.627948 (+ 72588us) log.cc:844] Serialized 52 byte log entry
0709 13:10:40.628138 (+   190us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.643687 (+ 15549us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.643917 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.644010 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.774768 (+130758us) raft_consensus.cc:1685] finished
0709 13:10:40.774800 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.775000 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30105,"prepare.queue_time_us":268580,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":33268,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":16771,"spinlock_wait_cycles":6464768,"thread_start_us":794719,"threads_started":3,"wal-append.queue_time_us":358150}
I20260709 13:10:40.771689 24108 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:40.780014 24108 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:40.782927 24108 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.785136 23933 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:40.793906 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.797185 24120 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:10:40.800937 24119 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:40.802403 24121 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:40.808719 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.821058 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.764820 24026 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:40.850790 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.725178 23857 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.870028 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.871392 19367 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:40.871929 19367 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 12.
I20260709 13:10:40.870407 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.874132 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:40.874814 19372 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:40.835321 23193 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:40.879063 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.879294 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.879560 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:40.848075 24108 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:40.852139 24114 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.890159 19372 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:40.835747 24029 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:10:40.904419 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.891552 19372 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:40.848201 24051 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:40.870596 23867 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.909521 19266 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 12.
I20260709 13:10:40.840963 23855 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:10:40.916074 19898 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:40.833223 23676 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:40.917130 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:41.008757 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:40.917393 24118 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:10:40.918294 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.920637 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:40.921691 24125 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:10:40.924811 24123 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:40.924368 24094 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:40.929018 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 168212us
I20260709 13:10:40.930493 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:40.930999 24128 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:40.931434 24124 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:10:40.932461 24115 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:41.033067 24115 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.035267 24115 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:40.932281 24026 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.039726 23887 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.040148 23887 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:41.040755 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2076) took 1730 ms. Trace:
I20260709 13:10:41.040974 23887 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.041285 19218 rpcz_store.cc:276] 0709 13:10:39.314359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.140835 (+826476us) service_pool.cc:224] Handling call
0709 13:10:40.141141 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.316477 (+175336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.316720 (+   243us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.317287 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.589920 (+272633us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.589980 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.590067 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.040451 (+450384us) raft_consensus.cc:1685] finished
0709 13:10:41.040482 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.040676 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":283594,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":416416,"threads_started":2,"wal-append.queue_time_us":317665}
I20260709 13:10:41.046588 24134 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.047169 24134 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.043704 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 767) took 1253 ms. Trace:
W20260709 13:10:41.018164 24129 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:10:41.050624 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2351) took 1221 ms. Trace:
I20260709 13:10:40.910363 24114 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.051201 19374 rpcz_store.cc:276] 0709 13:10:39.829177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.475354 (+646177us) service_pool.cc:224] Handling call
0709 13:10:41.050438 (+575084us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400313154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:41.050557 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681158912}
I20260709 13:10:41.052733 24114 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.050205 19901 rpcz_store.cc:276] 0709 13:10:39.790787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.810617 (+ 19830us) service_pool.cc:224] Handling call
0709 13:10:39.811057 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.002780 (+191723us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:40.048680 (+ 45900us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.659795 (+611115us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18003a5760. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:10:40.871303 (+211508us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.883209 (+ 11906us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.883362 (+   153us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:40.883407 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.883481 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.043308 (+159827us) raft_consensus.cc:1685] finished
0709 13:10:41.043435 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.043623 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23881,"prepare.queue_time_us":41111,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":426665,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":5090,"spinlock_wait_cycles":35225984,"thread_start_us":354816,"threads_started":2,"wal-append.queue_time_us":850122}
I20260709 13:10:41.011745 24087 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.060501 24087 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.004575 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:41.005203 19266 leader_election.cc:403] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:41.062922 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 165269us
I20260709 13:10:40.892939 23935 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:40.892572 23330 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:41.007092 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:41.023837 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:41.025818 19191 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 2.196s (SENT)
I20260709 13:10:41.074352 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:40.933663 24014 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.049732 24134 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:41.063668 19372 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:40.964071 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.063616 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:41.070217 19374 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.076758 19374 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:41.076411 19367 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.082679 19374 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.017660 23867 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.088614 24108 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:41.095237 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 84575.6us
I20260709 13:10:41.108700 19374 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.073616 23945 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.081506 23935 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:41.031848 24110 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:41.150629 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53507.2us
I20260709 13:10:41.062263 24105 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.151471 23494 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.152143 24134 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:41.173038 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:41.135380 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.094822 24039 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.003s
I20260709 13:10:41.195854 19366 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:10:41.069141 24128 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.199640 19371 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:10:41.414722 19371 pending_rounds.cc:85] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 7
I20260709 13:10:41.415210 19371 pending_rounds.cc:107] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:41.415532 19371 raft_consensus.cc:2889] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:41.240549 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.314191 19368 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:41.420058 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 247084us
I20260709 13:10:41.427009 19366 pending_rounds.cc:85] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 5
I20260709 13:10:41.427395 19366 pending_rounds.cc:107] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:10:41.427698 19366 raft_consensus.cc:2889] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:41.436643 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 410820us
W20260709 13:10:41.437875 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.004s	sys 0.013s
W20260709 13:10:41.438323 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.005s	sys 0.013s
W20260709 13:10:41.439059 19369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.005s
W20260709 13:10:41.439517 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.005s	sys 0.005s
W20260709 13:10:41.438688 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 753870us
W20260709 13:10:41.451139 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.458724 19263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.059s	sys 0.136s
W20260709 13:10:41.459095 19263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.059s	sys 0.136s
I20260709 13:10:41.337345 24105 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.310850 24138 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.473338 19107 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:41.474326 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.474928 19217 raft_consensus.cc:1813] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Handling vote request from an unknown peer 0316f581086f40549fea44a772fc2dec
I20260709 13:10:41.461665 19374 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:41.196621 23935 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:41.477561 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:41.477578 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.479395 19900 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.462256 19367 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:41.478286 19217 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 12.
I20260709 13:10:41.480876 23867 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.481408 23867 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.481849 23867 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.483850 23867 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.335687 24108 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:41.484941 24108 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:41.487780 24126 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.757s	user 0.008s	sys 0.022s
I20260709 13:10:41.488644 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:41.289815 23494 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.489464 19367 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
W20260709 13:10:41.490320 24091 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.052s	user 0.009s	sys 0.000s
I20260709 13:10:41.490770 24091 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.490813 23935 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.493144 24110 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.493954 24110 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:41.494442 24110 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.476420 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:41.496675 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:41.497002 23494 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.490903 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:41.501600 24131 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.502053 24131 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.502377 24131 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.450788 23193 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.504505 23193 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.506655 23193 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:41.511168 24044 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.780s	user 0.006s	sys 0.001s
W20260709 13:10:41.512425 24137 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:10:41.478145 24087 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:41.514978 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:41.515635 19896 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.520803 19223 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:41.521615 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2348) took 1743 ms. Trace:
I20260709 13:10:41.522178 19219 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:41.463493 24014 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:41.491946 19899 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:41.523327 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.526257 19225 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:41.526685 19224 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:41.446493 24115 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:41.527855 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.528472 19218 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:41.521978 19373 rpcz_store.cc:276] 0709 13:10:39.781539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.479150 (+697611us) service_pool.cc:224] Handling call
0709 13:10:40.479550 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:40.493978 (+ 14428us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:40.527450 (+ 33472us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.879449 (+351999us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:40.885111 (+  5662us) log.cc:844] Serialized 52 byte log entry
0709 13:10:40.885262 (+   151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:40.885522 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.885721 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.885790 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.045999 (+160209us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b18003606a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:41.048997 (+  2998us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b18003606a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:41.521418 (+472421us) raft_consensus.cc:1685] finished
0709 13:10:41.521436 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.521559 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40878,"prepare.queue_time_us":50107,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":1575,"raft.queue_time_us":14256,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":15443,"spinlock_wait_cycles":17944576,"thread_start_us":318445,"threads_started":1,"wal-append.queue_time_us":538814}
I20260709 13:10:41.530104 19900 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
W20260709 13:10:41.531704 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 83442.3us
I20260709 13:10:41.460361 23330 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.533823 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.534322 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:41.540786 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:41.546383 19218 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:41.547369 19216 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.476900 23949 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:41.580677 23949 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.583333 23949 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.526022 24013 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:10:41.587909 24128 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:41.535969 24115 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.589500 24115 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.592857 23588 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.511445 24131 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.462781 24039 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:41.556840 19220 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:10:41.553965 23330 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.527707 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:41.575174 19896 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:41.597139 19339 leader_election.cc:400] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12.
W20260709 13:10:41.604847 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 77225.1us
I20260709 13:10:41.605671 19339 leader_election.cc:403] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.597754 19218 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:41.615648 19222 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
W20260709 13:10:41.617400 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.511695 24044 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.478777 24105 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.524088 24138 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.601580 23679 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:41.600467 24110 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.610441 24113 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:41.629005 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.636698 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:41.636891 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:41.637394 19292 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:41.637405 19293 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:41.641387 19221 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:41.646817 19216 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:41.648327 19365 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:41.624063 23949 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12.
I20260709 13:10:41.658659 19222 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:41.659349 19222 pending_rounds.cc:85] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
W20260709 13:10:41.643534 24094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.027s	sys 0.123s
I20260709 13:10:41.640439 24113 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:41.618216 24039 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.659792 19222 pending_rounds.cc:107] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:10:41.665571 19222 raft_consensus.cc:2889] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.668989 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:41.657559 24048 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.937s	user 0.009s	sys 0.001s
W20260709 13:10:41.660893 24094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.027s	sys 0.124s
I20260709 13:10:41.674685 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:41.674866 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 142435us
I20260709 13:10:41.675813 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:41.639947 23679 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.667796 24113 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.702170 19293 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:41.705914 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:41.707049 24110 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:41.707748 24110 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.710451 24110 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:41.711238 24144 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:41.711787 24144 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.712256 24144 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.717561 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:41.718626 19896 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
W20260709 13:10:41.719699 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 282167us
I20260709 13:10:41.723028 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:41.720474 19191 connection.cc:256] RPC call timeout handler was delayed by -1.2369556379999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:10:41.726547 19191 connection.cc:256] RPC call timeout handler was delayed by -1.2282443029999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23340000000000002s for a response
I20260709 13:10:41.689292 24143 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:41.727023 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.735251 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1400443029999678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2432s for a response
W20260709 13:10:41.735734 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0307218379999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2451s for a response
I20260709 13:10:41.699379 23952 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.667552 24133 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:10:41.750226 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.704957 23494 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.755162 23330 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:41.756106 24141 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:10:41.757205 24104 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.757725 24104 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:41.758733 24104 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.760288 24087 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.760442 24104 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.760968 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:41.761531 23945 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.001s
I20260709 13:10:41.761989 23945 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 12.
I20260709 13:10:41.762187 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:41.687397 23933 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:10:41.763384 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.764336 24142 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.764957 24138 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.765060 24142 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.688894 24048 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.765841 24142 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:41.765952 24044 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.744110 24091 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:41.766463 24142 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.767336 24048 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.767678 23679 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.768836 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.769836 23330 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.770804 24039 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.771440 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.772332 23494 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.772792 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.773756 24110 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.774477 24110 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.774525 23494 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.775874 23494 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:41.776491 23494 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.779085 23494 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.781204 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.784380 24131 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:41.785699 24039 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.788821 19221 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:41.789595 24039 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:41.791323 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:41.792960 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:41.793489 19294 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:41.794013 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:41.795111 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:41.795670 19371 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
W20260709 13:10:41.796229 24128 consensus_queue.cc:1175] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0316f581086f40549fea44a772fc2dec" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:10:41.796590 24110 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:41.797662 24105 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:41.798276 23330 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:41.799521 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:41.815420 23330 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:41.816395 23330 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:41.817111 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:41.817592 23330 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.818657 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:41.818926 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:41.821764 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:41.822373 19371 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.825234 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:41.829070 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:41.833289 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:41.834771 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:41.835366 19300 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.829095 19294 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:41.849529 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:41.838819 23193 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:41.838750 24044 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.862026 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:41.872563 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.760842 24087 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:41.880304 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:41.873317 19217 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:41.884862 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:41.885689 19217 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:41.838474 24142 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:41.911949 19371 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:42.102705 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.104391 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.105173 19217 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:42.106294 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.109254 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.107014 19217 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:42.116080 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.118095 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.118938 19223 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:41.840044 24115 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:42.223282 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 358681us
I20260709 13:10:41.879770 24044 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:42.245595 19901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.067s	sys 0.087s
W20260709 13:10:42.247195 19901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.067s	sys 0.087s
W20260709 13:10:42.253428 19222 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.046s	sys 0.111s
W20260709 13:10:42.253973 19222 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.046s	sys 0.111s
I20260709 13:10:42.098924 24091 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:42.098572 24105 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.117617 23494 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.288018 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:42.251461 24044 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:41.885774 24000 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.002s	sys 0.014s
W20260709 13:10:42.297137 24000 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.002s	sys 0.014s
I20260709 13:10:42.293207 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.117024 19217 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:42.300103 19223 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:10:42.399081 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 111179us
I20260709 13:10:42.405658 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.407073 19217 raft_consensus.cc:2410] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:42.518514 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:42.519673 19223 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:10:42.533182 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 132692us
W20260709 13:10:42.538939 19374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.022s	sys 0.041s
I20260709 13:10:42.315548 24161 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.434540 24144 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.006s
I20260709 13:10:42.420956 24105 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:42.279237 24091 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:42.548377 19374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.022s	sys 0.041s
W20260709 13:10:42.551164 19220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.028s	sys 0.071s
W20260709 13:10:42.565285 19220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.028s	sys 0.072s
W20260709 13:10:42.548430 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.020s	sys 0.044s
W20260709 13:10:42.565963 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.020s	sys 0.044s
I20260709 13:10:42.538960 23933 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.584005 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:42.541405 23783 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.036s	sys 0.091s
I20260709 13:10:42.543139 24142 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:42.293881 23494 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:42.541273 24139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.054s	sys 0.071s
I20260709 13:10:42.639809 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2358) took 2281 ms. Trace:
I20260709 13:10:42.645078 19366 rpcz_store.cc:276] 0709 13:10:40.336987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.516733 (+179746us) service_pool.cc:224] Handling call
0709 13:10:40.516967 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.432826 (+915859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.618314 (+1185488us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54000947d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:42.618562 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560341376}
I20260709 13:10:42.578119 24039 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:42.650905 19868 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.558s (SENT)
I20260709 13:10:42.651532 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:42.646695 24139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.055s	sys 0.071s
W20260709 13:10:42.517544 23935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.065s	sys 0.090s
W20260709 13:10:42.705328 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.006s	sys 0.003s
W20260709 13:10:42.705989 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.006s	sys 0.003s
W20260709 13:10:42.641438 23783 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.037s	sys 0.091s
I20260709 13:10:42.547976 24144 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:42.718676 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:42.617589 23933 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:42.673832 19300 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.837s	user 0.010s	sys 0.000s
I20260709 13:10:42.724813 19300 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:42.728746 19265 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 12.
I20260709 13:10:42.732551 23494 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:42.735951 23787 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:42.738399 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2355) took 2402 ms. Trace:
W20260709 13:10:42.739820 23330 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.001s
W20260709 13:10:42.741219 24166 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:10:42.743052 23933 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:42.547601 24161 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:42.714907 23935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.066s	sys 0.090s
I20260709 13:10:42.743283 24108 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:42.748201 19340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.000s	sys 0.010s
W20260709 13:10:42.814584 19340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.001s	sys 0.010s
W20260709 13:10:42.775942 19368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.031s	sys 0.036s
W20260709 13:10:42.815927 19368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.032s	sys 0.036s
I20260709 13:10:42.777760 24157 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:42.778715 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 97162us
I20260709 13:10:42.777913 23494 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:42.783424 19894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.017s
I20260709 13:10:42.784198 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:42.738907 19369 rpcz_store.cc:276] 0709 13:10:40.336262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.501887 (+165625us) service_pool.cc:224] Handling call
0709 13:10:40.543023 (+ 41136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.643425 (+100402us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:40.879019 (+235594us) log.cc:844] Serialized 14 byte log entry
0709 13:10:41.452224 (+573205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:41.452574 (+   350us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:41.453042 (+   468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.738097 (+1285055us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54000ea454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:42.738163 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.738325 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13771,"prepare.queue_time_us":29648,"prepare.run_cpu_time_us":5359,"prepare.run_wall_time_us":21016,"raft.queue_time_us":21916,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11698,"spinlock_wait_cycles":230344576,"thread_start_us":773440,"threads_started":2,"wal-append.queue_time_us":742551}
W20260709 13:10:42.823315 19894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.006s	sys 0.018s
W20260709 13:10:42.777434 19216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.012s	sys 0.012s
W20260709 13:10:42.823815 19216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.012s	sys 0.012s
I20260709 13:10:42.790329 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:42.780678 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50984.6us
I20260709 13:10:42.824658 19217 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:42.717569 24087 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:42.757639 24113 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.031s	user 0.007s	sys 0.003s
I20260709 13:10:42.770417 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2532) took 1289 ms. Trace:
W20260709 13:10:42.816762 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 954780us
W20260709 13:10:42.818845 19293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.070s	sys 0.102s
I20260709 13:10:42.820991 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:42.823333 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:42.811208 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.827711 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 808) took 1373 ms. Trace:
W20260709 13:10:42.849220 19293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.072s	sys 0.107s
I20260709 13:10:42.847425 19903 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:10:42.849902 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.849162 19220 rpcz_store.cc:276] 0709 13:10:41.480884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.610911 (+130027us) service_pool.cc:224] Handling call
0709 13:10:41.617410 (+  6499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.617649 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:41.841159 (+223510us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.769932 (+928773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.770006 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.770071 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.770164 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.770338 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11965,"prepare.queue_time_us":702224,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":74063,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2375,"thread_start_us":1085109,"threads_started":3,"wal-append.queue_time_us":920650}
I20260709 13:10:42.851758 19223 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:42.831081 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:42.817833 24150 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.528s	user 0.000s	sys 0.001s
I20260709 13:10:42.858373 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:42.806980 24115 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:42.852728 19368 rpcz_store.cc:276] 0709 13:10:41.453829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.627285 (+173456us) service_pool.cc:224] Handling call
0709 13:10:41.627604 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.627852 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:41.847198 (+219346us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.827308 (+980110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.827370 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:42.827430 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.827510 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.827648 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10859,"prepare.queue_time_us":650148,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":1162412,"threads_started":2}
I20260709 13:10:42.784709 23741 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.856284 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:42.853529 19868 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.633s (SENT)
I20260709 13:10:42.831723 24157 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:42.863431 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:42.865118 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2533) took 1384 ms. Trace:
W20260709 13:10:42.848786 24152 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.474s	user 0.001s	sys 0.001s
W20260709 13:10:42.867216 19222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.007s	sys 0.012s
I20260709 13:10:42.861196 24142 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:42.870723 19222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.008s	sys 0.012s
W20260709 13:10:42.870118 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 346580us
I20260709 13:10:42.830406 24131 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.870415 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:42.870096 19218 rpcz_store.cc:276] 0709 13:10:41.481143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.619156 (+138013us) service_pool.cc:224] Handling call
0709 13:10:41.620259 (+  1103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.620447 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:41.848677 (+228230us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.864811 (+1016134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.864863 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:42.864909 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.864971 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.865068 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64109,"prepare.queue_time_us":956729,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":92616,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7800,"spinlock_wait_cycles":7462528,"thread_start_us":1159702,"threads_started":3}
I20260709 13:10:42.852844 24087 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:42.907338 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:42.910573 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2537) took 1426 ms. Trace:
I20260709 13:10:42.920588 19222 rpcz_store.cc:276] 0709 13:10:41.482094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.670449 (+188355us) service_pool.cc:224] Handling call
0709 13:10:41.694326 (+ 23877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.694602 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:42.254450 (+559848us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.907829 (+653379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.907880 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:42.907929 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.907991 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.908101 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34952,"prepare.queue_time_us":919882,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":1165687,"threads_started":2}
W20260709 13:10:42.912551 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59046.3us
W20260709 13:10:42.923660 19868 leader_election.cc:336] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.956s (SENT)
W20260709 13:10:42.936667 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116034us
I20260709 13:10:42.966240 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:42.909775 24115 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.912417 24105 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.848155 23494 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:42.962322 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:42.974498 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:42.869724 23741 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:42.984934 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2053) took 1165 ms. Trace:
I20260709 13:10:42.985433 19293 rpcz_store.cc:276] 0709 13:10:41.819812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.819914 (+   102us) service_pool.cc:224] Handling call
0709 13:10:41.820215 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.820419 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:42.850221 (+1029802us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.984116 (+133895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.984264 (+   148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.984381 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.984521 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.984810 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10019,"thread_start_us":1152839,"threads_started":2}
I20260709 13:10:42.963483 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:42.872567 24108 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.860767 24113 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:42.996676 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 140625us
W20260709 13:10:42.910343 24000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.014s	sys 0.006s
W20260709 13:10:42.963141 19868 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.003s (SENT)
W20260709 13:10:43.008556 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 83057.8us
I20260709 13:10:42.993734 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.003736 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2374) took 2125 ms. Trace:
I20260709 13:10:43.010522 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:42.975250 24154 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.387s	user 0.001s	sys 0.001s
I20260709 13:10:43.011296 19371 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:43.009758 19374 rpcz_store.cc:276] 0709 13:10:40.878074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.497997 (+619923us) service_pool.cc:224] Handling call
0709 13:10:41.498419 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.498801 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.498837 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.499407 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.700886 (+201479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.563803 (+862917us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.564034 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.564251 (+   217us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.003503 (+439252us) raft_consensus.cc:1685] finished
0709 13:10:43.003533 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.003667 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9838,"prepare.queue_time_us":595778,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":208397,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":31946,"thread_start_us":1023993,"threads_started":2,"wal-append.queue_time_us":612135}
I20260709 13:10:43.074241 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.075487 19371 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 9: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:43.076593 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:43.123445 19371 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:42.970489 24149 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.969141 23679 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.003216 24091 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:42.964237 24186 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.280s
W20260709 13:10:43.263914 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 254503us
W20260709 13:10:43.266304 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 300178us
I20260709 13:10:43.267184 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.181419 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:42.919821 24087 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:42.995092 23933 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.256337 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.277465 19374 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:43.256752 19895 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:43.133368 24000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.015s	sys 0.006s
I20260709 13:10:43.003604 24180 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.268915 19371 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:43.283224 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.284384 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.259003 23679 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.278705 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.301981 19896 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:43.279633 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:43.206758 24181 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:43.257351 24184 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.272621 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 264735us
I20260709 13:10:43.333660 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 806) took 1880 ms. Trace:
I20260709 13:10:43.285194 19371 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:10:43.285629 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.335245 19374 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:43.334179 19373 rpcz_store.cc:276] 0709 13:10:41.453358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.529995 (+ 76637us) service_pool.cc:224] Handling call
0709 13:10:41.530333 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.530694 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.530721 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.531108 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.841659 (+310551us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:41.841711 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.841797 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.333383 (+1491586us) raft_consensus.cc:1685] finished
0709 13:10:43.333413 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.333588 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7809,"thread_start_us":237129,"threads_started":1,"wal-append.queue_time_us":881115}
I20260709 13:10:43.336792 19374 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:43.337248 19373 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:43.338492 19374 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:43.332573 19897 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 7: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:43.274307 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:43.349211 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 74974.1us
I20260709 13:10:43.280290 24108 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.349972 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:43.393404 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 120953us
I20260709 13:10:43.391350 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:43.393945 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 396560us
W20260709 13:10:43.397928 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48026us
W20260709 13:10:43.347901 24150 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:43.399068 19191 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:43.421413 19191 leader_election.cc:403] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.398138 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.332084 23679 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.423163 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.430371 19896 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:10:43.426116 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.253077 24149 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.387794 24144 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:43.421051 24169 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.559s	user 0.001s	sys 0.001s
W20260709 13:10:43.452137 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 118351us
W20260709 13:10:43.420686 24151 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.602s	user 0.000s	sys 0.001s
I20260709 13:10:43.461337 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:43.462003 19366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.021s	sys 0.025s
W20260709 13:10:43.462431 19366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.021s	sys 0.025s
I20260709 13:10:43.455356 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.456602 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:43.260545 24142 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.457456 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:43.418260 24181 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:43.464869 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:43.467403 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.434731 24157 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:43.463256 24163 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.596s	user 0.001s	sys 0.000s
I20260709 13:10:43.474188 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.453608 24108 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:43.477903 24175 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:10:43.478120 24149 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.479096 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 784) took 1652 ms. Trace:
I20260709 13:10:43.479440 19894 rpcz_store.cc:276] 0709 13:10:41.826946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.827347 (+   401us) service_pool.cc:224] Handling call
0709 13:10:41.844871 (+ 17524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.850856 (+  5985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.850885 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.882793 (+ 31908us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.823717 (+940924us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:42.823757 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.823831 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.478893 (+655062us) raft_consensus.cc:1685] finished
0709 13:10:43.478912 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.479040 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5984,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":15512,"thread_start_us":569141,"threads_started":1,"wal-append.queue_time_us":853511}
W20260709 13:10:43.481153 24145 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.825s	user 0.020s	sys 0.017s
W20260709 13:10:43.481462 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 82575.2us
I20260709 13:10:43.482245 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.483480 19191 leader_election.cc:400] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:43.483737 19191 leader_election.cc:403] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:10:43.484232 24174 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.561s	user 0.000s	sys 0.001s
I20260709 13:10:43.485110 24087 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.485921 23494 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:43.486148 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2536) took 2004 ms. Trace:
I20260709 13:10:43.486546 23494 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.487461 23494 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:43.486518 19216 rpcz_store.cc:276] 0709 13:10:41.481838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.647874 (+166036us) service_pool.cc:224] Handling call
0709 13:10:41.648284 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:41.851445 (+203161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.851487 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:41.882682 (+ 31195us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.824216 (+941534us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:42.824252 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.824313 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.485939 (+661626us) raft_consensus.cc:1685] finished
0709 13:10:43.485959 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.486092 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117565,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":760801,"threads_started":2,"wal-append.queue_time_us":733167}
W20260709 13:10:43.491925 24177 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:10:43.492350 23741 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.492949 24157 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:43.332497 24180 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.495668 24180 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:43.467540 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70087.9us
I20260709 13:10:43.473196 24113 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:43.471309 24176 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.550s	user 0.000s	sys 0.001s
I20260709 13:10:43.465622 24189 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:43.502565 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 45196.7us
I20260709 13:10:43.505307 19897 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:43.506001 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.426211 19373 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:10:43.512323 19368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.006s	sys 0.000s
W20260709 13:10:43.512837 19368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.006s	sys 0.000s
I20260709 13:10:43.518906 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.353152 24184 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:43.527386 19188 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.005s	sys 0.004s
W20260709 13:10:43.527738 19188 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.005s	sys 0.004s
W20260709 13:10:43.502884 24044 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.174s	user 0.012s	sys 0.001s
I20260709 13:10:43.476387 24108 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:43.522635 24170 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.556s	user 0.000s	sys 0.001s
W20260709 13:10:43.528803 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 631723us
I20260709 13:10:43.471722 24196 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:10:43.531749 23741 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.531498 24044 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.532658 24201 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:43.528637 24055 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.534157 19371 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:43.551712 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 86905.7us
I20260709 13:10:43.536634 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:43.556543 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 805) took 2103 ms. Trace:
I20260709 13:10:43.535880 24199 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:43.563859 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 80485.1us
I20260709 13:10:43.567294 24199 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.567953 24199 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.568078 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.531160 24108 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.538669 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.564898 19107 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet aff34caf0ca44db08f7c49f51ca52966 with cas_config_opid_index 3: aborting the task: latest config opid_index 7; task opid_index 3
I20260709 13:10:43.564577 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.573464 24180 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.529748 23946 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:10:43.534785 24183 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:43.576514 24210 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:43.577283 24210 consensus_queue.cc:1243] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:43.577610 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.556321 24044 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.535544 24194 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.579200 24044 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.579270 24194 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.579813 24194 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.578459 24184 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.579784 24044 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:43.566175 19367 rpcz_store.cc:276] 0709 13:10:41.453102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.505706 (+ 52604us) service_pool.cc:224] Handling call
0709 13:10:41.506076 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.506445 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.506483 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.507030 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.829930 (+322900us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:41.829976 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.830041 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.556257 (+1726216us) raft_consensus.cc:1685] finished
0709 13:10:43.556289 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.556471 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":982,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":322514,"threads_started":1,"wal-append.queue_time_us":1151191}
I20260709 13:10:43.580279 24189 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.528857 23855 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:10:43.583736 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.596432 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.580036 24211 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:43.599670 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 102337us
I20260709 13:10:43.600735 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2368) took 2755 ms. Trace:
I20260709 13:10:43.534111 24172 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.535154 24185 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.564275 24173 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.577299 24196 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:43.537302 24200 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.602185 19372 rpcz_store.cc:276] 0709 13:10:40.845156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.006019 (+160863us) service_pool.cc:224] Handling call
0709 13:10:41.021887 (+ 15868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.076071 (+ 54184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.600499 (+2524428us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:43.600677 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95271296}
I20260709 13:10:43.584074 24031 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:43.613118 24200 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:43.538268 24206 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:43.613565 24200 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.613678 24206 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:43.614194 24206 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.614354 23679 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.616433 24196 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.616890 24196 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:43.603461 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 134767us
W20260709 13:10:43.610664 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46822.5us
I20260709 13:10:43.612576 24208 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.554368 23741 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.622155 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.597741 24189 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.645512 24189 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.645656 24216 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:43.646256 24216 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.647161 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 778) took 2726 ms. Trace:
I20260709 13:10:43.624565 19263 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.603091 24180 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:10:43.648628 24180 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:43.647545 19901 rpcz_store.cc:276] 0709 13:10:40.920285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.058165 (+137880us) service_pool.cc:224] Handling call
0709 13:10:41.062848 (+  4683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.458665 (+395817us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:41.706040 (+247375us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.247755 (+541715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.247825 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:42.247883 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.646914 (+1399031us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54004d0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:43.646963 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.647081 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":800135,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":1341,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5564,"spinlock_wait_cycles":909699968,"thread_start_us":788230,"threads_started":2,"wal-append.queue_time_us":1100407}
I20260709 13:10:43.648955 24180 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:43.649653 23946 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:43.650130 19868 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.882s (SENT)
I20260709 13:10:43.649755 24180 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.650610 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:43.651046 24180 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.651854 24136 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.654894 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.656225 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:43.624835 24044 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.625980 24173 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.626083 23679 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:43.617695 24185 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.626703 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.627367 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:43.627936 24198 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:43.628376 24208 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.611699 24172 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.629725 24206 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.632576 23741 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.535568 24203 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:10:43.576574 24183 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.673985 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:43.646482 24187 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:43.602314 24201 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:43.657493 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.658484 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.661149 24039 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.686419 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:43.661492 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:43.688542 19220 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.661798 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.602609 24211 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.662611 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:43.666344 19868 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.090s (SENT)
I20260709 13:10:43.656484 23952 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.694118 23952 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.694545 23952 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.696489 24217 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:43.697057 24217 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.669821 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:43.700822 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76659us
I20260709 13:10:43.701126 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.701835 19216 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:43.672441 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.702250 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.702884 19222 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:43.651080 23840 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.641058 24110 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.703888 24110 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.706238 24143 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:43.706750 24143 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:43.678287 23193 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.708788 23193 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.708847 24017 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:43.709426 24017 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:43.710258 24017 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.660571 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.683869 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:43.712409 24195 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:43.707633 24143 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:43.716398 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 59509.4us
I20260709 13:10:43.717773 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.718364 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.718977 24161 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:43.719724 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.721155 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:43.722149 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.722817 19297 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:43.723815 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.723956 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.725158 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.725534 23933 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:43.726163 23933 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.727046 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.679579 24136 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:43.729632 24136 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.731849 24136 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:43.736534 24211 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.737596 24214 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.738224 24214 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.738638 24214 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.739075 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 776) took 2820 ms. Trace:
I20260709 13:10:43.739446 19899 rpcz_store.cc:276] 0709 13:10:40.918987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.919201 (+   214us) service_pool.cc:224] Handling call
0709 13:10:40.919534 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.526324 (+606790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.738840 (+2212516us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54006a5c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:43.739017 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315774208}
I20260709 13:10:43.740504 23741 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.740928 23741 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:43.741293 23741 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.744005 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 812) took 2126 ms. Trace:
I20260709 13:10:43.744127 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:43.744603 19365 rpcz_store.cc:276] 0709 13:10:41.617252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.668228 (+ 50976us) service_pool.cc:224] Handling call
0709 13:10:41.688407 (+ 20179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.690512 (+  2105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.690552 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:41.690610 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:41.690656 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.743720 (+2053064us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5400197654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:43.743779 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.743936 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4292992}
I20260709 13:10:43.745800 24208 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:43.683873 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100219us
I20260709 13:10:43.689831 19218 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:43.751114 19191 leader_election.cc:400] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:43.712486 19217 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:43.751506 19191 leader_election.cc:403] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.748368 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.752976 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.687716 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:43.756884 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.757674 19294 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:43.759268 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 71678.4us
W20260709 13:10:43.761395 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57250.3us
I20260709 13:10:43.761183 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:43.763183 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.767010 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:43.786074 19366 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.771641 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:43.785149 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:43.782085 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:43.772234 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:43.772773 19296 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:43.772895 24192 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:43.773504 24172 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.794171 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:43.776810 24217 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:43.778573 24183 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.779165 24196 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.779991 24216 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:43.685139 24198 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:43.771863 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:43.801530 19295 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 7: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:43.792035 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.802299 19374 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:10:43.792835 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:43.774595 24185 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:43.799399 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:43.803548 19367 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:43.805178 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.808815 19220 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:43.809443 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:43.781042 24157 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:43.781880 24039 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.782508 24136 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:43.793394 24208 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.815258 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.856323 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.817683 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:43.818048 24198 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.819056 24218 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:43.671044 24173 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.820240 24144 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.820822 24171 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:43.875425 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 124435us
I20260709 13:10:43.821367 24039 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.884137 24039 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.884545 24039 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.886309 23952 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.796403 23949 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.822016 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:43.788573 23945 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:43.822607 24122 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:43.826658 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.826853 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:43.890288 19298 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:43.795197 23698 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.798604 24149 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:43.856992 19292 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:43.856662 24208 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.799415 24115 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.801322 24184 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.861009 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.865916 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:43.866981 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.867470 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.857781 24014 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.882306 19370 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:43.887991 19373 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:43.898608 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 253661us
I20260709 13:10:43.908303 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.864702 24136 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:10:43.913045 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52116us
I20260709 13:10:43.912844 19223 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.935954 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:43.913199 19216 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:43.916200 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:43.927601 24053 raft_consensus.cc:993] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:43.871887 23946 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:43.932992 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65630.1us
I20260709 13:10:43.870779 24144 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:43.934037 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.895578 23698 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.910681 24208 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.858668 24114 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:43.907196 24149 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:43.910965 24115 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.912453 24184 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.955746 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.950572 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:43.957305 19300 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:43.929189 23783 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.934731 24216 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:43.951089 24161 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.936355 23840 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.977491 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:43.944159 23949 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:43.947923 24209 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.966674 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:43.946347 24144 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.951719 23698 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.989593 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.993795 19224 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.966480 24149 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:43.975574 24115 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.864135 24201 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.911175 24189 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:43.979153 24184 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.979580 23946 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.937789 24014 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:44.010190 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54549.8us
I20260709 13:10:43.930368 24194 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.033066 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.034251 24194 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.034343 24180 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.035636 23356 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:44.036448 24143 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:44.027415 19223 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:43.997256 23840 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.997160 23494 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.030090 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.958575 24000 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:10:44.027990 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77540.5us
I20260709 13:10:44.053160 19225 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:44.040717 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:43.997603 23949 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:44.054378 19223 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:43.897183 24171 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.058133 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.058847 19220 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:44.014019 24114 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:44.008351 24206 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.013516 24209 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:44.070719 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:44.001585 23787 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:43.992916 23933 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:43.989930 23783 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.073133 19223 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:10:44.044292 23840 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.996915 24216 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.064222 23949 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.011552 23193 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.079568 23952 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.021101 24017 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:44.064044 24193 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:44.095054 19297 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:44.097152 24220 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:10:44.097694 24221 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:10:44.007905 24223 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:10:44.063814 24136 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.100548 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2378) took 1235 ms. Trace:
I20260709 13:10:44.100944 19368 rpcz_store.cc:276] 0709 13:10:42.864839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.865238 (+   399us) service_pool.cc:224] Handling call
0709 13:10:42.865575 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.513273 (+647698us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:43.571663 (+ 58390us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.787723 (+216060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.788220 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.788391 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.788424 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.788537 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.100350 (+311813us) raft_consensus.cc:1685] finished
0709 13:10:44.100368 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.100490 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45675,"prepare.queue_time_us":106341,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":598504,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":13870,"thread_start_us":905587,"threads_started":3,"wal-append.queue_time_us":360740}
I20260709 13:10:44.102135 24039 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.103389 19372 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.105872 19372 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.110940 24216 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.113029 23933 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.113401 24110 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:44.119843 24199 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.000s
I20260709 13:10:44.121467 24189 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.121886 24171 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.122614 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:44.139055 19894 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.124293 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.131147 19293 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:44.134501 19366 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:44.090870 24181 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.137311 19367 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:44.146597 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75992.6us
I20260709 13:10:44.147404 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:44.090662 24196 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.149315 19901 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:44.150943 19894 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:44.152400 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.153141 24189 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:44.107700 23741 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:44.145869 24234 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:44.156097 24216 raft_consensus.cc:2764] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:44.163373 24173 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.139070 24199 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.204653 23193 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.180629 24039 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.215843 19368 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:44.207139 24138 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.211753 24131 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.200110 24208 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:44.262159 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.608s (SENT) [suppressed 18 similar messages]
I20260709 13:10:44.131501 24193 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.262998 19295 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.293327 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:44.293247 19224 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:44.299057 19903 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:44.234874 24014 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.311749 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:44.300276 24214 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.009s
W20260709 13:10:44.300837 24238 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:10:44.302312 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:44.306263 24211 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.004s
I20260709 13:10:44.308934 24115 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.168689 24209 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:44.317116 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.235280 24144 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.312821 19224 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:44.319151 19217 raft_consensus.cc:2376] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15. Re-sending same reply.
W20260709 13:10:44.322252 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 60134.7us
I20260709 13:10:44.314141 24114 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:44.296712 24138 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.330868 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.331363 19217 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.332481 23741 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.335019 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:44.327699 24240 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:44.335603 19224 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
W20260709 13:10:44.329527 24202 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.841s	user 0.005s	sys 0.000s
I20260709 13:10:44.341135 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.341863 19219 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:44.342779 24091 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.342867 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.343226 24091 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.343504 19219 raft_consensus.cc:2376] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12. Re-sending same reply.
W20260709 13:10:44.341369 24108 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.003s
I20260709 13:10:44.343428 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.346036 19216 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:44.319286 24214 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.348857 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:44.337821 24229 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:10:44.361619 24144 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.362578 23698 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.364606 24091 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.365800 24091 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.365901 24138 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:44.366775 24242 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:44.346120 24244 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:10:44.369596 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 727) took 2731 ms. Trace:
I20260709 13:10:44.370378 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.371547 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.324726 24211 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.372663 19366 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:44.372982 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:44.373435 19218 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:44.373569 19903 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:44.374141 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:44.374507 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:44.374702 19366 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.353935 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:44.375610 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:44.375897 23840 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.348304 24108 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.376569 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:44.354465 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:44.370136 19291 rpcz_store.cc:276] 0709 13:10:41.637696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.637810 (+   114us) service_pool.cc:224] Handling call
0709 13:10:41.638170 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.655878 (+ 17708us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:43.725036 (+2069158us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180047c380. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf 00007fe8d7ecf038
0709 13:10:43.946942 (+221906us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.046818 (+ 99876us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.063178 (+ 16360us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.063387 (+   209us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:44.063440 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.063544 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.369224 (+305680us) raft_consensus.cc:1685] finished
0709 13:10:44.369341 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.369501 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33949,"prepare.queue_time_us":1269261,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":40607,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":16959,"spinlock_wait_cycles":6103296,"thread_start_us":297226,"threads_started":2,"wal-append.queue_time_us":187586}
I20260709 13:10:44.354624 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:44.355141 24222 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 13:10:44.356119 19900 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:44.356305 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:44.378005 23840 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.378578 19897 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:44.378868 19894 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:44.379432 24108 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.372089 19220 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:10:44.356711 24200 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.000s
I20260709 13:10:44.357241 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:44.359025 24190 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.866s	user 0.000s	sys 0.004s
I20260709 13:10:44.359591 23741 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.387070 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.373730 24211 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.382481 19219 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:44.349766 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:44.344439 24237 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:10:44.384793 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.343605 23949 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.385964 19366 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:44.397614 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:44.398627 19366 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:10:44.399725 19220 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:44.371876 24184 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.401321 19220 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:44.404493 24208 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.365945 24181 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:44.406373 19220 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.406941 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:44.411356 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.412045 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.413705 24208 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.414143 24208 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.414494 24208 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.416467 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:44.390676 24200 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.423475 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.424101 19216 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.448521 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.450186 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.452945 19217 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:44.455720 19224 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:44.456120 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:44.458159 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.458271 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.407816 19220 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:44.408747 19223 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:44.458974 19291 raft_consensus.cc:2410] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:44.406482 19366 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:44.479795 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.457517 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.502776 19296 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:44.458863 19217 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:44.504980 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.509344 19216 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:44.510667 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:44.512279 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.510965 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 54522us
I20260709 13:10:44.513509 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:44.510846 23193 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.516625 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.517529 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.518157 19224 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:10:44.519266 19224 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:44.520794 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.522007 19298 raft_consensus.cc:2368] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:44.524259 19368 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:44.455430 24053 raft_consensus.cc:1081] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:44.396211 23741 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.527787 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.527658 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:44.530439 19220 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:44.455698 23840 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.510411 24131 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.529245 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2379) took 1664 ms. Trace:
W20260709 13:10:44.533699 19191 connection.cc:256] RPC call timeout handler was delayed by -2.4845167769999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 13:10:44.534360 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.529043 19216 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:44.535764 19366 raft_consensus.cc:1217] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-14.9]   Dedup: 11.7->[12.8-14.9]
I20260709 13:10:44.455349 23787 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:10:44.402974 24149 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.537218 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:44.541438 19191 connection.cc:256] RPC call timeout handler was delayed by -2.397216776999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 13:10:44.551697 19366 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [11.7-14.9]
W20260709 13:10:44.551940 19191 connection.cc:256] RPC call timeout handler was delayed by -2.3522167769999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 13:10:44.502652 24211 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.557821 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.558056 23193 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.553840 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:44.553998 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.555259 19366 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:10:44.556010 19372 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:44.559922 19366 pending_rounds.cc:85] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 7
I20260709 13:10:44.560209 19366 pending_rounds.cc:107] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:44.560462 19366 raft_consensus.cc:2889] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.560796 19366 pending_rounds.cc:107] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:10:44.540714 19369 rpcz_store.cc:276] 0709 13:10:42.865136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.866179 (+  1043us) service_pool.cc:224] Handling call
0709 13:10:42.906642 (+ 40463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:43.261371 (+354729us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:43.262099 (+   728us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:43.271313 (+  9214us) log.cc:844] Serialized 52 byte log entry
0709 13:10:44.523606 (+1252293us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b1800442720. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1
0709 13:10:44.523747 (+   141us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:44.523781 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.523851 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.523891 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:44.523900 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.529188 (+  5288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10773,"raft.queue_time_us":595470,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":7950,"spinlock_wait_cycles":34229632,"thread_start_us":458168,"threads_started":2,"wal-append.queue_time_us":241188,"wal-append.run_cpu_time_us":2089,"wal-append.run_wall_time_us":1007540}
I20260709 13:10:44.524070 24087 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.561271 19298 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:44.561480 19366 raft_consensus.cc:2889] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.534742 24219 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:44.510885 24039 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:44.565898 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:44.547912 24131 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.572619 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.578655 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.525841 24196 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:10:44.581780 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.565521 24014 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:44.568985 24216 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.588142 19902 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:44.552848 24113 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:10:44.591216 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.591774 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.572093 24087 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.561147 24241 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:44.600695 24214 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.602108 24208 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.605106 24149 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.588645 24014 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:44.607470 23887 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.583312 24219 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:44.611644 24219 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.608017 24014 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.578107 24000 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:10:44.615069 24014 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.591961 24115 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.616763 23949 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.618073 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.619554 24029 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:44.619626 23935 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:44.620474 23935 consensus_queue.cc:1243] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:44.620968 24104 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.620918 23935 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:44.621852 23787 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:44.621547 24104 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.622027 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:44.622265 23787 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:44.623047 23787 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.582309 24181 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.584699 23698 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.632892 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:44.626437 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:44.627457 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49290us
I20260709 13:10:44.634383 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:44.635221 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:44.631136 19369 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:44.615140 24239 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:44.624009 24104 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.656483 19369 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:10:44.586735 24144 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:44.660231 19369 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.664503 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:44.655104 24122 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.628862 23787 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.706375 19365 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:44.707830 19898 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:44.708555 24093 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.709043 24093 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.710438 24128 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:44.710929 24128 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.711102 24131 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.656720 24241 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:10:44.711874 24128 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.713191 24241 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:44.713677 24241 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.714637 24241 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.663282 24091 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:44.716642 24091 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.717458 24091 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.652992 24239 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.720860 24239 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.722282 24239 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.643174 24136 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:44.724469 24136 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.637735 24198 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:44.709156 24026 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:44.713253 24131 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.713738 24208 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.628823 24115 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:10:44.639829 24000 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:10:44.703419 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:44.729974 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.739828 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.735837 19365 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:44.777935 19365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:44.778803 19365 raft_consensus.cc:606] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:44.701395 24122 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.779270 19365 raft_consensus.cc:614] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:44.725344 24136 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.732890 23952 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.733048 24184 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.732911 24104 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:10:44.836558 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:44.784364 24181 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:44.738699 24200 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:44.837663 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2048) took 4985 ms (client timeout 2034 ms). Trace:
I20260709 13:10:44.786707 24122 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:44.845896 19370 rpcz_store.cc:269] 0709 13:10:39.852757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.211893 (+359136us) service_pool.cc:224] Handling call
0709 13:10:44.837391 (+4625498us) spinlock_profiling.cc:243] Waited 3.58 s on lock 0x7b54002d0354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:44.837532 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8236894464}
I20260709 13:10:44.850103 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.826531 24198 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.846937 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:44.858369 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:44.859318 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:44.845438 24113 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:44.862561 24053 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:10:44.874173 24184 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.833669 23952 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.853271 23935 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.855868 24181 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.859202 24259 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.860937 24115 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:44.860517 24031 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:44.888454 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:44.874636 23933 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:44.898029 23787 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:44.898576 23787 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:44.899585 23787 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:44.895385 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 239794us
I20260709 13:10:44.867143 23741 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.874935 24131 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:44.864570 24113 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.888134 24259 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.903400 24113 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.903523 24259 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.904315 23952 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.904479 24113 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.904763 24259 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.885815 24184 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:44.908981 24184 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.893872 24115 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.909842 24115 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:44.901912 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.913507 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.909614 24258 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:44.885412 23935 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.920116 24055 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:44.921731 24087 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.923369 24216 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:44.924197 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.926941 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:44.886528 24181 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.934712 23935 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.937580 23952 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.948974 23952 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.951661 23952 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:44.954109 23783 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.954833 23783 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:44.955297 24199 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:44.901520 23787 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.927119 19225 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:44.958148 19225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:10:44.958767 19225 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:44.959108 19225 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.928232 19374 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:10:44.928959 19898 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 777) took 4009 ms (client timeout 1914 ms). Trace:
W20260709 13:10:44.960526 19898 rpcz_store.cc:269] 0709 13:10:40.919955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.023568 (+103613us) service_pool.cc:224] Handling call
0709 13:10:44.928765 (+3905197us) spinlock_profiling.cc:243] Waited 3.63 s on lock 0x7b54006ddb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:44.928870 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8356128640}
I20260709 13:10:44.938889 19222 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.944626 19217 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.932030 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.939203 19371 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.938067 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:44.964468 19220 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:44.945875 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.901505 24131 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:44.978586 19225 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.959565 24144 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:44.955430 23783 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:44.987958 19218 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:44.993995 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.917428 24031 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:45.007368 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:45.021735 19222 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:44.940709 24181 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:44.963155 24216 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:45.028626 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 288863us
I20260709 13:10:45.009466 19225 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:45.081370 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.086133 19191 leader_election.cc:400] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:45.086601 19191 leader_election.cc:403] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.087914 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.090854 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.077245 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.103931 19371 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:45.104959 24181 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:45.105170 24115 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.024900 23952 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.106266 23952 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.107390 24115 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.108439 23952 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.110723 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.110982 24093 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.073695 24087 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.112545 24087 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.111965 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.114506 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:45.114717 24087 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.073897 23741 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.116626 23741 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.118431 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 823) took 1291 ms. Trace:
I20260709 13:10:45.118829 19367 rpcz_store.cc:276] 0709 13:10:43.827478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.827640 (+   162us) service_pool.cc:224] Handling call
0709 13:10:43.871312 (+ 43672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.145658 (+274346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.118189 (+972531us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54000938d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:45.118370 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611274112}
I20260709 13:10:45.119632 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.127127 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.128225 19220 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:45.132548 19369 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:45.136019 24261 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:10:45.139907 24014 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.004s
I20260709 13:10:45.125211 24131 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.141355 24131 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.144366 24216 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.126209 24105 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.146090 24105 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.147617 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:45.148444 19367 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:45.149374 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.150166 19367 raft_consensus.cc:2410] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:45.151077 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.151933 19367 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:45.152767 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.158483 24241 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.153950 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.164439 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.165320 19368 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:45.162544 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.166188 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:45.167548 19368 raft_consensus.cc:2368] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:45.120332 24108 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.168676 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:45.173624 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 258865us
I20260709 13:10:45.176990 19371 raft_consensus.cc:2368] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:45.175714 19369 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
W20260709 13:10:45.180651 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 477272us
I20260709 13:10:45.189544 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:45.189558 19371 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:45.183257 24259 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:10:45.219370 19224 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:45.223822 23783 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.188023 24031 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.233197 19225 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:45.246943 19371 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:45.209645 24091 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:45.252442 24187 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:45.253456 24187 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:45.253840 24187 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:45.254700 24187 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.255841 24187 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.263636 24055 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:45.264680 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:45.266203 24055 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:45.266750 24055 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:45.245976 24000 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.285312 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:45.288779 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.312427 19371 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:45.284821 23933 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:45.326098 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:45.276422 24000 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.337893 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:45.338974 19371 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:45.281546 24187 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:10:45.343663 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:45.388856 24122 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.003s
I20260709 13:10:45.378114 23933 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.386521 24013 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:10:45.416319 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 72757.9us
W20260709 13:10:45.419981 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.325688 24055 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.286418 24053 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:10:45.425220 24053 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.425714 24053 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:45.426833 24053 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.390825 24193 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:45.387327 24280 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:10:45.428104 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.429083 24053 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:45.366997 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.394811 24138 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.405054 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2401) took 1006 ms. Trace:
I20260709 13:10:45.409408 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:45.410358 23935 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.432546 24138 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:45.433511 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:45.432657 19373 rpcz_store.cc:276] 0709 13:10:44.398241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.620693 (+222452us) service_pool.cc:224] Handling call
0709 13:10:44.620974 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.621313 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:44.734809 (+113496us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.174426 (+439617us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.352280 (+177854us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b2c001323f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:10:45.352830 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.353046 (+   216us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:45.353101 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.353204 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.395661 (+ 42457us) raft_consensus.cc:1685] finished
0709 13:10:45.404766 (+  9105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.404977 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":287352,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":11462,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8995,"spinlock_wait_cycles":14753664,"thread_start_us":448317,"threads_started":2,"wal-append.queue_time_us":410405}
I20260709 13:10:45.433513 24138 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.337287 24136 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:45.350311 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.434646 24199 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:45.434187 23935 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:45.434947 24138 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.362649 19371 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:45.435127 24199 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.435683 24199 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.436460 24209 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:45.436993 23935 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:45.438028 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 87833.5us
I20260709 13:10:45.437021 24209 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.438860 24209 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.439335 24104 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.440068 24104 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:45.437817 23935 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.446658 23935 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:45.446861 24199 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.435110 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:45.450587 24184 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.451078 24184 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.451525 24184 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.459903 19365 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.461580 19371 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.461975 24138 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:10:45.434688 24136 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:45.471931 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54410.3us
I20260709 13:10:45.472957 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:45.473500 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.475801 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.476517 19216 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.466982 24209 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.482734 24209 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.483632 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.484411 19223 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.492919 24199 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.498291 19223 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:45.530958 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.411373 23783 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.470350 24136 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.415385 24013 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:45.503981 24105 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.470947 24108 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:45.527287 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.506374 24271 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.531563 19902 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:45.532593 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:45.533659 19895 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.506059 24287 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:45.538990 19899 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:45.539557 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:45.541571 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.541981 19894 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:45.546409 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.557077 19298 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:45.547768 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.548727 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.502861 19216 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:45.554131 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.415196 24122 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.559019 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.560926 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.534286 24138 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.566610 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.568141 19216 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.574690 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.581646 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.635941 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.637389 19218 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:45.601737 24198 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:45.639123 24198 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.620494 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:45.639789 24198 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.640245 19370 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:45.621474 19367 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:45.622539 19369 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.625088 24266 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.642609 24266 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:45.643826 24266 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.645587 24266 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.626348 19365 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:45.629066 23741 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.632562 24144 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.654474 24144 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.633888 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:45.607260 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.661129 24144 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:45.667909 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.669117 19218 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.575982 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.685971 19216 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:45.686754 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.686996 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.687415 19223 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.691978 19903 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:45.576097 24104 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.696727 24104 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.573467 24287 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.699581 24104 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:45.537274 24199 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:10:45.537261 23783 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.703578 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.551621 24105 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.750245 19216 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:45.751494 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:45.706526 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.711653 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.754241 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.738283 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:45.758021 19897 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:45.748752 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.737851 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:45.705672 24260 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:10:45.760434 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:45.760640 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:45.760951 19298 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:45.577443 24184 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:45.768431 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:45.765693 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.702247 24013 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.814294 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.814888 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.817560 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.828228 19216 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.835095 19223 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:45.837044 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:45.838948 24199 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:45.763046 24000 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:45.837513 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:45.841758 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 61629.9us
I20260709 13:10:45.846040 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.850555 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.861982 19897 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:45.577657 24138 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:45.700426 24287 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:45.839707 24199 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.875268 19216 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:45.885002 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.888495 19895 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:45.895634 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 422749us
I20260709 13:10:45.901382 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.903544 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.908514 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:45.910074 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.905846 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.911823 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.913444 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.915434 19371 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:45.842285 23698 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:10:45.941677 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.943015 19300 raft_consensus.cc:606] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:45.943540 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.879252 24199 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.943694 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:45.944330 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.943537 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.945529 19216 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:45.916227 24093 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.949786 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:45.948043 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:45.915886 24284 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:10:45.893074 24181 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.954979 19191 leader_election.cc:400] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:45.916520 23935 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.962982 19191 leader_election.cc:403] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.967307 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.969821 19372 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:45.972051 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:45.916081 24209 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:45.973031 19216 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:45.982203 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:45.983363 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.981431 24278 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.934058 24055 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:45.993690 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.995029 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.991626 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.947408 24014 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:10:45.998016 19294 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:10:45.998412 19294 pending_rounds.cc:85] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:10:45.998812 19294 pending_rounds.cc:107] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:10:45.999315 19294 raft_consensus.cc:2889] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:45.999622 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:45.954423 24282 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:45.988803 23933 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.014642 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:45.988476 24122 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.006249 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:46.018602 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:46.007678 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 327405us
I20260709 13:10:45.972831 24093 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.013705 24184 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.014546 24287 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:45.996326 24286 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:10:46.018373 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 39) took 1129 ms. Trace:
I20260709 13:10:46.025904 19300 rpcz_store.cc:276] 0709 13:10:44.886797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.886923 (+   126us) service_pool.cc:224] Handling call
0709 13:10:46.016250 (+1129327us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540034f154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:46.016334 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409015680}
W20260709 13:10:46.016258 24301 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:10:45.985731 23935 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.010684 19218 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
W20260709 13:10:46.000998 24291 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:10:45.987844 24209 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:46.021661 24295 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:10:46.020128 19217 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.026s
W20260709 13:10:46.084614 19217 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.007s	sys 0.026s
I20260709 13:10:46.085839 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2580) took 1146 ms. Trace:
I20260709 13:10:46.028303 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2414) took 1197 ms. Trace:
I20260709 13:10:46.087879 19374 rpcz_store.cc:276] 0709 13:10:44.831289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.961802 (+130513us) service_pool.cc:224] Handling call
0709 13:10:44.962094 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.984075 (+ 21981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.984114 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.013200 (+ 29086us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.272238 (+259038us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:45.272282 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.272345 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.028048 (+755703us) raft_consensus.cc:1685] finished
0709 13:10:46.028068 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.028228 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":407,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":17833,"thread_start_us":181175,"threads_started":1,"wal-append.queue_time_us":306845}
W20260709 13:10:46.031059 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.031827 24093 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.036823 24184 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:46.039186 24299 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:46.039378 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:46.039840 24302 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:10:46.040426 24303 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:10:46.040663 24136 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.042511 24216 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.044457 19221 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:46.056630 24294 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:10:46.065241 24211 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:46.069031 19295 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:46.099804 19295 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.070060 24181 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:46.073858 24306 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:46.079639 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:46.080147 24122 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.080679 24305 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:10:46.092545 24287 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.019235 19294 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:46.091096 19222 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.992650 24000 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:10:46.029544 24055 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.098826 19900 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:46.086257 19217 rpcz_store.cc:276] 0709 13:10:44.939781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.010015 (+ 70234us) service_pool.cc:224] Handling call
0709 13:10:45.075135 (+ 65120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.075397 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:45.353189 (+277792us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.014218 (+661029us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b18000f67c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:46.085268 (+ 71050us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.085451 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.085503 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:46.085559 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.085650 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.085775 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38306,"prepare.queue_time_us":236994,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":92826,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":1914,"spinlock_wait_cycles":243199744,"thread_start_us":968245,"threads_started":3,"wal-append.queue_time_us":219718}
I20260709 13:10:45.994593 24193 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:46.102639 19298 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
W20260709 13:10:46.105161 19225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.033s
I20260709 13:10:46.100817 19295 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:46.117197 19225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.017s	sys 0.033s
I20260709 13:10:46.117594 19295 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.091794 24105 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:46.119032 19224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.022s
I20260709 13:10:46.122104 24181 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:46.122862 19222 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:46.124632 23935 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.125238 24192 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:46.106817 24211 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:46.115294 24055 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.093555 23698 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:46.128911 24199 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.105909 24309 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:46.131701 24287 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:46.135149 19224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.008s	sys 0.023s
W20260709 13:10:46.170126 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 258387us
I20260709 13:10:46.104755 24308 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.158610 23741 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:46.164264 24013 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:46.164599 24093 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.140239 24192 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.168929 24209 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.106930 24184 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:46.184464 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 202910us
I20260709 13:10:46.177134 19295 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:46.106827 24122 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.167018 24312 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.172753 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:46.187413 19365 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:46.149542 23783 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.190601 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:46.170945 24271 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.141047 24181 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.179885 23741 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:46.178867 24298 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:46.196332 24318 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:10:46.205428 24198 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.009s
I20260709 13:10:46.195397 24312 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:46.193567 24051 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:10:46.197695 23783 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.199347 24184 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:46.212378 24298 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.247943 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.258898 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc8043164d78443493704a95fae3b832"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:46.189354 24093 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:46.257530 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 55760.8us
I20260709 13:10:46.259524 19295 raft_consensus.cc:606] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:46.207198 24122 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.196252 24055 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:46.258574 19188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.007s	sys 0.027s
I20260709 13:10:46.219777 24308 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.195080 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:46.265022 19188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.008s	sys 0.027s
I20260709 13:10:46.266557 19219 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:46.283797 19224 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:46.270505 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 288379us
I20260709 13:10:46.260885 23787 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.288276 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.296553 19220 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:46.267051 24000 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.262099 24136 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.292591 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.223408 24198 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.261004 24029 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:10:46.316361 19296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.001s	sys 0.023s
I20260709 13:10:46.322286 19191 leader_election.cc:400] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:46.212715 24211 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:46.329680 19296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.002s	sys 0.024s
I20260709 13:10:46.325897 19224 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:46.292497 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 267403us
I20260709 13:10:46.330554 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:46.259723 23783 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.336335 24287 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:46.284967 24317 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.337064 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:46.291234 24322 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.223021 24192 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.346256 19218 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:46.295691 23787 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.282778 24308 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.345878 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:46.299899 24055 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.350112 19295 raft_consensus.cc:606] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:46.352113 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:46.352480 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:46.352938 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:46.358246 19293 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:46.361598 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:46.363377 19293 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:10:46.363862 19293 pending_rounds.cc:85] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 13
I20260709 13:10:46.364131 19293 pending_rounds.cc:107] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:10:46.365664 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:46.339986 24321 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:46.376689 19217 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:10:46.368642 19225 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:10:46.281595 23741 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.369868 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:46.365182 19293 raft_consensus.cc:2889] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.326545 24000 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.383365 19900 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:46.337038 24287 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:46.384227 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:46.352088 24199 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.354540 24319 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:46.369051 24105 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.390581 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:46.389709 23741 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:46.395068 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 180948us
I20260709 13:10:46.395555 24319 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:46.396654 24319 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.343760 24184 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.378288 24216 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.323737 24298 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.351799 24318 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:46.383860 24325 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.438020 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:46.359829 24031 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:46.421284 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:46.466251 19900 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.462927 19894 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:46.346755 24317 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.477522 24308 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.477986 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:46.392123 23783 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.350273 24322 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:46.482268 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.489823 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.461643 24199 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:46.504808 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 309827us
I20260709 13:10:46.474773 24144 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.485893 19900 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:46.509838 19337 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:46.483601 24313 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:46.511360 24330 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.472832 24122 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.403342 24105 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.461294 24216 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.517390 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:46.518455 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:46.394189 23787 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.524457 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.518916 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:46.542886 19220 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:46.545943 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:46.547488 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:46.548534 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:46.520696 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 250074us
I20260709 13:10:46.523195 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.492641 24312 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.475098 24325 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:46.551837 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.551105 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.577867 19300 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:46.550959 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:46.516605 24122 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.505925 23783 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:10:46.521871 24211 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.518276 24093 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.538620 24199 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:46.607153 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56252.5us
I20260709 13:10:46.513224 24144 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.600751 19220 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:46.595583 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:46.550942 19219 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:46.614799 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.540798 24136 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:10:46.623044 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.623167 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.623576 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:46.623073 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:46.584816 24324 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.628434 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.629209 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2075) took 1084 ms. Trace:
I20260709 13:10:46.623836 19219 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.621171 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.578051 24000 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.587463 23787 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:46.627507 24324 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.625181 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.626633 19366 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.629568 19296 rpcz_store.cc:276] 0709 13:10:45.544946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.546758 (+  1812us) service_pool.cc:224] Handling call
0709 13:10:45.547144 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.552699 (+  5555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.552743 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.564619 (+ 11876us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.331935 (+767316us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:46.331987 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.332054 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.629033 (+296979us) raft_consensus.cc:1685] finished
0709 13:10:46.629050 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.629162 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112010,"raft.queue_time_us":8591,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10079,"thread_start_us":648879,"threads_started":1,"wal-append.queue_time_us":824787}
I20260709 13:10:46.582214 24330 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:46.624388 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.632491 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.602646 24198 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.581060 24332 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.637286 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:46.641117 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.603399 24122 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.637049 19374 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:10:46.608254 24321 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:46.649609 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.650556 19365 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:46.652905 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:46.656497 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.657217 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:46.657917 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.658433 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.620544 24312 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.621868 24336 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:46.662789 19297 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:10:46.605844 24029 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:10:46.671736 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.621124 24211 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.670984 24312 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.655263 24332 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.662037 24108 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.722450 24108 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.722574 24322 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.697273 24199 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.698731 24321 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.703168 24347 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:46.703374 23783 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:46.706624 24013 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:46.708127 24087 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.661167 24198 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:10:46.722937 24108 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.731844 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.733237 24198 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:46.733791 24198 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:46.701363 24000 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.726333 19295 raft_consensus.cc:2410] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:46.726910 24347 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.735397 24347 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.735160 24000 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.737463 24000 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.738837 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.734609 24198 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.741339 24198 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:46.742274 24278 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.003s
I20260709 13:10:46.742689 24278 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.743449 19292 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:46.745224 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.745857 19225 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:10:46.746735 24325 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.746826 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.728647 24317 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.745889 24105 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.708389 24216 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.760025 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.760524 24211 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.762953 24312 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.724095 24332 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.775506 24298 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.777817 24324 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.780861 24196 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:46.781422 24196 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.781711 24347 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.782183 24196 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.783861 24087 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.784552 24187 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:46.785056 24187 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.770726 24108 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.785983 24187 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.795203 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:46.796115 19894 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:10:46.787422 24187 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.800453 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:46.804415 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:46.805559 19894 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:46.783361 24196 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:46.804813 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 181292us
I20260709 13:10:46.807350 19895 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:46.809371 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:46.810880 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:46.815655 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:46.901232 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 85656us
I20260709 13:10:46.826084 24093 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:46.903510 24093 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:46.886955 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 89016.9us
I20260709 13:10:46.904533 24093 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.806665 24108 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:46.885643 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 207094us
W20260709 13:10:46.797595 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 200241us
I20260709 13:10:46.907786 24108 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.909001 24108 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.909507 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:46.909991 24122 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.880846 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:46.812901 24087 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.912575 23356 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:46.913359 24087 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.914613 24122 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.820276 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:46.914794 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.918519 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.919806 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:46.922474 19216 raft_consensus.cc:2410] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:46.919823 19374 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:46.920850 24184 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.926290 19225 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:46.926110 24184 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.929219 24184 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.929800 24184 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.930449 24184 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.933194 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:46.934111 24216 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.935237 24216 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.935999 24051 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:46.936542 24199 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.936583 24051 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:46.937108 24201 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:46.937343 24051 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.937700 24201 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.938185 24216 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.938896 24216 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.939721 24216 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.942471 24216 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:46.839931 24318 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:46.840575 24342 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 13:10:46.954690 24318 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:46.835301 24336 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:46.956410 24318 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.957873 24318 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.958017 24336 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.959298 24108 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:46.838575 24346 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 13:10:46.961192 19225 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:46.829234 24347 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.819535 24330 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:46.965423 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 145175us
I20260709 13:10:46.966836 24355 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.966701 24330 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:46.893219 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 364503us
I20260709 13:10:46.939519 24201 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:46.969172 24201 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.970793 19374 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:46.971325 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.914273 24087 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.972646 19366 raft_consensus.cc:2410] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:46.973320 24181 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:46.973505 24031 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:46.974383 24087 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:46.945065 19216 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:46.944742 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:46.937351 24199 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:46.920588 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:46.891045 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:46.960346 24332 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:46.968132 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.967442 24355 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:46.997061 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:46.997485 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:46.998106 19894 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:47.000108 19900 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:47.000347 24192 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:47.002027 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:47.004761 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 71959.3us
I20260709 13:10:47.005986 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:47.009096 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102678us
I20260709 13:10:47.010703 24362 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.010887 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.011298 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.011615 24362 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:47.012284 19365 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:47.013404 24209 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.014129 24199 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.014357 24013 raft_consensus.cc:993] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:47.014986 24013 raft_consensus.cc:1081] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:47.005303 19219 raft_consensus.cc:2376] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15. Re-sending same reply.
I20260709 13:10:47.025182 19365 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:47.027827 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.015396 24355 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.030133 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.031730 24321 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.030321 19223 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:47.032449 24271 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.033079 24271 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:47.033586 24271 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:47.037159 24316 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.871s	user 0.003s	sys 0.005s
I20260709 13:10:47.032051 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:47.038081 24013 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:47.052556 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46806.8us
I20260709 13:10:47.052452 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:47.050813 24287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.001s	sys 0.013s
W20260709 13:10:47.054728 24287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.001s	sys 0.014s
I20260709 13:10:47.058372 24138 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:47.062268 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.062752 23698 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:47.063663 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:47.063951 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.063449 23698 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.071990 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:47.073019 19367 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.074503 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:10:47.064842 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.076813 19372 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:10:47.079170 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47275.9us
I20260709 13:10:47.081143 24332 raft_consensus.cc:2764] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:47.081143 24138 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.082094 24138 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.085619 24138 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.087811 19217 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:47.088200 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:47.065822 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:47.066644 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.090464 23698 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.050776 24184 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.109679 19370 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:47.111640 19370 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:47.126626 19119 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 5 to 8, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 8 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:47.127671 24309 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:47.129036 19119 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 6 to 10, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 10 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:47.129968 24144 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.132433 19900 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:47.154708 24309 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:47.132808 23933 raft_consensus.cc:993] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:47.156352 19119 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 5 to 7, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 7 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:47.135864 19371 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:47.158444 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.159605 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:47.135793 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2087) took 1192 ms. Trace:
I20260709 13:10:47.160399 19298 rpcz_store.cc:276] 0709 13:10:45.943776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.944097 (+   321us) service_pool.cc:224] Handling call
0709 13:10:47.135410 (+1191313us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54002a9254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:47.135594 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362517760}
I20260709 13:10:47.136502 19369 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:47.137301 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2092) took 1142 ms. Trace:
I20260709 13:10:47.168398 19292 rpcz_store.cc:276] 0709 13:10:45.994957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.000865 (+  5908us) service_pool.cc:224] Handling call
0709 13:10:46.014240 (+ 13375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.743769 (+729529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.136781 (+393012us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54002b8ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:47.137102 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676254080}
I20260709 13:10:47.138396 19299 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:47.169294 24287 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.170043 24287 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.132261 19291 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:10:47.172318 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49885us
I20260709 13:10:47.139956 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.156467 24309 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.133322 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.173597 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:47.188654 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93332.3us
I20260709 13:10:47.197544 24138 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:47.198195 24138 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.198685 24138 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:47.205382 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.205343 24013 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.206827 24192 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.207983 24360 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.207708 24192 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.207449 24013 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.210487 24192 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.211639 24013 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.212527 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.213374 19291 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:47.214295 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.214605 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.215276 19299 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:10:47.215969 23933 raft_consensus.cc:1081] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:47.217527 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.218251 19294 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:47.220378 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.220651 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.221050 19295 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:47.221062 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.220589 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.222280 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.221741 19299 raft_consensus.cc:2410] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 15 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:47.224591 24000 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.225099 24000 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:47.225610 24000 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.225688 24122 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.226511 24122 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.234558 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.235991 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:47.236680 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.239084 19367 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:10:47.246124 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.247637 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:47.248908 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75443.6us
I20260709 13:10:47.249030 24199 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:47.251048 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.254604 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.235208 24287 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.191180 24093 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.257531 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.259325 19368 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:47.264597 24309 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:47.267156 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.267762 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.268005 19298 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:47.268826 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.269999 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:47.267264 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.255404 19299 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:10:47.241878 24184 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:47.276713 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:47.276571 24184 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.277529 19218 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:47.279126 24184 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.280189 24122 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.284376 19220 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:47.323241 24355 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.286756 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:47.324353 19894 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:47.326076 24332 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.326628 24332 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:47.327106 24332 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:47.328295 24198 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.008s
I20260709 13:10:47.287230 19222 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:10:47.288278 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77851.4us
I20260709 13:10:47.333500 24330 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:47.335048 24330 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:47.290731 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.336534 19298 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:47.336810 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 109315us
I20260709 13:10:47.338181 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:47.340356 24144 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.340837 24144 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.341240 24144 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.257911 24360 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:47.291529 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 158453us
I20260709 13:10:47.253727 24051 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.293277 19294 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:47.346341 24051 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.300290 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:47.347014 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100810us
I20260709 13:10:47.308490 19292 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:47.310011 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.348062 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:47.348425 19291 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:47.310420 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.349072 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:47.349992 24198 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.350368 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:47.314133 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.350567 24198 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:47.351188 24198 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:47.315215 24373 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:10:47.355372 24287 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.355875 24287 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.356338 24287 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.359205 19119 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:47.360872 24370 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:47.361073 23787 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:47.361497 24370 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.362008 24370 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.362488 24187 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:47.362897 24187 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:47.362963 19119 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 4 to 8, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 8 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:47.363867 24187 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.365425 24187 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.313460 19217 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:47.344350 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.369372 19897 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:47.370241 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.370551 24093 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.371315 24093 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:47.294126 19218 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:47.350066 24144 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.322371 24271 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.372027 24104 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.382522 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:47.339812 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.368780 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.383617 19371 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:47.379770 19298 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:47.388619 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.393841 19295 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:47.394371 19897 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:47.405190 19369 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:47.395602 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.395908 19223 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:47.408349 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.372021 24093 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:10:47.410632 19222 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:47.412814 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.415580 19365 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:47.416625 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.417508 19368 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:47.424742 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:47.426529 24051 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.427331 23356 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:47.427372 24051 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:47.428264 23933 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:47.429522 24017 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:47.429735 24181 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.429924 24017 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:47.430387 24051 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:47.430810 24051 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:47.430972 24017 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.431794 24051 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.432596 24017 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.433107 24051 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.437323 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.437992 19292 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:10:47.438809 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:47.441135 24271 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.445883 19294 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:47.447242 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.448145 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.382592 24104 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.449371 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:47.389567 24216 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.423571 24287 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.454514 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:47.458252 19370 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:47.455729 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.469107 19300 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:47.455730 24104 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.468816 19223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:10:47.451205 24138 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.472609 19223 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.473093 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.473940 19295 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:47.474165 24138 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.455614 23741 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:47.474823 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.475742 19299 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:10:47.473192 19223 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:47.484805 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 145120us
I20260709 13:10:47.485829 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.487344 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.487536 24184 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.499097 19371 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:47.517923 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 110989us
I20260709 13:10:47.520006 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.508073 19223 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.524240 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:47.529347 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 160721us
I20260709 13:10:47.529664 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.517235 24093 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:10:47.507467 24336 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.548619 19299 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:10:47.529241 24360 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.549491 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.555650 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.550416 19223 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.512243 24216 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.562126 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:47.563263 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.563513 24104 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.597882 24216 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.543824 24051 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:10:47.598941 24051 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:47.599318 24051 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:47.564429 24318 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:47.600281 24051 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.569264 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.569923 24309 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.558332 24360 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.571265 24336 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.575734 19225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc8043164d78443493704a95fae3b832"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:10:47.607050 19225 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:47.607530 19225 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.601052 24318 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:47.608287 24318 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:47.608609 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:47.609190 24318 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.577688 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:47.578524 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:47.581285 24370 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.582803 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.583938 19222 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:47.588996 19224 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:47.590377 24000 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.591771 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:47.611268 19220 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:47.616883 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:47.555449 24138 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:47.602397 24355 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:47.623661 19221 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:47.601646 24104 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.606240 24309 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:47.554081 24198 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:47.619819 24184 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.644246 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:47.647954 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 78783.1us
W20260709 13:10:47.649296 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66611.5us
I20260709 13:10:47.621645 24051 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.632694 24216 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.627041 23933 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:10:47.666258 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:47.666898 24336 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:47.632396 24309 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.643910 24187 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:10:47.633106 24138 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:47.632515 24201 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:10:47.685464 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:47.629455 23356 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:10:47.700850 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:47.679217 24318 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.718183 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:47.724691 19119 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:47.728713 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49264.1us
I20260709 13:10:47.729579 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.732681 24370 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.727406 19119 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 10, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.703018 24287 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:47.736294 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.717901 24184 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:47.744999 19895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.041s
W20260709 13:10:47.746105 19895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.017s	sys 0.042s
W20260709 13:10:47.747882 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 81753.7us
W20260709 13:10:47.738768 24375 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.187s	user 0.004s	sys 0.000s
I20260709 13:10:47.734645 24216 raft_consensus.cc:2764] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:47.720700 23787 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:10:47.748392 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 296997us
I20260709 13:10:47.792315 24184 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:47.776687 24187 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:10:47.786064 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:47.760411 24104 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.793561 24184 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.806622 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet aff34caf0ca44db08f7c49f51ca52966 with delete_type TABLET_DATA_TOMBSTONED (TS 0316f581086f40549fea44a772fc2dec not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:41698
I20260709 13:10:47.806934 19119 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 6 to 8, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 8 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:10:47.808670 19119 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 3 to 8, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 8 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:47.783298 24198 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.785720 24287 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.811365 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:47.773569 23356 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:47.817333 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:47.820891 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 250) took 29118 ms (client timeout 15000 ms). Trace:
I20260709 13:10:47.823004 23356 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:47.823626 23356 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:47.824502 23356 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.826174 23356 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.832521 24337 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.833307 24337 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.811400 24104 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.835407 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:47.836997 24104 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:47.838025 24377 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:10:47.815490 24287 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:47.840958 24287 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:47.842152 24332 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.004s
I20260709 13:10:47.842593 24332 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:47.823146 24376 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:10:47.837080 24382 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:10:47.848532 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54392.5us
I20260709 13:10:47.810657 24199 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:47.850724 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 303814us
I20260709 13:10:47.800416 24355 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:10:47.856444 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53614us
I20260709 13:10:47.860567 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.861325 19900 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:47.835917 24337 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.864596 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:47.851830 24360 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:47.852946 24198 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.853758 24199 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.876019 19894 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:47.885566 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:47.800773 24138 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.897521 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:47.889734 19899 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
W20260709 13:10:47.930186 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62616.4us
W20260709 13:10:47.931457 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 120281us
I20260709 13:10:47.932261 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.933727 19119 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 13, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.895452 24181 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:47.927405 24199 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.885556 24330 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.929191 24332 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:47.932221 24209 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.941005 24187 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:47.962147 24380 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:10:47.968950 23952 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:47.973587 19899 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:47.973609 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 281558us
W20260709 13:10:47.976050 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43878.8us
I20260709 13:10:47.977556 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:47.932801 24198 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:47.977463 23952 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:47.984737 19900 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:10:47.985097 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130760us
I20260709 13:10:47.971889 24187 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:47.983237 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 103151us
I20260709 13:10:47.937052 24360 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:10:47.986389 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:47.992146 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:48.019112 19265 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.978528 24332 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:48.024899 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:48.029139 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:48.031785 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 72752.2us
I20260709 13:10:48.034343 19219 raft_consensus.cc:2368] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11.
I20260709 13:10:48.034807 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:47.990950 24187 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.989022 24337 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.038048 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:47.821480 19118 rpcz_store.cc:269] 0709 13:10:18.681418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.681592 (+   174us) service_pool.cc:224] Handling call
0709 13:10:47.794151 (+29112559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:39.194810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:39.195462 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:39.195505 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:10:39.195538 (+    33us) tablet.cc:662] Decoding operations
0709 13:10:39.197534 (+  1996us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:39.197629 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:39.197655 (+    26us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:10:39.199815 (+  2160us) tablet.cc:701] Row locks acquired
0709 13:10:39.199875 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:10:39.200031 (+   156us) write_op.cc:270] Start()
0709 13:10:39.208003 (+  7972us) write_op.cc:276] Timestamp: P: 1783602639199972 usec, L: 0
0709 13:10:39.247445 (+ 39442us) op_driver.cc:348] REPLICATION: starting
0709 13:10:39.351447 (+104002us) log.cc:844] Serialized 10653 byte log entry
0709 13:10:40.743708 (+1392261us) op_driver.cc:464] REPLICATION: finished
0709 13:10:41.034732 (+291024us) write_op.cc:301] APPLY: starting
0709 13:10:41.034888 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:41.500822 (+465934us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:41.500972 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:41.759433 (+258461us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:41.759908 (+   475us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:10:41.759974 (+    66us) write_op.cc:312] APPLY: finished
0709 13:10:41.824770 (+ 64796us) log.cc:844] Serialized 236 byte log entry
0709 13:10:42.723417 (+898647us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:42.808067 (+ 84650us) write_op.cc:454] Released schema lock
0709 13:10:42.847018 (+ 38951us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:42.920556 (+ 73538us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:42.923741 (+  3185us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":735829,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":238558,"apply.run_cpu_time_us":166595,"apply.run_wall_time_us":1859866,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116879,"num_ops":27,"prepare.queue_time_us":117787,"prepare.run_cpu_time_us":84728,"prepare.run_wall_time_us":552496,"raft.queue_time_us":285960,"raft.run_cpu_time_us":25564,"raft.run_wall_time_us":301890,"replication_time_us":1477286,"thread_start_us":1321329,"threads_started":5,"wal-append.queue_time_us":1226163,"wal-append.run_cpu_time_us":20514,"wal-append.run_wall_time_us":2727763}]]}
I20260709 13:10:48.027048 24330 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:48.033262 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:48.044330 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.016304 24209 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.051954 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:48.052845 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75418.2us
I20260709 13:10:48.041172 23933 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:48.052960 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:48.066496 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.060628 19224 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:48.042369 24144 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:48.057824 24393 tablet_replica.cc:333] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:10:48.046072 24330 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:48.059446 24385 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:48.062229 23933 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:48.088369 19902 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:48.108865 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64704.9us
I20260709 13:10:48.111088 19225 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.053939 24053 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.179s
I20260709 13:10:48.116056 19339 leader_election.cc:400] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11.
I20260709 13:10:48.064354 23952 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.116231 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.112028 24385 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:48.116885 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.117344 23933 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.102054 24391 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:48.088526 24029 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.116938 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:48.123062 19903 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.003s
I20260709 13:10:48.138661 19903 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:48.123413 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:48.124852 19339 leader_election.cc:403] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:48.127038 19374 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:48.056802 24337 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.106472 24330 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:48.130789 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47968.7us
I20260709 13:10:48.128813 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:48.131764 24385 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:48.140484 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 80843.2us
I20260709 13:10:48.142867 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:48.124758 24184 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.101868 24309 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.088025 24287 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.156297 19225 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.161940 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.132797 24391 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:48.170516 19367 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:48.150164 24104 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:48.177591 24000 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.178588 24198 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.179265 24198 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:48.179708 24198 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:48.180666 24198 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.182729 24298 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:48.183454 24298 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.166597 24370 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:48.199867 24370 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.200599 24370 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:48.203380 19218 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:48.205405 19218 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:10:48.205969 24387 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:10:48.207058 19218 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:48.209342 24309 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.217295 24393 raft_consensus.cc:2243] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:48.218214 24393 raft_consensus.cc:2272] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:48.218788 24399 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.223120 24336 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.167416 24391 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:48.228521 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77199.3us
I20260709 13:10:48.229359 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.230616 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.231722 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:48.232676 24209 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.233404 24209 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.217398 24337 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.235301 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.188095 24199 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:48.253006 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.196790 24104 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:10:48.258502 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 135181us
I20260709 13:10:48.273242 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:48.276592 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:48.277819 24216 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:48.279736 24216 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:48.280409 24093 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:48.281002 24093 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.281422 24093 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.244065 24336 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:48.243321 24184 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:48.248682 24298 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.286387 24216 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:48.290593 24336 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.309482 24355 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:48.346750 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:48.313382 24216 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:48.346930 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 204154us
I20260709 13:10:48.316850 24181 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.320009 24336 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.352512 24406 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.353251 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 237387us
I20260709 13:10:48.356597 24393 ts_tablet_manager.cc:1916] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:48.359606 23787 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:48.374521 24104 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.375666 23787 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:48.376089 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 757) took 1108 ms. Trace:
I20260709 13:10:48.376616 19297 rpcz_store.cc:276] 0709 13:10:47.267832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.268028 (+   196us) service_pool.cc:224] Handling call
0709 13:10:47.274090 (+  6062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.276468 (+  2378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.276514 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:47.277119 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.652367 (+375248us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:47.652408 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.652471 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.958557 (+306086us) raft_consensus.cc:1685] finished
0709 13:10:47.958584 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.375720 (+417136us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b54002b84d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:48.375909 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84288,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":10339200,"thread_start_us":374732,"threads_started":1,"wal-append.queue_time_us":442696}
I20260709 13:10:48.350822 23933 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.361641 24420 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:48.356586 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:48.363336 24309 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:48.364032 24408 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:48.346446 24017 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.382340 19897 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:48.376029 23787 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:48.364836 24198 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.390971 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:48.394801 24422 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:48.394874 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.395565 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.396407 19225 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.399089 23787 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.399703 24309 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.400086 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.421736 19370 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.400520 24413 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.403254 24287 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.401961 23933 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.395773 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.395694 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.397284 24192 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.438366 19374 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:10:48.417011 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70354.2us
I20260709 13:10:48.393239 24017 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.423605 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.423751 19371 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:48.426265 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 59443.1us
I20260709 13:10:48.399093 24013 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:48.382118 24406 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.427462 24053 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:48.434248 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.367642 24355 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.411489 24370 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.396147 24408 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.408360 24385 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.408812 24198 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.433065 24199 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.433869 23787 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.451297 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.410235 24420 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.460846 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:48.460685 24390 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:48.461447 24370 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.442173 24013 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:48.453117 24287 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:48.487188 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.464222 24414 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:48.465641 24219 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:48.466593 24391 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.442405 24053 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.462476 24330 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.494235 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.501585 19371 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.497816 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:48.442303 24192 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.509052 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.505543 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.504757 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.466966 24017 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.511565 24199 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.435716 24422 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.516004 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.438974 24413 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.497216 24425 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.525681 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64909.9us
I20260709 13:10:48.535282 24330 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:48.580049 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.541973 24187 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.542893 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.582530 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.544024 24192 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.495684 24219 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:48.553406 24355 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:48.554960 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49533us
I20260709 13:10:48.555548 23952 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.601451 19365 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.601636 24422 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.602618 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.556736 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.599464 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.556383 24287 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.559079 24391 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.559087 24216 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.606824 24187 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.606926 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:48.607411 24216 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.607820 19897 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:48.560387 24198 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.562870 24399 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 10. Current term is 11.
I20260709 13:10:48.501993 24053 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.566018 19223 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.570851 19370 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:48.573184 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:48.574978 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 126413us
I20260709 13:10:48.576593 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.577250 19224 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:48.578799 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.579089 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:48.613891 19296 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.579655 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.535449 24408 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.543928 19371 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:48.614861 19300 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.586761 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.584794 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:48.591919 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.614514 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.620018 19296 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:48.592242 24414 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:48.593647 24219 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.594451 24425 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:48.583142 24415 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:48.596381 24013 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.598134 24385 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.580632 19297 raft_consensus.cc:2376] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15. Re-sending same reply.
I20260709 13:10:48.599516 24209 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.642321 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.642994 19221 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:48.600756 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.602702 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.645680 19369 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:48.608258 19217 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.647330 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.576732 24406 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.608563 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.611583 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.612007 24332 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:48.622469 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.653585 19371 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:48.625470 19300 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:48.630065 24219 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.602818 24413 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:48.609531 23952 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.634941 24393 ts_tablet_manager.cc:1929] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:10:48.635303 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.610862 23741 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:10:48.681342 19218 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:10:48.680642 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75298us
I20260709 13:10:48.635957 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.637524 19224 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:48.648859 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.624289 24309 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.684882 19223 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:10:48.661512 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51401.1us
I20260709 13:10:48.650736 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:48.683251 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:48.678897 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.686942 19900 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.648270 24013 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.683264 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.688366 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.688575 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.689785 19219 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:48.690516 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:48.690995 19894 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 7.
I20260709 13:10:48.642493 24287 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.652357 24209 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.690157 19218 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:48.631271 23933 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:10:48.697646 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.696998 19367 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:48.700101 19223 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:10:48.701141 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.701784 19300 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.641215 24399 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:10:48.702562 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.703722 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:48.705019 19296 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:48.642781 24093 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.709020 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:48.707012 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56347.6us
I20260709 13:10:48.708320 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.710228 19365 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:48.711966 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.637583 24414 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.715323 19297 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:48.695730 24309 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:48.696213 24393 log.cc:1199] T aff34caf0ca44db08f7c49f51ca52966 P 0316f581086f40549fea44a772fc2dec: Deleting WAL directory at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/wals/aff34caf0ca44db08f7c49f51ca52966
I20260709 13:10:48.709657 19292 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:48.717756 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.696473 24391 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.720213 19298 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.720860 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.721727 19222 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:48.719486 24309 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:48.725431 24393 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41698 (request call id 79) took 1057 ms. Trace:
I20260709 13:10:48.725589 24309 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.725852 24393 rpcz_store.cc:276] 0709 13:10:47.668424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.688914 (+ 20490us) service_pool.cc:224] Handling call
0709 13:10:48.033024 (+344110us) ts_tablet_manager.cc:1151] Deleting tablet aff34caf0ca44db08f7c49f51ca52966
0709 13:10:48.043784 (+ 10760us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:48.592339 (+548555us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:48.634806 (+ 42467us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:48.725321 (+ 90515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132908,"tablet-delete.queue_time_us":225253,"thread_start_us":137162,"threads_started":1}
I20260709 13:10:48.726728 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.727981 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:48.728633 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.729712 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.730794 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:48.731318 19365 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:48.735282 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:48.736791 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet aff34caf0ca44db08f7c49f51ca52966 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
W20260709 13:10:48.859692 19110 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 123054us
I20260709 13:10:48.858578 19365 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:48.798925 24420 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.696738 24355 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:48.701722 24000 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:48.867753 19222 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:48.700817 24413 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:10:48.860661 19294 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:10:48.861586 19300 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:10:48.862221 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 134289us
I20260709 13:10:48.873878 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:48.864936 19900 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:48.866070 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:48.720759 24399 consensus_queue.cc:1243] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:48.872279 19293 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:48.877611 19292 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:10:48.877141 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 141923us
I20260709 13:10:48.871825 23741 consensus_queue.cc:1243] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:48.881399 23356 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:48.857443 24051 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.883481 24427 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:48.883077 24017 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.884008 24093 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:48.890848 24336 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.006s
I20260709 13:10:48.880700 23698 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.888913 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:48.775298 24391 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:48.892923 24429 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.311s	user 0.002s	sys 0.000s
I20260709 13:10:48.904246 24287 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.904600 23356 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.905413 24355 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:48.905885 24436 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:48.872356 24122 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:48.875052 24420 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.906581 24414 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.906353 24399 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:48.936638 24433 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:10:48.887989 24430 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.170s	user 0.000s	sys 0.005s
I20260709 13:10:48.937920 24399 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:48.938441 24399 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.872641 24406 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:48.907238 24434 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:48.940341 24434 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:48.911875 19224 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:48.911527 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:48.941352 24434 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.903640 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.942724 24434 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.943328 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:48.916880 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 221419us
I20260709 13:10:48.944231 19365 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:48.944759 24209 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:48.945387 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:48.946092 19365 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.927150 19298 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:48.915500 24422 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.916402 24427 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.939836 24406 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.940379 24199 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.920987 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:48.910986 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 255006us
I20260709 13:10:48.951918 19219 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.951753 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:48.952484 19222 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:48.955750 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:48.915940 24051 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.928557 24355 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:48.962191 19220 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:48.974609 24355 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.962735 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.930075 24436 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:48.977737 24436 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:48.979125 24436 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.954865 24406 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.985086 24425 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.963369 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.987394 19223 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:48.989995 24013 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.990636 24013 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.994118 24013 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:48.966105 23356 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.969558 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:48.970548 24000 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:48.996510 19219 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:48.925386 23698 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:48.997810 24427 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.999248 23698 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:49.002420 23787 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 13:10:48.929833 24287 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:49.007417 24432 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:10:48.975001 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.013798 24051 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.976109 24355 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.972721 24391 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:48.920689 24017 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.020655 19298 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:10:49.054394 19298 pending_rounds.cc:85] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 9
I20260709 13:10:48.991806 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.029918 19299 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
W20260709 13:10:49.037988 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 82321us
I20260709 13:10:49.056387 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:48.923357 24336 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:49.043131 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87458.9us
I20260709 13:10:49.045922 24199 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.059536 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:49.060793 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 69065.8us
I20260709 13:10:49.054711 19298 pending_rounds.cc:107] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:10:49.062911 19298 raft_consensus.cc:2889] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.063603 19222 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:49.066825 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:49.070168 19370 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19.
I20260709 13:10:49.071851 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.054742 24399 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:49.055785 24441 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.076299 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:49.081573 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.061861 24138 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.062958 24391 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:49.090055 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:49.093308 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53274.2us
W20260709 13:10:49.093724 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.077497 24000 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.074146 24093 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:49.077914 24122 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.106834 19291 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:49.065254 24199 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.101011 24427 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.115475 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.093109 24391 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.092183 24138 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.156474 24391 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.156858 24138 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.103067 23356 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:49.159230 23356 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.159703 23356 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.107450 24000 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:49.175843 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.186590 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.114629 24441 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:49.188890 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.190248 19368 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.106423 24414 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:10:49.168444 24436 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:10:49.205196 19171 auto_rebalancer.cc:629] Failed to schedule move for tablet de5df46c0c944a9ba1bf0fd628f9e9b3: Illegal state: Replica 0316f581086f40549fea44a772fc2dec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:49.188876 24407 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.180884 24000 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.206096 24407 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.206553 24336 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.207723 24414 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:49.208074 24414 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:49.208444 24407 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.208925 24414 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.210350 24414 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.210687 24407 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.211949 24017 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.218554 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:49.219326 19297 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.102959 24053 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.222772 19295 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:49.223302 24053 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.224463 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:49.225282 19898 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:49.225473 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.224506 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.174719 24184 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:49.173292 24093 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.203575 23356 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.211288 24407 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:49.231302 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 155116us
I20260709 13:10:49.226130 19295 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:49.225306 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.200927 19368 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:49.235565 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.237002 19368 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:49.234180 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 118770us
I20260709 13:10:49.192467 24441 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.239499 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.250511 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.205531 24199 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.252108 19225 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:49.256052 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.230340 24184 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.238957 24122 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:10:49.285604 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.292973 19222 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:10:49.293339 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 234350us
I20260709 13:10:49.293862 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.294071 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.294449 19225 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:49.180987 24442 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:10:49.256313 24337 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.297062 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.248543 24441 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.301354 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.302178 19220 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:49.295596 24184 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.239204 24093 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.307881 24452 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:49.308300 24093 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:49.306087 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.309075 19902 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:49.309502 19225 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:49.292625 24051 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:49.299216 24199 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.319123 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.321710 24051 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.324079 24051 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.325845 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.326912 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:49.327523 19222 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.320142 19220 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:49.330955 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93900.8us
I20260709 13:10:49.334025 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.332870 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:49.339305 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.339231 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.317394 24287 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.302693 24337 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.341238 19895 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:49.303016 24391 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.347980 19300 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:49.349722 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:49.351235 24391 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.339129 24452 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.342262 24122 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:49.353073 24452 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.353746 24122 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:49.354725 24122 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.355370 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.355566 24452 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:49.356884 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.357460 19373 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:49.357790 24337 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.358309 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.358963 19373 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:49.361404 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.362172 19367 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:49.362221 24407 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.319274 24451 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:10:49.344754 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:49.332311 24051 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.344980 24447 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:49.340420 24199 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:49.362986 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.344182 19903 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:49.365175 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:49.365520 19897 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:49.359961 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.366161 19297 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:10:49.390651 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:49.391175 19297 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:49.366910 24287 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.367228 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:49.356015 19294 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:49.367552 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.392679 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.393276 19294 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:49.366109 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.342720 24336 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:49.384655 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.332831 24442 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:10:49.394968 19367 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:49.395313 19220 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:49.393937 19373 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:49.403970 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.404465 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.405162 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.405450 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.405790 19220 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:49.406092 19373 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:49.398087 24199 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:49.406859 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.407516 19373 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:49.407281 24199 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.405211 19292 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:49.394711 24287 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.403959 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.409129 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.409878 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.399711 24336 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.410318 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.411422 24138 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.410094 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.412422 19292 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:49.411767 19294 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:49.413010 24336 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:49.414630 19373 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:49.416255 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.417701 24138 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.417819 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.418207 24422 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:49.418895 19225 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:49.419090 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.419919 19373 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:49.421617 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.422194 19370 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:49.423276 19370 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:49.423386 19298 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:49.424085 19373 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:49.388526 24051 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.427002 24051 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.429476 19222 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:49.430235 19365 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:49.359923 24000 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.439817 19365 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.441730 19291 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:49.449712 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.441787 19297 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:10:49.410462 24287 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.457515 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.461027 19899 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.464617 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:49.465415 19897 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:49.456389 24201 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:49.494237 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:49.492591 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.499101 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.469254 24201 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:49.500676 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.500873 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.489336 24051 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.505733 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.504423 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.506960 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.509475 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.500574 24442 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.500180 24138 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.516541 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.503048 24017 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:49.502380 24337 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:49.503123 24104 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:49.505420 23787 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.528213 23787 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.535818 23787 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.511222 24391 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.511052 24413 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:49.513084 24436 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:49.511135 24407 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.521872 24017 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.507633 24051 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.525791 24337 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.518330 24093 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:49.511701 24199 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:10:49.524377 24219 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:49.537935 24391 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.526090 24138 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.522461 24442 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.549283 24407 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.552920 24017 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.566995 19897 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:10:49.554248 24337 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.577860 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:49.532624 24201 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:49.568924 24406 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.003s
I20260709 13:10:49.564940 24391 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.582286 24427 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:49.583424 24138 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.591440 24104 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:49.592300 24053 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:49.592747 24053 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:49.592830 24093 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:49.593389 24093 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:49.593513 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.593721 24053 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.594297 24093 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.594837 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.595587 24093 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.568620 24407 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.578717 24000 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.569870 24355 raft_consensus.cc:2764] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:10:49.603394 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.592833 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.596027 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.604986 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:49.604770 24104 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.605473 24051 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.605811 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.594862 24053 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.607084 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.607693 19224 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:10:49.610133 24442 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:49.600440 24406 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.613219 19295 raft_consensus.cc:2368] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:49.613600 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 854) took 1017 ms. Trace:
I20260709 13:10:49.614188 24406 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.613981 19372 rpcz_store.cc:276] 0709 13:10:48.595742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.602951 (+  7209us) service_pool.cc:224] Handling call
0709 13:10:48.606194 (+  3243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.861448 (+255254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.861478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.861518 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:48.861565 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.613401 (+751836us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000b3bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:49.613440 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.613548 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519765760}
I20260709 13:10:49.620229 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.622370 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:49.621150 24427 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:49.635540 24427 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.624790 24451 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.628372 24425 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:49.637178 24425 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.637761 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:49.639875 24425 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.640872 24425 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:49.641430 24425 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:49.642578 24425 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.619451 24181 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:49.624246 24422 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:49.646150 24422 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:49.647013 24422 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.615971 24201 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.651854 19372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:49.652750 19372 raft_consensus.cc:606] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.653122 19372 raft_consensus.cc:614] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:49.656733 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:49.625274 19869 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19.
W20260709 13:10:49.657361 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.621917 24309 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:49.629885 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:49.657367 19293 raft_consensus.cc:606] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.634414 24438 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:49.666215 19224 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.667748 24309 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:49.671789 24309 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.625434 24138 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:49.656870 24355 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:49.692201 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:49.693048 19296 raft_consensus.cc:2376] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14. Re-sending same reply.
I20260709 13:10:49.695720 24017 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.698405 24017 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:49.699223 24443 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.497s	user 0.000s	sys 0.004s
I20260709 13:10:49.700793 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 652) took 1050 ms. Trace:
I20260709 13:10:49.701247 19221 rpcz_store.cc:276] 0709 13:10:48.650168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.652322 (+  2154us) service_pool.cc:224] Handling call
0709 13:10:48.684859 (+ 32537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.705677 (+ 20818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.705706 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.714023 (+  8317us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.053172 (+339149us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:49.232138 (+178966us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.232932 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.234704 (+  1772us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.698510 (+463806us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:49.700394 (+  1884us) raft_consensus.cc:1685] finished
0709 13:10:49.700529 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.700720 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4194,"prepare.queue_time_us":264469,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":1244,"raft.queue_time_us":4713,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":6337,"spinlock_wait_cycles":25806592,"thread_start_us":340632,"threads_started":2,"wal-append.queue_time_us":300742}
I20260709 13:10:49.710167 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:49.710103 24407 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.710924 19298 raft_consensus.cc:606] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.711284 19298 raft_consensus.cc:614] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:49.711172 23356 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.712803 19292 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:49.717434 24330 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:49.719549 24181 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:49.723891 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.723233 19365 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:49.669446 24438 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:49.676451 19293 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:10:49.727098 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:49.727752 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:49.728411 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.729871 19900 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:49.730041 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.733183 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.733568 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.734000 19291 raft_consensus.cc:2410] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:10:49.735502 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.622270 24441 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.744707 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.746495 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.746819 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.747254 19374 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.737154 19224 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:49.740623 24453 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.720131 24181 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.741191 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d825739f94b747959f93597edca9200a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:49.742440 24438 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.735674 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.756223 23356 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.785272 19292 raft_consensus.cc:606] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.758916 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.786586 23356 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.632754 24184 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.790884 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.759455 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.668799 24391 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:49.774039 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46969.4us
I20260709 13:10:49.782577 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.786489 19365 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.783437 19221 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:49.757869 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.787616 19292 raft_consensus.cc:614] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:49.762494 19894 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:49.795575 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 157885us
I20260709 13:10:49.852176 19897 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:10:49.853143 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.732805 24437 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:49.806926 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47558.7us
W20260709 13:10:49.897743 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44691.5us
I20260709 13:10:49.898911 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:49.899901 19220 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.900013 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:49.781702 24442 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.906458 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.902089 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.904258 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:49.792208 24469 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:49.909906 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2454) took 1216 ms. Trace:
I20260709 13:10:49.905009 19368 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:49.755679 24406 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.745695 24198 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.907498 19372 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.760341 24330 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.788972 24017 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:49.910332 19371 rpcz_store.cc:276] 0709 13:10:48.686180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.686873 (+   693us) service_pool.cc:224] Handling call
0709 13:10:48.698844 (+ 11971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.933916 (+235072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.933946 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.953082 (+ 19136us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.121304 (+168222us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:49.121355 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.856001 (+734646us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5400189f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:49.856076 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.856139 (+    63us) raft_consensus.cc:1685] finished
0709 13:10:49.856159 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.902587 (+ 46428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5021,"raft.queue_time_us":197161,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":5229,"spinlock_wait_cycles":33977728,"thread_start_us":270998,"threads_started":2,"wal-append.queue_time_us":226654}
I20260709 13:10:49.755842 24453 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:49.860564 24438 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.787730 24138 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:49.917435 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.796218 24407 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.782147 24399 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.129s
W20260709 13:10:49.933027 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70706.2us
I20260709 13:10:49.934794 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.935161 23356 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.937443 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:49.934341 19366 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:49.859061 24466 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:49.906128 24442 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:49.928143 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:49.851289 24104 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:10:49.942651 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.940933 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:49.915336 24469 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:49.950778 19365 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:49.933687 24216 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:49.953225 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:49.937359 24287 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:49.961194 24138 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.963305 24287 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:49.964385 24287 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.919229 24406 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:49.922222 24198 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:49.966734 24406 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:49.966912 24198 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:49.956149 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2475) took 1018 ms. Trace:
I20260709 13:10:49.956422 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:49.958568 24467 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:10:49.958758 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:49.938894 24309 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:49.968344 19292 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:49.968480 19367 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:49.957710 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:49.960400 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.960644 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:49.961052 24428 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:49.923681 24437 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:49.967501 19373 rpcz_store.cc:276] 0709 13:10:48.937950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.425063 (+487113us) service_pool.cc:224] Handling call
0709 13:10:49.955511 (+530448us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:10:49.955679 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.955853 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.955884 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.955920 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:49.955958 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.956010 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.956100 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10967936}
I20260709 13:10:49.974735 19372 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:49.990376 19291 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:49.991466 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:49.952514 24455 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:49.991997 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.992830 19902 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:49.954238 24469 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:49.979782 19218 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:49.951730 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:49.938081 24453 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:49.944262 24442 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.005340 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:49.949456 24017 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.980940 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2089) took 1407 ms. Trace:
I20260709 13:10:49.944275 24433 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:10:49.968246 24478 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:49.984210 24428 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:49.995020 24451 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:49.995249 24455 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:49.992347 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.996750 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:49.988570 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:49.948434 24385 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:10:50.010958 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59296.1us
I20260709 13:10:49.968855 24216 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.062420 19296 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:50.008450 19299 rpcz_store.cc:276] 0709 13:10:48.573416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.573536 (+   120us) service_pool.cc:224] Handling call
0709 13:10:49.980799 (+1407263us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54001d56d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:49.980888 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921901952}
W20260709 13:10:50.046934 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 50251.8us
I20260709 13:10:50.047989 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:49.990989 24336 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:50.185261 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 137359us
W20260709 13:10:50.052570 24474 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:10:50.047748 19895 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:50.048339 19898 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:50.008280 24017 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.993126 24053 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.049533 24330 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:50.012215 24478 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.052862 24181 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:50.012116 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2165) took 1061 ms. Trace:
I20260709 13:10:50.060477 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:50.134021 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:50.197220 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:50.197677 19218 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:50.062950 24385 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:50.053067 24309 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:50.140842 24462 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.576s	user 0.002s	sys 0.000s
I20260709 13:10:50.142201 24407 raft_consensus.cc:993] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:50.012923 23787 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.143986 24428 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.147974 19300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:50.152590 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:50.132202 24216 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:50.156504 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:50.160786 24472 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:10:50.165390 24437 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.167382 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2469) took 1246 ms. Trace:
W20260709 13:10:50.170639 24475 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
W20260709 13:10:50.174690 24337 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.001s
I20260709 13:10:50.175362 19220 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:50.293305 19896 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:10:50.067981 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.194904 24478 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.185338 19897 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:50.300868 19903 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:50.004861 24399 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:50.201943 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 141577us
I20260709 13:10:50.274040 23356 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:50.275323 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 78165.8us
I20260709 13:10:50.307933 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:50.194813 19217 rpcz_store.cc:276] 0709 13:10:48.950722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.976405 (+ 25683us) service_pool.cc:224] Handling call
0709 13:10:48.976813 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:49.065397 (+ 88584us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:49.259045 (+193648us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.449567 (+190522us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:49.459568 (+ 10001us) log.cc:844] Serialized 52 byte log entry
0709 13:10:49.459758 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.459805 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.007070 (+547265us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b5400077bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:50.007142 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.007214 (+    72us) raft_consensus.cc:1685] finished
0709 13:10:50.011839 (+  4625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.012054 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255327,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":312,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":10529,"spinlock_wait_cycles":188158336,"thread_start_us":309504,"threads_started":2,"wal-append.queue_time_us":195387}
I20260709 13:10:50.190014 24017 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.188583 24201 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:50.276705 24309 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:50.286418 19300 raft_consensus.cc:606] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:50.192376 24330 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:50.182803 19374 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:50.298345 19299 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:50.291383 19368 rpcz_store.cc:276] 0709 13:10:48.921349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.258784 (+337435us) service_pool.cc:224] Handling call
0709 13:10:50.167188 (+908404us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540018a454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:50.167318 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391944064}
I20260709 13:10:50.274194 24181 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:50.274811 24441 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.289194 24051 raft_consensus.cc:1081] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:50.277518 24184 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:50.312140 19293 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:50.305050 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:50.314605 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:50.196524 24053 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.209897 24391 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.325300 19188 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:50.408383 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83198.1us
I20260709 13:10:50.325969 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:50.386693 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:50.404758 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 90259.7us
W20260709 13:10:50.410001 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 84151.6us
W20260709 13:10:50.405756 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100820us
I20260709 13:10:50.410274 23356 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:50.410979 23356 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.411525 23356 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.411098 19191 leader_election.cc:400] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:50.412384 19191 leader_election.cc:403] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:50.285799 24442 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.292042 24466 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:10:50.426169 24453 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.320241 23698 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.320688 24309 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.495723 24051 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.410216 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:50.559803 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 149647us
I20260709 13:10:50.386412 24451 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:50.443279 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.402978 24479 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.564455 24051 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.510198 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:50.582217 19216 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:50.581598 24451 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.475412 19366 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:50.493028 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.572s (SENT) [suppressed 14 similar messages]
I20260709 13:10:50.316804 24455 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.301853 24337 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.447806 23698 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:50.483192 24461 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:50.520514 24473 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:50.521613 24485 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:10:50.520541 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:50.591272 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70817.4us
W20260709 13:10:50.522488 24438 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:10:50.522891 24422 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.320608 24385 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.592970 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:50.475133 24453 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:50.528497 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:50.529299 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:50.613899 19300 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:50.530910 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:50.614578 19297 raft_consensus.cc:606] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:50.615010 19297 raft_consensus.cc:614] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:50.532155 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:50.534610 24428 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.446236 24198 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:50.429994 24425 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:50.480643 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:50.489333 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:50.508268 24441 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:50.548583 24184 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.472121 24330 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.549422 24199 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:50.484368 24471 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:10:50.551011 24436 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:50.436695 24287 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:50.551883 24209 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:50.482992 24482 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:50.492364 23787 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:50.553129 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44484.6us
I20260709 13:10:50.497308 24442 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:50.554037 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:50.557024 23356 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.557614 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:50.558696 19373 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:50.469656 24053 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:50.561743 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:50.564414 24478 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.405453 24181 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:50.572690 19369 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:50.564716 24466 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:50.616115 19296 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:50.564889 24399 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.565083 24434 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.589184 23698 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.627921 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:50.636122 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:50.642284 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:50.588306 24479 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.667119 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:10:50.648911 19263 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1668ce4cb86e4e9daf99a53a2be8a396. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:50.682372 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46352.1us
W20260709 13:10:50.683043 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 57135.8us
I20260709 13:10:50.683795 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:50.668504 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 112198us
I20260709 13:10:50.628708 24422 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:50.684326 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 191312us
I20260709 13:10:50.684924 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:50.685566 19900 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:50.685710 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.686640 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 60250.7us
W20260709 13:10:50.664939 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 103271us
I20260709 13:10:50.669709 23356 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:50.642144 24287 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.672977 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:50.679767 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 189165us
I20260709 13:10:50.680593 19898 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:50.680805 19293 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:10:50.620085 24473 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.657617 24451 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.668203 24414 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:50.642397 24184 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.672461 24201 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:50.702513 19223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.035s
W20260709 13:10:50.765726 19223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.000s	sys 0.035s
W20260709 13:10:50.760082 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 76317.7us
I20260709 13:10:50.688962 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:50.671279 24466 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:50.763629 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.764249 19900 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:10:50.770903 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68654.4us
I20260709 13:10:50.766314 19366 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:10:50.679854 24053 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.669175 24498 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.772526 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:50.682125 24434 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.685519 24436 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.688887 23787 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:50.679594 24199 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:50.781139 24093 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:50.757483 24438 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.785087 23356 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:50.761896 24287 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:50.785266 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 96347.3us
I20260709 13:10:50.786375 19368 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:50.791955 24500 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.795949 24473 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.776180 24053 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.796617 24053 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.797195 24473 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.797752 24473 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.804517 24434 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:50.804302 24181 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.805292 24506 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:50.756708 24437 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:50.689791 24499 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:50.759840 24414 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:50.790230 23356 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:50.809053 23356 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:50.787446 24093 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:50.773577 24466 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.810105 19293 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:50.679561 24399 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.803615 24053 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.818032 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:50.782357 24451 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:50.788300 24199 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:50.813141 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:50.840307 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:50.808591 24434 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:10:50.810775 24437 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.850479 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:50.777680 24216 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:50.828637 24017 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:10:50.811522 23787 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:50.857753 23356 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.862262 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:50.785831 24436 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.821354 24425 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:50.862928 19374 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
W20260709 13:10:50.866318 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53444.7us
I20260709 13:10:50.829268 24498 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.789994 24198 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 13:10:50.872968 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 106528us
I20260709 13:10:50.837815 24451 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.852984 24407 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:50.876812 23356 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.809691 24438 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.855964 24437 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.885217 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:50.856487 24337 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.890492 24502 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.887404 19366 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:10:50.811170 24414 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.897284 23356 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:50.899767 23356 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:50.900537 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:50.900748 23356 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.880672 24427 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.903527 19223 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:50.878438 24451 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.908937 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:50.894905 24309 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.910764 24442 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.827312 24201 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:50.888424 24469 consensus_meta.cc:287] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.001s
I20260709 13:10:50.915624 19223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:10:50.921239 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:50.931666 19223 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.932246 19223 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.931710 19220 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:50.933974 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:50.933195 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 173879us
I20260709 13:10:50.866003 24017 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.937136 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:50.940547 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:50.941186 19217 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:10:50.941476 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 123563us
I20260709 13:10:50.942314 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:50.944782 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:50.945394 19225 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.945109 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:50.948907 19216 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:50.936122 24198 consensus_queue.cc:1243] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 16.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:10:50.956153 24507 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.956875 24507 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.959079 24507 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:50.960210 24516 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:10:50.938047 24499 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:50.965991 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:50.966704 19374 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:50.970043 19225 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:50.970922 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:50.977656 19365 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.972461 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:50.876077 24093 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.891081 24502 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.982110 19374 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.984011 19295 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:10:50.987237 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.990260 19372 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:50.992722 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:51.056473 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 502492us
I20260709 13:10:50.935194 24427 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.939684 24442 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.093380 19370 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.094310 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:50.960901 24414 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.983373 24479 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.990526 24478 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:50.986794 24507 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.096062 19365 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:51.096809 19223 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:50.911239 23787 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:50.939853 24469 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.143743 24507 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.144968 24520 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.145679 24469 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.145525 24520 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.146584 19298 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:51.135987 19218 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.137398 19217 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:51.133060 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:51.142410 24309 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.143304 24337 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.143666 19223 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.144248 24525 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.145948 24507 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:50.987382 24198 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:51.140271 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:50.989523 24355 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 13:10:51.158900 24184 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.122511 24471 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.096846 24514 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:50.986825 24199 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.160457 24523 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.160699 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.161123 24216 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.161561 24442 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.227360 24471 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.161732 24219 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:51.229058 23698 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.002s
I20260709 13:10:51.229457 23698 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:51.162410 24504 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
W20260709 13:10:51.162734 24496 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:10:51.230741 24199 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.131193 24053 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.232690 24453 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:51.233013 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2173) took 1514 ms. Trace:
I20260709 13:10:51.233106 24453 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:51.234154 24453 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.233536 19222 rpcz_store.cc:276] 0709 13:10:49.718857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.722749 (+  3892us) service_pool.cc:224] Handling call
0709 13:10:49.723026 (+   277us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:50.178344 (+455318us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b180037bdc0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7eadbfb 00007fe8d7eb864b
0709 13:10:50.178501 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.178537 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:50.183595 (+  5058us) log.cc:844] Serialized 78 byte log entry
0709 13:10:50.402708 (+219113us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:50.432386 (+ 29678us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.524724 (+ 92338us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b180037bdc0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:50.659646 (+134922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.659751 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.232739 (+572988us) raft_consensus.cc:1685] finished
0709 13:10:51.232763 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.232925 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12529,"prepare.queue_time_us":41852,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":137387,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":99853,"spinlock_wait_cycles":78708736,"thread_start_us":479562,"threads_started":3,"wal-append.queue_time_us":448835}
I20260709 13:10:51.166409 24530 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.987504 24425 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.236403 24515 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.168627 24511 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.148455 24481 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:51.237006 24515 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.169281 24512 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:51.237931 24473 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.238080 24512 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.239215 24515 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.172778 19365 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:51.239821 24531 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.240402 24531 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.240722 24530 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.227890 24523 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:51.242791 24501 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:10:51.178349 24479 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:51.204053 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63854.4us
I20260709 13:10:51.131778 19374 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:51.132449 24500 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.216776 19370 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:51.147965 24520 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:51.225929 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 283671us
I20260709 13:10:51.230630 24427 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.177541 24455 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.244410 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 774) took 1287 ms. Trace:
I20260709 13:10:51.015895 24181 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.176348 24399 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.190510 24198 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:51.260540 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:51.207803 24469 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:51.256541 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.247210 24428 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.621s	user 0.004s	sys 0.004s
I20260709 13:10:51.181347 24337 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.258600 19295 rpcz_store.cc:276] 0709 13:10:49.957188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.957307 (+   119us) service_pool.cc:224] Handling call
0709 13:10:51.244142 (+1286835us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54003f2fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:51.244348 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293634304}
I20260709 13:10:51.247426 24522 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:51.224329 24507 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.250476 24017 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.271036 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:51.258862 24453 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.266048 24471 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.275017 24441 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:10:51.281642 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.212734 24525 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:51.244577 24519 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:10:51.243112 24422 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.250233 24436 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.263290 24515 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:51.266356 24469 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:51.289494 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 164513us
I20260709 13:10:51.262892 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:51.174770 24499 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.284404 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.286947 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:51.265741 24481 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.289700 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.298662 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.298825 23356 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.273285 24522 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:51.258173 24479 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.248265 24466 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.299393 23356 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.299309 19219 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:51.259397 24500 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.290081 24053 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:51.282632 24441 consensus_queue.cc:1243] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:51.280869 24523 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.265805 24473 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:51.275182 24122 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:10:51.327663 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.264050 24455 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.326894 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.327684 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:10:51.326808 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64021.7us
I20260709 13:10:51.282629 24471 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:10:51.330474 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.330909 24533 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.288185 24531 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.291054 24198 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.332115 24515 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.332518 24427 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.333127 24502 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.301568 24512 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.333799 24437 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.335791 24500 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.300999 24469 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.337960 24481 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.340638 24522 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.345134 24524 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.345309 23356 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.346043 19291 raft_consensus.cc:2368] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13.
I20260709 13:10:51.346613 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.347122 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.347385 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.348299 24466 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.348357 23698 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.348531 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.281272 24507 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.353287 24451 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.354483 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.355502 19297 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:51.356603 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:51.432482 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75985.1us
I20260709 13:10:51.410197 24427 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.259266 24514 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.365119 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.363161 19219 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:51.392217 19224 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
W20260709 13:10:51.436939 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71917.6us
W20260709 13:10:51.405525 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77961.3us
W20260709 13:10:51.413836 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 62186.8us
W20260709 13:10:51.404948 24529 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:10:51.391412 24053 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.391857 24523 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.416455 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 777) took 1110 ms. Trace:
I20260709 13:10:51.363225 24530 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:51.426223 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.426740 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.427372 24531 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.410256 24428 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:51.468268 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:51.468904 19373 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.453153 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:51.440040 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:51.424986 24385 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.425818 24198 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.463259 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:51.436620 24199 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.463842 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.437168 24427 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.452472 19292 rpcz_store.cc:276] 0709 13:10:50.306411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.306603 (+   192us) service_pool.cc:224] Handling call
0709 13:10:50.328037 (+ 21434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.564023 (+235986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.564068 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.617217 (+ 53149us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.842228 (+225011us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:50.842271 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.842364 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.416181 (+573817us) raft_consensus.cc:1685] finished
0709 13:10:51.416213 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.416380 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2838,"raft.queue_time_us":4047,"raft.run_cpu_time_us":43,"raft.run_wall_time_us":43,"thread_start_us":371235,"threads_started":2,"wal-append.queue_time_us":329778}
I20260709 13:10:51.432236 24522 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.445849 19903 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:51.465813 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.467306 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:51.467459 19369 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:10:51.427513 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 155584us
I20260709 13:10:51.506332 19366 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
W20260709 13:10:51.513423 24494 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:51.503803 19367 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.448526 24407 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:51.514438 24053 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.514984 24407 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:51.428491 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.505300 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.408664 24533 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.505378 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:51.504407 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57442us
I20260709 13:10:51.511878 19365 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.466125 24473 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:51.524384 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.555402 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.533463 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:51.534868 19366 pending_rounds.cc:85] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 9
I20260709 13:10:51.450066 24414 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.449994 24451 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.445803 24539 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.560974 19292 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:51.561328 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:51.537257 24534 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:10:51.564841 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.505378 24531 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:51.539572 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.487222 23787 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.451623 24507 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.540910 19367 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:10:51.502357 24051 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.511116 24093 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.506991 24406 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.584317 23787 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:51.584880 24543 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:10:51.584962 24406 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.585644 24406 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.548542 19899 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:51.508549 24428 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.588235 23787 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.588850 24428 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.594065 24406 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.594722 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:51.596843 24406 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.597669 24531 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:51.579936 24287 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.002s
I20260709 13:10:51.583906 24545 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.600848 24287 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.601445 24545 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.603201 24514 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.603615 24287 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.603663 24545 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.605072 19223 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:51.562811 24199 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:10:51.572557 24414 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.610013 24414 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.450301 24523 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.614395 24523 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.614953 19374 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:51.551539 19901 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:51.572284 24533 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.556717 19366 pending_rounds.cc:107] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:10:51.553968 24219 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.618046 24219 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.558094 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.428238 24524 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.561969 19898 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:51.563050 19365 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:51.557247 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:51.537971 24542 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:51.568306 19296 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:51.573768 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.574579 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.543228 24453 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.573038 24539 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.604893 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.616456 19366 raft_consensus.cc:2889] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.452631 24466 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:10:51.495307 24500 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:51.617204 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.572912 24527 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:10:51.620153 24219 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.620638 19294 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:51.631893 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.632479 19294 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:10:51.633965 24414 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.635504 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:51.636068 24530 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.636489 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.636617 24530 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.638088 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.638466 24209 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.638604 24530 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.635613 24414 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:10:51.639014 24209 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.641007 24209 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.622234 24524 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.622367 19298 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
W20260709 13:10:51.623040 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65884.8us
I20260709 13:10:51.645525 24434 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:51.646097 24434 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.624908 19299 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:51.644556 24538 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.625649 24453 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.647410 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.648066 19367 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:51.648547 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.648936 24453 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.649201 19299 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:51.650143 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.651149 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.651674 19299 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:51.633358 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.651927 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:51.624300 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:51.652829 24385 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:51.652927 19292 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.653226 24385 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.653664 24385 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:51.628032 24525 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.646231 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:51.628472 24500 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.657541 23356 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:51.657585 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:51.658123 23356 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.658313 24500 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.659010 23356 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.658959 24500 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:51.628710 24199 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:51.662427 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.662642 24199 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:51.662910 24515 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.663681 24473 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:51.663602 24199 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.664436 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:51.664942 24199 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:51.664690 24473 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.628978 19295 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:51.661002 24480 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.669765 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:51.669601 19373 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:51.670990 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.671792 19222 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:51.652997 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.672610 19294 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:10:51.662374 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 222377us
I20260709 13:10:51.675033 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.670598 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.673209 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.681388 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:51.683401 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.682745 24524 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.685602 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:51.686252 19297 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.686970 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.687808 19224 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:51.688697 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.689514 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.690069 19221 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.690337 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.690889 19225 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:51.691109 24538 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.628705 24533 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:51.692447 24533 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.692494 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.693207 19220 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:10:51.689545 19219 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:10:51.697273 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.699229 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.700090 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.700335 19292 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:51.700675 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.701056 19297 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:51.701318 19222 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:10:51.702694 19365 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:51.685755 24524 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.703550 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.703620 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.704668 19225 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:51.705122 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.706434 19218 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.688817 24539 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.707405 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:51.709087 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.728884 19373 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
W20260709 13:10:51.727890 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46571us
I20260709 13:10:51.729897 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.731097 19365 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:51.732254 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.734004 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.644546 24436 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.739984 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.628192 24466 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:51.749576 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.646476 24434 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.683844 24414 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.739975 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:51.741482 19373 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:51.730566 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.744915 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.747094 19224 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:10:51.760622 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.747740 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.761888 19219 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:10:51.755571 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.661907 24500 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.766083 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.756116 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.757270 19217 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:51.750460 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:51.708510 24531 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:51.728471 24527 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:51.661908 24498 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:10:51.736887 24524 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.750026 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:51.781610 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51139us
I20260709 13:10:51.782806 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:51.783026 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.709271 24453 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.735872 23698 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:51.789974 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.791010 19223 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:10:51.770387 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.763947 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.741258 24436 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.771075 24545 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.758258 24184 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.771440 24541 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:51.772122 24536 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:51.814277 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.772219 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.773151 24500 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.780978 24479 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.775293 19901 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:51.627352 24469 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.776656 24437 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.777215 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:51.777616 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:51.848024 19900 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:51.779978 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.736265 24053 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:51.698514 24514 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:51.860419 19295 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:51.787026 24538 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.683145 24209 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:10:51.793546 19222 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:51.863752 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.801757 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.802480 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:51.804088 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.804502 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:51.870405 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65959.3us
W20260709 13:10:51.873669 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2141) took 1345 ms (client timeout 1628 ms). Trace:
I20260709 13:10:51.803320 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:51.767026 24414 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:51.698037 24480 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.807737 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.801633 24453 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.808620 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.816741 19372 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:51.781519 24531 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.773653 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.787827 24513 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.805124 24436 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.807605 23698 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.894357 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:51.838974 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.895381 19296 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:10:51.835800 19221 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:51.896775 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.897485 19221 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:51.898545 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.899183 19221 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.800716 24499 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:51.805915 24330 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.852278 24469 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.852988 19300 raft_consensus.cc:2368] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:51.802086 24391 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.853876 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:51.778749 24427 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.858577 19896 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.800093 24527 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.746061 24442 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.806905 24184 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.875168 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.885407 19223 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:51.874243 19291 rpcz_store.cc:269] 0709 13:10:50.528104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.528250 (+   146us) service_pool.cc:224] Handling call
0709 13:10:51.873429 (+1345179us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540004d3d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:51.873591 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684762496}
I20260709 13:10:51.888723 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:51.888726 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 115121us
I20260709 13:10:51.889827 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:51.829025 24545 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.893517 24538 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.935242 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:51.905007 24453 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.908735 23698 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.909565 24532 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.911381 24480 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:51.915505 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:51.916491 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.918174 24524 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.922511 19899 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:51.891801 24531 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.013381 19222 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:51.860435 24407 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.885571 24414 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.951467 24427 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:51.888972 24466 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.862321 24536 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:51.866842 24053 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:51.890990 24513 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.945919 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:52.028465 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 387435us
I20260709 13:10:51.949442 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:51.949932 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.951926 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:51.955775 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:51.945102 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.954434 19374 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:51.952781 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:51.953698 19370 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:51.965479 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:51.949956 19903 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.972148 19223 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:52.011513 19221 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:52.032192 19367 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:10:52.034853 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 85485.4us
I20260709 13:10:52.032325 19294 raft_consensus.cc:2368] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:51.968042 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.036528 19296 raft_consensus.cc:2368] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:52.036319 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:52.036643 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.986999 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:52.037392 19294 raft_consensus.cc:2368] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:51.968889 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:51.986601 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51457.1us
I20260709 13:10:51.994916 19896 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:52.032547 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.033209 19219 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:52.008639 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.039584 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:52.040267 19221 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 13:10:52.011049 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:51.959599 24184 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:52.044803 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75994.2us
I20260709 13:10:52.044927 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.044946 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.046012 19218 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:52.016286 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.942252 24499 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.924152 24385 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.018690 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:51.863957 24514 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:51.939921 24438 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:51.985906 24219 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.997596 24541 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:52.029099 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:51.949442 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:52.071915 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 122543us
I20260709 13:10:52.072522 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.001595 19898 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:52.072997 19219 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:52.033509 19901 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.033839 19374 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:52.032768 19216 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:52.046085 19294 raft_consensus.cc:2368] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:52.046365 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.035635 24513 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.072959 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.040717 19221 pending_rounds.cc:85] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 14
I20260709 13:10:52.049830 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:52.051369 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:51.949676 24391 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.077590 19221 pending_rounds.cc:107] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 13:10:52.056965 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:52.078857 19221 raft_consensus.cc:2889] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.057783 19217 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:52.060765 23356 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.065810 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.079617 23356 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.080047 23356 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.080425 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.081012 19895 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:52.066987 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.029809 24466 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.090898 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:52.092886 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:52.058775 24502 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.986001 24538 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:52.058828 24453 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.049125 24512 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.084015 19902 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:52.086167 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.088333 19903 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:52.058409 24499 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.058233 24330 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.087841 19220 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.068876 19218 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:52.016474 24532 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.096002 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.066473 24184 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.077713 23787 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:52.070990 24469 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:52.030606 24510 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:10:52.101460 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.165743 19225 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.105676 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:51.957212 24527 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.078617 24438 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:52.108439 19899 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:52.089658 24466 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.110495 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.201681 19895 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:10:52.084473 24391 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.116957 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.086968 24480 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.066176 24434 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.099341 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.208568 19898 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:52.100025 24051 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.120253 24330 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.140532 24536 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.142179 24355 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.143936 24532 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.100373 24437 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.075794 24219 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.118147 24184 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:52.154093 19220 raft_consensus.cc:2410] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:52.203986 24479 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:52.151868 24414 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:52.170313 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64733.4us
I20260709 13:10:52.102942 24538 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.100239 24522 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.102699 24453 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:52.200096 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.105818 24539 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.215368 24330 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.097718 24399 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:10:52.119184 24512 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:52.102483 24199 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:10:52.215345 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.216833 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.103014 24502 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.152570 23356 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.207711 24480 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.216516 24051 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:52.296115 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.278672 24453 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.225299 24184 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.230003 24524 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.294677 19300 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:52.295313 19368 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:52.111788 24053 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.308734 19291 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:52.310155 24545 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.301934 23356 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.296535 24480 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.311579 24502 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.312564 24514 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.313611 24407 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.313776 24385 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.206583 19225 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:52.279151 24539 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.318184 24539 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.321085 24434 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.219791 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:52.322610 19300 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:52.218585 24355 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.219978 24531 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:52.335662 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.337396 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.338517 19898 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:52.297194 24479 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:52.346633 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:52.358855 19295 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:52.360620 19295 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:52.299556 24522 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:52.337468 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 264984us
W20260709 13:10:52.366943 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 167432us
W20260709 13:10:52.367710 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 475245us
I20260709 13:10:52.348595 24541 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:52.375363 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:52.388767 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:52.349220 24436 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.379048 19295 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 13:10:52.392278 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:52.379045 24385 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.390524 24399 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:52.426584 19365 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:52.380079 24093 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:10:52.393392 24437 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:52.448001 24437 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:52.448509 24437 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:52.449747 24562 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:10:52.393314 24442 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:10:52.425175 24438 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:52.455470 24438 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.377261 24512 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.375181 24051 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.459298 24209 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.459816 24209 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:52.460585 24565 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:52.462149 24532 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.468086 24517 raft_consensus.cc:993] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:52.471055 24184 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.471393 24537 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.491065 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:52.471845 24437 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.435169 24500 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.474222 19370 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:52.474890 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.475333 24355 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.475483 24520 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:52.516984 24520 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:52.517928 24520 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.519088 24520 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.477421 24219 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:52.478291 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 427972us
I20260709 13:10:52.484916 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.523947 24552 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.524567 24552 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.525115 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:52.526358 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:52.526739 24552 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.526866 19221 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:52.528131 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.485428 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.411661 24536 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:10:52.488942 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.537755 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 888) took 1004 ms. Trace:
I20260709 13:10:52.498169 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:52.539335 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.539898 19221 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:52.538326 19371 rpcz_store.cc:276] 0709 13:10:51.533470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.535358 (+  1888us) service_pool.cc:224] Handling call
0709 13:10:51.535830 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.629201 (+ 93371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.629230 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.629678 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.860213 (+230535us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:51.860253 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.528291 (+668038us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54001626d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:52.528343 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.528388 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:52.528401 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.537663 (+  9262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16390,"raft.queue_time_us":17737,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":176004480,"thread_start_us":230155,"threads_started":1,"wal-append.queue_time_us":600403}
I20260709 13:10:52.541224 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.541915 19371 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:52.544493 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.545234 19220 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.498768 19901 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:10:52.527311 24552 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:52.485260 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:52.551810 19223 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:52.529232 19218 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.486362 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.494910 19219 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:52.555017 19216 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.491731 24567 ts_tablet_manager.cc:933] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.531745 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.481913 24510 raft_consensus.cc:1081] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:10:52.548185 19370 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:52.523670 24513 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.481698 24514 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.530224 19374 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:52.563714 19295 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:52.533012 24434 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:52.515208 24578 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.529315 24436 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.559657 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:52.433904 24122 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 13:10:52.535180 24414 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.562741 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:52.602867 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.564404 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.604707 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.605232 19367 raft_consensus.cc:2368] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:52.537444 24399 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.575919 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.606031 19897 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:52.608034 19337 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.514297 24537 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.619882 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.547597 24219 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.544036 24209 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.589646 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.621722 19370 raft_consensus.cc:2368] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:52.596860 24391 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.622046 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:52.623204 19897 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:52.437640 24479 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.516156 24522 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.534269 24500 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.487574 24385 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:10:52.609916 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.592389 24578 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.629885 19898 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:52.630431 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.515218 24541 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.631806 19220 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:52.636814 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:52.636468 19221 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:52.635612 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.603108 24498 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.617156 24436 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.619014 24184 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.650734 19221 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:10:52.647433 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 255232us
I20260709 13:10:52.647469 19370 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:52.649358 19223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:10:52.651670 19223 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.629604 24545 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.589962 24434 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.620759 24531 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.597985 24514 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.652046 19223 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.652516 19191 leader_election.cc:400] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:52.652938 19219 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.569021 24552 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.649744 19292 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:52.657493 19219 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:52.657122 19191 leader_election.cc:403] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.659143 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:52.619714 24399 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.645543 24209 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.635818 24578 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.660214 19901 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:10:52.668628 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.653712 24427 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:52.650199 24436 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.701310 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.639389 24407 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:10:52.659873 24564 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.295s	user 0.001s	sys 0.001s
I20260709 13:10:52.703409 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:52.725608 19897 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.654930 24536 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:10:52.704128 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:10:52.729152 24558 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.869s	user 0.002s	sys 0.001s
I20260709 13:10:52.636083 24533 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.648993 24337 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.708238 19374 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
W20260709 13:10:52.702114 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49719.6us
I20260709 13:10:52.756783 19218 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:52.709666 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:52.712136 19900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 964) took 1766 ms (client timeout 1515 ms). Trace:
I20260709 13:10:52.702731 19292 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:52.758445 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.758636 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.759444 19218 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:52.760412 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.721385 19223 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.630093 24330 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:52.713280 24568 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:10:52.731950 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2106) took 1385 ms. Trace:
I20260709 13:10:52.776240 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:52.732445 24573 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 13:10:52.780575 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70974us
I20260709 13:10:52.733016 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2523) took 1027 ms. Trace:
W20260709 13:10:52.734345 24575 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:10:52.735841 24582 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:52.711661 24427 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.736877 19225 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:52.739032 24537 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.741022 24399 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.655699 24498 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:52.735541 24453 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.744336 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.707489 19188 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.758510 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:52.799796 24399 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.800329 24399 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:52.801095 24391 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.801357 24399 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.803330 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.804801 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:52.805651 24453 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.793567 24427 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.659677 24455 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.653306 24545 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:52.706318 24209 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.808400 24209 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.800354 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:52.769953 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:52.757663 19900 rpcz_store.cc:269] 0709 13:10:50.936755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.936916 (+   161us) service_pool.cc:224] Handling call
0709 13:10:52.703127 (+1766211us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:52.703229 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059053440}
I20260709 13:10:52.771080 19191 leader_election.cc:400] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:52.713313 24436 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.812697 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.766278 19897 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:52.713439 24531 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.723377 24570 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:10:52.821029 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.653548 24510 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:10:52.781903 19365 rpcz_store.cc:276] 0709 13:10:51.705685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.731909 (+ 26224us) service_pool.cc:224] Handling call
0709 13:10:52.732760 (+1000851us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:52.732944 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594537216}
I20260709 13:10:52.825594 19365 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:52.783864 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.784237 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:52.787623 19223 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.827077 19221 raft_consensus.cc:2393] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:52.778956 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:52.827136 19894 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:10:52.827633 19224 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:52.659513 24219 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:10:52.789878 19225 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:52.794250 19373 raft_consensus.cc:2368] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:52.793418 24586 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.810093 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:52.772668 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:52.814857 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.832304 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:52.815565 19191 leader_election.cc:400] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:52.832957 19191 leader_election.cc:403] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.833153 19370 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:52.833550 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 848) took 1057 ms. Trace:
I20260709 13:10:52.835152 19903 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:10:52.789737 24442 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:52.774382 19293 rpcz_store.cc:276] 0709 13:10:51.346746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.346864 (+   118us) service_pool.cc:224] Handling call
0709 13:10:52.731736 (+1384872us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540034f154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:52.731888 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320855936}
I20260709 13:10:52.852207 19297 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:52.823277 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:52.853150 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.773955 24587 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:52.833935 19902 rpcz_store.cc:276] 0709 13:10:51.776071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.779748 (+  3677us) service_pool.cc:224] Handling call
0709 13:10:52.833363 (+1053615us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54006beed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:52.833498 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508902656}
I20260709 13:10:52.810720 24437 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.845918 19365 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:52.851356 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.863811 19216 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:52.845682 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.845516 24535 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:52.794876 24480 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.867165 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:52.867602 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:52.868999 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2708) took 1128 ms. Trace:
I20260709 13:10:52.879794 19294 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
W20260709 13:10:52.881578 19298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2105) took 1535 ms (client timeout 1936 ms). Trace:
I20260709 13:10:52.863745 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:52.859966 24513 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.868324 19225 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.824350 24531 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.846803 24585 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:52.920979 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57357.1us
W20260709 13:10:52.922029 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 54573.9us
I20260709 13:10:52.924687 19225 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.897058 19222 rpcz_store.cc:276] 0709 13:10:51.740945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.028397 (+287452us) service_pool.cc:224] Handling call
0709 13:10:52.031701 (+  3304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.032508 (+   807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.032546 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.034161 (+  1615us) log.cc:844] Serialized 513 byte log entry
0709 13:10:52.356920 (+322759us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:52.359290 (+  2370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.359364 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.868688 (+509324us) raft_consensus.cc:1685] finished
0709 13:10:52.868718 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.868923 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":287338,"threads_started":1,"wal-append.queue_time_us":469481}
I20260709 13:10:52.900738 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:52.898820 19298 rpcz_store.cc:269] 0709 13:10:51.346384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.354212 (+  7828us) service_pool.cc:224] Handling call
0709 13:10:52.881448 (+1527236us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54002e7a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:52.881533 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437765504}
I20260709 13:10:52.928731 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:52.929370 24589 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:52.929669 19902 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:52.929643 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:52.921480 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 214037us
I20260709 13:10:52.931447 19294 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:52.932004 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:52.932940 24527 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.933465 24527 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:52.930902 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:52.898061 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:52.861749 24481 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.862382 24593 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.938126 24593 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.938378 24481 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:52.939545 24481 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.940219 24593 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:52.810288 24545 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:52.941263 24538 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.000s
I20260709 13:10:52.941368 24545 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.941772 24538 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.943962 24427 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:52.944633 24330 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.945624 19297 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:52.934360 24527 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:52.945925 24592 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:52.920787 24500 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:52.947422 24434 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.937312 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:52.926290 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:52.948920 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2529) took 1163 ms. Trace:
I20260709 13:10:52.950150 19372 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:52.943445 19225 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:10:52.951578 19225 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 7
I20260709 13:10:52.951968 19225 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:52.952796 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:52.954239 19218 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:52.955296 19218 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:52.955571 19223 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:52.955960 19222 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:52.904419 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.954324 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.879894 24536 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:52.957419 19223 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:52.954486 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:52.957329 19225 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.958041 19223 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:52.958410 19224 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:10:52.920495 24579 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:10:52.862483 24355 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:52.921123 24535 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:52.948899 24391 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.956015 19218 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.869851 24537 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:52.958786 19223 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:52.992600 19218 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.951196 24597 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.950162 19369 rpcz_store.cc:276] 0709 13:10:51.785457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.802441 (+ 16984us) service_pool.cc:224] Handling call
0709 13:10:51.831747 (+ 29306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.832132 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:51.832419 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.237514 (+405095us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.295939 (+ 58425us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.296084 (+   145us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:52.296118 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.296207 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.948712 (+652505us) raft_consensus.cc:1685] finished
0709 13:10:52.948734 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.948858 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":6220,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":50041,"thread_start_us":385528,"threads_started":1,"wal-append.queue_time_us":552342}
I20260709 13:10:52.862185 24567 tablet_copy_client.cc:323] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:10:52.886533 24587 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:52.987665 24469 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:10:52.988688 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2111) took 1108 ms. Trace:
I20260709 13:10:52.987308 24407 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:52.943876 24538 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:52.992899 19223 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:52.972085 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45938.3us
I20260709 13:10:52.990860 24199 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:52.995003 24122 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.995437 24537 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:52.996532 24594 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:10:52.975138 24532 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:10:52.975899 24337 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:53.007745 19295 rpcz_store.cc:276] 0709 13:10:51.880425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.429356 (+548931us) service_pool.cc:224] Handling call
0709 13:10:52.431439 (+  2083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.564265 (+132826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.988455 (+424190us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540004c254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:52.988628 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303642368}
I20260709 13:10:53.012916 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:52.948683 24588 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:52.983605 24581 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:53.020802 19218 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:10:53.019934 19293 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:52.973579 24578 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.000180 24598 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:52.880235 24498 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:53.012414 24553 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.469s	user 0.006s	sys 0.000s
I20260709 13:10:52.983994 24514 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.030411 24455 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:10:53.040794 24537 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:53.019521 24199 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:53.008921 24599 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:53.039141 24584 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:10:53.024864 24122 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:10:53.078186 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 115581us
I20260709 13:10:53.048944 24581 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.051358 24471 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.038188 24536 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:53.002827 24597 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.049994 19218 pending_rounds.cc:85] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:53.110157 19218 pending_rounds.cc:107] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:10:53.110458 19218 raft_consensus.cc:2889] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.085907 19292 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.114329 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2525) took 1408 ms. Trace:
I20260709 13:10:53.114908 19368 rpcz_store.cc:276] 0709 13:10:51.706282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.769821 (+ 63539us) service_pool.cc:224] Handling call
0709 13:10:51.801327 (+ 31506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.307352 (+506025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.114095 (+806743us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400314554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:53.114267 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135515904}
W20260709 13:10:53.118162 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52991.8us
I20260709 13:10:53.102272 24599 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:53.091740 19223 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:10:53.068727 24337 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:53.038576 24605 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:53.122783 19223 pending_rounds.cc:85] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:10:53.124032 19223 pending_rounds.cc:107] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:10:53.124387 19223 raft_consensus.cc:2889] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.107986 24581 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.090884 24209 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.127964 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:53.127411 19191 leader_election.cc:400] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:10:53.113389 24545 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:10:53.158299 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:53.103227 24122 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:53.157042 24466 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.944s	user 0.012s	sys 0.001s
I20260709 13:10:53.091231 24598 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:53.154386 24499 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.986s	user 0.012s	sys 0.000s
W20260709 13:10:53.127875 24539 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.809s	user 0.013s	sys 0.000s
I20260709 13:10:53.123409 24427 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.122092 24599 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.083178 24535 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:53.235623 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79129.5us
W20260709 13:10:53.232512 24549 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.651s	user 0.003s	sys 0.001s
I20260709 13:10:53.238858 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:53.235997 24466 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.239286 24603 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:53.242723 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.158614 24479 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:10:53.248937 19902 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.248993 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.248993 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.259920 19216 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.260236 19222 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.237664 24536 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:53.261309 24600 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:10:53.263064 24597 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.248716 24593 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.125346 24199 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.238417 24539 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.268814 24199 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:53.270268 24539 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.271087 19366 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:53.272348 24606 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.273130 24436 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.237106 24122 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:53.255411 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.247828 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.235033 24337 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.276832 19221 raft_consensus.cc:2410] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:53.277735 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.278620 24391 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:53.278780 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.279610 19221 raft_consensus.cc:2410] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:53.238771 24499 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.154556 24604 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:10:53.252369 24514 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.281662 19299 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:53.282579 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.261205 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.284668 19221 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:53.281021 24514 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.253883 24603 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.286242 24598 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.287114 19216 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:53.287184 24514 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:53.289669 24520 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
I20260709 13:10:53.291945 24209 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.297435 24466 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.283775 19222 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
W20260709 13:10:53.250823 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 2716) took 1501 ms (client timeout 1950 ms). Trace:
W20260709 13:10:53.302217 19217 rpcz_store.cc:269] 0709 13:10:51.743214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.767556 (+ 24342us) service_pool.cc:224] Handling call
0709 13:10:53.243848 (+1476292us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001d5454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:53.244266 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443791616}
I20260709 13:10:53.303242 24578 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.299536 24581 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.322795 19902 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:53.332073 24581 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.332559 24528 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:10:53.307173 24603 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.353400 24537 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.323968 24499 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:53.373149 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 122108us
I20260709 13:10:53.357393 24599 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.386164 24537 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.390705 24599 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:53.392095 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.398684 24436 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.402244 19219 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:53.408932 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.433132 24533 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:53.438144 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:53.438725 19366 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:10:53.439685 24199 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:53.440529 24572 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.889s	user 0.009s	sys 0.000s
I20260709 13:10:53.440340 24199 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:10:53.442680 24199 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:53.444060 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.444535 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 621848us
I20260709 13:10:53.446327 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:53.446723 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.452433 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.454813 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.453830 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.455997 19295 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.457226 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.458076 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.452625 24436 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.452499 24535 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:53.452351 24528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53066 (request call id 1) took 3752 ms. Trace:
I20260709 13:10:53.465510 24528 rpcz_store.cc:276] 0709 13:10:49.674230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.674384 (+   154us) service_pool.cc:224] Handling call
0709 13:10:49.908852 (+234468us) log.cc:844] Serialized 513 byte log entry
0709 13:10:50.520797 (+611945us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:53.425472 (+2904675us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2800,"raft.queue_time_us":4691,"raft.run_cpu_time_us":2012,"raft.run_wall_time_us":39982,"spinlock_wait_cycles":17601792,"thread_start_us":85773,"threads_started":1,"wal-append.queue_time_us":338860,"wal-append.run_cpu_time_us":3813,"wal-append.run_wall_time_us":1387104}
I20260709 13:10:53.464260 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.468686 24209 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.469094 24184 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.469655 24184 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.470228 24552 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.471835 24184 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.473299 19295 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:10:53.472146 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.475790 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:53.461843 24436 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.479547 24436 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.482695 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.483906 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.484474 19217 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.485929 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.486631 19294 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.486795 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:53.487548 19373 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:53.487540 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:53.489297 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.489986 19221 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:53.491165 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.491859 19292 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:53.491905 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.489235 19191 leader_election.cc:400] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:53.492105 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:53.492411 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.492544 19191 leader_election.cc:403] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.492559 19221 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.492967 19222 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.493883 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.473304 24199 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.496012 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.497732 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.498718 19220 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:53.499881 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.500481 19293 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.505019 19372 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:10:53.505384 19372 pending_rounds.cc:85] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 10
I20260709 13:10:53.505607 19372 pending_rounds.cc:107] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:53.505841 19372 raft_consensus.cc:2889] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.499750 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.507123 19217 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:53.496887 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:53.476472 24184 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.509016 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.513828 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:53.497256 24209 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:53.493654 24434 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.496793 24585 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.500727 24538 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:53.522164 24538 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:53.523092 24538 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.524394 24585 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.526674 24585 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.496555 24539 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:53.462790 24535 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.527446 24539 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.517640 24581 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:53.519773 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:53.519773 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet 1668ce4cb86e4e9daf99a53a2be8a396 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:10:53.520443 24608 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:53.519012 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:53.506721 24385 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:10:53.534781 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.510067 24532 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:10:53.512442 24436 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:53.540457 19221 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:53.543228 19222 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:53.547226 19291 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:53.539682 24455 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:53.556363 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2112) took 1675 ms. Trace:
I20260709 13:10:53.556931 19299 rpcz_store.cc:276] 0709 13:10:51.880723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.518411 (+637688us) service_pool.cc:224] Handling call
0709 13:10:52.528881 (+ 10470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.282193 (+753312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.556063 (+273870us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540008fa54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:53.556289 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730629888}
I20260709 13:10:53.558553 24531 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.539721 24209 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:53.560968 24535 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.560457 24209 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.563256 24539 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.563885 19219 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.543293 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet 1668ce4cb86e4e9daf99a53a2be8a396 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-1668ce4cb86e4e9daf99a53a2be8a396
I20260709 13:10:53.567215 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.535099 24581 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.509454 24199 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.570577 24539 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:53.571038 24473 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:53.581194 19293 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:53.570248 24581 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.569319 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.565117 24436 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.590793 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2137) took 1042 ms. Trace:
I20260709 13:10:53.600499 19310 tablet_copy_source_session.cc:215] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:53.607265 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:53.608948 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:53.610016 19902 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:53.593189 19374 rpcz_store.cc:276] 0709 13:10:52.548202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.604405 (+ 56203us) service_pool.cc:224] Handling call
0709 13:10:53.590626 (+986221us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400189f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:53.590732 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236281600}
I20260709 13:10:53.613070 19221 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.614063 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.614760 19221 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:53.615610 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.616534 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:53.616658 24581 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.617327 19894 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:53.618402 24512 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:53.618705 24581 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.618933 24512 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.620121 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.620826 19218 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:53.620990 24512 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.621179 24199 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.622911 24436 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.582018 24473 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:53.630779 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.631361 24473 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.631963 24017 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.632551 24017 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.648492 19219 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
W20260709 13:10:53.644968 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75720.8us
I20260709 13:10:53.649003 19219 pending_rounds.cc:85] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:10:53.649389 19219 pending_rounds.cc:107] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:10:53.649482 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.649709 19219 raft_consensus.cc:2889] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.649880 19218 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:10:53.650615 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2738) took 1002 ms. Trace:
I20260709 13:10:53.650975 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:53.651237 19219 rpcz_store.cc:276] 0709 13:10:52.648667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.649155 (+   488us) service_pool.cc:224] Handling call
0709 13:10:52.652827 (+  3672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.401895 (+749068us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400154620. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e3306f 00007fe8d7eabf60 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62
0709 13:10:53.563720 (+161825us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b580085cad0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:10:53.650392 (+ 86672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.650565 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415148672}
I20260709 13:10:53.653877 19219 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:53.655212 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:53.656481 19191 leader_election.cc:400] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:53.656754 19191 leader_election.cc:403] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.664719 19897 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:53.667315 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:53.668964 24587 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:53.670010 24480 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:53.672029 24536 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:53.673890 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:53.676713 19218 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:10:53.680258 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 977) took 1590 ms. Trace:
W20260709 13:10:53.680421 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76063.7us
I20260709 13:10:53.680721 19903 rpcz_store.cc:276] 0709 13:10:52.074858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.127434 (+ 52576us) service_pool.cc:224] Handling call
0709 13:10:52.834874 (+707440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.835556 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.665000 (+829444us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54006beed0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:53.665149 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625828096}
W20260709 13:10:53.686246 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.687618 19296 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:53.695385 19218 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:53.696079 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:53.696111 19903 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.646266 24539 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:53.703147 19300 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:53.699717 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:53.704908 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55520.5us
I20260709 13:10:53.705127 19191 leader_election.cc:400] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:53.705703 19191 leader_election.cc:403] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.705523 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.713606 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:53.682798 24512 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.714318 19374 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.714581 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:53.711980 19218 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:53.715796 19373 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:53.716429 19367 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:53.716547 19365 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:53.717147 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:53.691497 24528 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.719534 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:53.724356 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:53.754823 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:53.755121 19366 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:53.755462 19372 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.754644 24624 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.719611 19216 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:53.755872 19218 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:53.751139 24480 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:53.757826 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.793967 19218 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.709072 24473 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.704365 24535 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.714345 24531 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:53.753829 24626 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:53.768519 24541 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:53.775017 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.776448 19291 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:53.802065 19294 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.802554 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.803362 19291 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.803170 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.804104 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.804410 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.804885 19291 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.805188 19294 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:53.805780 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.806340 19294 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.776633 19295 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.778683 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.777665 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.808435 19299 raft_consensus.cc:2368] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:53.808573 19374 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:10:53.714155 24587 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:53.778188 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.776999 19372 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
W20260709 13:10:53.756922 24636 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:53.781311 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.783293 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.755551 24532 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:10:53.751361 24199 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.756446 24434 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:53.758733 24624 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.828722 24434 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.829203 24434 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:53.830453 24624 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:53.788863 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 69415.8us
I20260709 13:10:53.831686 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:53.764931 24575 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:53.801694 24535 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:53.795854 24522 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.832686 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:53.833786 24587 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:53.759243 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67134.7us
I20260709 13:10:53.836000 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 787) took 2166 ms. Trace:
I20260709 13:10:53.836395 19300 rpcz_store.cc:276] 0709 13:10:51.669986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.332455 (+662469us) service_pool.cc:224] Handling call
0709 13:10:52.332841 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.703638 (+1370797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.835777 (+132139us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001bf654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:53.835933 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3150742400}
I20260709 13:10:53.836930 19265 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:53.759791 24528 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:53.838065 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:53.838656 19901 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:53.839015 24528 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.839594 24527 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:53.796571 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:53.793748 24512 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:53.842706 19372 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:53.811653 19371 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:53.812273 19292 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:53.814970 24500 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:53.841816 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:53.816075 24608 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:53.846592 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:53.821870 24545 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:53.832453 19895 raft_consensus.cc:2368] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
W20260709 13:10:53.840971 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44505.7us
I20260709 13:10:53.843578 19292 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:53.844990 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.845016 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:53.796241 19218 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.006599 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.907510 24528 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:53.855620 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:54.011852 19217 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:53.856298 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:54.012481 19222 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.926205 24624 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:10:53.859035 19903 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:53.862196 19291 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:54.014896 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:53.861231 19296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2120) took 1942 ms (client timeout 2044 ms). Trace:
I20260709 13:10:53.947140 19372 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:53.865507 24498 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:10:53.845608 24500 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:53.845712 24337 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:10:53.945533 24480 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.905853 19300 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:53.849767 24502 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 13:10:53.975318 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.949177 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.059338 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:54.059630 19368 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:53.854322 24522 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.830474 24017 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:53.903738 19900 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:54.061792 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:53.851414 24608 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:53.884186 19898 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:53.879643 24471 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:53.906311 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:54.064589 19897 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:10:53.905882 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:53.914490 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.904584 19899 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:10:54.066098 19899 pending_rounds.cc:85] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 11
I20260709 13:10:54.010318 24581 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:54.066336 19899 pending_rounds.cc:107] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:54.066612 19899 raft_consensus.cc:2889] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.834088 24535 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:53.907662 19902 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:53.910912 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.068702 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 158981us
I20260709 13:10:53.946501 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:53.950443 19370 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:53.958454 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:54.069955 19299 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:54.070346 19373 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:54.070948 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.916968 19374 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:53.961369 24199 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.976351 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:53.925520 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:53.906157 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56970.7us
I20260709 13:10:53.900740 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:54.075630 19901 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.995085 19298 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:54.076404 19222 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:10:53.913208 24219 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:53.999948 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:54.001396 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:53.849552 24473 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:10:53.907625 24355 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:10:53.950253 19365 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:54.011134 19894 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:53.979836 24531 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.015822 19296 rpcz_store.cc:269] 0709 13:10:51.919218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.037154 (+117936us) service_pool.cc:224] Handling call
0709 13:10:53.861002 (+1823848us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400346554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:53.861155 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3568261888}
I20260709 13:10:54.022080 19369 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:54.023330 19218 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:54.087648 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:54.024295 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.088801 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.026607 24567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1668ce4cb86e4e9daf99a53a2be8a396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:54.027825 24427 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:54.002429 24539 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.035391 24434 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.091298 19373 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:53.942739 24512 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:10:54.095299 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:53.981304 24603 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:54.059983 19895 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.079159 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:54.082868 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 81540.5us
I20260709 13:10:54.087934 19218 pending_rounds.cc:85] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 10
I20260709 13:10:53.908309 24545 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:54.092329 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 166905us
I20260709 13:10:54.109124 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.110277 19299 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
I20260709 13:10:54.111200 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:54.111572 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 130477us
I20260709 13:10:54.111819 19218 pending_rounds.cc:107] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:54.112174 19218 raft_consensus.cc:2889] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.112344 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:54.039812 24587 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:54.097477 19291 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:54.095043 24537 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.081833 24471 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:54.116549 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.061223 24480 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.119123 19297 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:54.116964 19901 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:54.121912 24624 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:54.092155 24535 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:54.146073 24535 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:54.146955 24535 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.148449 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.149302 19299 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:54.092389 24219 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:54.152634 19903 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 7.
I20260709 13:10:54.125334 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:54.145352 24434 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:54.149039 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:54.144719 24471 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.105242 24500 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.084656 24612 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:54.105368 24539 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.104732 24473 consensus_queue.cc:1243] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:54.086398 24533 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:10:54.151491 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 146393us
I20260709 13:10:54.179986 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:54.181560 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:54.181715 19901 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:54.093032 24355 consensus_queue.cc:1243] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:54.185515 24527 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:10:54.183533 24624 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:54.188679 24512 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.189229 24512 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.191550 24512 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.191728 19292 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.193008 19292 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.095577 24531 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.194967 24531 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:54.196276 24122 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:54.082357 24199 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.200969 24199 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:54.201545 19367 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.157559 19372 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:54.092510 24581 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:54.205857 24608 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.205744 24581 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.207183 24608 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.173455 19895 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:54.114324 24603 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.171887 24209 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.209224 19171 auto_rebalancer.cc:629] Failed to schedule move for tablet d8f20bf866b6473ca02552904ffcbe5a: Illegal state: Replica 56df67425e6f45d3b2b42441e3c143ba is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:54.209175 24209 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.210554 24603 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.162390 24436 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:54.211297 24209 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:54.211552 24436 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.212141 24436 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:54.212991 24545 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.211323 24537 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.216907 24480 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.177711 24017 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.217682 24017 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.218043 24017 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.192641 24219 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.087630 24498 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:54.174225 24612 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:54.224234 24612 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.225378 24612 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:54.234751 19367 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:54.246869 19292 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
W20260709 13:10:54.249607 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 137355us
I20260709 13:10:54.225926 24522 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:54.266454 24520 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:54.267225 24520 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:54.230631 24500 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:54.268342 24520 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.270566 24520 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:54.184445 24510 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:10:54.254259 24502 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:54.280702 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 205762us
W20260709 13:10:54.281621 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 98999.5us
I20260709 13:10:54.283550 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:54.289005 19366 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:54.292050 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.292279 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.278401 24522 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:54.264106 24603 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:10:54.292764 19368 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:54.287477 24209 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:54.302860 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:54.294282 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 146556us
I20260709 13:10:54.280473 24502 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:10:54.293640 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 157685us
I20260709 13:10:54.292908 19373 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:54.300632 19372 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
W20260709 13:10:54.297333 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 186191us
I20260709 13:10:54.303682 19365 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.052078 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.307839 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:54.314821 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.321450 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:54.325179 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.327194 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:54.334964 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.335789 19370 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:10:54.336484 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49112.1us
I20260709 13:10:54.338289 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:54.340641 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.341250 19371 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:54.342042 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.342672 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.343200 19374 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:54.327158 24209 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:54.342720 19371 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17.
I20260709 13:10:54.343221 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:54.331532 24545 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.348762 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.349000 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.349610 19369 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:10:54.346029 24502 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.353827 19365 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
W20260709 13:10:54.353760 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47146.1us
I20260709 13:10:54.356215 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.357000 19365 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:10:54.361768 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:54.343640 24480 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:54.363143 24545 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:54.379377 19371 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:54.362599 24051 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:54.381120 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:54.377621 24471 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:54.382766 19372 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:10:54.362565 24502 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.385799 19372 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:54.332012 24517 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:54.384305 24471 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.392606 24337 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:54.393237 24528 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:54.362053 24651 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:54.384127 24051 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.404525 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.406373 19372 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:54.402578 24603 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.410806 24603 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:54.417899 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.394335 24337 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.390091 24538 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.392653 24471 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.348492 24522 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.389596 24427 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:10:54.416926 24051 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:54.442611 24654 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:10:54.443620 24533 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:54.446584 24539 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:54.397118 24209 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.414117 24603 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.439633 24538 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.453205 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.415179 24531 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:54.458101 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 84078.4us
W20260709 13:10:54.439877 24646 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:10:54.480311 19221 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:54.481763 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.482753 19365 raft_consensus.cc:2368] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:54.507066 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:54.510818 19222 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:54.508180 19218 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:54.509541 19372 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:54.460711 24533 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:54.520551 19222 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:54.520594 19366 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:54.513635 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 151947us
I20260709 13:10:54.580569 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.581270 19374 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:54.582652 24645 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:54.580978 24662 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:10:54.585017 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:54.522126 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 137475us
I20260709 13:10:54.586289 24648 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:54.587265 24471 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:54.588088 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.580902 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.588737 24219 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:54.580574 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.589561 24539 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:54.590086 19371 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:54.590404 24668 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:54.591066 24668 consensus_queue.cc:1243] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:54.592020 24538 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:54.580787 24666 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:10:54.594978 24567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37382 (request call id 847) took 2819 ms. Trace:
I20260709 13:10:54.595396 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.528604 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:54.596128 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.596230 19299 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:10:54.596901 19292 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 8: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:54.597152 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:54.598096 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:54.598510 24661 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:54.598603 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.599436 19299 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:54.599855 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.576272 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:54.577736 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.601291 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:54.597895 19300 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:54.585429 24662 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:54.597709 19291 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:54.521788 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:54.573137 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 234891us
W20260709 13:10:54.572366 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.608800 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.640910 19291 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:54.612123 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:54.643625 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:54.646065 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.644348 19224 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:54.613188 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:54.652448 19223 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:10:54.653503 19223 pending_rounds.cc:85] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:10:54.653793 19223 pending_rounds.cc:107] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:10:54.654036 19223 raft_consensus.cc:2889] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.617177 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:54.576196 24649 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.666131 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:54.666987 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.483796 24531 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.640652 24532 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.611122 24662 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:54.676859 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.691380 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:54.692242 19217 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:54.684911 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:54.686690 19895 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:10:54.698444 19895 pending_rounds.cc:85] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 11
I20260709 13:10:54.698843 19895 pending_rounds.cc:107] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:54.699174 19895 raft_consensus.cc:2889] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.655579 24648 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.611269 24500 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:10:54.645161 24473 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:54.681051 24502 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.711508 24655 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:10:54.703294 24645 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:54.684311 24649 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:54.713927 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48419.3us
I20260709 13:10:54.742708 19297 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:54.743723 24649 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.671795 24541 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 13:10:54.671415 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54343us
I20260709 13:10:54.713280 19372 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:10:54.595467 24567 rpcz_store.cc:276] 0709 13:10:51.775753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.778978 (+  3225us) service_pool.cc:224] Handling call
0709 13:10:52.563342 (+784364us) ts_tablet_manager.cc:934] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
0709 13:10:53.909594 (+1346252us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:54.241512 (+331918us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:54.241640 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:54.594120 (+352480us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:54.594488 (+   368us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:54.594819 (+   331us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:54.594883 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44951,"tablet-copy.queue_time_us":589335,"thread_start_us":461486,"threads_started":2}
I20260709 13:10:54.745864 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:54.746495 24567 tablet_copy_client.cc:806] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:54.747079 24567 tablet_copy_client.cc:670] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:54.698515 24532 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.714007 24122 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:54.699025 24539 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:10:54.756743 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 143777us
I20260709 13:10:54.763293 19337 leader_election.cc:400] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:10:54.763638 19337 leader_election.cc:403] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:54.764739 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:54.765039 24522 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:10:54.765560 24199 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:54.782475 19191 leader_election.cc:400] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17.
I20260709 13:10:54.782886 19191 leader_election.cc:403] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:54.779505 24434 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.784365 24434 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.786638 24434 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:54.787587 24660 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:10:54.790896 19216 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:54.794478 24473 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.795012 24473 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:54.795383 24473 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.801183 24531 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:54.766924 24662 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.802054 24662 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.805018 24122 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.805212 24471 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:54.805604 24122 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:54.677295 24533 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:54.749961 24498 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:54.813908 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.833562 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:54.807911 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:54.838433 19894 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:54.839157 24512 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:54.839736 24512 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:54.771898 24612 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.008s
I20260709 13:10:54.842563 24512 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:54.844115 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61791.7us
W20260709 13:10:54.846685 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.844728 24512 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:54.770790 24502 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:54.846297 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:54.898903 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52689.2us
I20260709 13:10:54.899596 19895 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:54.899642 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:54.900682 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:54.901295 24531 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:54.903781 24603 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:54.904253 24603 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:54.904726 24603 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:54.794502 24670 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:10:54.783414 24500 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.162s
I20260709 13:10:54.898602 24502 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:54.962699 24531 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:54.960966 24498 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:10:55.016207 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 331375us
I20260709 13:10:55.059027 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:10:54.976301 24679 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.109073 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 205937us
I20260709 13:10:55.078673 24531 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:55.122574 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.223953 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.259872 24645 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:55.260759 24531 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:55.260519 24645 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:55.262189 24541 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.262665 24645 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:55.262663 24541 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:55.264456 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:55.264947 24541 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:55.265455 24679 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:55.267771 24679 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:55.271580 24532 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:55.272344 24532 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:55.272725 24122 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:55.273293 24532 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:55.274252 24532 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:55.274605 24532 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:55.274991 24532 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:55.277220 24209 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.277768 24209 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:55.278309 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:55.279989 24209 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:55.281050 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:55.281656 19902 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:10:55.283310 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:55.284083 24517 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:55.284466 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:55.284655 24517 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:55.286365 24612 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.286602 24517 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:55.297164 19225 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.070s
W20260709 13:10:55.297771 19225 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.008s	sys 0.070s
I20260709 13:10:55.340762 19370 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:10:55.352686 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2547) took 1392 ms. Trace:
I20260709 13:10:55.332293 24651 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:55.356578 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:55.361145 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:55.362919 19897 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:55.353158 19367 rpcz_store.cc:276] 0709 13:10:53.948398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.976005 (+ 27607us) service_pool.cc:224] Handling call
0709 13:10:55.340357 (+1364352us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400189a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:55.340505 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296082176}
I20260709 13:10:55.368098 19897 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:55.373028 19365 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:10:55.373286 19902 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:55.376849 19371 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:55.378842 19367 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:55.350839 24427 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.111912 24502 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:55.359494 19266 connection.cc:256] RPC call timeout handler was delayed by -1.5406091619998961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:10:55.365329 24436 consensus_meta.cc:287] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.153s	user 0.013s	sys 0.004s
I20260709 13:10:55.371340 24651 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:55.384969 24017 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.166s	user 0.010s	sys 0.008s
I20260709 13:10:55.377061 19365 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:10:55.397306 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:55.370936 24655 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.401870 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:55.402211 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:55.370313 24199 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:55.385033 24531 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:55.400141 24677 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 13:10:55.421434 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:55.444396 19894 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.004s
I20260709 13:10:55.444967 19894 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:10:55.445307 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.450990 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:55.335368 24498 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.406505 24651 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:55.457706 19171 auto_rebalancer.cc:629] Failed to schedule move for tablet d825739f94b747959f93597edca9200a: Illegal state: Replica 0316f581086f40549fea44a772fc2dec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:10:55.453339 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:55.463274 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:55.477291 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 212911us
I20260709 13:10:55.509330 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:55.405393 24696 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:55.513370 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:55.514658 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61445.7us
W20260709 13:10:55.515050 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.460299 24662 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
I20260709 13:10:55.429241 24624 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:55.445422 24502 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.553483 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:55.534233 24686 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:55.540479 24500 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:55.540912 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:55.399905 24427 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.406404 24436 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:55.407413 24017 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.429042 24199 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.512310 24685 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.554749 19191 leader_election.cc:400] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
W20260709 13:10:55.660894 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 106942us
I20260709 13:10:55.533238 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:55.624264 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.541347 24683 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.576200 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:55.541174 24645 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:10:55.673401 19294 raft_consensus.cc:2410] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:55.429524 24655 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.529533 24696 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:55.445113 24531 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:55.688658 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 155517us
I20260709 13:10:55.532091 24644 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:55.535727 24539 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.554160 19371 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
W20260709 13:10:55.617491 24682 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.525s	user 0.000s	sys 0.001s
I20260709 13:10:55.658174 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:55.661628 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:55.620906 24713 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:55.596364 24712 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
W20260709 13:10:55.668720 19368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2150) took 1367 ms (client timeout 1540 ms). Trace:
I20260709 13:10:55.683382 19292 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:55.683430 19373 raft_consensus.cc:2368] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9.
I20260709 13:10:55.704459 19293 raft_consensus.cc:2376] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13. Re-sending same reply.
W20260709 13:10:55.707628 19368 rpcz_store.cc:269] 0709 13:10:54.301802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.542836 (+1241034us) service_pool.cc:224] Handling call
0709 13:10:55.668643 (+125807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.710649 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:55.596447 24624 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:55.685480 19903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.014s	sys 0.032s
W20260709 13:10:55.714768 19903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.015s	sys 0.032s
I20260709 13:10:55.714931 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2773) took 1237 ms. Trace:
I20260709 13:10:55.687532 24385 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:55.711836 19369 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:10:55.712839 19368 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:55.718755 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:55.717018 19223 rpcz_store.cc:276] 0709 13:10:54.477879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.484008 (+  6129us) service_pool.cc:224] Handling call
0709 13:10:54.509323 (+ 25315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.654450 (+145127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.714682 (+1060232us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000181d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:55.714861 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328288512}
I20260709 13:10:55.535326 24219 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:55.667753 24685 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.672075 24683 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.684671 24699 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:55.707087 24679 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.714902 24700 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.727986 19293 raft_consensus.cc:1217] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Deduplicated request from leader. Original: 11.7->[12.8-15.10]   Dedup: 14.9->[15.10-15.10]
I20260709 13:10:55.736878 19293 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: [12.8-15.10]
I20260709 13:10:55.705775 24644 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:55.715762 24500 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:55.688026 24701 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:10:55.743384 19340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.530s (SENT) [suppressed 22 similar messages]
I20260709 13:10:55.715349 24539 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.868296 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 871) took 1264 ms. Trace:
W20260709 13:10:55.870211 24704 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:10:55.884974 24017 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:55.885783 24710 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:10:55.886314 24473 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.091s	user 0.009s	sys 0.002s
I20260709 13:10:55.724395 24385 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:55.875146 24705 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:10:55.875345 24199 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:55.863709 24713 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:55.730224 24696 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:55.740046 24679 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:55.884176 24698 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:10:55.870786 24655 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:55.872661 19901 rpcz_store.cc:276] 0709 13:10:54.604366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.604866 (+   500us) service_pool.cc:224] Handling call
0709 13:10:54.655752 (+ 50886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.656066 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.656097 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.675433 (+ 19336us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.847633 (+172200us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:54.847700 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.847790 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.747813 (+900023us) raft_consensus.cc:1685] finished
0709 13:10:55.747841 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.868221 (+120380us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25458,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5564,"thread_start_us":124732,"threads_started":1,"wal-append.queue_time_us":263711}
W20260709 13:10:55.880465 24703 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:10:55.870266 24436 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:56.093204 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 349817us
I20260709 13:10:55.886721 24473 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.096575 19225 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:56.070282 24713 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:56.062554 24712 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:56.143935 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 482338us
W20260709 13:10:56.129774 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.004s	sys 0.043s
I20260709 13:10:56.172127 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.189109 19220 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:55.742882 24700 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.168298 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:56.193960 19191 connection.cc:256] RPC call timeout handler was delayed by -1.4265032289999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:10:56.194591 19191 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.008s (SENT)
W20260709 13:10:56.195082 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.004s	sys 0.043s
I20260709 13:10:56.127810 24696 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:56.214648 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2784) took 1562 ms. Trace:
W20260709 13:10:56.230670 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.254997 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:56.177372 24517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.020s	sys 0.015s
W20260709 13:10:56.240000 24603 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.335s	user 0.005s	sys 0.008s
I20260709 13:10:56.243255 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2156) took 1902 ms. Trace:
I20260709 13:10:56.245266 24679 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:56.245968 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.246488 24385 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:56.099562 24644 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.247702 24668 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:56.250136 24502 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
W20260709 13:10:56.178555 24532 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.903s	user 0.008s	sys 0.007s
I20260709 13:10:56.170202 24713 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:56.268451 19374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.019s	sys 0.054s
W20260709 13:10:56.299407 19374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.019s	sys 0.055s
W20260709 13:10:56.268672 19365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.040s	sys 0.072s
W20260709 13:10:56.299922 19365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.040s	sys 0.072s
I20260709 13:10:56.185808 24427 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.233532 24721 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.301787 24717 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:10:56.301962 24473 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:56.303208 24724 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:10:56.303593 24512 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.395s	user 0.011s	sys 0.000s
I20260709 13:10:56.265120 24531 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:56.306828 24651 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.778s	user 0.002s	sys 0.006s
I20260709 13:10:56.304040 24512 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17.
I20260709 13:10:56.307245 24651 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.312384 24730 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.313022 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.312903 24730 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.315078 24645 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:56.299108 24502 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:56.315606 24645 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.315842 24502 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.317590 24645 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.317677 24502 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.318172 24502 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:56.318774 19217 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:56.318629 24502 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.319208 24612 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:56.319649 24612 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:56.274848 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 799043us
I20260709 13:10:56.265098 19221 rpcz_store.cc:276] 0709 13:10:54.652362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.803731 (+151369us) service_pool.cc:224] Handling call
0709 13:10:54.804021 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.804229 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:55.407850 (+603621us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.722919 (+315069us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.214157 (+491238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.214234 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:56.214300 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.214395 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.214575 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56852,"prepare.queue_time_us":224514,"prepare.run_cpu_time_us":1290,"prepare.run_wall_time_us":18459,"raft.queue_time_us":265809,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":205726,"thread_start_us":1244385,"threads_started":4,"wal-append.queue_time_us":299735}
I20260709 13:10:56.270292 19370 rpcz_store.cc:276] 0709 13:10:54.341145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.343549 (+  2404us) service_pool.cc:224] Handling call
0709 13:10:55.340492 (+996943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.350203 (+  9711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.243028 (+892825us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400189a50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:56.243188 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292022144}
I20260709 13:10:56.198508 24701 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:56.276451 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:56.296540 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 995) took 1393 ms. Trace:
I20260709 13:10:56.252607 19115 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 11, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.170248 24720 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:56.271974 24517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.021s	sys 0.016s
I20260709 13:10:56.314987 24730 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.188408 24712 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.335942 19293 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:56.335991 19895 rpcz_store.cc:276] 0709 13:10:54.903391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.903513 (+   122us) service_pool.cc:224] Handling call
0709 13:10:54.903861 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:54.962208 (+ 58347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.962244 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:54.962900 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.336561 (+373661us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:55.513175 (+176614us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.536122 (+ 22947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.536241 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.296254 (+760013us) raft_consensus.cc:1685] finished
0709 13:10:56.296275 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.296452 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80536,"prepare.queue_time_us":335493,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":86288,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":25504,"thread_start_us":488679,"threads_started":2,"wal-append.queue_time_us":493583}
I20260709 13:10:56.286464 24603 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:56.429015 24718 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:10:56.289109 24385 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:10:56.429388 24711 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.670s	user 0.000s	sys 0.001s
I20260709 13:10:56.430148 24651 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.430590 24502 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:56.431770 24051 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.961s	user 0.008s	sys 0.013s
I20260709 13:10:56.286830 24668 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:56.410207 24512 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.335052 24721 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.475430 24624 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:56.326787 24532 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.496593 24685 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:56.516278 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.522922 19191 connection.cc:256] RPC call timeout handler was delayed by -1.18014390299993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:10:56.523470 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1452557100000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:10:56.523509 24712 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:56.523844 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1319027209999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:10:56.474848 24720 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:56.524274 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1052032289999261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:10:56.524760 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0495612579999261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 13:10:56.524809 24730 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:56.525138 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0021993079999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2604s for a response
I20260709 13:10:56.525353 24730 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.526075 24720 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:56.502313 24385 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.527779 24473 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:56.528501 24732 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:10:56.518128 24539 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:56.529192 24385 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.524224 24502 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:56.530055 19220 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:56.528384 24473 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.530527 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2565) took 1149 ms. Trace:
I20260709 13:10:56.582747 19371 rpcz_store.cc:276] 0709 13:10:55.380928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.694824 (+313896us) service_pool.cc:224] Handling call
0709 13:10:55.705199 (+ 10375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.705425 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.705453 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.719037 (+ 13584us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.231800 (+512763us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:56.231855 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.231949 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.530315 (+298366us) raft_consensus.cc:1685] finished
0709 13:10:56.530335 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.530459 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":489683,"threads_started":1,"wal-append.queue_time_us":795055}
I20260709 13:10:56.537863 19293 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:10:56.530524 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:56.499372 24683 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.589761 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.590673 19293 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:56.592185 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:56.595257 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.596282 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.585858 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2574) took 1190 ms. Trace:
I20260709 13:10:56.608965 19371 rpcz_store.cc:276] 0709 13:10:55.395155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.584509 (+1189354us) service_pool.cc:224] Handling call
0709 13:10:56.585196 (+   687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.585421 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.585457 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.585511 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.585575 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.585647 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.585789 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:56.614038 19868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.021s	sys 0.101s
W20260709 13:10:56.614468 19868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.021s	sys 0.101s
I20260709 13:10:56.615840 24730 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.529830 24701 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.620666 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 90199.7us
I20260709 13:10:56.513613 24051 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.626864 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:56.518554 24512 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:56.627228 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.008s	sys 0.015s
I20260709 13:10:56.631146 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:56.615767 24385 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:10:56.633220 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.008s	sys 0.015s
I20260709 13:10:56.619638 24726 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.634279 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2191) took 2039 ms. Trace:
I20260709 13:10:56.638586 19297 rpcz_store.cc:276] 0709 13:10:54.595333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.595448 (+   115us) service_pool.cc:224] Handling call
0709 13:10:54.595718 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.743083 (+147365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.634055 (+1890972us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002e9854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:56.634223 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337332480}
W20260709 13:10:56.641243 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.663168 19295 raft_consensus.cc:2368] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:56.631706 24730 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.614594 24685 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:10:56.631831 24739 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.616114 24502 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.673835 24747 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:56.681332 24512 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.682915 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.662197 24385 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.684620 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2151) took 2382 ms. Trace:
I20260709 13:10:56.685177 24603 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.661998 24726 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.622598 24668 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.687661 24502 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.688194 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2150) took 1286 ms. Trace:
I20260709 13:10:56.688500 19293 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:56.706101 19293 pending_rounds.cc:85] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 6
I20260709 13:10:56.706671 19293 pending_rounds.cc:107] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:56.705905 19294 rpcz_store.cc:276] 0709 13:10:55.401815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.401938 (+   123us) service_pool.cc:224] Handling call
0709 13:10:56.687967 (+1286029us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002b75d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:56.688117 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612948736}
I20260709 13:10:56.706966 19293 raft_consensus.cc:2889] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.672910 24532 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.692502 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.695140 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.630285 24701 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:56.702848 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.671092 24700 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:56.728545 24693 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.323s	user 0.003s	sys 0.027s
I20260709 13:10:56.728888 24531 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:56.729516 24531 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.730269 24520 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:56.730647 24736 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:56.730815 24520 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.731348 24736 consensus_queue.cc:1243] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:10:56.730006 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 403309us
I20260709 13:10:56.732385 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:56.732813 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 477886us
I20260709 13:10:56.688975 24721 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.732837 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:56.669458 24730 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.693923 24739 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:56.711684 24691 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.282s	user 0.000s	sys 0.012s
I20260709 13:10:56.694092 24747 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.713376 19217 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:56.752072 19224 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:56.752148 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:56.753186 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:56.754462 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:56.756031 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:56.714721 19221 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:56.761721 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:56.762308 19896 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:56.695827 19366 rpcz_store.cc:276] 0709 13:10:54.302155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.401373 (+ 99218us) service_pool.cc:224] Handling call
0709 13:10:54.401754 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.579491 (+177737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.684317 (+2104826us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400297a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:56.684540 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272905472}
I20260709 13:10:56.719827 24473 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.721529 24385 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.723044 24668 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:56.784595 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2200) took 2129 ms. Trace:
I20260709 13:10:56.785089 19291 rpcz_store.cc:276] 0709 13:10:54.655675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.656288 (+   613us) service_pool.cc:224] Handling call
0709 13:10:54.656578 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.735619 (+ 79041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.735664 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.749850 (+ 14186us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.287307 (+537457us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:55.287345 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.776131 (+1488786us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b5400049cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:56.784240 (+  8109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.784296 (+    56us) raft_consensus.cc:1685] finished
0709 13:10:56.784310 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.784518 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44704,"raft.queue_time_us":26363,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9009,"spinlock_wait_cycles":154408704,"thread_start_us":252923,"threads_started":1,"wal-append.queue_time_us":634375,"wal-append.run_cpu_time_us":2159,"wal-append.run_wall_time_us":1204731}
W20260709 13:10:56.724669 24742 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:10:56.725124 24655 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:56.789301 24655 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.790026 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:56.790638 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2570) took 1408 ms. Trace:
I20260709 13:10:56.725601 24051 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.726436 24436 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.792649 24436 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.794654 24612 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.795485 24532 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.796238 24532 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.797159 24721 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:56.797643 24721 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.798713 24532 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.799360 24532 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.799526 24721 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.800823 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:56.727273 24726 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.803761 24385 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:56.729960 24531 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:56.805469 24694 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.341s	user 0.002s	sys 0.014s
I20260709 13:10:56.805814 24531 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:56.708282 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77220us
I20260709 13:10:56.739599 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2776) took 2253 ms. Trace:
I20260709 13:10:56.807302 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:56.806463 19219 rpcz_store.cc:276] 0709 13:10:54.478812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.478937 (+   125us) service_pool.cc:224] Handling call
0709 13:10:54.614542 (+135605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.836537 (+221995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.836568 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.837107 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.261706 (+424599us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:55.261750 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.685030 (+1423280us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540039b7d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:56.685078 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.727987 (+ 42909us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:56.732220 (+  4233us) raft_consensus.cc:1685] finished
0709 13:10:56.732240 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.732368 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1965,"raft.queue_time_us":7143,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":803338880,"thread_start_us":273756,"threads_started":1,"wal-append.queue_time_us":522385}
I20260709 13:10:56.795650 24502 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.808557 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.809259 19191 leader_election.cc:400] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:56.808612 24502 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.809546 19191 leader_election.cc:403] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:56.740402 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2560) took 1368 ms. Trace:
W20260709 13:10:56.810423 24740 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:56.810226 19374 rpcz_store.cc:276] 0709 13:10:55.372063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.374340 (+  2277us) service_pool.cc:224] Handling call
0709 13:10:55.374716 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.393425 (+ 18709us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:55.509178 (+115753us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.299733 (+790555us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.300228 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.300364 (+   136us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:56.618433 (+318069us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.724729 (+106296us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b1800462fa0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8dbd8958f 00007fe8d4dc8571 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd
0709 13:10:56.732214 (+  7485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.732284 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.740200 (+  7916us) raft_consensus.cc:1685] finished
0709 13:10:56.740221 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.740352 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161702,"prepare.queue_time_us":519700,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":19308,"raft.queue_time_us":532886,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":15329,"spinlock_wait_cycles":21583616,"thread_start_us":1126178,"threads_started":4,"wal-append.queue_time_us":603159}
I20260709 13:10:56.812392 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.813925 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.814584 19225 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:10:56.744621 24701 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.744758 24725 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.815523 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.815819 24725 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.816349 24502 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.809511 19219 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:10:56.817916 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.818078 24725 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.745447 19223 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:56.818598 24533 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.818970 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:56.750118 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.770752 24730 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.819999 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:56.820420 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.820658 19223 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:56.771147 24735 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:56.768041 24747 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:56.821491 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.822222 19223 raft_consensus.cc:2410] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:10:56.822881 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.823372 19223 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:10:56.772336 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.819983 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.824463 19217 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:56.825079 19219 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:56.825327 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:56.772780 19372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2174) took 2129 ms (client timeout 1540 ms). Trace:
I20260709 13:10:56.825923 24655 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.826104 19217 raft_consensus.cc:2410] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:10:56.826267 19372 rpcz_store.cc:269] 0709 13:10:54.643269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.643393 (+   124us) service_pool.cc:224] Handling call
0709 13:10:56.772556 (+2129163us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b540012e3d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:56.772698 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157737216}
I20260709 13:10:56.827010 19219 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:56.827553 19217 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:56.781056 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2202) took 2013 ms. Trace:
I20260709 13:10:56.824056 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:56.781148 24520 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:56.763242 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:56.828850 19223 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:10:56.827605 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:56.829836 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:56.830058 19223 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:56.782910 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:56.830242 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:56.790916 19896 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
W20260709 13:10:56.825978 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 910) took 2511 ms (client timeout 2095 ms). Trace:
W20260709 13:10:56.831465 19373 rpcz_store.cc:269] 0709 13:10:54.314349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.314530 (+   181us) service_pool.cc:224] Handling call
0709 13:10:56.825804 (+2511274us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400424ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:56.825918 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134257536}
I20260709 13:10:56.828311 19300 rpcz_store.cc:276] 0709 13:10:54.768131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.779179 (+ 11048us) service_pool.cc:224] Handling call
0709 13:10:54.779565 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.799529 (+ 19964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.799567 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.800066 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.968260 (+168194us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:54.968335 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.968401 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.711061 (+1742660us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:56.780788 (+ 69727us) raft_consensus.cc:1685] finished
0709 13:10:56.780811 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.780996 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19500,"raft.queue_time_us":20730,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":212318464,"thread_start_us":167723,"threads_started":1,"wal-append.queue_time_us":550911}
I20260709 13:10:56.832716 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:56.833067 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.833351 19373 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
W20260709 13:10:56.773808 24690 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.218s	user 0.012s	sys 0.009s
I20260709 13:10:56.770933 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.791045 19365 rpcz_store.cc:276] 0709 13:10:55.382253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.722691 (+340438us) service_pool.cc:224] Handling call
0709 13:10:55.722975 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.300440 (+577465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.300468 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.300913 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.611205 (+310292us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.611254 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.611338 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.790421 (+179083us) raft_consensus.cc:1685] finished
0709 13:10:56.790444 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.790579 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532101,"raft.queue_time_us":435930,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":15583,"thread_start_us":883520,"threads_started":2,"wal-append.queue_time_us":363223}
I20260709 13:10:56.824465 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.830940 19372 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:56.834986 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:56.830376 19366 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.800292 24713 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.827931 24436 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:56.844869 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:56.934543 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.960193 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:56.909380 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:56.833834 19300 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
W20260709 13:10:56.913836 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 157899us
W20260709 13:10:56.968519 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 198521us
I20260709 13:10:56.837105 19869 leader_election.cc:400] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9.
I20260709 13:10:56.987396 19869 leader_election.cc:403] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:56.907353 19220 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:10:57.025153 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.025370 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:10:57.025873 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 188945us
I20260709 13:10:57.026266 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:56.984687 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.837900 19225 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:10:56.961485 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:56.987308 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55121.9us
I20260709 13:10:56.985328 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:57.029918 19295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2149) took 1629 ms (client timeout 2044 ms). Trace:
W20260709 13:10:57.030318 19295 rpcz_store.cc:269] 0709 13:10:55.400965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.401645 (+   680us) service_pool.cc:224] Handling call
0709 13:10:57.029744 (+1628099us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400346554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.029865 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889195776}
I20260709 13:10:57.030716 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.945115 24735 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:57.034245 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.983705 19374 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:56.990525 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:56.796829 24612 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:56.982527 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:56.944914 24725 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.067741 24725 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.021407 19216 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:56.913915 24539 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:56.920960 24712 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:56.944990 24727 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.070921 24712 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:56.934988 24538 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.800097 24721 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.024091 19896 pending_rounds.cc:85] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 8
W20260709 13:10:56.873353 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.910782 24199 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:56.921388 24510 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.032496 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:56.899575 24726 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.071368 24712 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.074700 24510 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:56.915143 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:57.075804 19297 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
W20260709 13:10:56.957875 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 148706us
I20260709 13:10:56.921180 24749 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:10:56.911175 24665 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.921167 24644 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:57.042196 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.043602 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:57.044040 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:57.033547 24655 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.064270 19299 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:57.066896 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.023962 24624 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.092506 19300 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:57.092855 19298 raft_consensus.cc:606] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.093235 19298 raft_consensus.cc:614] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:56.935158 24671 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.075974 19896 pending_rounds.cc:107] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:10:57.075695 24721 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.021482 24527 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:10:57.079114 19365 raft_consensus.cc:1217] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-16.10]   Dedup: 11.7->[12.8-16.10]
I20260709 13:10:57.107419 19365 pending_rounds.cc:85] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 7
I20260709 13:10:57.107695 19365 pending_rounds.cc:107] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:10:57.107942 19365 raft_consensus.cc:2889] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.080142 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:57.076442 19373 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.036010 19900 raft_consensus.cc:2410] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:57.083702 24650 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9.
I20260709 13:10:57.028074 24662 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
W20260709 13:10:57.083511 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 418730us
I20260709 13:10:56.912458 24722 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
W20260709 13:10:57.088867 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44908.7us
I20260709 13:10:56.799937 24532 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:56.901434 24385 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.100780 19896 raft_consensus.cc:2889] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.121500 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.130658 19300 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:10:57.072395 24733 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.076406 19294 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.989770 24499 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:10:57.081954 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.110137 24720 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.091153 24665 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.116113 24545 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.117766 24721 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.099344 24199 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:57.118323 24539 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:57.099632 24500 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:57.129806 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49735.9us
I20260709 13:10:57.082677 24700 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:57.071552 24538 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.091131 24726 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:57.105829 24671 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.099457 24644 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.136263 19373 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:10:57.161150 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:57.179375 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:57.164865 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.172529 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:57.177469 19294 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:57.174561 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.181725 19222 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:10:57.180492 19225 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:10:57.105199 24624 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:10:57.137830 24535 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:57.158562 24750 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.168017 24567 tablet_copy_client.cc:538] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:57.155949 19374 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:10:57.183362 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:57.184619 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.187228 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.187419 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:57.244736 19374 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:57.156999 24539 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:57.238910 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 326021us
I20260709 13:10:57.168242 24520 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:57.244424 19291 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 8.
W20260709 13:10:57.240381 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 196871us
I20260709 13:10:57.244488 19217 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:57.182458 19294 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:57.243957 19300 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
W20260709 13:10:57.256369 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73070.1us
I20260709 13:10:57.259438 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.186291 24612 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:57.183727 24721 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.263759 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:57.265127 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 97329.7us
I20260709 13:10:57.266593 19222 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:57.149288 24733 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.176191 24500 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.238682 24696 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.247350 24655 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:57.270109 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 228000us
I20260709 13:10:57.252316 24539 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.284775 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.262248 24725 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.268102 24730 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.268355 24650 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.277487 24510 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.289427 24427 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:57.278232 24612 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:57.277752 24713 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.157312 24735 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.294340 24696 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:57.324913 24753 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:10:57.331805 24538 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:57.333483 24624 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.268916 24199 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:57.338039 24758 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:10:57.308482 24427 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:57.340098 24733 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.341115 24427 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.342312 24644 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:57.342680 24427 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:57.343318 24754 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:10:57.344950 24665 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.297148 24655 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:57.333691 24668 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:10:57.305719 24650 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:57.364580 24759 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:10:57.365542 24612 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:57.354431 24747 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.005s
I20260709 13:10:57.377014 24712 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.379724 24712 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:57.372594 24747 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.381928 24747 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:57.432816 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 328286us
I20260709 13:10:57.433852 19218 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:57.433209 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.436355 19225 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:10:57.433213 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.436901 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:57.438581 19223 raft_consensus.cc:2410] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:57.442461 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.445330 19217 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:57.445761 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:57.460456 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 175629us
I20260709 13:10:57.461515 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2573) took 2071 ms. Trace:
I20260709 13:10:57.462922 19370 rpcz_store.cc:276] 0709 13:10:55.389991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.324003 (+934012us) service_pool.cc:224] Handling call
0709 13:10:56.325691 (+  1688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.728999 (+403308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.729032 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.729494 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.089462 (+359968us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:57.089516 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.089584 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.460819 (+371235us) raft_consensus.cc:1685] finished
0709 13:10:57.460860 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.461197 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402838,"raft.queue_time_us":404319,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":488704,"thread_start_us":359622,"threads_started":1,"wal-append.queue_time_us":389902}
I20260709 13:10:57.469218 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.474371 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.481812 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.478549 24782 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:10:57.484418 19370 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:57.490077 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:57.501021 24782 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:57.524263 24385 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.526660 24712 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.527392 24725 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:57.529554 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48247.4us
I20260709 13:10:57.530709 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:57.532433 24608 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.533707 24608 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.534984 24522 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.536828 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.538637 24650 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.539775 24541 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:57.540373 24541 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.540791 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.540902 24541 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:57.541354 19224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2227) took 2962 ms (client timeout 2941 ms). Trace:
W20260709 13:10:57.541896 19224 rpcz_store.cc:269] 0709 13:10:54.578861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.670819 (+ 91958us) service_pool.cc:224] Handling call
0709 13:10:56.682760 (+2011941us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:10:57.540902 (+858142us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54000181d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.541130 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138480128}
W20260709 13:10:57.543797 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.544543 24689 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:57.548658 24765 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:57.549304 24765 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:57.549391 19370 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:57.539358 24665 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:57.551244 24765 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:57.554706 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77357.1us
I20260709 13:10:57.558794 19370 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:57.536010 24522 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:57.570020 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2579) took 2117 ms. Trace:
W20260709 13:10:57.602329 19366 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.013s
I20260709 13:10:57.602540 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.602845 19366 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:57.603550 19370 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:10:57.604187 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.605209 19366 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:57.612409 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:57.559662 24655 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:57.612654 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2212) took 1340 ms. Trace:
W20260709 13:10:57.562438 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 306085us
I20260709 13:10:57.616420 24733 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.618602 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2569) took 2236 ms. Trace:
I20260709 13:10:57.573220 24385 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
W20260709 13:10:57.622509 19369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2577) took 2214 ms (client timeout 1521 ms). Trace:
W20260709 13:10:57.622993 19369 rpcz_store.cc:269] 0709 13:10:55.407991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.462765 (+ 54774us) service_pool.cc:224] Handling call
0709 13:10:57.622159 (+2159394us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54004268d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.622323 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466175360}
I20260709 13:10:57.624900 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2572) took 2242 ms. Trace:
I20260709 13:10:57.625988 24735 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.626511 19374 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:57.629381 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:57.632867 24533 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:57.634045 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53565.8us
I20260709 13:10:57.600679 24522 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:57.561043 24608 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.630901 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:57.614991 19293 rpcz_store.cc:276] 0709 13:10:56.272522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.600858 (+328336us) service_pool.cc:224] Handling call
0709 13:10:56.688102 (+ 87244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.708412 (+ 20310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.612132 (+903720us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b54002b75d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.612400 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199817984}
I20260709 13:10:57.572472 24624 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.636790 24741 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.635502 24533 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.644708 24533 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.645009 24733 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.643518 24741 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.560554 24671 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.643885 24520 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.647975 24733 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.679222 24520 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:57.679486 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:57.656457 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.681289 24741 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.625313 19367 rpcz_store.cc:276] 0709 13:10:55.382806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.308669 (+925863us) service_pool.cc:224] Handling call
0709 13:10:56.685248 (+376579us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:56.752665 (+ 67417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.752700 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:56.753252 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:10:57.109504 (+356252us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:57.149349 (+ 39845us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.149600 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.149695 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.458184 (+308489us) raft_consensus.cc:1685] finished
0709 13:10:57.458233 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.624553 (+166320us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400297a50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.624733 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57290,"prepare.queue_time_us":63938,"raft.queue_time_us":73763,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":13766,"spinlock_wait_cycles":873876480,"thread_start_us":320993,"threads_started":1,"wal-append.queue_time_us":400654}
I20260709 13:10:57.681762 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.668540 24655 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.682548 19897 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 4.
I20260709 13:10:57.682909 24655 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.683408 24655 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.683682 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.648011 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:57.670476 24385 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.684875 19895 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:57.655614 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.686376 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.687003 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 47) took 2629 ms. Trace:
I20260709 13:10:57.652048 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:57.688957 19898 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.687455 19298 rpcz_store.cc:276] 0709 13:10:55.057744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.058897 (+  1153us) service_pool.cc:224] Handling call
0709 13:10:57.686609 (+2627712us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b54002e8e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.686763 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4644834176}
I20260709 13:10:57.659130 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:10:57.653414 19902 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:57.696111 24689 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.692874 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2576) took 2292 ms. Trace:
I20260709 13:10:57.696650 24689 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:57.697178 24689 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.696405 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2235) took 1006 ms. Trace:
I20260709 13:10:57.699508 19218 rpcz_store.cc:276] 0709 13:10:56.689934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.692285 (+  2351us) service_pool.cc:224] Handling call
0709 13:10:56.692663 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.434708 (+742045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.675977 (+241269us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b540039bcd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:57.696309 (+ 20332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703170304}
I20260709 13:10:57.670351 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.659618 24785 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:57.700706 24785 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.701077 24785 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.701663 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.702528 19902 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:57.703414 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.687587 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.619835 19368 rpcz_store.cc:276] 0709 13:10:55.381989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.721269 (+339280us) service_pool.cc:224] Handling call
0709 13:10:56.773082 (+1051813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.773285 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:56.773532 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.159033 (+385501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.159080 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:57.159127 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.159189 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.618184 (+458995us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540012e3d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.618384 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1503,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":4837,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":1449,"spinlock_wait_cycles":2418201472,"thread_start_us":385196,"threads_started":1,"wal-append.queue_time_us":498337}
W20260709 13:10:57.650908 24695 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 2.190s	user 0.008s	sys 0.026s
W20260709 13:10:57.678501 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.706038 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:57.665043 19115 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.707712 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:57.708561 24736 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:57.709095 24736 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.709493 24736 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.709774 24731 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.710258 24731 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.710704 24731 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.711251 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2205) took 2897 ms. Trace:
I20260709 13:10:57.711638 19296 rpcz_store.cc:276] 0709 13:10:54.813803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.813926 (+   123us) service_pool.cc:224] Handling call
0709 13:10:54.814317 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.814749 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.814788 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.815357 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.276766 (+461409us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:55.276824 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.276913 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.649715 (+2372802us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:57.710707 (+ 60992us) raft_consensus.cc:1685] finished
0709 13:10:57.710731 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.711050 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18339,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11821,"spinlock_wait_cycles":158753664,"thread_start_us":368199,"threads_started":1,"wal-append.queue_time_us":539042}
I20260709 13:10:57.713929 24700 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.708561 19902 raft_consensus.cc:2410] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:57.714560 24700 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.715101 24700 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:57.715718 24779 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
I20260709 13:10:57.701591 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.716490 24723 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:57.716974 19900 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:57.717314 24723 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.696986 19372 rpcz_store.cc:276] 0709 13:10:55.400908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.990920 (+1590012us) service_pool.cc:224] Handling call
0709 13:10:56.991262 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.072047 (+ 80785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.072094 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.072152 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:57.073151 (+   999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.692359 (+619208us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b5400297f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:57.692428 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.692689 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185198976}
I20260709 13:10:57.662029 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:57.722870 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61045.9us
I20260709 13:10:57.723305 24545 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:10:57.723935 24545 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.724303 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:10:57.704689 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45786us
I20260709 13:10:57.661098 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:57.707015 24385 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.719902 24723 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.732806 19898 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:57.637262 24522 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.740290 24735 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.739552 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:57.740875 24735 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.601718 19365 rpcz_store.cc:276] 0709 13:10:55.452674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.028442 (+1575768us) service_pool.cc:224] Handling call
0709 13:10:57.028827 (+   385us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:10:57.129770 (+100943us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:57.295745 (+165975us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.550256 (+254511us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:57.551371 (+  1115us) log.cc:844] Serialized 78 byte log entry
0709 13:10:57.551537 (+   166us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:57.551571 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.551707 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.554253 (+  2546us) raft_consensus.cc:1685] finished
0709 13:10:57.554274 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.569773 (+ 15499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71507,"prepare.queue_time_us":235895,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":33811,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":13057,"thread_start_us":176000,"threads_started":2,"wal-append.queue_time_us":86835}
W20260709 13:10:57.753708 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 141687us
I20260709 13:10:57.757805 24434 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.758361 24434 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.758414 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:57.758822 24434 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.761478 24385 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.762090 24385 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.762428 24385 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.762840 24385 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.766266 24539 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.768692 19373 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:57.771241 24721 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:57.772488 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48971.8us
I20260709 13:10:57.773705 24541 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.776321 24741 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:57.776861 19292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2196) took 3177 ms (client timeout 1530 ms). Trace:
I20260709 13:10:57.776980 24741 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:10:57.777290 19292 rpcz_store.cc:269] 0709 13:10:54.599497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.599630 (+   133us) service_pool.cc:224] Handling call
0709 13:10:57.776434 (+3176804us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400031954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:57.776656 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471323392}
I20260709 13:10:57.778321 24741 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.778792 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.779757 19218 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:57.773746 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.790426 24531 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.790498 24722 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:57.795470 19191 leader_election.cc:336] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.540s (SENT)
I20260709 13:10:57.795959 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:57.796777 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.750839 24735 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.804452 19895 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:10:57.802736 24671 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:10:57.810382 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.811575 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:57.815100 24199 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:57.816190 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.817442 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.817953 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:57.818504 19298 raft_consensus.cc:2393] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:57.819644 24712 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.820528 24786 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.820701 24539 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:57.822078 24786 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:57.824311 24721 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.824968 24721 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.819665 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.776026 24541 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.818338 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:57.831246 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.836982 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.844952 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.846860 24545 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.848601 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.796571 24535 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:57.820099 24712 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:57.829167 24539 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.815032 24720 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.851008 24768 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.877110 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.876842 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.881203 19368 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:57.862017 24712 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.837646 24731 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.851040 24786 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:10:57.893548 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.896623 19292 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 13:10:57.897176 24427 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.554s	user 0.014s	sys 0.003s
I20260709 13:10:57.887024 24733 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.898463 24533 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:57.900007 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 80479.1us
I20260709 13:10:57.900313 24537 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:10:57.900843 19188 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:57.902616 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.903949 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:10:57.904394 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 86229us
I20260709 13:10:57.905623 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.907044 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:57.907079 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:57.908448 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53281.7us
I20260709 13:10:57.909322 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:57.910115 19217 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:57.909417 24722 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:57.911479 24722 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:57.911891 24722 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:57.913034 24722 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.915184 19370 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:57.916229 24731 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.879134 24520 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.916983 24721 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.918079 24721 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:57.918501 24520 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.911499 19217 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.919907 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.921911 24747 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.922565 24747 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.907977 19366 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.916088 24522 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:57.924279 24752 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.924906 24752 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.927006 24752 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.928309 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.924969 19374 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:57.929194 19294 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
W20260709 13:10:57.930805 24788 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:57.919322 24722 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:57.933104 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 137807us
I20260709 13:10:57.931109 24522 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:57.882095 24689 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.933719 24533 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.895161 24655 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:57.939049 24655 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:57.940436 24500 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:57.933892 19191 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.044s (SENT)
I20260709 13:10:57.936124 24689 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:57.960623 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:57.961345 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:57.962329 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.918514 24721 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:57.966527 19366 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:10:57.963645 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.003677 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:57.951042 24712 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:58.013592 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 52959.3us
I20260709 13:10:58.015143 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:10:58.016196 24752 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:58.012841 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 130184us
I20260709 13:10:57.963112 24786 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:57.966022 24427 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.004522 24721 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.022871 19373 raft_consensus.cc:2410] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:10:58.024000 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:58.028455 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94606.6us
I20260709 13:10:58.028710 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:10:58.029726 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 120507us
I20260709 13:10:58.032100 19366 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.955776 24736 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.025902 19368 raft_consensus.cc:2376] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13. Re-sending same reply.
I20260709 13:10:58.017262 24752 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:58.018545 24786 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:10:58.061448 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:58.075430 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.031188 24747 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:58.089516 19373 raft_consensus.cc:2368] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:58.059741 24752 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.087397 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:58.088826 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:58.024017 24735 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.061201 24427 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:58.073549 24741 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.104451 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.115711 19895 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:58.088464 24545 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:58.120265 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.120836 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.121697 19296 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:58.110265 19366 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:10:58.112239 24741 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:10:58.137140 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.074743 24385 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.139315 24726 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.141661 24427 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.147516 19216 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:10:58.143442 19367 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
W20260709 13:10:58.149928 24794 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:58.152125 24730 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:58.145687 24434 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.153939 24735 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:58.154302 24811 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.154826 24811 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.155184 24434 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:58.156985 24798 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:58.156790 24726 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.159081 24726 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:58.162285 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56449.8us
I20260709 13:10:58.144517 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:58.156482 24741 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.147977 19216 pending_rounds.cc:85] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:10:58.192734 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:58.193646 19897 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:10:58.194075 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.168157 19216 pending_rounds.cc:107] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:10:58.197399 19216 raft_consensus.cc:2889] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:58.205909 24785 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.005s
I20260709 13:10:58.206435 24785 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.165129 24786 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.208770 24786 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.208567 24763 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:58.190325 24500 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:58.211773 24500 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:58.214030 24736 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:58.214483 24700 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.223405 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.227145 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.232457 19898 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.231416 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:58.238799 19368 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:58.247221 24385 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:58.248684 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.249965 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:10:58.250344 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.251546 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.251936 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.252665 19216 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:58.253832 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.255087 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.255749 19216 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:10:58.256202 24764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.020s
I20260709 13:10:58.256287 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.256645 24785 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:58.257694 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:58.258826 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.259449 19369 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:10:58.260265 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:58.260968 19369 raft_consensus.cc:2368] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:58.261945 19369 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:58.262027 24500 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.265177 24772 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:58.266131 24772 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.266499 24772 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:58.267313 24772 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:58.256734 24764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.002s	sys 0.020s
I20260709 13:10:58.258833 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.268330 24726 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.271142 24795 log.cc:927] Time spent T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:10:58.270884 24726 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.272710 24764 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:58.239657 24747 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:10:58.278797 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.273850 24741 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.305001 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.308907 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:58.289829 24624 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
W20260709 13:10:58.328881 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49231us
I20260709 13:10:58.313869 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.330874 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.343101 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.344287 24528 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:58.344522 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.347764 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:10:58.348052 24715 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 2.178s	user 0.000s	sys 0.003s
I20260709 13:10:58.348429 19217 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:10:58.349400 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.332887 24624 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.352905 24700 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:58.353426 19217 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:58.331568 19220 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:10:58.378553 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64056.1us
I20260709 13:10:58.311549 24811 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:58.383698 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.384450 19221 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:58.386924 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.391464 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:10:58.348191 24726 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.395670 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:58.401352 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.344307 24721 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.417168 19220 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:58.424301 24726 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:58.424925 24726 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:10:58.426277 24700 raft_consensus.cc:2764] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:10:58.432693 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53631.8us
I20260709 13:10:58.435664 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:10:58.432034 24797 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:10:58.452315 19224 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:58.458380 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 62804.9us
I20260709 13:10:58.469233 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 873) took 3771 ms. Trace:
I20260709 13:10:58.457489 24700 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.465288 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:58.467895 24722 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.002s
I20260709 13:10:58.469741 19903 rpcz_store.cc:276] 0709 13:10:54.673286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.673523 (+   237us) service_pool.cc:224] Handling call
0709 13:10:54.673981 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:54.682396 (+  8415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.682444 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:54.690399 (+  7955us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.715287 (+1024888us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:55.726691 (+ 11404us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.727012 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.727177 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.727254 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.310128 (+582874us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b18003e95c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:56.718830 (+408702us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18003e95c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8dcdde328 00007fe8dcdd5901 00007fe8dcdd58a7 00007fe8dcecd288 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508
0709 13:10:56.830635 (+111805us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b18003e95c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:10:58.347230 (+1516595us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:58.437080 (+ 89850us) raft_consensus.cc:1685] finished
0709 13:10:58.437110 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.444762 (+  7652us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124931,"prepare.queue_time_us":1116085,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":51248,"raft.run_cpu_time_us":19043,"raft.run_wall_time_us":1002706,"spinlock_wait_cycles":22923520,"thread_start_us":964853,"threads_started":1,"wal-append.queue_time_us":1189898}
I20260709 13:10:58.492342 19368 raft_consensus.cc:2410] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:10:58.494599 24747 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.496186 24747 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.496712 24747 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:58.497774 24747 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.499580 24721 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.503093 24752 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.511181 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.520620 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:58.532833 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54387.2us
I20260709 13:10:58.556939 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.557154 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.557765 19369 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:58.558370 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.560072 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:58.561661 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:58.562827 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.553187 24813 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.565423 24813 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:58.566983 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.559149 19367 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:58.617362 19365 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
W20260709 13:10:58.620612 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 100129us
W20260709 13:10:58.621476 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49500.7us
I20260709 13:10:58.602623 24722 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:58.627112 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.602799 24624 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.623293 24700 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:58.623132 24768 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:58.645478 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.645937 19372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5150fb077a470497ba70512f18f476"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:10:58.647070 24567 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:10:58.647871 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:58.648891 24828 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.649559 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.629863 24722 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:10:58.650116 24819 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:10:58.650067 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.659725 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:58.660812 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.661293 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.662649 24752 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.663275 24768 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.672300 19292 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:10:58.566475 24813 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.675733 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.675961 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.676368 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.676563 19297 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:58.677259 24823 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:58.677659 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.679006 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.676699 19292 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:10:58.687949 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.664847 24700 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:58.716539 24700 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.725036 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.726346 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.726871 19222 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.729887 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.731905 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.732831 19291 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.693516 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:10:58.735587 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.702662 24831 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.712028 24696 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.712733 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.748279 19218 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:58.623559 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.723734 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:58.746351 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71864.4us
I20260709 13:10:58.669338 24722 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.756179 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.760562 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:58.755087 19115 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:10:58.766906 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 143855us
I20260709 13:10:58.764940 24747 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:58.770256 24747 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:58.772645 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.779471 24603 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.783581 24768 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.753468 24828 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:58.790792 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:58.797963 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.798228 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.812502 19367 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:58.813184 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.802667 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:58.816334 24696 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:58.816886 24696 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:58.817380 24696 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.817433 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.819090 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.824088 19365 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:10:58.826591 24712 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.820714 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.780085 24603 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:10:58.829257 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.831969 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.832747 19293 raft_consensus.cc:2368] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:58.836601 19369 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:58.796023 24828 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:58.847645 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.859820 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.861003 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:58.865541 24756 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.755s	user 0.003s	sys 0.000s
I20260709 13:10:58.851711 19191 leader_election.cc:400] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:58.869333 19191 leader_election.cc:403] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:58.870532 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.876466 19291 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:10:58.876667 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.877274 19367 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:10:58.845506 24828 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.845695 24624 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:58.850455 24831 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.856185 24209 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:58.880151 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:58.884791 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 73755.5us
I20260709 13:10:58.884905 19297 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:58.884075 24209 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:10:58.887192 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1003) took 2120 ms. Trace:
I20260709 13:10:58.887528 24209 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:58.887897 24730 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.887643 19899 rpcz_store.cc:276] 0709 13:10:56.761704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.761822 (+   118us) service_pool.cc:224] Handling call
0709 13:10:56.762131 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:56.762504 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.762532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:56.771664 (+  9132us) log.cc:844] Serialized 52 byte log entry
0709 13:10:57.091691 (+320027us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:57.091731 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.091797 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.864808 (+1773011us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:58.868292 (+  3484us) raft_consensus.cc:1685] finished
0709 13:10:58.868312 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.882137 (+ 13825us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2090,"spinlock_wait_cycles":6505728,"thread_start_us":319640,"threads_started":1,"wal-append.queue_time_us":338114}
I20260709 13:10:58.888844 24603 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:58.892241 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.893919 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:58.894596 19216 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:10:58.895623 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.895955 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 809) took 1965 ms. Trace:
I20260709 13:10:58.897240 19367 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:58.897753 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.896363 19300 rpcz_store.cc:276] 0709 13:10:56.930927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.254521 (+323594us) service_pool.cc:224] Handling call
0709 13:10:57.676372 (+421851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.676858 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.676900 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.676982 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:57.677048 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.677122 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.895662 (+1218540us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001d3650. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:58.895778 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913192320}
I20260709 13:10:58.899334 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.898342 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.899920 19224 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.880358 24624 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:58.903460 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:58.934862 19218 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:10:58.926815 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:58.904278 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:10:58.927191 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 176220us
I20260709 13:10:58.904628 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.906234 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:58.926973 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.957095 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.904711 24624 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:58.959493 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.960438 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.960729 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.964653 19220 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:58.955008 24835 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:58.965698 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:58.965806 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.966282 19216 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.961521 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:58.931900 24752 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:58.945310 24747 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:58.993266 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:58.974012 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:58.954424 24603 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.967031 24712 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:10:58.971869 24752 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.073371 24752 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.965574 24835 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:59.080255 24835 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:59.084565 19297 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:10:59.086021 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:59.087406 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:10:59.090732 24696 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:59.000874 24839 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:59.023911 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 887) took 1380 ms. Trace:
I20260709 13:10:59.138690 19901 rpcz_store.cc:276] 0709 13:10:57.644760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.646926 (+  2166us) service_pool.cc:224] Handling call
0709 13:10:57.647359 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.738178 (+ 90819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.738230 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.749018 (+ 10788us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:57.752051 (+  3033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.023381 (+1271330us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54006b3354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:59.023474 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.023676 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192609536}
I20260709 13:10:59.107254 24209 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.047156 19115 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 14, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:59.049510 19299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2203) took 4239 ms (client timeout 1739 ms). Trace:
I20260709 13:10:59.050333 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:59.163106 19294 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:59.050737 19291 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:10:59.092211 19300 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:59.100240 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:59.101207 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:59.104382 24532 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:59.110049 24755 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 2.000s	user 0.000s	sys 0.004s
I20260709 13:10:59.112579 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:10:59.114492 24726 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:58.989593 19369 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:59.116143 24712 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:59.117151 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2184) took 1100 ms. Trace:
W20260709 13:10:59.126099 24802 log.cc:927] Time spent T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.974s	user 0.001s	sys 0.002s
W20260709 13:10:59.128685 24827 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.565s	user 0.002s	sys 0.001s
I20260709 13:10:59.047377 24730 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:10:59.160089 19224 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
W20260709 13:10:59.161206 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 929801us
I20260709 13:10:59.194693 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:59.171401 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:59.162021 19299 rpcz_store.cc:269] 0709 13:10:54.809515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.809639 (+   124us) service_pool.cc:224] Handling call
0709 13:10:59.048983 (+4239344us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54002e8e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:59.049282 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5125772032}
I20260709 13:10:59.173100 19365 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:59.178364 19222 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:59.180838 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.185456 19903 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:59.187266 19373 rpcz_store.cc:276] 0709 13:10:58.018340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.031959 (+ 13619us) service_pool.cc:224] Handling call
0709 13:10:59.116881 (+1084922us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54001bbcd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:59.117057 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44221184}
W20260709 13:10:59.194674 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 221685us
I20260709 13:10:59.220948 19223 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:59.197074 24696 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:59.217981 24700 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:10:59.204098 24812 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:59.232625 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.235369 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.233217 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.261179 24209 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:59.263366 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46268.7us
I20260709 13:10:59.270514 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.273691 19368 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:59.266081 24722 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:10:59.231721 24700 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:59.300450 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 119673us
I20260709 13:10:59.269874 24811 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.301385 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.272863 24730 raft_consensus.cc:2764] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:59.308368 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.285140 24696 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.284947 24209 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.303861 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:10:59.311532 19365 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:59.321341 19370 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:59.326997 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 897) took 1101 ms. Trace:
I20260709 13:10:59.327479 19897 rpcz_store.cc:276] 0709 13:10:58.225958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.226247 (+   289us) service_pool.cc:224] Handling call
0709 13:10:58.235048 (+  8801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.139758 (+904710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.139794 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.180562 (+ 40768us) log.cc:844] Serialized 26 byte log entry
0709 13:10:59.271423 (+ 90861us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:59.271464 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.271532 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.326770 (+ 55238us) raft_consensus.cc:1685] finished
0709 13:10:59.326789 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.326933 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":969462,"raft.queue_time_us":921649,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7113,"thread_start_us":78056,"threads_started":1,"wal-append.queue_time_us":139671}
I20260709 13:10:59.332218 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:59.305299 24811 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:59.359036 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.368114 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66836.8us
I20260709 13:10:59.291949 24722 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:10:59.379271 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 207952us
I20260709 13:10:59.381706 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 894) took 1002 ms. Trace:
I20260709 13:10:59.390107 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2575) took 3907 ms. Trace:
I20260709 13:10:59.337731 24726 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:59.396744 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 88467.4us
I20260709 13:10:59.398428 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.401028 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.347188 24712 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.329921 24608 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.409327 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.417330 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.336925 24537 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:10:59.308395 24809 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.112s
W20260709 13:10:59.425487 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 118764us
I20260709 13:10:59.439942 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.426122 24726 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:10:59.377283 24811 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:59.430462 24813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.013s	sys 0.002s
I20260709 13:10:59.400077 24786 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.387235 19896 rpcz_store.cc:276] 0709 13:10:58.217497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.223050 (+  5553us) service_pool.cc:224] Handling call
0709 13:10:58.232519 (+  9469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.274650 (+ 42131us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:58.308141 (+ 33491us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.215472 (+907331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.215546 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:59.219376 (+  3830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.219423 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.219504 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883377,"prepare.queue_time_us":29188,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1065,"raft.queue_time_us":880842,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7923,"thread_start_us":25317,"threads_started":1,"wal-append.queue_time_us":113570}
I20260709 13:10:59.433056 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.390637 19371 rpcz_store.cc:276] 0709 13:10:55.397196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.610239 (+1213043us) service_pool.cc:224] Handling call
0709 13:10:56.610666 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.731184 (+120518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.731217 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.731691 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.110840 (+379149us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:57.276336 (+165496us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.277062 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.277137 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.109211 (+1832074us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:10:59.282617 (+173406us) raft_consensus.cc:1685] finished
0709 13:10:59.288658 (+  6041us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.304338 (+ 15680us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180415,"prepare.queue_time_us":254580,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":151913,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":15513,"spinlock_wait_cycles":34994048,"thread_start_us":486677,"threads_started":2,"wal-append.queue_time_us":378249}
W20260709 13:10:59.425693 24755 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:10:59.413877 24741 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:59.427131 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1022) took 1278 ms. Trace:
W20260709 13:10:59.443650 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73649.4us
I20260709 13:10:59.380522 24624 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:10:59.424988 24764 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:10:59.454404 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:10:59.455276 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43745.3us
W20260709 13:10:59.448215 24813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.013s	sys 0.002s
W20260709 13:10:59.443425 24725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.876s	user 0.016s	sys 0.009s
W20260709 13:10:59.463197 24851 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:10:59.461477 24801 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:59.427281 24853 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:59.464748 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.448900 24845 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:59.471364 19369 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:59.474444 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:59.467092 24725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.016s	sys 0.009s
I20260709 13:10:59.452543 19900 rpcz_store.cc:276] 0709 13:10:58.148767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.148944 (+   177us) service_pool.cc:224] Handling call
0709 13:10:58.163613 (+ 14669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.189543 (+ 25930us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:58.199552 (+ 10009us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.138567 (+939015us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b18004b1420. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:10:59.307823 (+169256us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.426776 (+118953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.426829 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:59.426878 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.426938 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.427074 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88666,"prepare.queue_time_us":248061,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":10724,"raft.queue_time_us":946108,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14955,"spinlock_wait_cycles":29539968,"thread_start_us":275560,"threads_started":2}
I20260709 13:10:59.469938 24696 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:59.449246 24726 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:10:59.500624 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 72690.5us
W20260709 13:10:59.478605 24848 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:10:59.509513 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 182576us
W20260709 13:10:59.511680 19216 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
I20260709 13:10:59.478528 24730 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:59.477053 24741 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.516590 19216 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:10:59.516574 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:10:59.519619 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 86661.6us
I20260709 13:10:59.512682 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.521711 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2277) took 1025 ms. Trace:
I20260709 13:10:59.522729 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.523099 19216 rpcz_store.cc:276] 0709 13:10:58.496516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.905179 (+408663us) service_pool.cc:224] Handling call
0709 13:10:59.521636 (+616457us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:59.530036 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46483.3us
I20260709 13:10:59.522754 24859 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:59.547123 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 102152us
I20260709 13:10:59.520255 24700 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:59.546258 19191 leader_election.cc:400] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:10:59.552737 19191 leader_election.cc:403] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:59.542626 24801 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.542469 24857 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.560570 19216 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:59.549227 24722 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:59.546454 24846 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:59.580825 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 100109us
I20260709 13:10:59.581959 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.585541 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.585904 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.587407 19371 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:59.558902 24741 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:59.561986 24859 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:59.579931 24786 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.583109 24700 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.629380 24700 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.593250 24801 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:59.633459 24828 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.003s
I20260709 13:10:59.634042 24828 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.636600 24612 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
W20260709 13:10:59.638182 24864 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 13:10:59.640551 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:59.641415 24828 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:59.604573 24856 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:10:59.600343 24741 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.593006 24650 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:59.607438 24866 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:59.594441 24722 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:59.611076 24835 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:10:59.616976 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 929) took 1817 ms. Trace:
I20260709 13:10:59.595652 24859 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:10:59.621667 24752 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:10:59.622295 24696 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.622849 24726 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:59.626015 24786 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.629984 19371 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:59.605355 24861 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:59.595937 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:59.644079 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:59.648736 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 95485.7us
I20260709 13:10:59.678478 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:59.679402 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:59.679811 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.619618 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:10:59.641425 24624 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:10:59.652743 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62847.5us
I20260709 13:10:59.656798 19374 rpcz_store.cc:276] 0709 13:10:57.799292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.803204 (+  3912us) service_pool.cc:224] Handling call
0709 13:10:57.830088 (+ 26884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.929293 (+ 99205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.616737 (+1687444us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b54001626d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:10:59.616915 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217736960}
I20260709 13:10:59.669503 19368 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:10:59.657239 24863 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.226s	user 0.000s	sys 0.004s
I20260709 13:10:59.687898 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:59.688637 19223 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.689153 24700 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:10:59.690302 24869 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:59.692517 19216 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:59.674738 24752 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.694481 24752 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:59.697889 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:59.699360 19223 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:10:59.692705 24810 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.198s	user 0.003s	sys 0.000s
I20260709 13:10:59.720911 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:10:59.721367 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 162015us
I20260709 13:10:59.723388 19371 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:59.724272 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2260) took 1427 ms. Trace:
I20260709 13:10:59.676200 24801 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.731546 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:10:59.724751 19221 rpcz_store.cc:276] 0709 13:10:58.275699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.395854 (+120155us) service_pool.cc:224] Handling call
0709 13:10:59.619465 (+1223611us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:10:59.702633 (+ 83168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6920448}
I20260709 13:10:59.683244 24726 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:59.742375 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62627us
I20260709 13:10:59.703734 24722 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:59.700932 24857 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:59.668509 24835 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.750156 19374 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:59.750918 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.756301 24835 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:59.728776 24532 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.752139 24726 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.760845 24726 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:59.761648 19220 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:59.757467 24818 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.249s	user 0.004s	sys 0.000s
I20260709 13:10:59.736760 24764 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:59.768549 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 245901us
I20260709 13:10:59.771719 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.770901 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:10:59.785508 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:59.757503 24786 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:59.786350 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:59.777937 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.795152 19367 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:10:59.792603 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:59.787761 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:10:59.771472 24764 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.746620 24773 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:59.807665 19900 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:59.774840 24700 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.736655 24801 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.777130 24500 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.823876 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:59.776669 24853 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.838790 24845 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.838965 24853 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.814198 19372 raft_consensus.cc:606] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:10:59.824755 19894 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:59.825368 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:59.841205 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:59.826980 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:59.781275 24857 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:59.840946 19897 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:59.834566 24510 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:10:59.861274 24510 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:59.861707 24510 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:59.862676 24510 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.836004 24741 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:10:59.836380 24337 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:59.864759 24877 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:59.865676 24877 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:59.864099 24510 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:59.866779 24877 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.811281 24700 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.870426 24700 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:10:59.810765 24764 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:59.878131 24871 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:10:59.810501 24726 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.772491 24859 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.885172 24859 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:59.794440 24722 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:10:59.888938 24722 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:10:59.845700 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:10:59.829947 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:10:59.850258 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:59.836053 24801 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:10:59.851178 24865 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:59.851802 19899 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:59.852113 24807 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:10:59.852324 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74482us
I20260709 13:10:59.853018 24662 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.854411 24773 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:10:59.856329 24502 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:59.827935 24603 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.011s
I20260709 13:10:59.840924 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:59.857827 24853 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:10:59.858786 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:10:59.864781 24337 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:10:59.943710 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:10:59.849422 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.895305 24811 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.925803 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:10:59.929364 24532 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:59.964704 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.933969 24765 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:59.947386 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 117548us
I20260709 13:10:59.937529 24807 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.958262 24772 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.961244 19218 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:10:59.961942 19366 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:00.007725 19218 pending_rounds.cc:85] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
W20260709 13:10:59.961247 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2197) took 1427 ms (client timeout 1574 ms). Trace:
I20260709 13:11:00.008080 19218 pending_rounds.cc:107] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:11:00.008507 19218 raft_consensus.cc:2889] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:00.008247 19370 rpcz_store.cc:269] 0709 13:10:58.533696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.533823 (+   127us) service_pool.cc:224] Handling call
0709 13:10:59.961026 (+1427203us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b5400357354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:10:59.961188 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650794240}
W20260709 13:11:00.011910 19191 connection.cc:256] RPC call timeout handler was delayed by -1.0467027300001064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:11:00.019852 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 243162us
W20260709 13:11:00.018098 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50899.6us
I20260709 13:11:00.021520 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.022891 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.021356 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.023694 24500 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.027746 24337 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.027927 24500 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.028404 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.029047 24337 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.029495 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.030329 24500 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.030493 24801 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.031021 24801 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:10:59.935981 24857 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.033052 24801 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.035332 24764 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.036448 24773 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.007359 24853 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:59.938674 24662 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.045611 24712 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:00.046346 24854 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.056547 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.057289 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:00.014108 24726 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.047151 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.047657 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.048211 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.048437 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.049090 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.050230 19903 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:00.059645 19373 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:00.050189 19894 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:00.054613 24801 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:11:00.040400 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.047034 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41484 (request call id 21) took 2337 ms. Trace:
I20260709 13:11:00.063921 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:00.053555 24865 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:11:00.063458 19372 rpcz_store.cc:276] 0709 13:10:57.709163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.645690 (+936527us) service_pool.cc:224] Handling call
0709 13:11:00.046876 (+1401186us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54004263d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:00.046951 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661287808}
I20260709 13:11:00.068532 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.069164 19368 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:00.074759 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.076766 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:00.068384 24712 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:00.058809 24510 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:11:00.078517 24801 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:00.078922 24801 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:00.071586 24853 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:00.079871 24801 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.080662 24853 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.085645 24662 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:00.086066 24875 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:11:00.088531 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.055004 24741 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:11:00.090544 24878 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:00.090941 24878 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:00.093241 24807 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.054869 24786 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:11:00.094175 24773 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:00.095172 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 68407.1us
I20260709 13:11:00.095599 24811 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.097478 24764 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.098263 24859 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.098744 24859 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.099547 24876 raft_consensus.cc:993] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:00.100736 24876 raft_consensus.cc:1081] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:00.060390 24854 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:00.120847 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44169us
I20260709 13:11:00.121774 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:00.124286 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.127027 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.129699 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.131346 19374 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:00.130561 19217 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:00.131479 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.134706 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.135907 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.136525 19297 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:11:00.137403 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.137912 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.139988 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.153702 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.217643 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:00.131139 24537 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:00.236312 19894 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:00.132727 19221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f5150fb077a470497ba70512f18f476"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47354
I20260709 13:11:00.237634 19221 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.238018 19221 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.242149 19291 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:00.246124 19293 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:11:00.154058 24567 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
I20260709 13:11:00.250623 19293 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:00.251178 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.251410 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.252043 19374 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:00.252302 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.247172 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.252869 19297 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.253327 24741 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.253803 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.254607 24741 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:00.254999 24741 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.255089 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.255420 24741 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.255771 19292 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:00.252883 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.257272 24545 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:00.258389 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126431us
I20260709 13:11:00.153702 24811 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.271287 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.271864 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:00.269759 19300 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
W20260709 13:11:00.273087 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 253808us
I20260709 13:11:00.237135 24537 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.248819 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:00.247731 19265 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.266453 19291 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:11:00.078919 24712 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.286985 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.091887 24878 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.291426 19297 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 9.
I20260709 13:11:00.247802 24608 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:00.294028 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 45029.9us
I20260709 13:11:00.307044 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.307451 19293 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:00.271019 24811 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.268112 24545 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:00.311112 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.321993 19372 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:00.314016 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.313285 24608 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.328511 24608 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.287352 24537 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.335330 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.331840 19299 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:00.276348 24845 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:00.305913 24662 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:11:00.324205 24882 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:00.311120 24875 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.345844 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:00.348533 19291 raft_consensus.cc:606] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:00.346308 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.324360 24811 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.314543 24876 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:00.355103 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 107580us
I20260709 13:11:00.358274 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:00.359236 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.354408 19293 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:00.364104 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:00.364784 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.364977 24528 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.365263 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.342785 24878 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.365406 19293 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:00.368124 24645 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.368655 24645 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.365521 24528 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.339342 24773 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:11:00.384541 24545 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.371199 24844 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.386138 24844 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.385715 24545 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:00.388661 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.390578 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.351887 24872 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.395260 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:00.397920 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:00.397883 19372 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:00.400079 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.406201 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.386499 24844 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.370615 24807 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:00.363229 24765 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.347643 24888 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:11:00.363162 24786 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:00.392720 24733 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:00.354395 24875 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.433780 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.433835 19294 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:00.435813 19291 raft_consensus.cc:606] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:00.435971 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.436213 19291 raft_consensus.cc:614] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:00.418135 24877 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.409030 24885 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:00.437120 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 129538us
I20260709 13:11:00.414937 24889 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:00.437261 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 69928.8us
I20260709 13:11:00.398406 24700 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:11:00.446964 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2615) took 1146 ms. Trace:
I20260709 13:11:00.433080 24857 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.424372 24722 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:00.431691 24807 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:00.448805 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.450222 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2827) took 1726 ms. Trace:
I20260709 13:11:00.398133 24876 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:11:00.450181 19366 rpcz_store.cc:276] 0709 13:10:59.300111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.421889 (+121778us) service_pool.cc:224] Handling call
0709 13:10:59.961772 (+539883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.007886 (+ 46114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.446788 (+438902us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400357350. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:00.446904 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218032000}
I20260709 13:11:00.445963 24337 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:00.453624 19218 rpcz_store.cc:276] 0709 13:10:58.720132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.957612 (+237480us) service_pool.cc:224] Handling call
0709 13:10:58.957955 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.009317 (+1051362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.446267 (+436950us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400076cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:00.446433 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306212096}
I20260709 13:11:00.457573 19372 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:00.454818 19370 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:00.440728 24877 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.460050 24807 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.461110 19366 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:00.462100 24881 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 13:11:00.463383 24875 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.465974 24537 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.456897 24337 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:00.409646 24872 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.476312 24436 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:00.477375 24528 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:00.456816 24889 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:00.458055 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.501886 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.441315 24733 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.491410 24877 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:00.510139 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52170.7us
I20260709 13:11:00.512032 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.490191 24722 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:00.516268 24845 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.457293 24857 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.516672 24845 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.517091 24845 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.518283 24857 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:00.519402 19366 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:00.519508 24859 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.500303 24337 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:00.522734 24903 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:00.523244 24903 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:00.497606 24436 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:00.524631 24436 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.525636 24436 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.518301 24645 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.528333 19368 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:00.533650 24872 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:00.534526 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 169951us
I20260709 13:11:00.535622 24537 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.535740 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.537801 24786 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.538187 24786 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:00.538576 24786 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.539290 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.539850 19369 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.545035 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:00.546305 19898 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:00.555354 19221 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.559110 19217 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:00.559964 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62592us
I20260709 13:11:00.560338 19898 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:00.565274 24811 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.566053 24890 raft_consensus.cc:993] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:00.566593 24890 raft_consensus.cc:1081] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
W20260709 13:11:00.572029 24894 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:00.558909 24773 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:00.573513 24773 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:00.573865 24773 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:00.574649 24773 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.575846 24773 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.576854 24741 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.576764 24889 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.578365 19895 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:00.578433 24811 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.580098 24741 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.582780 19373 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:00.584543 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.585358 19296 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:11:00.586190 19292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2164) took 1810 ms (client timeout 1527 ms). Trace:
W20260709 13:11:00.586608 19292 rpcz_store.cc:269] 0709 13:10:58.776131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.795068 (+ 18937us) service_pool.cc:224] Handling call
0709 13:11:00.585973 (+1790905us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003f16d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:00.586093 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889452416}
I20260709 13:11:00.524066 24903 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.594337 24786 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:00.619926 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.621634 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.623565 19898 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:00.627206 19369 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:00.596608 24786 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.628386 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:00.629518 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:00.633876 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.632306 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.636031 19221 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:00.635100 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:00.638111 19371 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:00.626760 24741 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.650786 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.648356 24537 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:00.652364 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.652984 19371 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.657974 24880 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:00.640395 24689 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:11:00.640781 24725 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:00.660703 24725 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.661072 24725 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:00.665761 24537 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:00.666734 24537 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.668084 24801 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.670768 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:00.671165 19296 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:00.671372 19291 raft_consensus.cc:606] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:00.674973 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:00.535827 24844 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.680794 19371 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:00.681037 19295 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:00.682294 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:00.684495 24567 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:00.684999 24051 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.697294 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 679389us
W20260709 13:11:00.687860 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48463.8us
I20260709 13:11:00.698297 19188 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:00.699635 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.700435 19297 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:00.685930 19374 raft_consensus.cc:2368] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15.
I20260709 13:11:00.690722 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.691395 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:00.691082 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:00.695405 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.704525 19293 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.704541 19292 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:00.704308 19296 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.714318 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:00.719599 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.721093 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.721930 19299 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:00.721194 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.721630 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.685369 24844 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.729512 19225 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:00.734273 19218 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:11:00.713104 24811 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:00.736965 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.741504 19296 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:00.711280 24765 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:11:00.742841 19299 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:11:00.734776 19218 pending_rounds.cc:85] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 7
I20260709 13:11:00.746315 19218 pending_rounds.cc:107] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:00.746579 19218 raft_consensus.cc:2889] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:00.747748 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.752094 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.757189 24853 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.758558 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:00.759127 19225 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.692301 24741 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.767686 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:00.772330 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64831.8us
I20260709 13:11:00.736327 24811 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:00.713922 24813 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:11:00.713299 24051 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.778877 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:00.795575 24844 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:11:00.806864 19297 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:00.718442 24502 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:11:00.781402 24901 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:00.808643 24901 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:00.809011 24901 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.799113 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:00.792127 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.729959 24890 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:00.773981 24832 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.764839 24726 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:00.764801 24603 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:00.833149 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 81161.2us
I20260709 13:11:00.834199 19191 leader_election.cc:400] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11.
I20260709 13:11:00.836758 24832 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:00.836524 24726 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.837162 24832 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:00.838002 24832 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.839077 24726 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:00.839800 24726 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:00.840445 24603 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.841096 24854 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.840860 24725 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.842669 24603 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:00.842808 24683 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:00.843182 24683 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:00.839161 24832 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:00.835476 19340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.062s (SENT) [suppressed 13 similar messages]
I20260709 13:11:00.781272 24835 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.830873 24567 tablet_bootstrap.cc:492] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:11:00.780856 24888 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.867295 19292 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:11:00.868211 19299 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:00.868875 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:00.872655 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.877168 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:00.877833 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 97616us
I20260709 13:11:00.777967 24877 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:00.879513 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 131839us
W20260709 13:11:00.880127 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46065.2us
I20260709 13:11:00.880375 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.881345 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.885392 24854 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:00.886001 24854 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.886768 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.887648 19222 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:11:00.888433 24908 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:00.776142 24885 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:11:00.888974 24908 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.843179 24725 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:00.912061 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 113009us
W20260709 13:11:00.913035 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.920104 19222 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:11:00.867537 24888 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.922504 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:00.844101 24683 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.923981 19365 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:11:00.923363 24671 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:00.930064 24671 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:00.930542 24671 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.931559 24854 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:00.891861 24647 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:00.861186 24726 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.933264 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:00.936472 19370 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:00.934401 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.936959 19370 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:00.937747 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:00.867681 24835 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.919414 24567 ts_tablet_manager.cc:1403] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 2.273s	user 0.042s	sys 0.045s
I20260709 13:11:00.945438 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:00.876977 24845 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:00.929335 24888 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.946887 19222 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:00.904537 24689 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:00.958283 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67321.4us
I20260709 13:11:00.943223 24537 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:00.889871 24664 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:11:00.953131 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:00.953269 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 255069us
W20260709 13:11:00.947338 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68753.3us
I20260709 13:11:00.953933 19370 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:00.969005 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50385.2us
I20260709 13:11:00.970683 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:00.905208 24801 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:11:00.972981 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:00.984619 19225 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:00.993813 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2285) took 1295 ms. Trace:
W20260709 13:11:00.996899 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.999500 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:00.972757 24683 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.994320 19216 rpcz_store.cc:276] 0709 13:10:59.698636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.698754 (+   118us) service_pool.cc:224] Handling call
0709 13:10:59.699008 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.699193 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:59.703348 (+  4155us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.967826 (+264478us) log.cc:844] Serialized 14 byte log entry
0709 13:11:00.685526 (+717700us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b18000efb00. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:11:00.696044 (+ 10518us) log.cc:844] Serialized 14 byte log entry
0709 13:11:00.982001 (+285957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.982075 (+    74us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:00.982137 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.982225 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.993730 (+ 11505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":815050,"prepare.queue_time_us":39878,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":842243,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":12308,"spinlock_wait_cycles":55488384,"thread_start_us":470372,"threads_started":2,"wal-append.queue_time_us":548747}
I20260709 13:11:01.018453 19217 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:01.019968 19222 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:00.926550 24811 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:00.991261 24813 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:01.033818 24915 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:11:01.037117 19298 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:01.002408 24801 consensus_queue.cc:1243] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:01.039016 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.028504 24889 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:01.017366 24884 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:01.056999 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:01.057957 19296 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.042542 19292 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:01.044229 19216 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:01.052623 24908 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:01.078436 19297 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:11:01.080292 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.053762 19115 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 10, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.998281 24847 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:00.993083 24854 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:11:01.053984 24722 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:01.054515 19119 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 264) took 43535 ms (client timeout 15000 ms). Trace:
I20260709 13:11:01.085855 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.086664 19222 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:01.040704 24741 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:01.081750 24537 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.111022 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 275558us
W20260709 13:11:01.112457 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 141842us
I20260709 13:11:01.115236 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.120700 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:01.121049 19293 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:01.085418 24924 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:01.122404 19296 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:01.125411 19300 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:01.124498 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.115929 24877 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:01.137688 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 164312us
I20260709 13:11:01.110690 24889 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:01.207716 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 234817us
I20260709 13:11:01.114533 24857 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:01.211004 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68881.9us
I20260709 13:11:01.124181 24923 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.212114 19188 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:01.136921 24930 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:11:01.234668 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 110267us
I20260709 13:11:01.235518 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.212790 24857 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:01.214301 24835 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.216392 24726 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.121093 24537 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.244916 19291 raft_consensus.cc:606] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:01.242599 24909 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:11:01.236533 24877 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.243434 24917 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:11:01.250373 24835 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:01.276952 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2629) took 1041 ms. Trace:
I20260709 13:11:01.311885 19374 rpcz_store.cc:276] 0709 13:11:00.235962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.252664 (+ 16702us) service_pool.cc:224] Handling call
0709 13:11:01.276716 (+1024052us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b5400095bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:01.276874 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963106048}
I20260709 13:11:01.286671 24853 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:11:01.315374 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.084962 19119 rpcz_store.cc:269] 0709 13:10:17.518987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.519203 (+   216us) service_pool.cc:224] Handling call
0709 13:11:01.054304 (+43535101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:48.363394 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:48.364030 (+   636us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:48.364074 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:10:48.364091 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:48.401700 (+ 37609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:48.401782 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:48.401819 (+    37us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:10:48.409543 (+  7724us) tablet.cc:701] Row locks acquired
0709 13:10:48.428551 (+ 19008us) write_op.cc:260] PREPARE: finished
0709 13:10:48.437950 (+  9399us) write_op.cc:270] Start()
0709 13:10:48.439946 (+  1996us) write_op.cc:276] Timestamp: P: 1783602648433639 usec, L: 0
0709 13:10:48.439990 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:10:48.461732 (+ 21742us) log.cc:844] Serialized 4034 byte log entry
0709 13:10:49.200930 (+739198us) op_driver.cc:464] REPLICATION: finished
0709 13:10:49.427788 (+226858us) write_op.cc:301] APPLY: starting
0709 13:10:49.452522 (+ 24734us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:49.626836 (+174314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:49.626979 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:50.154085 (+527106us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:50.154460 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:10:50.154516 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:50.154925 (+   409us) log.cc:844] Serialized 97 byte log entry
0709 13:10:50.312202 (+157277us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.389403 (+ 77201us) write_op.cc:454] Released schema lock
0709 13:10:50.428052 (+ 38649us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:50.483679 (+ 55627us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.483719 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":455790,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":164051,"apply.run_cpu_time_us":33018,"apply.run_wall_time_us":1094985,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":263041,"prepare.run_cpu_time_us":76649,"prepare.run_wall_time_us":240375,"raft.queue_time_us":216476,"raft.run_cpu_time_us":16728,"raft.run_wall_time_us":160459,"replication_time_us":748848,"thread_start_us":683377,"threads_started":5,"wal-append.queue_time_us":361510,"wal-append.run_cpu_time_us":24974,"wal-append.run_wall_time_us":2649786}]]}
I20260709 13:11:01.315344 24853 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:01.328310 19896 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:01.330255 19900 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:01.295972 24926 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:11:01.301580 24928 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:11:01.293152 24764 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:01.288748 24912 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.478s	user 0.001s	sys 0.000s
I20260709 13:11:01.326031 24835 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.355578 24835 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.359402 24537 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:01.359594 19295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2235) took 2688 ms (client timeout 2062 ms). Trace:
W20260709 13:11:01.360141 19295 rpcz_store.cc:269] 0709 13:10:58.671370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.678752 (+  7382us) service_pool.cc:224] Handling call
0709 13:11:01.359380 (+2680628us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54001bf654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:01.359513 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4131233152}
I20260709 13:11:01.326290 24733 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.342545 24813 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:01.346251 24764 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:01.362870 24764 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:01.282804 24911 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.472s	user 0.000s	sys 0.002s
I20260709 13:11:01.232188 24923 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.300712 24933 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:01.299273 24891 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.931s	user 0.002s	sys 0.001s
I20260709 13:11:01.239264 24931 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:11:01.346915 24532 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.342727 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:01.347455 24853 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.351718 24801 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:01.385511 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:01.295362 24671 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.251986 24845 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:01.248867 24913 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:11:01.330004 24726 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:01.374311 19900 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:01.394394 19900 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:01.364094 24764 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.330935 24934 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.246738 24846 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:11:01.251454 24932 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.380856 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:01.351718 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:01.404258 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52618.5us
I20260709 13:11:01.407393 24733 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:01.407945 24733 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:01.408864 24733 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.410607 24940 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.411211 24940 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.413370 24671 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.392273 24532 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.398783 19900 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.416685 19900 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.387387 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2621) took 1252 ms. Trace:
I20260709 13:11:01.364676 24835 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.287246 24567 raft_consensus.cc:359] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:01.308717 24857 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.315627 24889 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.424783 19374 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:01.419015 19367 rpcz_store.cc:276] 0709 13:11:00.134539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.474263 (+339724us) service_pool.cc:224] Handling call
0709 13:11:00.474595 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.475012 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.475051 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.475491 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.688511 (+213020us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:00.688544 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.688604 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.387105 (+698501us) raft_consensus.cc:1685] finished
0709 13:11:01.387135 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.387314 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":721,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":1229056,"thread_start_us":212620,"threads_started":1,"wal-append.queue_time_us":323797}
I20260709 13:11:01.346505 24872 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:01.389293 24624 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.426647 24624 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.427024 24624 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.427091 24801 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:01.386860 24885 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:11:01.422827 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:01.345181 24877 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.424685 19369 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:01.418946 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:01.434463 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 199003us
I20260709 13:11:01.413370 24940 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:01.391940 24888 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.425032 24532 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:01.446890 24502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.003s	sys 0.027s
I20260709 13:11:01.438230 19365 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:11:01.420420 24567 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:11:01.425302 24875 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.444727 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.455224 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:01.450181 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 228553us
I20260709 13:11:01.436417 24857 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:01.430850 24901 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
W20260709 13:11:01.451386 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 239319us
W20260709 13:11:01.443192 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 222100us
I20260709 13:11:01.467193 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:01.458051 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.441395 24209 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:01.453975 24537 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:11:01.454190 24502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.003s	sys 0.028s
I20260709 13:11:01.459226 24567 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:01.481647 19266 leader_election.cc:400] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15.
I20260709 13:11:01.461249 24532 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:01.478605 24809 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:01.430985 24835 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:01.456727 24807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.009s	sys 0.005s
I20260709 13:11:01.415966 24932 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.470065 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2291) took 1369 ms. Trace:
W20260709 13:11:01.460775 24938 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:01.510972 19266 leader_election.cc:403] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:01.273082 19115 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 11, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:01.530071 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 62962.1us
W20260709 13:11:01.530966 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 74381.3us
W20260709 13:11:01.514751 24807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.017s	sys 0.010s
I20260709 13:11:01.480383 24877 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:01.510187 24801 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:01.550518 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:01.550278 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:01.550194 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 68754.4us
I20260709 13:11:01.453174 24908 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:11:01.515595 19220 rpcz_store.cc:276] 0709 13:11:00.100970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.101180 (+   210us) service_pool.cc:224] Handling call
0709 13:11:00.101534 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.732709 (+631175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.732737 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.765247 (+ 32510us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.960261 (+195014us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:01.224996 (+264735us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.433526 (+208530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.451884 (+ 18358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.469808 (+ 17924us) raft_consensus.cc:1685] finished
0709 13:11:01.469825 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.470003 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629118,"prepare.queue_time_us":352407,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":727591,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":17355,"thread_start_us":570615,"threads_started":3,"wal-append.queue_time_us":260935}
I20260709 13:11:01.564215 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:01.564535 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.513803 24809 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:01.455550 24939 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:11:01.567754 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:01.570880 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:01.575042 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:01.558284 24502 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:01.570443 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:01.558001 24801 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.513895 24901 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.575773 19903 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.581897 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:01.582553 19367 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.577136 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.576984 19369 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.558739 24941 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:01.593335 24502 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:01.575493 24944 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:01.584236 24813 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.610893 24650 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.618599 24773 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.991s	user 0.007s	sys 0.004s
I20260709 13:11:01.618099 24650 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:01.619746 24832 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.002s
I20260709 13:11:01.600965 19115 catalog_manager.cc:5697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 13, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.572484 24942 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15.
I20260709 13:11:01.621982 19115 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.616369 24944 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.625041 24944 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.625321 24932 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:01.581627 24726 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.606194 24835 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.570391 24940 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:01.568142 24946 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:01.617340 24337 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.595968 19369 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:01.636193 19365 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:01.580096 24801 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.642419 19900 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:01.636951 19903 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:01.640023 19372 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:11:01.616905 24813 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:01.645607 24947 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:01.647610 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.648674 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet aff34caf0ca44db08f7c49f51ca52966 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:41698
I20260709 13:11:01.648911 24624 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.649991 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:01.651352 24624 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:01.651214 24650 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.582589 24923 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.656699 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:01.659337 19369 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:01.616910 24888 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.664892 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:01.669418 19367 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:01.679376 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102312us
I20260709 13:11:01.634070 24931 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:11:01.659117 24946 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:01.681977 24650 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:01.687132 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74395.1us
I20260709 13:11:01.617142 24809 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.688475 24726 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.698798 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.700821 19300 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:01.702050 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:01.702594 19221 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:01.683812 24923 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:01.720100 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.720551 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.722976 19295 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:01.689967 24813 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.692255 24932 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.724393 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.724470 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.728048 19224 raft_consensus.cc:2410] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:01.725880 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.698772 24832 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.702919 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:01.723771 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.695824 24650 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.732460 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.732674 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.732973 19220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:01.733606 19220 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.733994 19220 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.731523 19217 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:01.730082 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.730783 19222 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:01.652643 19115 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 13, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.736456 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.737282 19219 raft_consensus.cc:2368] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15.
I20260709 13:11:01.737381 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.737144 19115 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 15, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.738078 24832 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.738966 19115 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 7 to 12, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 12 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:11:01.740285 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.740530 19115 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 13 to 16, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.743432 19300 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:01.742241 19115 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.745335 19220 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.745517 19115 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.751694 19221 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:01.753067 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.746222 24853 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.747803 19216 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:11:01.749781 24567 ts_tablet_manager.cc:1434] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.793s	user 0.010s	sys 0.015s
I20260709 13:11:01.759701 19222 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:01.760428 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.762121 19296 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:01.727638 24954 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:01.763058 24567 ts_tablet_manager.cc:1467] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Tablet startup took 814ms
I20260709 13:11:01.763315 19115 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:01.765724 24910 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.954s	user 0.000s	sys 0.003s
I20260709 13:11:01.770582 19220 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:01.771987 24741 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:01.771872 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:01.800789 19218 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:01.775385 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.727360 24726 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.763197 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.778170 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.776798 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:01.778330 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:01.806506 19295 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:01.778321 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.779563 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:01.808796 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:01.734275 24650 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:01.703181 24807 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:11:01.798430 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:01.819496 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 188802us
I20260709 13:11:01.820295 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:01.829154 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:01.815735 19216 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:01.810402 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:01.813542 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:01.815379 19218 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:01.860881 19218 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.863059 19224 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:01.863134 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:01.863868 19900 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:01.863997 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53662.2us
I20260709 13:11:01.815533 24532 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:01.853089 24889 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.868649 24889 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.870935 24889 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:01.854362 24875 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:11:01.761607 24932 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:01.806669 24832 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.800555 24741 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:01.874054 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:01.872953 24940 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:01.877990 24940 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.878407 24940 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.878365 24741 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.879629 24741 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.880316 24648 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:01.817082 24939 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.887112 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:01.892724 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:01.892976 19900 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:01.824554 24884 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:01.853314 24901 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:01.860728 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:01.896100 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.900455 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:01.796104 24954 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.800897 24946 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.912551 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:01.905197 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.921123 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:01.851748 24723 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:01.938848 19295 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:01.938357 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:01.938253 19294 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:11:01.942544 19295 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:01.892338 24931 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:11:01.923417 24934 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.506s	user 0.000s	sys 0.008s
I20260709 13:11:01.906447 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet aff34caf0ca44db08f7c49f51ca52966 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
I20260709 13:11:01.953845 19901 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:01.901077 24846 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:01.928129 24765 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:01.958709 19265 leader_election.cc:400] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15.
W20260709 13:11:01.953692 19895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 913) took 1709 ms (client timeout 1742 ms). Trace:
I20260709 13:11:01.954299 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2643) took 1079 ms. Trace:
I20260709 13:11:01.958663 19370 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.999116 19295 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:01.895697 24648 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:01.925563 24933 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 13:11:01.957691 24051 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.022873 19366 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:11:01.920658 24960 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:02.011140 19110 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 104855us
I20260709 13:11:01.885108 19115 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 13, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 13 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:01.905570 24545 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
W20260709 13:11:01.939581 24924 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.004s
I20260709 13:11:01.924924 24932 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:01.904526 24964 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.088399 19295 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.960476 24537 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.963155 24764 consensus_meta.cc:287] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.003s
W20260709 13:11:02.088939 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130393us
I20260709 13:11:01.896525 24726 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.090809 19223 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:01.974951 24954 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.089540 24933 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.896709 24939 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.089437 19371 rpcz_store.cc:276] 0709 13:11:00.875080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.875195 (+   115us) service_pool.cc:224] Handling call
0709 13:11:00.892910 (+ 17715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.934717 (+ 41807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.934760 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.934814 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:00.934878 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.954060 (+1019182us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:01.954109 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.954242 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95524736}
I20260709 13:11:02.201913 24939 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:02.203189 24962 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:11:02.206329 24944 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 13:11:02.206874 24944 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.209085 19219 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:02.088814 24765 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:02.090655 19895 rpcz_store.cc:269] 0709 13:11:00.244477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.244858 (+   381us) service_pool.cc:224] Handling call
0709 13:11:01.953435 (+1708577us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540049f054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:01.953601 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702992640}
I20260709 13:11:01.908807 24953 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:01.928345 24884 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:01.906075 24733 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:01.968104 24337 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.914286 24532 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:11:01.941256 24500 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.916654 24940 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.025455 24934 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:02.111652 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.049464 24683 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.091392 24966 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:02.175777 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44649.2us
I20260709 13:11:02.221797 24953 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.176465 24723 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:02.186029 24650 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.187147 19115 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 14, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:02.189141 24948 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.514s	user 0.003s	sys 0.000s
I20260709 13:11:02.099889 24545 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.126286 24537 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:01.788551 24567 ts_tablet_manager.cc:1469] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Trace:
0709 13:10:51.775753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.778978 (+  3225us) service_pool.cc:224] Handling call
0709 13:10:52.563342 (+784364us) ts_tablet_manager.cc:934] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
0709 13:10:53.909594 (+1346252us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:54.241512 (+331918us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:54.241640 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:54.594120 (+352480us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:54.594488 (+   368us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:54.594819 (+   331us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:54.594883 (+    64us) inbound_call.cc:177] Queueing success response
0709 13:10:56.686535 (+2091652us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b18004b84a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4c6ced8 00007fe8d4dc7de2 00007fe8dce2cd23 00007fe8dce2c55d 00007fe8dcec83d8 00007fe8dcef9f4e 00007fe8dcedefdd
0709 13:10:58.634819 (+1948284us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:00.958847 (+2324028us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:01.284665 (+325818us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:01.285326 (+   661us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":44951,"mutex_wait_us":20888,"raft.queue_time_us":45016,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7284,"spinlock_wait_cycles":6141824,"tablet-copy.queue_time_us":589335,"tablet-download-pool.queue_time_us":1132,"tablet-download-pool.run_cpu_time_us":1334,"tablet-download-pool.run_wall_time_us":2407383,"thread_start_us":583896,"threads_started":3}
I20260709 13:11:02.193975 24648 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:02.199774 24801 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.000s
W20260709 13:11:02.212698 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.215049 19295 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:02.219861 19370 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
W20260709 13:11:02.258033 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.258172 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2210) took 1338 ms. Trace:
I20260709 13:11:02.097625 24964 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.099560 24924 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:02.258646 19370 rpcz_store.cc:276] 0709 13:11:00.920287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.920432 (+   145us) service_pool.cc:224] Handling call
0709 13:11:01.958285 (+1037853us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b58006638d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb927c 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c
0709 13:11:02.258123 (+299838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3754240}
I20260709 13:11:02.099817 24931 consensus_queue.cc:1243] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:02.121408 24936 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:02.119895 24854 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:02.239187 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.253849 24537 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.254061 24972 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.228279 24733 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.241930 24953 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.228622 24500 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:02.268018 19370 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:02.279901 19370 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:02.242708 24966 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.289937 24966 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.291004 24940 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:02.292443 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 431762us
I20260709 13:11:02.293226 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:02.293994 24650 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.294353 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.294777 24847 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:02.295258 24847 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:02.295527 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.249396 24811 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.279752 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.278841 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 51) took 1594 ms. Trace:
I20260709 13:11:02.279697 24854 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.259702 24964 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:02.271844 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.270592 24884 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.282354 19115 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 12 to 15, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.260771 24765 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.278636 24537 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.261261 24801 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.259836 24939 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.256860 24545 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.286348 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2304) took 1288 ms. Trace:
I20260709 13:11:02.242192 24683 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.261188 24936 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:02.272073 24975 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.319881 24726 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.296116 24847 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.320406 24726 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.296470 24811 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.322446 24726 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:02.296795 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.326030 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:02.326794 19900 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.328466 24532 consensus_queue.cc:1243] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:02.329083 24807 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:02.297883 19368 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:02.304883 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.305799 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.308538 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.334111 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.334587 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:02.335152 19371 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.315963 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1042) took 1279 ms. Trace:
W20260709 13:11:02.339450 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 441259us
I20260709 13:11:02.308882 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.313650 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.340294 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:02.310858 24545 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.303033 24853 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.341842 24853 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:02.343701 24945 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.344362 24945 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.344906 24945 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.312479 24936 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.316488 24923 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.302126 24500 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.316967 24927 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:02.305788 24603 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:02.352730 24603 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:02.323163 24811 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.353605 24603 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.329674 24807 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:02.354934 24603 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.355291 24807 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.339543 19373 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:02.356609 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:02.358593 19901 rpcz_store.cc:276] 0709 13:11:01.036848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.036989 (+   141us) service_pool.cc:224] Handling call
0709 13:11:01.953564 (+916575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.011133 (+ 57569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.315767 (+304634us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540049f050. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:02.315902 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2107220736}
W20260709 13:11:02.318421 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.304540 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.320782 24847 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.305490 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.298007 19291 rpcz_store.cc:276] 0709 13:11:00.674680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.674826 (+   146us) service_pool.cc:224] Handling call
0709 13:11:02.269269 (+1594443us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54001d56d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:02.269354 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309361408}
I20260709 13:11:02.306643 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.308758 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:02.401242 19367 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:02.329473 24908 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:11:02.366107 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70654.1us
I20260709 13:11:02.381232 19371 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:02.402432 19368 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.414096 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.402845 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:02.310161 19225 rpcz_store.cc:276] 0709 13:11:00.997671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.997792 (+   121us) service_pool.cc:224] Handling call
0709 13:11:00.998127 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.206951 (+208824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.206984 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.207457 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.514174 (+306717us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:01.514239 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.514347 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.973987 (+459640us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:02.285993 (+312006us) raft_consensus.cc:1685] finished
0709 13:11:02.286021 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.286277 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32979,"raft.queue_time_us":255139,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":6581504,"thread_start_us":378790,"threads_started":2,"wal-append.queue_time_us":359315}
W20260709 13:11:02.416054 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75833us
I20260709 13:11:02.403743 19372 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:02.311985 19370 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.316708 24624 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:11:02.390130 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.413816 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.415799 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.338992 24934 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.306128 24860 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:02.416429 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 107735us
I20260709 13:11:02.304131 24809 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.308126 24801 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.306669 24537 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.306416 24765 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.311787 24773 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:02.422657 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.420564 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:02.339246 24832 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:02.311699 24683 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.297688 24733 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.314851 24890 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:02.318642 24946 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:02.429380 19295 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:02.428828 24877 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:02.402205 24811 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:02.445930 24885 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.486641 24811 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.487282 24811 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.487123 24885 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.488806 19373 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:02.489295 24885 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.366472 24853 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.490975 24537 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.436142 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:02.491500 24537 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:02.300596 24944 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.492218 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.302393 24854 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.307020 24939 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.435300 24844 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.493759 24844 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.494969 24939 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.495599 19366 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:02.495714 24844 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.314523 24671 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:02.428303 24436 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.460790 24773 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:02.496471 24436 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:02.496914 24436 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.497090 24773 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.498287 24946 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:02.416425 24500 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.499462 24946 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.500475 24500 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.477841 24890 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:02.503090 24500 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.424114 24510 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:02.453542 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:02.478627 24927 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.504779 24927 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.505070 24927 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.505254 19296 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:02.477433 24832 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:02.506620 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:02.318698 24975 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.507004 24832 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.306032 19115 catalog_manager.cc:5697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 9, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 9 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:02.509296 19115 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 12, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 12 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.511022 19115 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 11, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.457365 24835 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.458669 19217 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:02.459292 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.513154 24671 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:02.512920 24835 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.513594 19222 raft_consensus.cc:2376] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15. Re-sending same reply.
I20260709 13:11:02.308809 24972 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.514230 24671 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.515012 24835 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.515965 24972 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.516575 19895 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:02.516747 24975 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.516691 24811 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.460177 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.448503 24933 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.445518 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:02.521481 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76034.3us
I20260709 13:11:02.521874 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:02.464782 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44293.6us
I20260709 13:11:02.435204 24973 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:02.465782 24502 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.469831 19225 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:02.316278 24953 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.475528 19368 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:02.430382 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.478351 24930 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.543282 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.444250 24934 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.544401 19898 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:02.416193 24647 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.503451 24890 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.518755 19218 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:02.427495 24726 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:02.458714 24964 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.529910 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.531733 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:02.547566 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.535444 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.537721 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.549296 19373 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:02.541680 19291 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:02.443524 24860 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.542167 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.545389 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.550192 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.525431 24510 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.550679 19220 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:02.538906 24885 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.569885 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:02.570605 19367 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.551378 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.571758 19291 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:02.555918 19902 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:02.552904 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.553439 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.550472 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.557936 24966 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.535974 24532 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:02.558171 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-1668ce4cb86e4e9daf99a53a2be8a396 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:11:02.552726 24972 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:02.600845 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-1668ce4cb86e4e9daf99a53a2be8a396 on tablet 1668ce4cb86e4e9daf99a53a2be8a396 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:02.601015 24972 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:02.559180 19216 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:02.602200 19216 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:02.561868 24811 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.602098 24972 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.525242 24436 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.563066 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.564412 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.567220 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:02.605268 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.606561 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.591310 24953 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.550607 24930 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.615707 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.618788 19218 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:02.621295 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.622784 19292 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:02.598035 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.544826 24973 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:02.536557 24933 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.600693 24532 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.558625 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.652323 19225 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:02.610867 19365 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:02.633754 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.642225 19367 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:02.655095 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:02.655321 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:02.656999 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:02.658656 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:02.664876 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.667511 19292 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:11:02.577848 24966 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.672128 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.672731 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.673468 19223 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.673767 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:02.544548 24502 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.672791 19297 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:02.681900 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.674322 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.674719 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.616437 24924 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.549970 24662 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:11:02.642556 24537 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.704664 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.705691 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.669394 24890 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:02.680212 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.630131 24645 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:02.682587 19296 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:02.716336 19295 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:11:02.556533 24647 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.630445 24648 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.675550 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.687950 19221 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:02.603652 24885 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.676642 24953 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:02.680541 24966 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.693432 24964 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.694316 24502 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.681129 24975 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:02.588371 24723 consensus_queue.cc:1175] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56df67425e6f45d3b2b42441e3c143ba" responder_term: 11 status { last_received { term: 10 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:02.598918 19115 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 5 to 11, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 11 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:02.698184 24934 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.686566 24811 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:02.700992 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.790931 24811 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.791445 24811 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.791038 19115 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.792047 19218 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:02.793018 19115 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.701187 24860 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.794567 19115 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 12, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 12 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.702284 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.797958 24885 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.798552 24883 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:02.799428 19217 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:11:02.800283 24723 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:02.800714 24723 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:02.800475 19115 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 6 to 13, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.801617 24723 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.802843 24723 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.802328 19115 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.677986 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:02.686444 19216 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.774345 24648 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.669370 24726 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:02.709852 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.718254 19223 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:02.711977 24645 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.722167 24933 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.683439 24976 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.683280 24940 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.725997 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:02.814108 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 379248us
I20260709 13:11:02.814299 19374 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:02.719908 24436 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:02.742808 19898 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:02.745611 24936 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.748399 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.751829 24930 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.753149 24532 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.754629 19373 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:02.755781 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.714596 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.767371 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.769659 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.769721 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.702914 24537 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.777976 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.779275 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.776902 24953 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:02.785976 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.789716 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.866125 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.782253 24662 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:02.805080 19216 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.866189 24537 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.808651 19220 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:02.810058 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.816447 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.818464 19291 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:11:02.810882 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 132988us
I20260709 13:11:02.811939 19297 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:02.973569 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:02.834697 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:02.974100 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.974520 19223 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:02.975656 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:02.977032 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:02.835706 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.702840 24924 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.854683 19225 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.856591 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.859592 19372 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:02.860064 19296 raft_consensus.cc:2376] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16. Re-sending same reply.
I20260709 13:11:02.856756 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:02.986011 19369 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:02.854710 19298 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:02.993160 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:02.813454 24502 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:02.808351 24645 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.999739 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.945900 24733 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:02.740083 24927 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:02.833889 24976 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:02.946506 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 88693us
I20260709 13:11:02.806442 24648 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:02.925810 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.701813 24973 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:02.809716 24528 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:02.944311 19371 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:02.864606 24975 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:02.805904 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.965593 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.973706 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:03.014323 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.014910 19895 raft_consensus.cc:2410] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:03.016968 19225 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
W20260709 13:11:02.972813 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 231996us
I20260709 13:11:02.995383 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:02.995502 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.023286 19221 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:02.996506 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.023839 19291 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:03.024153 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.024900 19371 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:03.025400 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:02.985386 24603 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.808136 24647 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:02.851068 24940 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.041954 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.001230 19367 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:03.001433 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:03.002688 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:02.859078 24726 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:11:03.006615 19372 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:03.008095 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:03.052867 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51559.6us
W20260709 13:11:03.056627 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48624.3us
I20260709 13:11:03.058236 19369 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:03.024717 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:02.804535 24942 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:11:03.026126 19224 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:02.997929 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.059777 19223 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:03.000792 24532 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:03.027014 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.004642 24984 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.007133 24945 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.007s
W20260709 13:11:03.039994 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.044075 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.052618 19217 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:02.804136 19115 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:03.026248 24847 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.001s
I20260709 13:11:03.062947 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:02.994518 24662 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.063728 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.064231 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.087467 19371 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:11:03.051733 19298 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:03.027484 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.066354 19216 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:03.090524 19216 pending_rounds.cc:85] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 7
I20260709 13:11:03.090600 19373 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:03.008015 24977 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.999209 24807 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:11:03.071420 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.071475 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.026734 24051 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.006898 24976 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:03.055168 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52576.1us
I20260709 13:11:03.101011 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:03.076720 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:03.077526 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 115180us
I20260709 13:11:03.077749 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:03.075910 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:03.000039 24934 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:11:03.015951 24528 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:03.076022 19221 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:03.074867 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:03.063489 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.090808 19216 pending_rounds.cc:107] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:03.103200 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.103523 19216 raft_consensus.cc:2889] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.067637 19898 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:03.103776 19221 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:03.104252 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2861) took 1293 ms. Trace:
I20260709 13:11:03.104640 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.104573 19216 rpcz_store.cc:276] 0709 13:11:01.810885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.874792 (+ 63907us) service_pool.cc:224] Handling call
0709 13:11:01.903226 (+ 28434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.559090 (+655864us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540009f4a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb71c0 00007fe8d7eb8231 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c
0709 13:11:02.686138 (+127048us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b4c00077700. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d6181a20 00007fe8d6192a29 00007fe8d6158644 00007fe8d617ff2d 00007fe8d617fb93 00007fe8d7eb018b 00007fe8d7eb0cb5 00007fe8d7eabf30 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416
0709 13:11:03.104007 (+417869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.104204 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996253696}
I20260709 13:11:03.105260 19221 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:03.105387 24832 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:03.105793 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.106354 19216 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:03.091425 19293 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:03.016443 24846 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:11:03.065459 24647 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:03.098258 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:03.009598 24733 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.112231 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.074227 24502 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.112648 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.112879 19298 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:03.079082 24532 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:03.102023 19223 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:03.037487 24975 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.108711 19292 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.109910 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:03.072314 24500 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:03.082696 24941 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:11:03.114849 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:03.134491 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:03.119129 19221 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:03.107780 24647 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.071635 24966 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.051013 24603 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.132031 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.079355 24984 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.135116 19300 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.082674 24945 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.052078 24953 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.116436 24934 consensus_queue.cc:1243] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:03.132612 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:03.150337 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.150709 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:03.158897 19292 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:11:03.118180 24832 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:03.124094 24955 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:11:03.173709 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:03.163687 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53846.4us
I20260709 13:11:03.176276 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:03.176373 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:03.178335 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:03.125837 24844 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:03.134104 24500 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.181777 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.149410 24647 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.146143 24908 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:03.112843 24051 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.150884 24502 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:03.173705 24436 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:03.169816 24954 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.186616 19222 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:03.170624 24986 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:03.179021 24832 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:03.217039 19298 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:03.182397 24927 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.200547 24436 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:03.224048 24988 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:11:03.225705 24990 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:11:03.227083 24993 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:11:03.228618 24985 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:11:03.230372 24992 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:11:03.232664 24987 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:03.235620 19900 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:03.200982 25007 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.204875 24726 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:03.208506 24532 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.209105 24945 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.210399 24733 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.219128 24844 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:03.211764 24966 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.189728 24977 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:03.258908 24977 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:03.259294 24977 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.212297 25005 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:11:03.261206 25005 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:03.261555 25005 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:03.262364 25005 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.263535 25005 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:03.272322 24809 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.000s
I20260709 13:11:03.213238 24975 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.215274 24984 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.275233 24436 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.198854 19115 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 6 to 8, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 8 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.278148 19115 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 4 to 10, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.280985 25004 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.281313 24051 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.281575 25004 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.175000 24528 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.216079 24954 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.179421 24885 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:03.193125 24980 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:11:03.185904 24934 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:03.186585 24500 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.222397 19291 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:03.238798 19300 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:03.241647 19298 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:03.282056 24977 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.292416 24934 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:03.292868 24934 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.242057 24603 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.243023 24940 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:03.243371 25001 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:03.218544 24924 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.212074 24662 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:03.217463 24986 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:03.254194 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 80554.4us
I20260709 13:11:03.302402 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.219399 24908 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:03.288020 24885 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.309183 24645 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:03.309779 24954 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.310379 24885 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.310575 19296 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:03.312244 24645 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.257407 24844 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.296715 19370 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:03.312944 24537 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.315272 19298 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:03.255208 24811 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.321125 19295 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:03.323109 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.256518 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71892us
I20260709 13:11:03.337028 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:03.338851 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:03.342659 19191 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:11:03.342984 19191 leader_election.cc:403] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:03.343511 24940 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:03.344280 24940 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.345714 19370 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:03.346179 19370 pending_rounds.cc:85] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 8
I20260709 13:11:03.346501 19370 pending_rounds.cc:107] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:03.346805 19370 raft_consensus.cc:2889] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.347822 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 965) took 1080 ms. Trace:
I20260709 13:11:03.348886 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.352193 19219 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:03.354313 19899 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 13. Ops: []
I20260709 13:11:03.368548 19370 rpcz_store.cc:276] 0709 13:11:02.267190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.267554 (+   364us) service_pool.cc:224] Handling call
0709 13:11:02.267884 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.288084 (+1020200us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540010c0a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2aa1d 00007fe8d7e111a4 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419
0709 13:11:03.347490 (+ 59406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.347762 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268399488}
I20260709 13:11:03.306748 24908 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.319742 24984 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:03.306427 24986 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.372776 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.374452 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.376396 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:03.380848 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.382719 25008 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.384999 19368 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:03.388082 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.388597 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.388795 19370 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:11:03.388947 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.389823 19374 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:11:03.390952 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.300276 24976 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.339852 24977 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.340567 24954 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.398694 19366 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:03.350215 24844 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:03.365450 24603 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.365954 25003 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.414232 19374 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:03.414857 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.373382 24984 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.380381 24908 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.421056 19223 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:11:03.422470 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.425284 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.383515 25008 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.285665 19115 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.437521 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:03.423009 24984 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.422806 25007 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.452045 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.461323 24976 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.448431 24927 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:11:03.467028 24811 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.427023 24954 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:03.465610 24940 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:11:03.409869 24647 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.472077 25008 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.436954 24502 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:03.429235 24977 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:03.419328 24603 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.493808 24885 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:03.495357 24934 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.501144 19216 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:11:03.504416 25000 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:11:03.507896 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:03.508185 25004 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.418074 25003 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.508750 24954 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.509087 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:03.656201 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 147172us
I20260709 13:11:03.656656 24940 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.656852 24954 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:03.656968 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:03.657732 24954 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:03.657895 24975 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.658280 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:03.658543 24975 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:03.476562 25007 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.510592 24537 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.513898 24973 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:03.660641 25007 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.448426 24832 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:03.661501 24832 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:03.511106 24773 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.662448 24832 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.517619 24647 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:03.664505 19366 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:11:03.618829 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.629674 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.654012 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.666500 24809 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:03.666811 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:03.667475 19216 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.671727 24603 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:03.672438 24934 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.604424 24977 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.673918 24977 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.674737 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:03.675964 19216 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:03.677315 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.654443 25003 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:03.658219 24954 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:03.524540 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.683650 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.684113 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.684844 19898 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:03.528718 24502 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:03.678545 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:03.680657 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:03.684240 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.695400 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:03.715572 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:03.737896 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59525us
I20260709 13:11:03.750131 19373 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:03.748579 24537 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.753831 24537 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:03.754263 24537 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.759070 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.760629 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.761857 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.763453 19367 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:03.772753 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:03.785853 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2319) took 1100 ms. Trace:
W20260709 13:11:03.762029 25000 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:03.790407 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:03.678355 25004 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:03.796087 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:03.805635 19223 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.786346 19222 rpcz_store.cc:276] 0709 13:11:02.684976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.769375 (+ 84399us) service_pool.cc:224] Handling call
0709 13:11:03.785631 (+1016256us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54001c4154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:03.785775 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748880768}
I20260709 13:11:03.799206 19365 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:03.767805 24502 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.737043 24934 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:11:03.738430 24844 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.714169 24940 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.826049 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:03.841857 19216 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:11:03.847266 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.772882 24964 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:11:03.852731 19294 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:03.811915 24603 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.865232 19216 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:03.865824 19216 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:03.870136 19223 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:03.831828 24502 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.875746 24502 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.877624 24537 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.879765 24537 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.839929 24936 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:11:03.884306 24500 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.002s
I20260709 13:11:03.884459 24977 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.885515 24436 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.885080 24500 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.886018 24436 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:03.887844 24977 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.889348 24436 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:03.901772 19216 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.903067 19216 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.907513 24908 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.916867 24908 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.900672 24844 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.887773 24500 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.930886 24954 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.934284 24940 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.866880 24603 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.940311 24500 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:03.941210 24603 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:03.941053 24500 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:03.947368 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 179831us
I20260709 13:11:03.938117 24984 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.906438 24986 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:03.958701 24964 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:03.954797 25004 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:11:03.953545 24809 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:11:03.973440 19374 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:03.976831 24986 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:03.979882 19216 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:11:03.981190 19216 pending_rounds.cc:85] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 8
I20260709 13:11:03.981499 19216 pending_rounds.cc:107] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:11:03.981804 19216 raft_consensus.cc:2889] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:03.983464 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 162360us
I20260709 13:11:03.996505 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2280) took 1110 ms. Trace:
I20260709 13:11:03.996984 19298 rpcz_store.cc:276] 0709 13:11:02.886586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.341545 (+454959us) service_pool.cc:224] Handling call
0709 13:11:03.372397 (+ 30852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.395856 (+ 23459us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:03.685274 (+289418us) log.cc:844] Serialized 14 byte log entry
0709 13:11:03.945933 (+260659us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.960539 (+ 14606us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.960808 (+   269us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:03.960858 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.960948 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.996249 (+ 35301us) raft_consensus.cc:1685] finished
0709 13:11:03.996274 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.996437 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":471237,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":194,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":15563,"thread_start_us":458878,"threads_started":2,"wal-append.queue_time_us":243647}
I20260709 13:11:03.970571 24964 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.011785 24964 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.017292 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.017423 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:04.025653 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 724) took 1429 ms (client timeout 1903 ms). Trace:
W20260709 13:11:04.026086 19220 rpcz_store.cc:269] 0709 13:11:02.596547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.629075 (+ 32528us) service_pool.cc:224] Handling call
0709 13:11:04.025397 (+1396322us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000e4554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.025584 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289340160}
I20260709 13:11:04.027612 19222 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:04.031330 24984 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.033015 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 828) took 1607 ms. Trace:
I20260709 13:11:04.033553 19899 rpcz_store.cc:276] 0709 13:11:02.425686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.446093 (+ 20407us) service_pool.cc:224] Handling call
0709 13:11:02.463625 (+ 17532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.380117 (+916492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.032723 (+652606us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54006c48d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:04.032943 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047852288}
I20260709 13:11:04.029395 24888 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:04.036417 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2261) took 1392 ms (client timeout 1618 ms). Trace:
W20260709 13:11:04.036770 19297 rpcz_store.cc:269] 0709 13:11:02.643924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.681686 (+ 37762us) service_pool.cc:224] Handling call
0709 13:11:02.811740 (+130054us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54002b3520. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb8e18 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:04.036257 (+1224517us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b5400031e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.036363 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237333632}
I20260709 13:11:04.035145 24671 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:04.038249 24953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.007s	sys 0.022s
W20260709 13:11:04.043982 24953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.007s	sys 0.022s
W20260709 13:11:04.044299 24946 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:11:04.045253 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2312) took 1428 ms. Trace:
I20260709 13:11:04.045528 19224 rpcz_store.cc:276] 0709 13:11:02.617111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.797189 (+180078us) service_pool.cc:224] Handling call
0709 13:11:02.797407 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.059453 (+262046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.045068 (+985615us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:04.045210 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499515264}
I20260709 13:11:04.036036 24500 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:04.038178 24888 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.047533 24888 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.047792 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2279) took 1201 ms. Trace:
I20260709 13:11:04.048425 19294 rpcz_store.cc:276] 0709 13:11:02.846320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.038353 (+192033us) service_pool.cc:224] Handling call
0709 13:11:04.047555 (+1009202us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540008fa54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.047714 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733465344}
I20260709 13:11:04.054494 19224 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:04.055444 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.055737 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.056869 19216 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:04.057101 19372 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:04.057396 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.056756 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.057987 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.056488 19373 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:04.059119 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.060030 19898 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:04.059412 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.060807 19371 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:04.062415 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.063232 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.061893 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:04.063372 19372 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:04.064913 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.065899 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.064453 24603 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:04.067294 24603 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.067642 24603 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:04.068249 19898 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:04.069586 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.070509 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:04.070629 24999 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.071652 19224 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 5: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:04.056447 24984 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:11:04.072502 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:04.073026 24854 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:04.073357 24537 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:04.073910 24537 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:04.074712 24537 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.077778 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2670) took 1141 ms. Trace:
I20260709 13:11:04.063369 24946 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:04.078197 19369 rpcz_store.cc:276] 0709 13:11:02.936464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.002785 (+ 66321us) service_pool.cc:224] Handling call
0709 13:11:03.057928 (+ 55143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.058646 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.077597 (+1018951us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5400357850. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.077722 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126264576}
I20260709 13:11:04.078855 24946 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:04.079301 24946 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.080072 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1057) took 1060 ms. Trace:
I20260709 13:11:04.080770 24999 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:04.073439 24854 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:04.082206 24854 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.083328 24854 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.083817 25019 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:04.084797 24986 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:04.085134 24986 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:04.085832 24986 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.088338 24964 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:04.088707 24986 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.091061 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.080634 19902 rpcz_store.cc:276] 0709 13:11:03.019888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.020037 (+   149us) service_pool.cc:224] Handling call
0709 13:11:03.025591 (+  5554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.135620 (+110029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.135653 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:03.135691 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:03.135721 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.079849 (+944128us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54004f0954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:04.079897 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.080018 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252570880}
W20260709 13:11:04.092386 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.092795 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2276) took 1360 ms. Trace:
I20260709 13:11:04.093466 24500 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:04.094036 24500 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.093173 19296 rpcz_store.cc:276] 0709 13:11:02.732132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.112413 (+380281us) service_pool.cc:224] Handling call
0709 13:11:04.092615 (+980202us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003f25d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.092738 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453397760}
I20260709 13:11:04.097379 24500 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.062798 24953 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.098832 24953 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.101446 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.101689 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.102092 19296 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:04.102360 19294 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.103374 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.103552 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.105202 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.105942 19294 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.105793 24845 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.106295 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.106480 24845 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.106913 19299 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:04.107792 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.108633 19295 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:11:04.109454 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.110070 19292 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:04.110847 24845 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.112376 24888 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.113273 24885 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.115758 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.117431 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.105432 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.118536 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.119138 19299 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:04.120146 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.120111 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.121106 19295 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:11:04.122191 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.123437 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.105705 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.124073 19295 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 5.
I20260709 13:11:04.125746 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.127794 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.116323 19291 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:11:04.134820 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.136065 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.137108 19297 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 12: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.141894 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.142494 19293 raft_consensus.cc:2376] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17. Re-sending same reply.
I20260709 13:11:04.143265 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.143977 19293 raft_consensus.cc:2410] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:11:04.145434 19292 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:04.146759 19292 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:11:04.150781 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.156404 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.158375 19300 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.152849 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.152839 19295 raft_consensus.cc:2368] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:04.160707 24953 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.147648 24984 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:11:04.162985 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.163746 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.165864 24888 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.166208 19294 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:04.164374 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.163997 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.167346 19294 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:04.167061 24603 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.167992 19293 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:04.167069 19291 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:04.165287 19292 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:04.169268 24603 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.171723 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.172319 19298 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:04.174861 24946 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.191815 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.189141 24885 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.192715 19291 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.192773 24885 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.192101 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.192037 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.197685 24885 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:04.197914 24877 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:04.200464 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.176224 19292 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:11:04.180116 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.210870 19298 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.164490 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.211374 19372 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:04.181635 19296 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:04.183465 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.217687 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:04.209086 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:04.221091 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:04.223268 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.225335 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.178045 24741 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.251199 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.233686 19899 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:04.259539 24885 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:04.261897 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.262707 24500 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:04.264209 24860 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:04.259644 24845 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:04.266355 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.231976 19299 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:04.266426 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:04.266721 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.272150 19300 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:04.272192 19898 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:04.229553 24975 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:04.279963 19372 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:04.248231 24773 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.229120 24964 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.249992 24984 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:04.286572 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:04.247958 25007 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.249747 24953 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.266124 24671 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:04.302690 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.303196 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:04.298092 24941 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.304865 24941 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.313303 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2885) took 1509 ms. Trace:
I20260709 13:11:04.313784 19221 rpcz_store.cc:276] 0709 13:11:02.804325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.107513 (+303188us) service_pool.cc:224] Handling call
0709 13:11:03.118794 (+ 11281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.135679 (+ 16885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.313074 (+1177395us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b54000776d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.313228 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25275264}
I20260709 13:11:04.268142 24854 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:11:04.287029 24936 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:04.309275 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.325439 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.300007 24984 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.301258 24885 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:04.310253 24982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.015s	sys 0.004s
I20260709 13:11:04.310987 24983 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:04.329298 25021 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.333554 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.310179 25024 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.339229 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2313) took 1721 ms. Trace:
I20260709 13:11:04.330448 24939 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:04.364859 24939 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:04.365371 24939 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:04.354221 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.371282 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.353302 19217 rpcz_store.cc:276] 0709 13:11:02.617329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.800303 (+182974us) service_pool.cc:224] Handling call
0709 13:11:02.800583 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.079221 (+278638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.338914 (+1259693us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000e3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:04.339154 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555463936}
W20260709 13:11:04.334928 24982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.015s	sys 0.005s
I20260709 13:11:04.332311 24984 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.330811 24941 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.314455 25007 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.338341 24983 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.314252 24953 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.337688 24853 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:04.331830 24885 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.368628 24854 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.390074 25003 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:04.354255 24946 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.387234 24908 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.387372 25020 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.420738 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 134633us
I20260709 13:11:04.423985 24983 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:04.463518 24853 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:04.377400 25024 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.468009 24885 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:04.531718 19219 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:11:04.536268 25037 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:11:04.541759 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:04.542367 24844 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.526937 24946 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.544989 24528 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.545317 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.625506 19221 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.545634 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.544996 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:04.551651 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.507054 25003 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:04.640271 19217 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.571280 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.641685 19219 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.524696 24854 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.527459 24853 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:04.591400 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:04.624380 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.656138 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.657044 19299 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:04.658149 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.655889 19216 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.660250 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.618484 24955 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.646602 24945 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.639577 24844 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.684830 24945 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.687011 24844 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.687520 24945 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:04.646232 25003 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.688549 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.519224 25020 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.666189 19291 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:04.666980 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.692813 25020 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.693485 25020 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.694063 25020 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.667829 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:04.668869 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.698799 24936 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.608381 24811 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:04.699496 19293 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:04.699681 24811 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.700284 24811 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.681470 19298 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:04.650882 24854 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.707443 24945 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.708230 24945 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.709372 24854 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.711761 25007 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.712376 25007 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.712875 25007 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.715004 25007 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.683532 24955 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.687629 24844 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.731998 19221 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:04.743642 25042 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.744303 25042 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.746582 25021 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:04.711432 24945 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.640424 24603 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.732074 19296 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 5.
I20260709 13:11:04.753018 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2245) took 1072 ms. Trace:
I20260709 13:11:04.764459 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:04.786960 19297 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.786635 19374 rpcz_store.cc:276] 0709 13:11:03.680144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.680347 (+   203us) service_pool.cc:224] Handling call
0709 13:11:04.752749 (+1072402us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:04.752934 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541118720}
W20260709 13:11:04.770313 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 263625us
I20260709 13:11:04.782526 24844 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.804519 24844 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:04.808655 25044 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:11:04.810684 24955 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.740756 24941 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.746583 25042 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:04.747285 25021 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:04.649384 24946 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:04.848076 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.848596 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.815109 19297 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:11:04.800362 24603 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.834542 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.849692 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.850512 19368 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:04.850621 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.851023 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.852766 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.853014 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.853447 19216 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
W20260709 13:11:04.854441 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 171478us
W20260709 13:11:04.817276 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 245319us
I20260709 13:11:04.852807 19367 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:04.853662 19373 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:04.856941 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.857914 19372 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:04.858482 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.861176 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.783476 24936 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.816861 24877 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.003s
I20260709 13:11:04.811758 24941 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.865792 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.900503 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.901263 19223 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:04.901640 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:04.855090 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 277877us
I20260709 13:11:04.882757 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.894174 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.902396 19221 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:11:04.894745 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.865545 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.799695 25020 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.721158 25047 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.194s
I20260709 13:11:04.750600 24537 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:11:04.899791 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.903641 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:04.903661 19225 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
W20260709 13:11:04.898725 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.906595 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.908942 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:04.909191 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.911701 19216 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:04.845503 25007 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.906852 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:04.915282 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:04.855094 24844 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.857738 24955 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:04.918502 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.925498 19370 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:04.920210 19263 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:04.921528 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:04.926204 19371 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:04.922147 19220 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:04.921907 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.870082 24945 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.924378 19373 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:04.865314 24982 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:04.922701 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.925352 19217 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:04.903805 24764 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.865689 25061 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:04.929137 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:04.860122 24845 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:04.934185 19297 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:04.907714 24877 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.934834 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.939823 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.940366 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.940557 19297 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:04.931777 19373 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:04.941650 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.943406 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:04.936270 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:04.945479 19371 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:11:04.922633 24647 raft_consensus.cc:2764] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:04.900878 24936 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.962078 19369 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:04.933332 24953 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:04.933761 25061 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:05.001261 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52816.6us
I20260709 13:11:04.949457 25047 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.930430 25055 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:04.925315 25007 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.025215 19369 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:04.951435 25052 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.958323 24773 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:04.931761 24955 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:04.927914 24844 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:04.935822 24982 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.063515 24811 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.065622 24811 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:05.066241 24811 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:05.066712 24811 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.072846 24946 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:05.015683 25024 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:05.017231 25060 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.004004 25061 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:05.085165 25054 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:04.965062 25021 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.084256 25051 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.002712 25056 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:05.013623 24953 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:11:05.100620 19367 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:05.031127 24537 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:05.101310 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.110208 19219 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:04.965905 24436 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:11:05.119660 19368 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
W20260709 13:11:05.136840 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 207752us
I20260709 13:11:05.139822 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:05.121744 24939 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.756s	user 0.012s	sys 0.001s
I20260709 13:11:05.140607 19371 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.149035 24844 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.149899 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.150435 19371 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:05.152115 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:05.152848 24986 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:05.153136 19220 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:05.153296 24986 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:05.154289 24986 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.155412 24986 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.054211 24773 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.168553 24939 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.156788 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.176214 24811 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:05.157475 25064 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:11:05.183584 24939 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.183796 24975 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:05.185865 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.187587 24982 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:05.187757 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:05.187808 24603 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:05.191110 25041 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.658s	user 0.004s	sys 0.009s
I20260709 13:11:05.191365 24603 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:05.192416 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 735) took 1063 ms. Trace:
I20260709 13:11:05.193287 25064 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.194461 25064 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:05.125345 25056 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.195122 25064 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:05.195456 24500 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.134227 25051 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.195870 24500 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:05.196447 25064 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.196817 24500 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.178249 25007 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:05.186023 24936 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.178575 19219 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:05.198568 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2895) took 1409 ms. Trace:
I20260709 13:11:05.215466 19222 rpcz_store.cc:276] 0709 13:11:03.789191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.854581 (+ 65390us) service_pool.cc:224] Handling call
0709 13:11:04.025905 (+171324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.028109 (+  2204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.198369 (+1170260us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000e4550. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:05.198512 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393284864}
I20260709 13:11:05.201627 25081 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:11:05.206136 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56330us
I20260709 13:11:05.207813 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:05.221139 19225 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:05.208335 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:05.223001 19221 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:05.223977 24983 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
I20260709 13:11:05.224517 24983 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.210467 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:05.217082 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:05.217211 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:05.225854 19374 raft_consensus.cc:2368] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:11:05.208364 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:05.227837 19371 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:05.228807 19219 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:05.230155 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:05.192782 19218 rpcz_store.cc:276] 0709 13:11:04.128856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.129088 (+   232us) service_pool.cc:224] Handling call
0709 13:11:04.150963 (+ 21875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.151360 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.151390 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.189275 (+ 37885us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.329831 (+140556us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:04.329874 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.329952 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.190573 (+860621us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:05.192115 (+  1542us) raft_consensus.cc:1685] finished
0709 13:11:05.192134 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.192358 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1803,"spinlock_wait_cycles":39742848,"thread_start_us":59325,"threads_started":1,"wal-append.queue_time_us":305734}
I20260709 13:11:05.236333 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.237171 19295 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:05.241171 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.242007 19295 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.244480 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.246511 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.248386 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.250823 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:05.253844 24537 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.254293 24537 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:05.254650 24537 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.255168 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 989) took 1273 ms. Trace:
I20260709 13:11:05.255095 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.256489 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.253855 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:05.255631 19366 rpcz_store.cc:276] 0709 13:11:03.981348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.981524 (+   176us) service_pool.cc:224] Handling call
0709 13:11:03.986218 (+  4694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.986652 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.986693 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.987215 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.195052 (+207837us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18002e91e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:04.313220 (+118168us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:04.313254 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.313318 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.254172 (+940854us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b24001cf2f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e06fb0 00007fe8d7a7d488 00007fe8d7a7dbe8 00007fe8d7a55398 00007fe8d7a5076a 00007fe8d7a4fbb6
0709 13:11:05.254963 (+   791us) raft_consensus.cc:1685] finished
0709 13:11:05.254983 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.255113 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":29233,"spinlock_wait_cycles":17698432,"thread_start_us":117981,"threads_started":1,"wal-append.queue_time_us":557990}
I20260709 13:11:05.265254 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.266780 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.248073 25081 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:05.191869 24603 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:05.243252 24984 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.823s	user 0.008s	sys 0.003s
I20260709 13:11:05.195115 25056 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.243060 24528 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:05.273607 25081 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:05.287509 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 736) took 1158 ms. Trace:
I20260709 13:11:05.256878 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.200215 24773 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:05.197916 25051 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.301388 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:05.252753 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:05.307286 19293 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:05.305862 19224 rpcz_store.cc:276] 0709 13:11:04.129248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.131683 (+  2435us) service_pool.cc:224] Handling call
0709 13:11:04.151180 (+ 19497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.151506 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.151534 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.151945 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.556742 (+404797us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b18004abc60. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:04.878931 (+322189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:04.878988 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.879081 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.287156 (+408075us) raft_consensus.cc:1685] finished
0709 13:11:05.287184 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.287449 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":328,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":94,"spinlock_wait_cycles":65879808,"thread_start_us":309577,"threads_started":1,"wal-append.queue_time_us":803547}
W20260709 13:11:05.312096 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59426.9us
W20260709 13:11:05.312759 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 302344us
I20260709 13:11:05.270273 25007 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.285588 24647 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.273052 24983 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:05.272156 24975 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:05.346390 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 398678us
I20260709 13:11:05.348765 19295 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:05.288352 25042 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:05.367026 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.356684 24945 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.368908 24945 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.318907 24528 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:05.372985 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.372692 24528 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:05.374145 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.375250 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.372695 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.376266 25050 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.376648 25050 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:05.377445 25050 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.378602 25050 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.380887 24844 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:05.381945 25063 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:05.382587 25081 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.383988 24877 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:11:05.385924 25019 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:05.386324 25019 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:05.387107 25019 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.388258 25019 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.389182 24500 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.321499 25048 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:05.390203 25048 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.329228 25057 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.392503 25057 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:05.392584 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:05.393142 25057 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.342177 25065 raft_consensus.cc:2764] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:11:05.399153 19898 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:05.399322 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:05.362298 25060 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:05.401320 25060 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.405973 25061 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.362938 24946 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:05.408816 24946 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.411576 24946 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.414146 19374 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:05.338802 24975 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.419574 24975 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:05.317873 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 459444us
I20260709 13:11:05.319267 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:05.422590 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 103401us
I20260709 13:11:05.317960 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:05.424708 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 106813us
I20260709 13:11:05.326308 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:05.273754 25066 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:05.425426 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:05.426182 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 99945.3us
I20260709 13:11:05.426887 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:05.320495 24941 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:05.428553 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:05.306020 24984 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.427927 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.427954 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:05.429647 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:05.430850 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.433607 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.442600 19295 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:05.442186 19297 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.442210 19903 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:05.432261 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:05.445346 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:05.330726 24955 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:05.460541 19372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.011s
I20260709 13:11:05.460832 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:05.464946 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:05.465771 19372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.011s	sys 0.011s
I20260709 13:11:05.466961 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.469709 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:05.474586 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:05.468902 24983 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:05.477684 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.477908 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.476123 19295 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:05.463478 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:05.476418 24853 consensus_meta.cc:287] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.001s
I20260709 13:11:05.476841 24939 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.480616 24853 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.481120 24955 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.481921 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:05.482474 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.006s	sys 0.023s
I20260709 13:11:05.404067 25060 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.460000 24854 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:05.493779 19366 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:05.482120 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56534.9us
I20260709 13:11:05.498610 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:05.495270 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.487645 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:05.512372 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:05.512976 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:05.514078 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:05.514204 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:05.514866 19224 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:05.514773 19218 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:05.464758 24946 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:05.471951 24436 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:05.522912 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:05.524859 19293 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:05.525507 24500 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:05.474673 25053 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:05.478622 25045 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:05.473798 24941 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:05.488009 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:05.534596 19297 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:05.484376 24945 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.493443 24983 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:05.483578 25024 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.539906 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:05.497910 25061 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:05.475011 25078 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:11:05.493793 25052 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:05.497251 25055 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:05.519351 24854 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:05.537940 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:05.524647 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:05.522125 24647 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.528156 25042 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.547156 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:05.535354 24941 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.535521 25045 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.533847 25019 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:05.552750 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64839.3us
I20260709 13:11:05.541656 25024 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:05.544561 24945 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.540432 24436 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:05.644002 19294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.004s	sys 0.019s
W20260709 13:11:05.552393 24885 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.001s
W20260709 13:11:05.584246 24908 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.051s	user 0.007s	sys 0.005s
I20260709 13:11:05.550747 24854 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:05.646227 19294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.004s	sys 0.019s
I20260709 13:11:05.584975 24941 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.634593 25045 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.542533 25085 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.531656 24946 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.548678 25055 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:05.575742 24999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.032s	sys 0.025s
I20260709 13:11:05.584519 24939 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:05.551199 25061 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.636900 25052 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.553893 25086 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.648041 25024 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:05.685190 24973 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.016s
I20260709 13:11:05.646243 25070 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:05.831097 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 309826us
I20260709 13:11:05.841730 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.843372 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:05.791378 19296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.036s	sys 0.083s
I20260709 13:11:05.554320 24647 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:05.844322 19296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.043s	sys 0.088s
W20260709 13:11:05.711220 24999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.033s	sys 0.025s
I20260709 13:11:05.831750 24809 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:05.704495 24908 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:05.632509 25077 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.297s
I20260709 13:11:05.850242 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:05.853037 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 335001us
I20260709 13:11:05.710994 25085 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.715287 25055 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:05.848233 24973 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.016s	sys 0.019s
I20260709 13:11:05.873526 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:05.685279 24885 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.789712 25086 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:05.686772 24945 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.878106 19365 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.848313 25070 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.842026 25051 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.847666 24603 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.831755 24811 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:05.859696 25067 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:11:05.892913 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 355063us
I20260709 13:11:05.863545 24853 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:05.934458 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.871652 25085 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.703333 25076 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.247s
I20260709 13:11:05.892134 24645 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:05.940508 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:05.880772 24888 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:05.940634 24645 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.874871 24809 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:05.942384 25084 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
W20260709 13:11:05.933447 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 83307us
I20260709 13:11:05.872717 24436 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.887923 25061 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.945366 25061 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.945730 25061 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:05.941166 25088 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:05.715780 24983 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:05.932930 24939 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:05.892356 25070 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.886411 25086 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.985268 19191 leader_election.cc:400] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:06.003489 19191 leader_election.cc:403] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.933959 24603 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:05.893877 24984 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:05.958436 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 848) took 1306 ms. Trace:
I20260709 13:11:05.913367 25083 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:05.940655 25075 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260709 13:11:06.003978 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53512.1us
I20260709 13:11:05.879096 25042 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:11:05.988914 24741 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:06.022246 19300 rpcz_store.cc:276] 0709 13:11:04.652241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.655637 (+  3396us) service_pool.cc:224] Handling call
0709 13:11:04.704619 (+ 48982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.944029 (+239410us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:05.003581 (+ 59552us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.482197 (+478616us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.482706 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.482845 (+   139us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:05.876760 (+393915us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.876998 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.877079 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.958140 (+ 81061us) raft_consensus.cc:1685] finished
0709 13:11:05.958170 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.958366 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241358,"prepare.queue_time_us":60003,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":17178,"raft.queue_time_us":282283,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":16799,"thread_start_us":869449,"threads_started":3,"wal-append.queue_time_us":538508}
I20260709 13:11:06.001005 25060 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:06.056752 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.015s
W20260709 13:11:06.057389 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.015s
W20260709 13:11:06.058014 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 545640us
I20260709 13:11:06.058871 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:05.935634 24811 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:05.923923 25051 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.059689 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:06.043174 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 157996us
I20260709 13:11:06.056419 24741 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:06.091668 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2301) took 1420 ms. Trace:
I20260709 13:11:06.096742 19291 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.937453 25067 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.098495 19299 rpcz_store.cc:276] 0709 13:11:04.671100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.698762 (+ 27662us) service_pool.cc:224] Handling call
0709 13:11:04.699153 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.875806 (+176653us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:04.875854 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.894370 (+ 18516us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.312494 (+418124us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:05.312534 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.312599 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.091395 (+778796us) raft_consensus.cc:1685] finished
0709 13:11:06.091428 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.091601 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80031,"raft.queue_time_us":104162,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":485451,"threads_started":2,"wal-append.queue_time_us":621839}
I20260709 13:11:06.099951 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.100461 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.101115 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.101634 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:06.102620 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.103022 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:06.069706 24953 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.108700 24946 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:06.111120 25089 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:11:06.110592 24741 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.113673 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.122747 19291 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:06.132699 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:06.110643 25094 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:06.124732 24603 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:06.134408 19365 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
W20260709 13:11:06.175709 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 239122us
I20260709 13:11:06.188580 19300 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:06.195245 19297 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:06.116019 24436 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:06.176707 24908 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:06.191829 24946 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:06.174569 24953 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.234015 24953 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.211279 24647 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.168066 25085 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.052330 25083 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.256989 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 997) took 1054 ms. Trace:
I20260709 13:11:06.244210 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 852) took 1590 ms. Trace:
I20260709 13:11:06.242064 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 861) took 1002 ms. Trace:
I20260709 13:11:06.215075 24741 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.184633 25076 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:06.210451 25117 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.216895 24908 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:06.301070 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:06.254408 24936 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.291217 19298 rpcz_store.cc:276] 0709 13:11:05.239206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.239344 (+   138us) service_pool.cc:224] Handling call
0709 13:11:05.239730 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:05.286242 (+ 46512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.286288 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:05.316784 (+ 30496us) log.cc:844] Serialized 52 byte log entry
0709 13:11:05.703983 (+387199us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:05.704044 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.704140 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.241769 (+537629us) raft_consensus.cc:1685] finished
0709 13:11:06.241801 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.241998 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82041,"raft.queue_time_us":63452,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":11968,"thread_start_us":271155,"threads_started":1,"wal-append.queue_time_us":712284}
I20260709 13:11:06.253047 25048 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.281595 24955 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.291100 19292 rpcz_store.cc:276] 0709 13:11:04.653519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.659040 (+  5521us) service_pool.cc:224] Handling call
0709 13:11:04.659399 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.028001 (+368602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.028044 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.036943 (+  8899us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.494807 (+457864us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:05.494839 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.494934 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.243938 (+749004us) raft_consensus.cc:1685] finished
0709 13:11:06.243977 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.244126 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142691,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":126,"thread_start_us":707985,"threads_started":2,"wal-append.queue_time_us":716171}
W20260709 13:11:06.247870 25110 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:11:06.287111 19300 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:11:06.240288 25092 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:11:06.310074 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:06.290827 24946 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:06.236901 24885 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.104585 24939 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:06.308719 25057 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.915s	user 0.004s	sys 0.008s
I20260709 13:11:06.249246 25108 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:06.290977 19368 rpcz_store.cc:276] 0709 13:11:05.202365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.203664 (+  1299us) service_pool.cc:224] Handling call
0709 13:11:05.204030 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.204430 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.204457 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.204905 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.533621 (+328716us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:05.533671 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.533743 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.256781 (+723038us) raft_consensus.cc:1685] finished
0709 13:11:06.256801 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.256934 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":328407,"threads_started":1,"wal-append.queue_time_us":741981}
I20260709 13:11:06.298091 19191 leader_election.cc:400] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:06.253163 24811 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.305322 24936 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:06.223999 24436 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:06.305399 24908 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.321954 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:06.310667 19903 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:06.310704 24945 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.322827 25057 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.326483 25104 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:06.345558 24537 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.090s	user 0.010s	sys 0.001s
I20260709 13:11:06.346637 25055 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.349619 24936 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.380357 25060 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:06.381381 25060 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.383509 25086 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.351544 25085 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:06.352785 24975 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.933s	user 0.009s	sys 0.001s
W20260709 13:11:06.355258 24986 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.199s	user 0.006s	sys 0.006s
I20260709 13:11:06.393421 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:06.393631 24854 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
W20260709 13:11:06.391278 24941 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.000s
I20260709 13:11:06.362447 19297 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:06.356042 24647 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.321336 25076 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:06.310760 25124 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:06.324581 25133 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.364573 25061 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.367692 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:06.369783 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47896.9us
I20260709 13:11:06.324546 25108 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:06.422828 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 55243.6us
I20260709 13:11:06.312803 24955 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.374359 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:06.441555 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:06.442009 24955 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.304908 25117 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.442519 25133 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.444104 25117 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.363415 24811 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.444859 24811 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.420337 24935 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.447026 24811 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.317524 24946 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.454903 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:06.384779 25056 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.069s	user 0.008s	sys 0.003s
I20260709 13:11:06.385262 25083 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.385357 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:06.385586 25057 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.385689 24537 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.406994 24975 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.383118 25055 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.350746 25122 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.387791 25103 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.418543 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:06.395349 25045 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.001s
I20260709 13:11:06.418056 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:06.306643 24603 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.424599 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:06.422999 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:06.653333 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 230388us
I20260709 13:11:06.397264 24436 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.654322 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:06.426934 25125 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:06.427989 25061 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.655910 25125 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.656265 25061 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:06.656348 25125 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.421536 24854 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.559260 25056 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.658447 24854 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.435247 25070 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.658732 25114 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.659546 25114 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:06.491379 25020 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.660440 25070 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.660384 25020 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.421793 24941 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.662532 25020 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.438860 25086 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.420186 25064 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:06.664426 25064 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.666385 25064 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.447695 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:06.373169 25024 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.008s
I20260709 13:11:06.668304 25024 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.669752 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.670459 25024 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.663960 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:06.454103 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.671272 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.672837 25086 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.673305 25086 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.673636 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.674317 24946 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.674769 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.675400 25086 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.636044 25045 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.457691 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:06.675868 25086 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.460645 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.457062 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:06.554176 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.555881 19220 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:06.557392 19895 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:06.557936 19898 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:06.376994 25104 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.417201 25076 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:06.715248 19218 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:06.716323 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:06.421576 24647 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.642513 19297 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:06.555323 25066 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.728469 25066 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.649398 24975 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.432260 25124 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.467708 25113 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.661161 24537 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.667713 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.732885 19221 raft_consensus.cc:2368] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17.
I20260709 13:11:06.676285 19222 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:06.676462 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.676743 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.735445 19368 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:06.677093 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.677353 25045 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.459779 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.677556 25055 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.677716 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.678377 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:06.631350 25122 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.553777 24955 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.673250 19373 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:06.680953 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:06.679920 19292 raft_consensus.cc:2368] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15.
I20260709 13:11:06.708782 19219 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.711714 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:06.714177 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:06.744593 19300 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:06.444867 25133 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.712065 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.745994 19220 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:06.658931 25056 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.720290 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.708326 24854 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.680208 25061 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:06.746603 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:06.758042 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.719125 24946 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:06.730791 25066 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.731341 25124 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.755903 25024 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.715037 25086 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.760349 25061 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.731870 25113 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.755060 24955 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.755622 25055 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:06.776878 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.773039 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.835842 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:06.835418 19218 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.838444 19894 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEARNER]: Advancing to term 13
I20260709 13:11:06.839040 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:06.840210 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:06.843786 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:06.844367 19900 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.780215 25112 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:06.848604 25118 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:06.849157 25118 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:06.849112 25061 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.850152 25118 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.851346 25061 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.844939 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:06.853292 19894 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:06.768077 19219 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:06.856529 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:06.857129 19219 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.804397 24908 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.858575 19370 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:06.794628 25020 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.770035 24854 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.859841 25020 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.861754 24854 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.861909 25020 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.862048 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 841) took 1431 ms. Trace:
I20260709 13:11:06.862448 19895 rpcz_store.cc:276] 0709 13:11:05.430261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.430382 (+   121us) service_pool.cc:224] Handling call
0709 13:11:05.430668 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.709470 (+1278802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.861794 (+152324us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54006801d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:06.861993 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590669184}
I20260709 13:11:06.856629 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:06.794564 25057 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.794500 25052 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:06.874292 19219 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:06.793967 25113 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:06.875583 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 220115us
I20260709 13:11:06.911372 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:06.868678 25138 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.092s	user 0.004s	sys 0.000s
I20260709 13:11:06.788307 24860 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:11:06.867470 25112 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:06.917582 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:06.781868 24946 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.868911 25019 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.921442 19191 leader_election.cc:400] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:11:06.922648 19191 leader_election.cc:403] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:11:06.915483 25073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.029s
I20260709 13:11:06.842957 25024 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:11:06.925262 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:06.928392 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:06.915004 24964 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:06.920420 25060 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.931326 19224 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:06.920957 24647 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:06.925850 25073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.011s	sys 0.029s
I20260709 13:11:06.926007 25124 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:11:06.922178 25085 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.932140 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:06.932968 25135 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.923892 25061 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:06.940394 25061 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:06.940797 25061 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.945441 24946 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.947314 19216 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:06.923928 25019 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.948448 25019 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.950857 25125 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.852452 25076 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.917049 25057 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.952553 25076 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.952903 24908 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.929590 25122 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.921550 25104 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.927764 25133 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:06.954238 25057 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.916918 25052 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.956305 25112 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:06.932749 24964 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.933697 19900 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:06.937275 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:06.966205 24945 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:06.973637 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:06.975096 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:06.967221 19224 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:06.973703 19218 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:06.936647 24983 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.936401 25124 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.934363 24955 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:06.935866 25073 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:06.988320 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.957504 25112 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:06.996798 25124 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.001210 25124 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.004531 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.999320 25055 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:06.984676 24983 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:07.009068 25052 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.985342 25086 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:06.999794 25073 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:07.009511 24983 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.010602 25073 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:06.993569 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.989722 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:06.935510 25085 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.001222 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:07.015288 25085 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:07.016852 19223 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:07.016875 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.017692 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 2911) took 1807 ms. Trace:
I20260709 13:11:07.017741 19367 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:07.018183 19223 rpcz_store.cc:276] 0709 13:11:05.210149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.226821 (+ 16672us) service_pool.cc:224] Handling call
0709 13:11:07.016406 (+1789585us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:07.016657 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.017427 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.017634 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7373056}
I20260709 13:11:07.018849 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.020015 25103 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.020345 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.020804 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:07.020970 19368 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:07.021596 19371 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:07.022652 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.023253 19373 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:07.024242 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:07.024498 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 606482us
W20260709 13:11:06.991802 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.643s (SENT) [suppressed 7 similar messages]
I20260709 13:11:06.998554 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.011020 24983 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.011585 25073 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:07.029299 19366 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
W20260709 13:11:07.029330 19365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2247) took 2182 ms (client timeout 2723 ms). Trace:
W20260709 13:11:07.033179 19365 rpcz_store.cc:269] 0709 13:11:04.846598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.864153 (+ 17555us) service_pool.cc:224] Handling call
0709 13:11:07.029186 (+2165033us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400298454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:07.029280 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221088640}
I20260709 13:11:07.034492 19367 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:07.034739 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 194693us
I20260709 13:11:06.998306 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.036383 19218 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:06.993595 24964 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.034420 25048 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.056011 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:07.034261 25125 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.061486 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.062641 19300 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:07.063452 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.064658 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:07.065769 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.067222 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:07.069024 19295 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.072654 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:07.073553 19297 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.076546 25085 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.077075 25085 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.079097 25085 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.082454 19300 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:07.040951 24888 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:07.093948 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.095232 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.096117 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 995) took 2176 ms. Trace:
I20260709 13:11:07.096542 19372 rpcz_store.cc:276] 0709 13:11:04.920232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.920526 (+   294us) service_pool.cc:224] Handling call
0709 13:11:04.920826 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.921056 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.921081 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.924872 (+  3791us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.466321 (+541449us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:05.888747 (+422426us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.991304 (+102557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.991537 (+   233us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.095227 (+1103690us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b24002c91c8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e06fb0 00007fe8d7a7d488 00007fe8d7a7dbe8 00007fe8d7a55398 00007fe8d7a5076a 00007fe8d7a4fbb6
0709 13:11:07.095848 (+   621us) raft_consensus.cc:1685] finished
0709 13:11:07.095944 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.096060 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":478170,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":22,"raft.queue_time_us":116503,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":34291,"spinlock_wait_cycles":18987776,"thread_start_us":1015525,"threads_started":3,"wal-append.queue_time_us":709535}
I20260709 13:11:07.099098 25067 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.100004 25108 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.100307 25069 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:07.100844 25069 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.102210 25065 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.102847 25069 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.102746 25065 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.103385 25069 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.104745 25051 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:07.104947 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 49036us
I20260709 13:11:07.105355 25051 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:07.105810 25051 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:07.106483 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.106645 25051 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.108922 25065 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.116060 19295 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:07.117559 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:07.118278 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 842) took 1645 ms. Trace:
I20260709 13:11:07.118650 19898 rpcz_store.cc:276] 0709 13:11:05.480652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.480801 (+   149us) service_pool.cc:224] Handling call
0709 13:11:05.481115 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.709796 (+1228681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.118065 (+408269us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001eee54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:07.118223 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475962752}
I20260709 13:11:07.119592 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.121483 19297 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 6.
I20260709 13:11:07.121688 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.122053 24809 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:07.122484 19900 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:07.122802 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.123421 19295 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:07.124568 24645 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.125283 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:07.125507 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.126109 19297 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:07.127276 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.130723 19297 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:07.134289 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.134588 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:07.134989 19374 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:07.135224 19367 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:07.136099 19365 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:07.136425 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.137250 19366 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:07.140271 19340 leader_election.cc:400] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15.
I20260709 13:11:07.140782 19340 leader_election.cc:403] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:11:07.142485 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.143855 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:07.146548 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.146659 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:07.147440 19894 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:07.148718 24982 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.148571 25114 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:07.149600 25108 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:07.149971 25108 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:07.150754 25108 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.142295 19367 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:07.090230 25045 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.099702 25067 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:07.147688 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:07.159089 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.159119 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.146191 24809 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:07.091965 24888 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.178133 19224 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:07.183035 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.181914 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:07.154539 25050 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:07.163872 25088 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:11:07.184926 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.188642 19898 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:07.161561 24964 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:07.186861 24809 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.201184 24964 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.203083 24809 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.203559 24964 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.185074 25086 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:11:07.186098 25050 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.156524 25066 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:11:07.205173 25050 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.206002 25136 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:07.206383 25136 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:07.207156 25136 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.208346 25136 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.211138 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.156319 25125 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:11:07.214001 25125 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:07.214350 25125 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:07.215129 25125 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.164767 25118 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:07.217514 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.217546 19300 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:07.157123 25045 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.193267 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.182560 25085 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:07.181994 25103 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.103839 25069 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:07.237972 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 246159us
I20260709 13:11:07.240357 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.219133 25118 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.183511 25061 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.254750 19224 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:07.235432 25125 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.261159 19295 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:11:07.259505 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.278898 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:07.289283 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.292651 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:07.257422 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:07.302591 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45200.8us
I20260709 13:11:07.303457 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:07.304373 19216 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.309090 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:07.309966 19224 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:07.251416 25112 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.309754 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:07.312891 19223 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:07.255788 25118 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.315006 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:07.234464 25085 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.321426 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:07.265467 25070 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.317852 25124 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.323665 25133 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:07.262774 25045 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.325778 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.333541 19219 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:07.333453 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:07.313470 24955 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:07.336594 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:07.265516 25136 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:07.331050 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.337795 19224 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 6: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:07.334801 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.338881 19219 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:07.236232 25103 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:07.319397 24603 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:07.313078 25144 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:07.335922 25122 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.340780 24946 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.347607 25135 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.348572 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.320021 25112 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:07.348672 19369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2251) took 2500 ms (client timeout 2398 ms). Trace:
I20260709 13:11:07.349442 25060 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:07.349855 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:07.352730 19293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2247) took 1979 ms (client timeout 2092 ms). Trace:
I20260709 13:11:07.391110 25069 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.422356 25123 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:07.391512 25136 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.394099 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.424611 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:07.424917 25136 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.361243 24888 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.336052 25070 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:07.405213 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2324) took 1470 ms (client timeout 1571 ms). Trace:
W20260709 13:11:07.426383 19291 rpcz_store.cc:269] 0709 13:11:05.934336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.940240 (+  5904us) service_pool.cc:224] Handling call
0709 13:11:07.405009 (+1464769us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540004d3d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:07.405145 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357709056}
I20260709 13:11:07.427248 25070 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.364148 25048 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:07.364682 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.427613 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.368556 25045 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:07.428898 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.370625 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.432420 19898 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:07.432184 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.433756 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:07.420357 19369 rpcz_store.cc:269] 0709 13:11:04.847767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.850803 (+  3036us) service_pool.cc:224] Handling call
0709 13:11:07.348479 (+2497676us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000ea454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:07.348602 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253958016}
I20260709 13:11:07.370782 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.371227 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:07.436951 19222 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:07.373238 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.373610 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.375324 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.417794 19224 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:07.440663 19903 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:07.441082 19894 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:07.441241 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:07.422199 19293 rpcz_store.cc:269] 0709 13:11:05.373189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.375000 (+  1811us) service_pool.cc:224] Handling call
0709 13:11:07.352515 (+1977515us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54001bfb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:07.352660 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342717824}
I20260709 13:11:07.441754 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.442334 19224 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:07.440666 19901 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:07.444105 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.377234 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:07.384624 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.428900 25045 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:07.445618 25045 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:07.445770 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.446363 19223 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:07.446508 25045 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.389426 25085 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.423009 25123 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.447846 25045 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:07.366039 25103 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.369884 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.428980 25130 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:07.398341 25154 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.357461 25151 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:07.430099 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 860) took 2191 ms. Trace:
I20260709 13:11:07.409910 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:07.430648 19291 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:07.484138 19296 rpcz_store.cc:276] 0709 13:11:05.238873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.239037 (+   164us) service_pool.cc:224] Handling call
0709 13:11:05.239434 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.268938 (+ 29504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.268983 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.287579 (+ 18596us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.849216 (+561637us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:05.849280 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.849375 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.429051 (+1579676us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b240029ab48. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e06fb0 00007fe8d7a7d488 00007fe8d7a7dbe8 00007fe8d7a55398 00007fe8d7a5076a 00007fe8d7a4fbb6
0709 13:11:07.429781 (+   730us) raft_consensus.cc:1685] finished
0709 13:11:07.429801 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.430036 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21759,"raft.queue_time_us":29708,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":14289,"spinlock_wait_cycles":13271296,"thread_start_us":561261,"threads_started":1,"wal-append.queue_time_us":1029432}
I20260709 13:11:07.430809 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2299) took 2760 ms. Trace:
I20260709 13:11:07.412863 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:07.488795 19292 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:07.431255 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.409420 25061 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.372537 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.438673 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.439776 24936 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.406212 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.414904 25108 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.448801 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:07.450060 24941 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.395363 25076 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.422199 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 72398.2us
I20260709 13:11:07.515916 19292 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:07.420631 25112 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:07.517912 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:07.525919 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:07.526469 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 116667us
I20260709 13:11:07.528528 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.451617 25050 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:07.453212 25152 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:11:07.456807 19300 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:07.442350 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:07.545217 19374 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:07.425192 19221 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.398535 19216 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:07.475266 19895 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:07.398180 25019 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.483354 19225 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:07.486451 19294 rpcz_store.cc:276] 0709 13:11:04.670293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.689807 (+ 19514us) service_pool.cc:224] Handling call
0709 13:11:04.690226 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.779523 (+ 89297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.779571 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.797764 (+ 18193us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.686100 (+888336us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:05.990436 (+304336us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.427559 (+1437123us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b18002e28e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287
0709 13:11:07.427686 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.427773 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.427811 (+    38us) raft_consensus.cc:1685] finished
0709 13:11:07.430640 (+  2829us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.430761 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85175,"prepare.queue_time_us":532125,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":227047,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":53992,"spinlock_wait_cycles":60484992,"thread_start_us":1090969,"threads_started":3,"wal-append.queue_time_us":1353124,"wal-append.run_cpu_time_us":2378,"wal-append.run_wall_time_us":1032376}
I20260709 13:11:07.490803 19896 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:07.448089 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:07.497046 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 119911us
I20260709 13:11:07.555907 19225 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:07.497820 25085 raft_consensus.cc:2764] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:11:07.499295 24908 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:07.501806 19220 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:07.493896 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 312561us
I20260709 13:11:07.566388 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:07.447861 25123 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:07.526693 19372 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:07.481508 25130 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.580651 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:07.581058 19219 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:07.579259 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.531215 19370 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:07.532366 19365 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:11:07.583549 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.584472 19365 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:07.453009 19222 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:07.533424 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.536026 19371 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:07.537434 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:07.543149 25086 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.540364 19339 leader_election.cc:400] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17.
I20260709 13:11:07.545750 19217 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:07.546355 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.549263 19216 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:11:07.594988 19216 pending_rounds.cc:85] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:07.595281 19216 pending_rounds.cc:107] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:11:07.595537 19216 raft_consensus.cc:2889] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.558450 19225 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:07.558467 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.597643 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.541404 25105 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.542877 24983 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.541814 24982 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15.
I20260709 13:11:07.609701 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:07.611342 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:07.611912 25104 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:07.612413 25104 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:07.612754 25162 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:11:07.612934 25137 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:07.614104 25066 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:07.612763 25104 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:07.614140 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:07.615741 25048 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.553586 24935 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:07.582230 19372 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:07.626821 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.538875 19369 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:07.627580 19372 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:07.627961 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:07.628881 19372 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:07.592011 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.630249 19372 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:07.592831 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:07.594518 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54363.3us
I20260709 13:11:07.595407 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:07.640420 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45091.6us
I20260709 13:11:07.557917 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:07.644770 19295 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:07.648023 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.651314 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:07.600124 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.490556 25154 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.605820 24983 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.607545 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.606573 25118 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.608316 25051 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:07.530069 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.602252 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.542137 25076 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.700944 25048 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:07.701419 25048 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:07.701948 25154 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.702282 25048 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.703452 25048 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.710786 19373 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:07.653132 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.599121 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:07.658622 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:07.716261 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57738.9us
I20260709 13:11:07.631736 25056 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:07.631965 25073 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:07.580948 24908 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.632066 24603 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:07.674594 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46701.4us
W20260709 13:11:07.729332 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43486.5us
W20260709 13:11:07.743170 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.743912 25079 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:07.745072 24809 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:07.745468 24809 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:07.746021 24908 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.746415 19374 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:07.746306 24809 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.748857 24500 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:07.749269 24500 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:07.750237 24500 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.751546 24500 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.690388 24537 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:07.756547 25104 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.759184 25104 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.727259 25056 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.687528 25086 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:07.682919 25158 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:07.727603 25130 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.636085 24935 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.735405 24603 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.737644 25118 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:07.741804 25157 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:07.707583 25019 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.705566 25076 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.709897 25124 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:07.704057 24983 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:07.742620 25050 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:07.717481 25112 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.727147 25073 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.778316 25158 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:07.767663 25086 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.767841 25056 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.786955 25086 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.784667 25073 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.795202 25123 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:07.796502 25158 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:07.798143 25123 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:07.828866 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 485734us
W20260709 13:11:07.840863 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.666378 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.668031 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 324538us
I20260709 13:11:07.970873 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:07.726230 19297 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:07.863992 19300 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:07.865022 19221 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:07.730266 19337 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:07.876544 19373 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:07.730222 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:07.719645 19368 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
W20260709 13:11:07.992944 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 262694us
I20260709 13:11:07.995399 24983 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:07.996316 24983 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:07.997895 24983 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:08.002338 24936 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.006s
I20260709 13:11:08.002193 24908 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:08.003922 19298 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:11:08.004381 19298 pending_rounds.cc:85] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:11:08.004679 19298 pending_rounds.cc:107] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:11:08.005019 19298 raft_consensus.cc:2889] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.005648 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.006369 24537 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:08.007007 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.991367 19223 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:07.852041 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:07.898463 24645 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:07.903321 24935 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:07.901878 19117 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:08.012809 24955 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:07.903743 24809 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.013362 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:07.980139 24647 raft_consensus.cc:1064] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:11:07.925665 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:07.927335 19895 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:07.928853 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:07.975968 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.012948 25108 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:07.912731 25047 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.914780 25029 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:08.047331 25124 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.047184 25029 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.013549 24955 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:08.030174 24647 raft_consensus.cc:1068] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Unable to promote non-voter d50eb2dab6754df8bcbed1445f2e8430: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:08.026885 25130 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:08.025954 25154 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.037902 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 186299us
I20260709 13:11:08.027278 25085 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:07.995930 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:08.029095 25103 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.045921 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58631us
I20260709 13:11:08.047916 25124 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:08.052942 24955 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.068396 19900 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:08.055804 25130 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.059031 25124 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:08.072809 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 342437us
I20260709 13:11:08.074175 19337 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:08.071624 25085 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:08.077435 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:08.077561 25085 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.058817 25103 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.079195 25052 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:08.079797 25052 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:08.080507 25103 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.080888 25052 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.054291 25047 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.085788 24936 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.084574 25050 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.089836 25050 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.090240 25050 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.061754 25108 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:08.087733 24936 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.071990 25130 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.104348 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.105350 19221 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:08.101042 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:08.106097 19297 raft_consensus.cc:606] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:08.092916 25154 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.067452 25073 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:08.174240 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70872.1us
W20260709 13:11:08.180737 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 506610us
I20260709 13:11:08.192277 25056 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.192788 19217 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:08.194751 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:08.194967 25056 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.196324 24935 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:08.196981 24935 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:08.198243 24935 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.200572 19224 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:08.200992 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2329) took 1851 ms. Trace:
I20260709 13:11:08.201381 19298 rpcz_store.cc:276] 0709 13:11:06.349921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.350088 (+   167us) service_pool.cc:224] Handling call
0709 13:11:06.350362 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.005933 (+1655571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.200703 (+194770us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540034fb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:08.200921 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3800863616}
I20260709 13:11:08.203917 25123 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:08.213161 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.213533 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.214926 24936 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.217244 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.217538 24936 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:08.219218 24936 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.220125 24936 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:08.215206 19117 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:08.221827 25042 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:08.222265 25042 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:08.223486 25042 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.224822 25042 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.226075 19117 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 6 to 9, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 9 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:08.232705 25086 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.235636 25086 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:08.236804 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 241158us
I20260709 13:11:08.237843 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:08.239605 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.250226 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:08.251169 19367 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:08.204427 25123 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:08.261291 25047 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.263605 25164 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:08.271900 25029 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.272101 25164 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.273684 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.274735 25164 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:08.275296 25045 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.797s	user 0.013s	sys 0.010s
I20260709 13:11:08.266938 25019 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:08.268537 24982 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:08.276563 25073 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:08.277987 25163 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.488s	user 0.002s	sys 0.004s
W20260709 13:11:08.279489 25048 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.009s
I20260709 13:11:08.283160 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:08.283918 19900 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.285606 25154 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.270005 25123 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.286089 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:08.287031 25123 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:08.287925 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.289831 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.299755 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.305619 25112 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.308867 25112 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:08.280150 25124 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.309333 25112 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.309980 19225 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:08.310945 25130 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:08.315236 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 97432.4us
I20260709 13:11:08.308915 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:08.317656 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.320463 24955 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.321295 24955 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.328706 25176 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.329217 25176 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:08.329671 25176 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.330917 19224 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:08.236874 25108 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.332633 25019 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:08.333629 25158 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:08.335465 25050 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.299337 24982 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:08.336427 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62861.5us
I20260709 13:11:08.343194 19298 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:08.343873 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.353860 19900 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:08.347859 19221 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:08.360850 19369 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:08.368845 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.374760 19368 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:08.377460 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:08.411209 19298 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:08.378497 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:08.379674 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:08.380637 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:08.386181 19297 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:08.386512 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:08.387322 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.388617 25050 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.381520 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:08.421236 19294 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.435954 19296 raft_consensus.cc:2410] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:11:08.430259 19223 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:08.373908 25154 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:08.457019 19216 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:08.459824 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.460440 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:08.425729 25112 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:08.461580 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 89209.3us
I20260709 13:11:08.462411 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.463328 25112 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.462425 19369 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:08.467535 24809 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:08.473531 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 206973us
I20260709 13:11:08.451145 25047 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:08.474436 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.441476 24537 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:11:08.478070 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 149970us
I20260709 13:11:08.464031 25112 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:08.481335 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.477820 25047 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:08.489121 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 109553us
I20260709 13:11:08.494247 19216 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:08.483227 25130 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.496858 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.490625 25047 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:08.499795 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.505688 25112 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:08.505384 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.501152 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:08.514318 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.516049 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.516767 25108 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.517359 25108 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.519852 25108 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.491303 25019 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:08.482252 24982 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.529917 24647 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.530637 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:08.531976 24647 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.513197 25029 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.533701 24647 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.533969 25029 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.534425 25029 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.537833 25124 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.539379 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:08.544912 19221 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:08.547302 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:08.553829 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:08.556305 25130 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:08.556631 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.557500 19216 raft_consensus.cc:2410] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:11:08.560240 19225 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:08.566293 25130 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:08.566884 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:08.567569 25137 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:08.568034 25137 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.568429 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:08.568709 25130 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:08.569900 19296 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:08.570214 24645 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:08.568446 25137 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.571447 24936 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:08.548851 25045 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:08.561981 19223 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:08.532414 25108 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:08.576368 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:08.578881 25189 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:08.558240 25042 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.587296 24936 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.596993 24537 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:08.524055 25050 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:08.601611 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.603700 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:08.580279 25045 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.558615 25085 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:11:08.606383 19223 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:08.615049 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.620235 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:08.602489 19225 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.615073 24500 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:08.623915 25130 raft_consensus.cc:993] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:08.624522 24645 raft_consensus.cc:1081] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:08.624004 24500 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:08.623349 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64854.1us
I20260709 13:11:08.633494 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:08.634953 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.619858 25045 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.649302 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.601387 25108 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.589012 25176 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.659986 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:08.660682 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58737us
I20260709 13:11:08.665177 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.669238 25050 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:08.671141 25154 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.670783 25029 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.671605 25154 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:08.672137 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.672379 19296 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:11:08.673772 25029 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.662354 19221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:08.665001 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.619431 24936 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.666020 19369 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:08.664237 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:08.687527 19224 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:08.693491 19221 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:08.694067 19221 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:08.694603 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:08.697257 19372 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:08.672129 25154 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.693950 19223 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:08.700086 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:08.680998 25164 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.714838 19294 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:08.717391 25073 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:08.717896 25073 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:08.718847 25073 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.720331 25128 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:08.721048 25164 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.722815 24647 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.723197 25164 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.671620 25118 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:11:08.724287 25196 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:08.724848 25196 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.725992 25118 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:08.726393 25118 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:08.726925 25196 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:08.727191 25118 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.728344 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.728575 25118 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:08.729182 19368 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:08.729635 25128 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:08.730751 25128 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.732719 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.733493 19370 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:08.737383 25007 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:08.737829 25007 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:08.720101 25073 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.692741 25086 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:11:08.745743 24936 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:08.743705 25195 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.166s	user 0.004s	sys 0.000s
I20260709 13:11:08.693593 25103 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:08.743263 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.764799 19225 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:08.763356 19293 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
W20260709 13:11:08.764843 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 191912us
W20260709 13:11:08.771847 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77330.8us
I20260709 13:11:08.769286 19221 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:11:08.774678 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.776372 25019 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:08.776544 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:08.777074 25019 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.783468 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:08.744094 25042 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:08.785298 19368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:11:08.786222 19368 raft_consensus.cc:606] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:08.786568 19368 raft_consensus.cc:614] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:08.793228 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:08.791486 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 135171us
I20260709 13:11:08.796770 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:08.782858 25124 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.829140 25124 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.832285 25124 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.785382 24500 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.772634 25103 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.854314 25103 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.856595 25137 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.859583 25137 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.860812 24500 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:08.861430 24500 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:08.863430 24500 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.865625 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.866241 19225 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.866745 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.868623 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.869232 19217 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.805112 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.808070 19294 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:08.820885 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:08.878065 19292 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.823057 25019 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:08.823870 25192 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:08.907992 25192 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.908445 25192 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:08.906358 25188 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:11:08.906824 25124 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.913610 25124 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.915694 25124 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.918401 19225 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:08.921458 19294 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:08.924656 25194 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:11:08.925923 19217 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
W20260709 13:11:08.926380 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50009.5us
I20260709 13:11:08.922657 19221 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:08.795930 25085 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:08.946902 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.948483 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:08.946863 24935 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:08.951675 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 165636us
I20260709 13:11:08.951246 25007 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:08.961892 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:08.962126 25007 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.954052 24935 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:08.991201 19372 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:08.939419 19292 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:08.998380 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.997466 19221 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:09.030767 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:08.997962 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:08.994016 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:09.018648 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:08.951519 25164 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.034991 19217 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:08.959098 25085 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:08.968619 24935 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:08.987082 24647 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.053548 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:09.057169 19223 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:09.036466 25124 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:09.040000 25029 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.039309 25176 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:09.060353 19295 raft_consensus.cc:2376] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15. Re-sending same reply.
W20260709 13:11:09.084574 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 216385us
I20260709 13:11:09.049032 25164 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.059080 25154 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.087950 25108 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.097833 25205 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.112458 24983 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.117339 24983 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.118296 25164 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.123062 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:09.123560 19296 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:09.123896 19222 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.125510 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.126410 25128 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:09.128865 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.131141 25128 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:09.131494 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:09.131294 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:09.132499 19219 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.135645 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:09.137751 24955 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.138104 25137 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:09.138613 24647 raft_consensus.cc:2764] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:11:09.144317 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:09.146654 25128 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:09.148556 19297 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:09.144280 24647 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.158281 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.096022 25029 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.115890 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:09.119918 24983 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:09.175741 19222 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:09.180428 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:09.184496 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 491768us
I20260709 13:11:09.186916 19222 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.178527 24647 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:09.188014 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 84501.6us
W20260709 13:11:09.188246 25202 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:11:09.189146 25029 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:09.189604 25212 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:11:09.190274 25204 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:11:09.190979 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.191673 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:09.193770 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:09.153537 25019 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.196581 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:09.196825 19296 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.198101 19898 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.199800 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:09.199252 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:09.184496 25103 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:09.202541 19373 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:09.202771 19222 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:09.201450 19372 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:11:09.207850 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:09.208611 19900 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.203715 19218 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:09.206051 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:09.214193 25201 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:11:09.214354 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.215652 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.216641 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.216814 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.217417 19899 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.217577 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.217869 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.218125 19371 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.218696 19372 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:09.218834 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 96650.9us
I20260709 13:11:09.219496 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.219676 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:09.221680 19373 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:09.221647 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.196025 25029 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:09.227561 19366 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:09.228302 25207 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.228523 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.228848 25207 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.230587 25206 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:09.246768 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.156237 25205 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:09.231115 25207 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:09.231403 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:09.203377 25124 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:09.281632 25154 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.231804 25128 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.282790 25128 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.284425 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.284895 25128 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.285070 19898 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
W20260709 13:11:09.233430 25047 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.728s	user 0.005s	sys 0.005s
W20260709 13:11:09.274662 25045 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.002s
I20260709 13:11:09.285691 25047 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.286549 25045 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.286731 24936 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:09.225179 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:09.288614 25045 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.289681 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.236282 25019 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.239766 19366 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.244489 19373 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:09.245530 24647 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.246747 19296 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:09.247475 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.249056 25213 raft_consensus.cc:2764] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:09.255873 19222 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:09.281307 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.281472 19899 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:11:09.232189 25108 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:09.305467 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.285620 25192 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.233566 25203 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.312433 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.234292 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.194914 24955 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:09.293174 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:09.304872 19899 pending_rounds.cc:85] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 7
I20260709 13:11:09.321256 19899 pending_rounds.cc:107] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:11:09.321671 19899 raft_consensus.cc:2889] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.287915 25047 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.290407 19901 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:09.324803 19297 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:11:09.313982 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:09.295255 25079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.034s	sys 0.022s
I20260709 13:11:09.319599 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:09.318013 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:09.295110 19371 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:09.323817 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.328469 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:09.317574 25158 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.024s	sys 0.031s
I20260709 13:11:09.329069 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:09.329819 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.198908 25085 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:09.389986 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.425731 19218 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:09.419543 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 87416.1us
I20260709 13:11:09.254823 24935 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.446200 19370 raft_consensus.cc:2368] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13.
I20260709 13:11:09.441624 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.316704 25206 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:09.441932 25215 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:09.452545 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.320681 25045 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.452850 25029 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.327342 25079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.035s	sys 0.023s
I20260709 13:11:09.454447 25192 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:09.454810 25220 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.456403 19222 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:09.457521 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:09.482807 19220 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:09.458318 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 184465us
I20260709 13:11:09.459455 19221 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:09.460306 24647 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.456357 25207 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:11:09.460734 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 131729us
I20260709 13:11:09.461944 25218 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:09.303879 25086 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:11:09.469208 19366 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:09.470764 19895 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:09.471107 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 175297us
I20260709 13:11:09.477284 19894 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:09.477581 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.494022 19900 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:09.332135 25209 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.474630 25215 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.497511 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:09.475833 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:09.463743 25056 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:09.323753 25203 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:09.488608 19218 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.329203 25205 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:09.439201 25158 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.024s	sys 0.033s
I20260709 13:11:09.477989 25047 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:09.480508 25108 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.490283 25218 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:09.503918 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:09.510417 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.512526 19221 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:11:09.513293 25124 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.517339 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:09.529897 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 240074us
I20260709 13:11:09.521606 24935 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:09.470520 24955 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.485390 25045 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.554631 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:09.502524 25215 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.561822 19217 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:09.556007 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:09.490604 25029 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:09.577227 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.577201 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66861.2us
I20260709 13:11:09.582635 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.528492 25218 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:09.570190 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:09.586627 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:09.566533 25216 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.437s	user 0.004s	sys 0.000s
I20260709 13:11:09.491382 25220 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:09.597105 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.534590 25192 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:09.594956 19221 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:09.596289 19218 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:09.567107 25158 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:09.603747 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:09.605554 19217 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:09.532961 25108 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.568838 24647 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:09.584019 25007 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:09.584676 24935 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.502429 25209 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.620781 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:09.620946 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:09.621166 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 123581us
I20260709 13:11:09.562597 25047 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.623929 19295 raft_consensus.cc:606] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:09.624579 19295 raft_consensus.cc:614] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:09.623355 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67429.9us
I20260709 13:11:09.604944 25196 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:09.571163 25124 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.596709 25213 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:09.621631 25130 raft_consensus.cc:1064] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:11:09.633795 25029 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.634065 25108 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.632484 25196 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.604694 25158 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:09.622057 25205 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:09.626298 25154 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.652230 25047 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.655829 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:09.656497 25234 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:09.657588 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:09.658999 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:09.661373 25045 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:09.661834 19292 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:09.661988 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:09.662643 19295 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
W20260709 13:11:09.662741 25230 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:11:09.714345 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 72439.1us
I20260709 13:11:09.642033 25019 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:09.593818 25206 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.648269 25196 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:09.722054 19373 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:09.713764 25229 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:11:09.635154 25007 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:11:09.623751 25203 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.635591 25086 consensus_queue.cc:1243] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:09.736989 24955 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.647559 24935 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.661391 25234 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:09.691593 25154 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.634986 25192 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.744401 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:09.745657 25235 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:09.662005 25045 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:09.748665 25225 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:11:09.748893 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:09.749876 25226 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:11:09.727792 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2272) took 1350 ms. Trace:
I20260709 13:11:09.760532 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:09.761230 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:09.851576 19294 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:09.745230 25130 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:09.779525 25219 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.308s	user 0.004s	sys 0.000s
I20260709 13:11:09.783125 25196 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.784976 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:09.785527 25118 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:09.788497 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.859380 19298 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:09.788885 19220 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:09.790161 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 191480us
W20260709 13:11:09.794075 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.860733 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:09.795080 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:09.802564 25158 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.807197 25220 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:09.812266 24647 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.851792 19300 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:09.850888 19293 rpcz_store.cc:276] 0709 13:11:08.377656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.378100 (+   444us) service_pool.cc:224] Handling call
0709 13:11:09.727591 (+1349491us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540004c254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:09.727699 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716961024}
I20260709 13:11:09.872123 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:09.856954 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 197193us
W20260709 13:11:09.858357 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 254245us
I20260709 13:11:10.062043 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:10.063412 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:09.864075 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 68959.1us
I20260709 13:11:09.861435 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:09.866505 25019 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:10.065225 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 203842us
I20260709 13:11:10.065900 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:10.066418 25239 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:09.884543 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:09.916427 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.067243 19297 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:11:09.929459 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 980) took 1107 ms. Trace:
W20260709 13:11:09.931768 25222 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:11:10.068543 19297 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:11:10.069569 25243 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:09.855291 24955 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:10.070649 24955 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:10.071110 24955 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.071156 25239 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:09.932586 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.072193 19299 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 6.
I20260709 13:11:10.068028 19902 rpcz_store.cc:276] 0709 13:11:08.640608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.668014 (+ 27406us) service_pool.cc:224] Handling call
0709 13:11:08.690551 (+ 22537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.044747 (+354196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.044795 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.064049 (+ 19254us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.108437 (+ 44388us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:09.108466 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.108529 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.294886 (+186357us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:09.716621 (+421735us) raft_consensus.cc:1685] finished
0709 13:11:09.716650 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.747822 (+ 31172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94449,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6893,"spinlock_wait_cycles":7745920,"thread_start_us":348710,"threads_started":2,"wal-append.queue_time_us":42993}
I20260709 13:11:10.072285 25239 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.073675 25246 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:10.074033 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:10.074277 25246 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:10.074651 19371 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:10.075242 25246 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.077832 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:09.937227 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:10.078727 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2397) took 1082 ms. Trace:
I20260709 13:11:10.079248 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:09.859162 25234 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:10.081218 25086 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:10.079161 19225 rpcz_store.cc:276] 0709 13:11:08.996457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.049586 (+ 53129us) service_pool.cc:224] Handling call
0709 13:11:09.249178 (+199592us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:09.249360 (+   182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.249817 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.249845 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.250356 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.488899 (+238543us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:09.488960 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.489047 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.078452 (+589405us) raft_consensus.cc:1685] finished
0709 13:11:10.078474 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.078672 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":77,"spinlock_wait_cycles":40855296,"thread_start_us":238137,"threads_started":1,"wal-append.queue_time_us":334315}
I20260709 13:11:10.081794 25086 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.084213 19374 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:10.084576 19374 pending_rounds.cc:85] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 7
I20260709 13:11:10.084792 19374 pending_rounds.cc:107] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:10.085009 19374 raft_consensus.cc:2889] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.085721 25118 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.086184 25118 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.929122 19291 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:11:09.940476 19895 raft_consensus.cc:2368] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:09.941286 25238 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:10.086844 19291 pending_rounds.cc:85] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 7
I20260709 13:11:09.877707 24983 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:11:10.087182 19291 pending_rounds.cc:107] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:11:10.087445 19291 raft_consensus.cc:2889] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.087558 24983 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.088033 24983 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.090189 24983 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:10.090719 24983 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:10.091065 24983 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:09.942869 25196 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:09.945161 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.092623 25112 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:10.093053 25112 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:09.850227 25056 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:11:10.093885 25112 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.094600 25056 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:10.095005 25056 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:10.095180 25112 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.094830 25118 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.096031 25056 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.096372 25103 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:10.097327 25056 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.098328 25214 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:10.098763 25214 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:09.945885 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:09.946681 25219 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:09.948411 25192 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:09.953588 24935 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:09.955139 25124 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.083961 25086 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:09.964833 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:10.102448 19216 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:09.930440 25237 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:11:10.104054 25237 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:10.104450 25237 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:10.105002 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:09.984962 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.091905 24983 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.105283 25237 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.106127 19221 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:09.985853 19298 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:09.980232 25220 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:10.106668 25237 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.107157 25220 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.992017 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.053265 25218 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:10.054672 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46662us
I20260709 13:11:10.055877 25215 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:09.846223 25045 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:10.066373 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:10.070286 25243 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:10.080875 25234 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:09.940264 24500 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:10.119282 24500 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.120273 25220 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.117501 25243 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.121160 25243 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.121325 24500 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:10.117127 25045 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.086457 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:10.100447 19894 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 6.
I20260709 13:11:09.955613 25209 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:09.932806 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 289418us
I20260709 13:11:10.110062 19292 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.110215 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.099612 25214 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.125640 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:10.126902 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49576.7us
I20260709 13:11:10.106688 24983 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.135003 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.131011 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.136040 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:10.147500 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.148752 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.150691 19263 leader_election.cc:400] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:10.151046 19263 leader_election.cc:403] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.149698 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:10.128270 25238 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:10.166589 19292 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:10.220202 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:10.221312 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:10.222638 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 136228us
I20260709 13:11:10.146246 25029 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:10.220506 19369 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:10.168334 19868 leader_election.cc:336] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.837s (SENT)
I20260709 13:11:10.230020 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:10.226486 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 77834.8us
I20260709 13:11:10.231034 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:10.231252 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 93662.7us
I20260709 13:11:10.232295 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:10.149214 25214 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.158524 25124 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.231949 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:10.155750 24935 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:10.160035 25130 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.240325 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.158809 25239 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.158118 24982 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.241271 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:10.241595 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:10.153170 25233 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.254230 25047 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.258154 19895 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:10.259495 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.277271 19220 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:10.158360 25128 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.281864 25128 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.282285 25128 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.244843 25042 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:10.280270 25238 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.248986 25240 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:10.302925 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 148562us
I20260709 13:11:10.245934 25086 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:10.294229 25042 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.252324 25244 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:10.292176 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:10.321044 19225 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.276417 25047 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.307070 19266 leader_election.cc:400] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13.
I20260709 13:11:10.307901 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.325167 19266 leader_election.cc:403] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.325419 19221 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:10.312664 19220 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:10.314824 25206 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:10.315660 25241 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:10.267480 24982 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:10.348558 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 113464us
W20260709 13:11:10.349705 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.248816 24935 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.326212 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:10.323534 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 92567.5us
I20260709 13:11:10.294000 25233 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:10.304107 25124 raft_consensus.cc:2764] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:11:10.365049 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 196744us
I20260709 13:11:10.401135 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:10.401695 19899 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.367949 24935 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:10.368816 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.347723 25047 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.382978 25243 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.321985 25042 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:10.392323 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.392969 25218 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.361268 25130 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13.
I20260709 13:11:10.393997 25215 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:10.399413 19216 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:10.400367 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:10.436242 19217 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:10.436707 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.283308 24955 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.348034 25118 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:10.379303 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53176.8us
I20260709 13:11:10.411504 19225 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:10.379921 25244 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:10.421593 19224 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:11:10.410833 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 187301us
I20260709 13:11:10.366847 24982 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.393760 25019 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.400701 25233 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.319860 25086 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.397871 25241 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:10.446782 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.451941 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.445861 25029 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:10.453433 19374 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:10.454246 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.465914 25086 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:10.466898 25241 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.468312 19221 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:10.463346 19219 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:10.476485 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.463245 25233 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.482635 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:10.461138 25218 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:10.490247 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.488831 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:10.493162 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:10.473376 24500 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.494215 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.497248 19217 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:10.493686 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:10.498989 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.479856 25209 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:10.477804 25244 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:10.501344 25056 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:10.509068 25244 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.511284 25244 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.506711 25239 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:10.507237 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 138516us
I20260709 13:11:10.497726 25261 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.480589 25240 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:11:10.500347 25196 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:10.520923 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:10.527842 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.501686 25079 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:10.529296 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:10.502878 25209 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.488113 25045 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.543577 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.544560 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:10.545310 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.499747 24500 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.548914 19297 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:10.492244 25263 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:10.550514 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.554638 19300 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:10.522552 25196 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:10.559325 19293 raft_consensus.cc:606] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:10.553334 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.539569 25262 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:10.539772 25209 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:10.559816 19293 raft_consensus.cc:614] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:10.555962 25103 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.562516 25103 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:10.563311 25103 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:10.565521 25158 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.552909 25237 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.568403 25262 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:10.568620 25237 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.569654 25262 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.571028 25237 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:10.576154 25263 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:10.576402 25270 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:10.576613 19221 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:10.576798 25270 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:10.576912 25196 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.577819 25270 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.579102 25270 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.579385 19219 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:10.583235 19899 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:10.580446 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:10.584771 19291 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:10.575680 25239 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.518360 25085 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:11:10.588524 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.606381 19217 raft_consensus.cc:2393] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:10.580646 25056 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:10.564010 25103 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:11:10.631903 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 70232.9us
W20260709 13:11:10.633275 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.636737 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.637199 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:10.638226 19294 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:10.646209 19298 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:10.648795 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:10.619477 25234 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:10.576710 25263 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:10.678164 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.742157 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 93452.4us
I20260709 13:11:10.551216 25029 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.635700 24955 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:10.634820 25243 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:10.648330 25271 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:10.777381 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 107039us
I20260709 13:11:10.815796 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:10.810711 19294 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:11:10.774936 25216 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:11:10.775394 25112 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.003s
I20260709 13:11:10.767088 25019 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:10.814129 25234 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.815090 25271 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:10.774682 25130 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:10.809767 25086 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:10.873023 24500 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.879541 19297 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:10.779256 25128 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.846167 24955 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:10.667372 25056 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.888245 25047 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.924495 25280 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:10.925038 25047 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.925226 25280 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:10.925830 25047 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.927676 25276 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.928408 25276 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.928279 25047 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.932039 25047 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.921226 25271 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.918448 25128 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.919299 19292 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:10.926476 25280 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:10.932894 25277 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:11:10.935268 25273 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:11:10.919792 24955 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.936313 25276 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:10.937225 25045 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:10.890692 25103 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:10.983897 25103 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:10.984488 24955 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:10.981781 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.886968 25086 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:10.984017 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2411) took 1837 ms. Trace:
I20260709 13:11:10.880879 25209 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:10.898041 25130 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:10.908308 24935 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.005483 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:10.988364 19218 rpcz_store.cc:276] 0709 13:11:09.146752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.602306 (+455554us) service_pool.cc:224] Handling call
0709 13:11:09.602686 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.603000 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.603033 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.622800 (+ 19767us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.789752 (+166952us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:09.986761 (+197009us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.986970 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.987035 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.980108 (+993073us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b2400129368. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e06fb0 00007fe8d7a7d488 00007fe8d7a7dbe8 00007fe8d7a55398 00007fe8d7a5076a 00007fe8d7a4fbb6
0709 13:11:10.983700 (+  3592us) raft_consensus.cc:1685] finished
0709 13:11:10.983806 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.983931 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":205940,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":4253,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":5987,"spinlock_wait_cycles":49793408,"thread_start_us":324897,"threads_started":2,"wal-append.queue_time_us":309101}
I20260709 13:11:10.985536 25270 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:11.016516 25270 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.018392 19900 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:11.019227 25270 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.011402 19297 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:11.021163 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.021888 19297 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:11.022934 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.013217 25086 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:11.014592 25275 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 13:11:11.027372 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.029817 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.029940 25209 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.028076 25281 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.030592 25272 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.000341 25265 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
W20260709 13:11:10.997263 19191 connection.cc:256] RPC call timeout handler was delayed by -1.3088702420000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 13:11:11.031189 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:11.034660 19298 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:11.041118 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.040498 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:11.040766 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.051712 19894 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:11.038103 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:11.044925 19191 connection.cc:256] RPC call timeout handler was delayed by -1.1558702419999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:11:11.036023 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:11.058244 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.058882 19223 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.060495 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.061038 19221 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.064585 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.065196 19225 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:11.066082 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.066126 19223 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:11.067701 25279 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:11.068737 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:11.068377 19223 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.059818 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:11.043103 25042 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.003s
W20260709 13:11:11.041923 25214 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.801s	user 0.005s	sys 0.005s
I20260709 13:11:11.077293 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:11.075603 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67674.8us
W20260709 13:11:11.054347 25245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.008s	sys 0.031s
I20260709 13:11:11.082332 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:11.038811 25263 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.032130 25234 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.077929 19218 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:11.035655 24935 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.082437 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.090983 19221 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:11.032874 25284 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.084635 25245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.009s	sys 0.031s
I20260709 13:11:11.075143 24955 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.075033 25217 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.097846 19217 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:11.054068 25130 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:10.985116 25103 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.089056 25282 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.097287 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.073325 25279 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:11.101512 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.104354 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.034008 25272 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.107435 24500 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:11.082055 25042 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.071097 25128 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:11:11.111528 25103 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.092335 25270 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:11:11.108717 19221 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:11.111790 24982 consensus_meta.cc:287] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.000s
W20260709 13:11:11.120625 25196 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:11:11.117319 19265 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.119519 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 54) took 1379 ms. Trace:
I20260709 13:11:11.084189 25244 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:11.034250 25281 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.121495 24500 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:11.126194 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.096364 25283 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:11.149160 19217 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.149300 25241 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:11.149871 25241 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.126663 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.107523 25280 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.152037 25280 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.115893 25206 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.128541 19293 rpcz_store.cc:276] 0709 13:11:09.735718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.937068 (+201350us) service_pool.cc:224] Handling call
0709 13:11:11.115278 (+1178210us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54002b7ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:11.115385 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104493952}
I20260709 13:11:11.154279 25281 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.154241 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.155613 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.107996 25217 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.158499 24500 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.135140 25282 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:11.159380 25217 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.159597 25282 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.159749 25042 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.160014 25282 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:11.163024 19225 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:11.156113 19293 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.129524 19297 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:11.163722 25279 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.147774 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.159402 24500 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.184476 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.184767 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 879) took 1529 ms. Trace:
I20260709 13:11:11.185760 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.186376 19299 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:11.187295 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.129892 24982 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.185179 19296 rpcz_store.cc:276] 0709 13:11:09.655736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.660270 (+  4534us) service_pool.cc:224] Handling call
0709 13:11:09.660656 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:09.857188 (+196532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.857609 (+   421us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:10.063317 (+205708us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b2c0000e678. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:10.063890 (+   573us) log.cc:844] Serialized 52 byte log entry
0709 13:11:10.141380 (+ 77490us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:10.218705 (+ 77325us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.183760 (+965055us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b180044ec00. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8dbd8958f 00007fe8d4dc8571 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd
0709 13:11:11.184260 (+   500us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.184463 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.184530 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.184569 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:11.184580 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.184714 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":785394,"prepare.queue_time_us":827330,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":87,"raft.queue_time_us":64798,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":25886,"spinlock_wait_cycles":37851520,"thread_start_us":461122,"threads_started":3,"wal-append.queue_time_us":182512}
I20260709 13:11:11.188974 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.189327 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.189749 19291 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:11.190129 24982 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.190448 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:11.191015 19291 raft_consensus.cc:606] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:11.166957 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:11.194243 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64563.5us
I20260709 13:11:11.194243 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.151926 25241 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.181946 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.190349 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.198941 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.176385 19217 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:11.201370 19293 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:11.202862 19293 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:11.105101 25284 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.209844 25284 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.148229 25196 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.217906 19291 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:11.218190 25196 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.218967 19291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:11.219522 19291 raft_consensus.cc:606] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:11.219825 19291 raft_consensus.cc:614] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:11.220443 25218 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:11.220964 25218 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:11.221832 25218 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.216226 25283 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:11.224690 25283 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.225121 25283 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.225871 25154 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.221844 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.218899 19896 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:11.232776 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.204711 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.166328 25244 consensus_queue.cc:1243] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:11.203708 25042 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:11.240338 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.238752 25154 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.236814 25284 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:11:11.243695 25154 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.244951 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1104) took 1139 ms. Trace:
I20260709 13:11:11.245357 19900 rpcz_store.cc:276] 0709 13:11:10.102823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.102930 (+   107us) service_pool.cc:224] Handling call
0709 13:11:11.242024 (+1139094us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54001ee1d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:11.242145 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098965760}
I20260709 13:11:11.245846 25154 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.243218 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.246866 19895 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:11.247934 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:11.248688 25284 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:11.249042 25284 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.249357 25284 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.251369 25282 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.235453 25281 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:11.256059 25259 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.257817 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:11.260833 25233 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
I20260709 13:11:11.261214 25281 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.261708 25281 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.261392 25259 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.261559 25233 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.262749 25284 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.263615 25259 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.263815 25233 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.264470 19293 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:11.264644 19218 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:11:11.264983 19218 pending_rounds.cc:85] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 5
I20260709 13:11:11.265208 19218 pending_rounds.cc:107] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:11:11.265444 19218 raft_consensus.cc:2889] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.266064 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:11.266419 25282 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.266906 19895 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.268121 25284 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.211143 25206 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:11.239033 24500 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:11.279652 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:11.237744 25232 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:11:11.281356 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45584.5us
I20260709 13:11:11.285688 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.290122 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.300132 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.300202 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.300902 19291 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.301100 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.303969 25232 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.305004 25232 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.307086 19895 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:11.281252 25042 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.308349 25128 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.309082 25130 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:11.308869 25042 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.309994 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:11.310778 25284 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:11.309451 25130 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.311321 25284 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:11.313966 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.319561 25284 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.319556 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.321440 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.322467 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.322646 25283 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.323535 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.325086 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.315373 25130 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.344563 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.345252 19223 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:11.315124 24809 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.317390 25154 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:11.352438 19299 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:11:11.338867 25233 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.308892 25128 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.341132 25241 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.359513 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.315764 25290 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:11.356869 24936 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.023s	sys 0.018s
I20260709 13:11:11.367043 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.367935 19217 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:11.355955 24500 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:11.377557 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:11.366961 24936 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.023s	sys 0.018s
I20260709 13:11:11.357197 25214 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:11.360301 25154 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.386109 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.386804 19217 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.388213 25124 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:11.389329 25124 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:11.389700 25124 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:11.392048 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.365304 25290 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:11.352931 24809 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.401742 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:11.406106 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.364408 25233 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.409536 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:11.416487 25293 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:11:11.369935 25241 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.417634 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:11.418038 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.418489 19296 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.395221 25196 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.423970 19220 raft_consensus.cc:2376] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17. Re-sending same reply.
W20260709 13:11:11.424345 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46933.9us
I20260709 13:11:11.399330 25290 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.430280 25241 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.425426 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.385728 24500 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.433921 25079 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:11.434478 25079 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:11.435333 25296 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:11.437085 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.437903 25233 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.438284 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.439579 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.394407 25214 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.441702 25214 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.442430 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:11.442662 25271 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:11.443840 19895 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:11.423869 25283 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.450492 25239 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:11.457809 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.459605 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:11.471572 19902 raft_consensus.cc:2368] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19.
W20260709 13:11:11.450496 25295 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:11.469480 19217 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:11.477363 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.477931 19217 raft_consensus.cc:2376] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18. Re-sending same reply.
I20260709 13:11:11.479106 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:11.480108 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.460862 25237 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:11.482156 24500 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.483158 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.471071 25215 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:11.472245 24982 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:11:11.487898 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.485610 19263 leader_election.cc:400] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19.
I20260709 13:11:11.490501 19263 leader_election.cc:403] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:11:11.491014 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58471.8us
I20260709 13:11:11.491704 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:11.461194 25007 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:11:11.470973 25241 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:11:11.472579 25214 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.482653 25237 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.501631 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.502300 19217 raft_consensus.cc:2376] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17. Re-sending same reply.
I20260709 13:11:11.502959 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.505162 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.495076 25158 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.521118 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.522207 25207 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.522758 25207 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.499611 25237 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.524789 25207 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.522183 19217 raft_consensus.cc:2376] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18. Re-sending same reply.
I20260709 13:11:11.479817 25154 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.527315 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:11.528446 25103 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.515003 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:11.517289 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.530977 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.492763 25215 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.533075 25215 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.498412 25283 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19.
W20260709 13:11:11.517948 25253 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.144s	user 0.000s	sys 0.012s
I20260709 13:11:11.536293 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2416) took 1549 ms. Trace:
I20260709 13:11:11.536729 19222 rpcz_store.cc:276] 0709 13:11:09.986611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.986728 (+   117us) service_pool.cc:224] Handling call
0709 13:11:09.987012 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.991886 (+  4874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.991931 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.011747 (+ 19816us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.146250 (+134503us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:10.146283 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.146330 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.517357 (+1371027us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:11.535922 (+ 18565us) raft_consensus.cc:1685] finished
0709 13:11:11.535951 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.536223 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4480,"spinlock_wait_cycles":47497472,"thread_start_us":132700,"threads_started":1,"wal-append.queue_time_us":281483}
W20260709 13:11:11.519094 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 265) took 23927 ms (client timeout 15000 ms). Trace:
I20260709 13:11:11.506404 25079 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.519655 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.500972 25056 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:11.541706 19369 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:11.521286 25158 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.475739 25124 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.499295 25263 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:11.543479 19217 pending_rounds.cc:85] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 6
I20260709 13:11:11.496493 25218 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.551158 19291 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:11.550657 19217 pending_rounds.cc:107] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:11.559777 19217 raft_consensus.cc:2889] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.560559 25218 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.560998 19284 tablet_service.cc:1558] Processing DeleteTablet for tablet aff34caf0ca44db08f7c49f51ca52966 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:41698
I20260709 13:11:11.563187 25218 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.566646 25124 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:11.570801 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 79137.5us
I20260709 13:11:11.571481 25264 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:11.572291 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.572230 25264 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.573688 19868 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.574453 25079 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.574905 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.575008 25264 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.575109 25079 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.578758 25290 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.548671 25215 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:11:11.581449 19300 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:11.584492 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.593077 19291 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:11:11.618909 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44089.6us
I20260709 13:11:11.619704 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:11.620816 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:11.621613 25207 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.622243 25207 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.623519 25290 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.625385 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.626588 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.627357 25207 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:11.627902 25207 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:11.628806 25207 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:11.597661 25262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.022s	sys 0.020s
I20260709 13:11:11.550297 25263 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:11.639623 25079 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:11.637836 25290 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.640817 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 1042) took 1486 ms. Trace:
I20260709 13:11:11.641233 19374 rpcz_store.cc:276] 0709 13:11:10.154331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.154711 (+   380us) service_pool.cc:224] Handling call
0709 13:11:11.640568 (+1485857us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400355f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:11.640731 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519216512}
I20260709 13:11:11.642668 19365 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:11.616786 25289 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:11.644661 25289 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:11.645741 25289 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.647329 25289 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:11.623598 25237 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:11.637981 25262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.024s	sys 0.020s
I20260709 13:11:11.668020 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.616371 25261 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.613502 25214 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:11.591732 25281 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.669860 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.673947 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.634984 25158 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.676712 19223 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: [16.9-17.10]
I20260709 13:11:11.677709 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.684620 19896 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:11.679646 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.693913 24982 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.694463 24982 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.697111 25263 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.698312 25264 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.698848 25264 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.701040 25264 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.640872 25290 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.705109 25290 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.681399 25214 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.707264 25214 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.710561 24809 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.711263 24935 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:11.711670 24935 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.683516 25261 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.712584 24935 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.713991 24935 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.714867 25261 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.705124 19295 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:11.718040 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:11.540295 19115 rpcz_store.cc:269] 0709 13:10:47.591571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.592339 (+   768us) service_pool.cc:224] Handling call
0709 13:11:11.518860 (+23926521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:04.048860 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:04.155683 (+106823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:04.155738 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:11:04.155756 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:04.354881 (+199125us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:04.355015 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:04.355055 (+    40us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:11:04.358100 (+  3045us) tablet.cc:701] Row locks acquired
0709 13:11:04.358144 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:11:04.358359 (+   215us) write_op.cc:270] Start()
0709 13:11:04.358550 (+   191us) write_op.cc:276] Timestamp: P: 1783602664358286 usec, L: 0
0709 13:11:04.358596 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:11:04.359587 (+   991us) log.cc:844] Serialized 12236 byte log entry
0709 13:11:04.794197 (+434610us) op_driver.cc:464] REPLICATION: finished
0709 13:11:05.142190 (+347993us) write_op.cc:301] APPLY: starting
0709 13:11:05.142283 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:06.398675 (+1256392us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:06.398826 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:07.022783 (+623957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:07.023247 (+   464us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:11:07.023307 (+    60us) write_op.cc:312] APPLY: finished
0709 13:11:07.023882 (+   575us) log.cc:844] Serialized 268 byte log entry
0709 13:11:07.192576 (+168694us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:07.208441 (+ 15865us) write_op.cc:454] Released schema lock
0709 13:11:07.208535 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:07.208961 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:07.208999 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6218475,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":338220,"apply.run_cpu_time_us":59907,"apply.run_wall_time_us":2066766,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133583,"num_ops":31,"prepare.queue_time_us":97025,"prepare.run_cpu_time_us":80940,"prepare.run_wall_time_us":569740,"raft.queue_time_us":47061,"raft.run_cpu_time_us":20274,"raft.run_wall_time_us":164353,"replication_time_us":435411,"thread_start_us":630504,"threads_started":5,"wal-append.queue_time_us":585757,"wal-append.run_cpu_time_us":32268,"wal-append.run_wall_time_us":2356950}]]}
I20260709 13:11:11.694514 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.673645 24983 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:11.729607 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.698340 25263 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:11.747009 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52570us
I20260709 13:11:11.747802 25289 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.748423 25289 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.749238 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.750605 25289 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:11.747654 25245 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:11.751853 24982 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.752204 25245 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:11.752511 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 116929us
I20260709 13:11:11.752681 25245 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.756007 19896 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:11:11.751305 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.757931 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.758263 25281 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.758666 25128 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:11.759007 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.759474 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.760104 19216 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:11.762909 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:11.764212 25214 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.769459 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.769731 19895 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:11.770690 25261 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:11.747339 25284 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:11.771414 25261 consensus_queue.cc:1243] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:11.772367 25261 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:11.773298 24908 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:11.771430 25284 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:11.683660 25272 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.768054 25086 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.773808 24908 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:11.774274 25284 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.775231 25130 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.767848 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.776427 19298 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:11.776507 19903 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:11:11.777487 25130 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.773363 25261 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:11.750499 25290 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:11.765293 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.781147 19291 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:11.782054 19292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2374) took 1256 ms (client timeout 1660 ms). Trace:
I20260709 13:11:11.785034 19225 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:11.785493 19222 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:11.790410 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.790400 19903 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:11.793589 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.794248 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.793684 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.794492 19901 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:11.794870 19223 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:11.795735 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:11.789949 19292 rpcz_store.cc:269] 0709 13:11:10.526127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.528248 (+  2121us) service_pool.cc:224] Handling call
0709 13:11:11.781883 (+1253635us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54001d3b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:11.782003 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846133120}
I20260709 13:11:11.797139 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.797817 19373 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:11.799773 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:11.801288 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.802112 19222 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:11.807717 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.808612 19222 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:11.809782 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.816366 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.816931 19222 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.817126 19223 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:11.810979 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:11.819744 19220 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:11.819749 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.813483 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:11.820609 19221 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:11.820892 19218 raft_consensus.cc:2410] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:11:11.821215 19373 raft_consensus.cc:2368] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:11:11.820600 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:11.824132 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.813459 19225 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:11.785311 24983 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.815266 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:11.825750 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.830327 19293 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:11.826403 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:11.831928 19369 raft_consensus.cc:2368] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:11.823580 25272 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.829166 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:11.832028 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.785790 25261 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:11.827559 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.837517 25207 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:11.793488 25079 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:11.819136 24647 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:11:11.812912 25246 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:11.846496 19222 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:11.849004 19224 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:11.790303 25241 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:11.796542 25214 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:11.787956 25283 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:11:11.846689 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:11.847545 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:11.848124 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 212268us
I20260709 13:11:11.854977 24500 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:11.855118 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 55425us
I20260709 13:11:11.855366 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:11.856232 25241 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:11.856698 25241 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:11.857074 25297 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:11.857496 25297 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.857581 25241 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.859010 25241 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.861822 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:11.862427 19225 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.853402 25246 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.862165 25261 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.843091 25207 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.838585 25290 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:11.865069 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:11.837546 19110 catalog_manager.cc:5028] TS 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): tablet aff34caf0ca44db08f7c49f51ca52966 (table test-workload [id=efd3e72ba93844a5a418950d935e853f]) successfully deleted
W20260709 13:11:11.870188 19110 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 76811.6us
I20260709 13:11:11.838340 25271 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:11:11.842777 25206 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:11:11.882522 19365 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:11.854192 25259 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.867981 25207 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.886886 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.891510 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:11.905557 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.885070 25209 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:11.893517 24983 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.894089 25079 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:11.894644 25237 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:11.864389 25029 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:11.865963 25118 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.830081 24908 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:11.909081 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.912591 19373 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:11:11.943457 19373 pending_rounds.cc:85] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 10
I20260709 13:11:11.943743 19373 pending_rounds.cc:107] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:11:11.912663 19899 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:11.898094 25261 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.916227 19225 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:11.945631 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:11.940761 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:11.921474 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:11.928640 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:11.949054 19218 raft_consensus.cc:2410] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:11:11.948944 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.950938 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:11.905750 25130 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.873570 24982 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:11.937885 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.939420 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.944067 19373 raft_consensus.cc:2889] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.906396 19370 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:11.932650 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.933859 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.921422 25209 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:12.023325 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.038938 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.042318 19365 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:12.042174 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.043044 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.044709 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.045095 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:11.921072 25233 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:11.915439 25259 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.049854 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.051767 19374 raft_consensus.cc:2410] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:11:12.053731 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:12.060782 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.068537 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:11.937044 25317 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.133s
I20260709 13:11:12.037628 24809 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:12.087203 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.041205 25209 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.091238 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:12.043870 25318 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.037169 25218 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:12.081738 19292 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:12.046401 24908 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.968838 25214 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:12.082540 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:12.083209 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 137691us
I20260709 13:11:11.948211 25118 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.089013 19297 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:12.110440 19374 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:12.082652 25158 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.074900 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.090377 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:11.940786 25203 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:11:12.091997 19299 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:12.050275 25233 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:12.116612 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.117828 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.059302 25130 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:12.053192 25246 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:12.097440 19373 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:12.072028 19372 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:11.961742 25289 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.125s
I20260709 13:11:12.108482 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:12.091457 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.111845 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.116732 25233 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.118571 19374 raft_consensus.cc:2410] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:12.050181 24647 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:12.094462 25137 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.121879 25316 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:11:12.113310 25029 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:12.125458 19367 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:12.141607 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.095587 24809 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:12.127110 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.052765 25290 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.127651 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.130894 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:12.126205 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:12.148319 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:12.148798 19292 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.148985 19291 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:12.116063 25203 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:12.134630 25118 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:12.136777 25320 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:11:12.139143 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:12.115180 25158 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.140250 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.144214 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.117628 25214 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:12.148857 19372 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:12.167587 19374 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:12.066226 24982 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.109625 25318 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.151232 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.171765 19369 raft_consensus.cc:2410] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:11:12.157646 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:12.158771 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.161165 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.164436 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.174268 19367 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.125782 25218 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.176370 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.180823 19218 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:12.176977 19374 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:12.132699 24647 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.154989 25203 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:12.186088 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.132571 25137 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.237872 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:12.242944 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.189956 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.194875 19219 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:12.167168 25158 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.141294 25284 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.199765 19220 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:12.204833 25297 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.205626 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:12.249188 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.206780 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:12.247651 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:12.250931 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44216us
W20260709 13:11:12.208148 25325 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
I20260709 13:11:12.174702 25214 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.264669 19369 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:12.265964 19369 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:12.213375 25324 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:11:12.266831 25196 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.267225 25196 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.267568 25196 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.172577 25130 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:12.268656 25130 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.223270 25318 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.225672 25245 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.226310 19217 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:12.227555 25218 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.281474 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:12.198334 19374 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:11:12.255056 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49512.1us
I20260709 13:11:12.255709 24983 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:12.256400 25322 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:11:12.256722 25263 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.257860 25297 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.258427 19371 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:12.293301 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:12.263098 19365 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:11:12.266381 19266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.665s (SENT) [suppressed 16 similar messages]
I20260709 13:11:12.211225 19293 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:12.274559 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.276132 19292 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:12.278609 19370 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:11:12.284013 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:12.288264 19216 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:12.305060 19370 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 8
I20260709 13:11:12.305429 19370 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:11:12.305742 19370 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.305958 19298 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:12.296269 19218 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:12.308485 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:12.292520 24983 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:12.323591 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.327816 19372 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:12.301611 25263 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:12.304486 25205 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:12.279906 25289 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:11:12.337515 25263 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.337334 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:12.339294 19292 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:12.340327 19217 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:12.315501 25272 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.294610 25318 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:11:12.292062 25321 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:11:12.347577 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.352276 19365 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:12.353646 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.354660 19370 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:12.305140 25203 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.315392 25259 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.333879 24983 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.279932 24809 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.370398 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.351076 25205 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:12.303771 25029 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.371758 25192 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:12.369156 25124 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.392756 25264 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:12.393532 25130 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:12.394059 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 127689us
I20260709 13:11:12.394349 25042 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:12.395493 24935 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:12.379688 25203 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:12.412233 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 109056us
I20260709 13:11:12.415151 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:12.429792 19367 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:12.430805 19373 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:12.434127 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:12.371791 25209 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.444300 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:12.441188 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 91243.1us
I20260709 13:11:12.449582 19901 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:12.417104 25192 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:12.447533 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:12.464493 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.464622 25269 raft_consensus.cc:993] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
W20260709 13:11:12.472942 25332 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:11:12.479931 19896 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:12.408561 25154 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:11:12.421430 25124 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.503899 19367 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:11:12.504000 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:12.504565 19367 pending_rounds.cc:85] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 8
I20260709 13:11:12.504889 19367 pending_rounds.cc:107] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:11:12.505213 19367 raft_consensus.cc:2889] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.462093 24982 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:12.502127 25326 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:12.521975 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 87971us
W20260709 13:11:12.524183 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.489355 25284 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:12.490892 25318 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.514051 25137 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:12.545833 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.528651 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:12.547869 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.551954 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:12.553195 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:12.573372 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:12.493718 25317 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:11:12.535884 24982 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.530788 25318 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.585096 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.585863 19367 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:12.580118 19370 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:11:12.514817 25333 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:11:12.582891 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 190966us
W20260709 13:11:12.583092 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.597584 19369 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:12.546093 25245 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.599997 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.495188 25205 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.609951 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.611384 19369 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:12.582010 24982 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.599716 25086 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.002s
I20260709 13:11:12.596541 25318 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:12.618824 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 310392us
I20260709 13:11:12.599125 25176 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.544942 25341 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:11:12.620714 25207 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.691s	user 0.004s	sys 0.007s
I20260709 13:11:12.630607 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.579632 25158 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.633122 19367 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:12.619899 24982 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.623903 25262 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:12.640288 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67053.7us
I20260709 13:11:12.615553 25353 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.641341 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:12.626156 25118 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.623121 25347 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.639602 25207 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.636615 25342 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 13:11:12.668239 25346 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:11:12.644948 25347 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.685735 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:12.686368 19216 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.596824 25192 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.671752 25355 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:12.680292 19370 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:11:12.688755 19370 pending_rounds.cc:85] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 6
I20260709 13:11:12.689014 19370 pending_rounds.cc:107] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:11:12.679239 25233 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
I20260709 13:11:12.685209 19365 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:12.684397 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:12.689248 19370 raft_consensus.cc:2889] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.643648 25353 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.691430 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:12.693151 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:12.673384 25271 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:12.696175 19217 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:12.681241 25086 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.698563 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:12.703804 19218 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:11:12.706248 19218 pending_rounds.cc:85] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 10
I20260709 13:11:12.706539 19218 pending_rounds.cc:107] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:11:12.706831 19218 raft_consensus.cc:2889] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.707806 19191 leader_election.cc:400] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 12. Current term is 13.
I20260709 13:11:12.708907 25284 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.688393 25347 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.708760 25360 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:11:12.710963 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.713399 19216 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:12.742673 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:12.744720 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:12.745635 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.745687 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.746783 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.747761 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:12.716825 24908 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.002s
W20260709 13:11:12.719555 25261 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.755s	user 0.008s	sys 0.002s
W20260709 13:11:12.720749 25350 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:12.723487 25209 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.752066 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.753237 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.725332 25196 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.685086 25262 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.041s
W20260709 13:11:12.728629 25359 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 13:11:12.705629 25233 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.765064 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:12.730898 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.732712 25158 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.688634 24647 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:12.734988 25207 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.704008 25271 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:12.645346 25118 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.700579 25353 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.737736 19298 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:12.749528 19370 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:12.829437 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 121808us
W20260709 13:11:12.749830 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.755519 19297 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:12.830246 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:12.756646 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:12.765057 19339 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:12.769331 19368 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:12.753810 19365 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:12.802716 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:12.729564 25206 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.809092 19366 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:12.808148 19374 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:12.753818 25360 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:12.832777 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 67783.9us
I20260709 13:11:12.836992 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:12.842306 19294 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:12.830802 25269 raft_consensus.cc:1081] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:12.819882 25341 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.821921 25124 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:12.872092 19373 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:12.840787 24908 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:12.875702 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.876679 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 111744us
I20260709 13:11:12.876770 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:12.839699 25360 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:12.845834 25103 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:12.886781 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48515.3us
I20260709 13:11:12.887856 19191 leader_election.cc:400] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:12.888274 19191 leader_election.cc:403] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.889488 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:12.838356 25263 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.876901 24908 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:12.963881 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 87184.8us
W20260709 13:11:12.973605 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 84215.5us
W20260709 13:11:13.032536 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58341.1us
I20260709 13:11:12.896605 25270 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.882329 25365 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:12.851378 25206 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.977880 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:13.509305 25203 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.072s	user 0.010s	sys 0.018s
I20260709 13:11:13.038035 25218 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.226s
I20260709 13:11:12.974575 25364 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.302s
W20260709 13:11:13.038594 24983 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.662s	user 0.001s	sys 0.010s
W20260709 13:11:13.521087 25358 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.852s	user 0.002s	sys 0.000s
I20260709 13:11:13.520787 24983 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.201130 25360 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:12.888052 25262 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.148s
W20260709 13:11:13.421844 19221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.001s
W20260709 13:11:13.525205 19221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.001s
W20260709 13:11:13.250311 25367 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.367s	user 0.000s	sys 0.000s
I20260709 13:11:12.885900 25271 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:12.975435 24908 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.505079 25321 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:11:13.512831 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.521456 25297 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.217s	user 0.004s	sys 0.018s
I20260709 13:11:13.536718 25333 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:13.541575 25327 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:13.542212 25327 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.543041 25218 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:13.526372 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 629081us
W20260709 13:11:13.507915 25347 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.798s	user 0.005s	sys 0.010s
I20260709 13:11:13.532008 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 884) took 1056 ms. Trace:
I20260709 13:11:13.549167 19899 rpcz_store.cc:276] 0709 13:11:12.475745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.480928 (+  5183us) service_pool.cc:224] Handling call
0709 13:11:12.481256 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.481608 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.481639 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.492343 (+ 10704us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.616909 (+124566us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:12.616949 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.617014 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.520504 (+903490us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:13.525785 (+  5281us) raft_consensus.cc:1685] finished
0709 13:11:13.525815 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.531921 (+  6106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1367,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":26007,"spinlock_wait_cycles":13882240,"thread_start_us":86908,"threads_started":1,"wal-append.queue_time_us":147551}
W20260709 13:11:13.532719 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 499108us
I20260709 13:11:13.528359 25124 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
W20260709 13:11:13.249467 25371 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:11:13.564502 19217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:13.565204 19217 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.565583 19217 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.543669 25207 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:13.541512 25333 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.537148 25118 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.578148 25270 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.579567 25207 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.580338 25206 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:13.578255 25196 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.581825 25207 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.510300 25246 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.535487 25350 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.499s	user 0.011s	sys 0.011s
I20260709 13:11:13.556533 25297 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.556689 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.583695 25353 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.727s	user 0.000s	sys 0.013s
W20260709 13:11:13.593214 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.592804 25297 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.557895 25237 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.594286 25237 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.594928 25297 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:13.595920 25352 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.931s	user 0.008s	sys 0.001s
I20260709 13:11:13.560962 25130 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.509872 25263 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.550981 25271 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:13.574455 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 537405us
W20260709 13:11:13.577147 24982 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.933s	user 0.013s	sys 0.002s
I20260709 13:11:13.548336 24809 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:11:13.559312 25233 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:13.602699 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 901) took 1155 ms. Trace:
I20260709 13:11:13.593374 25353 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.610189 19293 rpcz_store.cc:276] 0709 13:11:12.447725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.447852 (+   127us) service_pool.cc:224] Handling call
0709 13:11:12.448224 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.807147 (+358923us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:12.840191 (+ 33044us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.529271 (+689080us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:13.530858 (+  1587us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.530997 (+   139us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:13.531041 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.531122 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.602466 (+ 71344us) raft_consensus.cc:1685] finished
0709 13:11:13.602486 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.602636 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":952913,"prepare.queue_time_us":37576,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":909737,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":8066,"thread_start_us":99189,"threads_started":1,"wal-append.queue_time_us":715777}
W20260709 13:11:13.618160 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 644658us
W20260709 13:11:13.609488 25374 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:11:13.622838 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:13.628645 19217 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.563033 25347 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.596427 25246 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.648772 19217 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:13.633970 25342 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:13.632591 25218 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.612504 24982 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.633270 25237 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.605476 25130 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.656978 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.664907 25353 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:13.667253 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46129.4us
I20260709 13:11:13.670526 25361 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:13.670781 24982 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.671195 25361 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:13.671977 19369 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:13.635174 25333 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.649058 25285 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:13.630887 25263 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 13:11:13.687811 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:13.680235 25318 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.047s	user 0.010s	sys 0.008s
I20260709 13:11:13.677636 25233 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.692803 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:13.650816 25355 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:11:13.678241 25283 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:13.700098 19224 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:13.701223 25342 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.706794 25342 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.700531 19218 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:13.708904 25342 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.702745 25318 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.713287 25318 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.716676 19222 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:13.724377 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:13.692044 25056 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:13.701889 19896 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:13.701234 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 723386us
I20260709 13:11:13.725178 19222 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:13.680449 24908 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.731555 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:13.680034 25218 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:13.733879 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.741133 19222 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:13.742468 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.717872 24809 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:13.683530 25285 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.731830 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:13.756439 19218 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:11:13.757038 19218 pending_rounds.cc:85] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 10
I20260709 13:11:13.757294 19218 pending_rounds.cc:107] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:11:13.757571 19218 raft_consensus.cc:2889] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:13.760311 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3043) took 1028 ms. Trace:
I20260709 13:11:13.727358 25381 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.767813 19217 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:13.705940 25233 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.760833 19221 rpcz_store.cc:276] 0709 13:11:12.731864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.741065 (+  9201us) service_pool.cc:224] Handling call
0709 13:11:12.799241 (+ 58176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.809748 (+ 10507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.809782 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.810216 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.525598 (+715382us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:13.525640 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.525747 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.760096 (+234349us) raft_consensus.cc:1685] finished
0709 13:11:13.760116 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.760252 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10156,"raft.queue_time_us":18077,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":16826,"thread_start_us":653482,"threads_started":1,"wal-append.queue_time_us":768407}
I20260709 13:11:13.719712 25283 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.777719 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:13.733872 25128 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.729154 25318 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:13.771481 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:13.768199 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:13.763942 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:13.726984 25328 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:11:13.780269 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:13.729507 25259 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:11:13.758100 25317 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:13.791690 24935 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.784965 19218 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:13.741230 25056 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.781699 19219 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.796517 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:13.800186 19368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2768) took 1751 ms (client timeout 1648 ms). Trace:
W20260709 13:11:13.794876 25372 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.829s	user 0.022s	sys 0.024s
I20260709 13:11:13.777788 25381 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:13.801904 25233 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.783838 25128 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.804585 25285 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:13.786396 25318 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.759506 24809 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.787710 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:13.827859 25283 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.820315 25382 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.777580 25290 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:13.820888 19901 raft_consensus.cc:2368] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:13.767230 25384 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:13.889196 19337 leader_election.cc:400] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:13.888871 25384 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.889549 19337 leader_election.cc:403] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.890480 25385 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:13.890240 25361 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.891228 25384 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.891690 25361 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:13.892959 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.893209 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 105612us
I20260709 13:11:13.893916 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2764) took 2010 ms. Trace:
I20260709 13:11:13.894390 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:13.896349 25283 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.896600 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.897045 25283 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:13.897213 19223 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:13.897408 19374 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:13.897717 25283 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:13.899097 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2791) took 1269 ms. Trace:
I20260709 13:11:13.899554 19369 rpcz_store.cc:276] 0709 13:11:12.630223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.630346 (+   123us) service_pool.cc:224] Handling call
0709 13:11:13.898890 (+1268544us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400314554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:13.899028 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387958016}
I20260709 13:11:13.766716 25203 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:11:13.821733 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50368.5us
I20260709 13:11:13.894260 19366 rpcz_store.cc:276] 0709 13:11:11.884041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.933529 (+ 49488us) service_pool.cc:224] Handling call
0709 13:11:13.893771 (+1960242us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b5400095bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:13.893865 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1782194432}
I20260709 13:11:13.785923 25244 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:13.826762 19896 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
W20260709 13:11:13.833078 19368 rpcz_store.cc:269] 0709 13:11:12.049241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.060527 (+ 11286us) service_pool.cc:224] Handling call
0709 13:11:13.799893 (+1739366us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400197b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:13.800084 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626964736}
I20260709 13:11:13.840065 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.839998 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:13.909209 19218 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:13.910136 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:13.910753 19218 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.841579 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:13.852567 25218 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:13.854678 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 122927us
I20260709 13:11:13.915228 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:13.915418 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:13.824883 25342 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:13.875459 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:13.876833 19902 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:13.804628 19367 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:11:13.827870 25130 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:13.921257 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:13.921974 19900 raft_consensus.cc:2368] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:13.881695 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.923611 19221 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:13.924219 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:13.925263 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:13.926067 19368 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:11:13.900921 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:13.901407 19365 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:13.927531 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:13.928114 19369 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:13.928923 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:13.929425 19369 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:13.930119 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:13.930830 19369 raft_consensus.cc:2410] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:11:13.902135 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:13.904721 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.912124 19372 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:13.852736 25209 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:13.841845 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:13.933928 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:13.881131 25246 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.909078 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:13.934609 19896 raft_consensus.cc:2368] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18.
I20260709 13:11:13.900550 25385 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:13.937285 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:13.937419 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:13.920109 19367 pending_rounds.cc:85] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 10
I20260709 13:11:13.938079 19366 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:13.938086 19367 pending_rounds.cc:107] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:11:13.938650 19367 raft_consensus.cc:2889] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:13.902846 24908 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:13.944468 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3040) took 1213 ms. Trace:
I20260709 13:11:13.932544 19223 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:13.933441 19895 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:13.883963 25271 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:13.931773 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.943935 25353 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.949414 25290 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:13.834210 25317 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:13.949680 25353 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.951823 25317 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:13.952040 25263 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:13.952533 25271 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:13.949892 25290 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:13.953922 25192 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:13.955467 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:13.955845 25056 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.918176 25342 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.956055 25395 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.956492 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:13.956591 25394 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:13.958168 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:13.944897 19220 rpcz_store.cc:276] 0709 13:11:12.731039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.738248 (+  7209us) service_pool.cc:224] Handling call
0709 13:11:12.738583 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:12.738909 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:12.738938 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.739408 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.828398 (+ 88990us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:12.828443 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.828534 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.794237 (+965703us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:13.935177 (+140940us) raft_consensus.cc:1685] finished
0709 13:11:13.935198 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.944407 (+  9209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10057,"raft.queue_time_us":2357,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7413,"spinlock_wait_cycles":8449408,"thread_start_us":88545,"threads_started":1,"wal-append.queue_time_us":132524}
I20260709 13:11:13.917755 25244 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:14.013804 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.017277 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:13.960695 19219 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:13.964659 19218 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:13.974464 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:13.975066 25128 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:13.993845 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.022651 19293 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:14.022718 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:13.994880 19223 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:13.997583 19296 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:13.998050 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:13.998466 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:13.998080 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.000308 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.000547 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.026027 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.001008 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:14.002800 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47405.4us
I20260709 13:11:14.027518 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:13.948101 25218 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.032302 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.004386 19222 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:14.007412 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.002844 25154 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:14.021607 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126154us
I20260709 13:11:14.019698 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:13.997267 25290 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:14.037914 19298 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:14.037984 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.028684 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.005108 25342 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.031369 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.049497 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.050276 19293 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:14.007443 24908 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:13.943971 25209 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.057092 25327 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.059052 25391 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:14.059530 25347 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.059605 25391 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.033427 25394 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:14.026245 25331 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.033197 19902 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:14.033694 25128 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:14.051460 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.034576 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:14.075742 19291 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.076504 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.067770 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.007612 24982 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:14.039404 25382 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.084091 19371 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:14.054461 24908 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:14.071893 25394 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.101883 19297 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:14.089828 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.108942 19291 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:14.075973 25328 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:14.114387 19337 leader_election.cc:400] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:14.118058 19337 leader_election.cc:403] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:11:14.120018 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.125182 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:14.084057 25124 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:14.077543 25206 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:14.093760 25399 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:11:14.079278 25128 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:14.050853 25154 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:14.132306 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.134035 25271 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.092631 25400 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:14.183780 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 53730.1us
I20260709 13:11:14.142699 19297 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:14.085284 24982 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.118585 25130 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.141731 25124 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:14.078958 25331 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.116585 25361 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:11:14.093828 25411 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:11:14.157749 25406 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:11:14.158452 25381 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.118016 25328 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.204038 25328 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.206555 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.206872 25237 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:14.207391 25237 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.207716 19263 leader_election.cc:400] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18.
I20260709 13:11:14.207854 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.208307 24809 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.208851 25264 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:14.209414 25237 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.209841 25264 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:14.210201 25264 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:14.210654 25154 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.210909 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.211179 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.200834 25246 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:14.213166 25246 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.215142 25246 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.214846 25264 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.216118 25264 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:14.217770 25331 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.217895 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:14.218518 19368 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.218991 19899 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:14.220425 24908 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.130127 25233 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:11:14.221474 24908 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.224476 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:14.225755 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:14.228560 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:14.229411 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.231412 25209 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.231652 19372 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:11:14.144065 25407 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:14.127327 25321 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.131489 25318 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.186208 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.190618 19371 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:11:14.242192 19293 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.190685 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:14.242923 19369 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:14.143105 25128 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.181818 25263 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.260637 25263 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.263276 25263 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.232097 25124 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:14.264344 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.121821 25029 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:11:14.199249 19291 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.183574 25269 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:14.268334 25269 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.208098 19263 leader_election.cc:403] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:14.233186 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.248070 19372 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:14.254935 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.255293 24982 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.259205 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.183163 25241 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:14.278537 19291 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:14.279850 19369 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:14.281574 19369 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:11:14.281978 19369 pending_rounds.cc:85] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 9
I20260709 13:11:14.282243 19369 pending_rounds.cc:107] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:11:14.282506 19369 raft_consensus.cc:2889] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.284571 19293 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:14.287438 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.288080 19218 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:14.289927 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 213474us
I20260709 13:11:14.209435 25244 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:14.288913 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 171563us
I20260709 13:11:14.293738 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:14.294411 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.295429 25400 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:14.297232 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.297978 25400 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.299106 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.299810 25400 raft_consensus.cc:2764] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:11:14.301397 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:14.284287 25297 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.008s	sys 0.008s
W20260709 13:11:14.292332 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 84752us
W20260709 13:11:14.305526 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 119402us
I20260709 13:11:14.308825 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:14.304626 25297 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.008s	sys 0.008s
I20260709 13:11:14.291294 25103 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:14.291517 25327 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:14.333680 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.333901 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.241267 25290 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.330113 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.308358 25400 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.335287 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.305948 25410 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18.
I20260709 13:11:14.340580 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.308419 25218 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.371176 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.344262 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.368345 19300 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:14.399307 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55172.7us
I20260709 13:11:14.400538 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.328896 25382 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:14.402864 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:14.403492 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 73433.8us
I20260709 13:11:14.305130 25241 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.408442 19370 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:14.407791 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:14.331981 25244 raft_consensus.cc:2764] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:14.417991 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:14.341172 25396 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:14.424714 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:14.361871 25154 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:14.428236 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.429212 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.430003 19292 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:11:14.367956 25290 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.346235 24936 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:14.409741 25263 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.340767 25333 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:11:14.408757 24982 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:14.344769 25124 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:11:14.413822 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.445968 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.411134 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.447800 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.448659 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.412251 19297 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:14.456910 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.412783 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.446978 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.424816 25261 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:11:14.342450 25103 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.413347 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.479022 19293 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:14.360211 25342 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.415079 24647 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.453533 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.497922 19217 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
W20260709 13:11:14.459306 25196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.027s	sys 0.061s
I20260709 13:11:14.428040 25353 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.435494 25400 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.444788 25203 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.450320 25385 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:11:14.463667 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.464397 25381 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:14.508720 25203 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.509768 19368 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
W20260709 13:11:14.494139 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.493484 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.450766 25285 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:14.512794 25285 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.513211 25285 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:14.521920 25412 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.301s	user 0.000s	sys 0.002s
W20260709 13:11:14.528218 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64575.7us
I20260709 13:11:14.449505 25382 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.453768 25244 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:14.458932 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.452113 25233 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:14.499569 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:14.463325 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52303.4us
I20260709 13:11:14.501122 25269 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.510228 25103 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.511050 25203 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.511576 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:14.531432 19222 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:14.545158 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.500159 19217 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:14.497987 25154 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.541193 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:14.541894 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 206626us
I20260709 13:11:14.499709 25377 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.455331 24936 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.536128 25244 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:14.505785 25417 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.550710 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:14.502763 25196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.027s	sys 0.062s
I20260709 13:11:14.553182 24982 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.554220 25285 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.547079 25237 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:11:14.557005 25380 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.865s	user 0.002s	sys 0.003s
I20260709 13:11:14.569279 25342 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.570009 25263 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.536051 25381 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:14.507611 25400 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.571488 25381 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.572943 25400 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.544381 25353 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:14.559619 24983 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:14.561779 25415 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.341s	user 0.000s	sys 0.002s
I20260709 13:11:14.564415 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.567080 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.543515 25233 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.579007 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2448) took 1834 ms. Trace:
I20260709 13:11:14.578979 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.603495 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.580449 25285 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.580821 25353 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:14.581528 25124 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:14.582378 25241 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.582832 25377 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:14.614259 25377 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:14.614502 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.614846 25377 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.615404 19223 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:14.566660 25244 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.583470 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:14.585268 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 274435us
I20260709 13:11:14.621232 25272 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:14.622661 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:14.586012 25321 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
W20260709 13:11:14.590898 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.574662 25420 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:11:14.596279 25128 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.598006 24936 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.604790 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:14.603624 19216 rpcz_store.cc:276] 0709 13:11:12.744197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.019153 (+1274956us) service_pool.cc:224] Handling call
0709 13:11:14.019484 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.032540 (+ 13056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.032570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.035586 (+  3016us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.112564 (+ 76978us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:14.112624 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.522749 (+410125us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5400018bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:14.522801 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.561186 (+ 38385us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:14.578787 (+ 17601us) raft_consensus.cc:1685] finished
0709 13:11:14.578810 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.578952 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10877,"raft.queue_time_us":10982,"spinlock_wait_cycles":45404544,"thread_start_us":76629,"threads_started":1,"wal-append.queue_time_us":184666}
I20260709 13:11:14.611225 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.612856 25263 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:14.613687 24982 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:14.613054 25353 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:14.636132 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.627252 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:14.644093 25272 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:14.648286 24982 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:14.651264 19223 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.651906 25272 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:14.652052 24982 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.652894 25272 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.649968 25396 raft_consensus.cc:2764] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:11:14.640100 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 183272us
I20260709 13:11:14.608347 24983 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:14.632671 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:14.658577 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:14.563158 25328 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.661154 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2406) took 2566 ms. Trace:
I20260709 13:11:14.604612 25233 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:14.608721 25400 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.642182 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:14.648705 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 43975.7us
I20260709 13:11:14.661600 19294 rpcz_store.cc:276] 0709 13:11:12.093124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.167374 (+ 74250us) service_pool.cc:224] Handling call
0709 13:11:12.185887 (+ 18513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.852724 (+666837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.658854 (+1806130us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54001d3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:14.659026 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508999552}
I20260709 13:11:14.670136 19223 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:14.671111 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.672353 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.673012 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:14.673270 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.674070 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.674625 19372 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:14.676303 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:14.677066 19368 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:14.677572 19217 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:14.679312 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:14.660852 25203 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:14.707266 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.708735 19223 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:11:14.663143 24936 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:14.708364 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:14.663947 24983 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:14.792640 25429 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.247s	user 0.004s	sys 0.002s
I20260709 13:11:14.712826 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.793403 25328 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.678645 25396 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.794747 25396 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.796774 19217 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:11:14.797045 25396 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:14.678352 25317 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:14.797794 25317 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.798166 25317 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.672333 25264 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:11:14.799717 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.708988 25203 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:14.707847 25417 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.800590 25203 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.801326 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.800881 25417 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.802070 19219 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:14.803196 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.793344 24983 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.804587 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.805104 19219 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 7.
I20260709 13:11:14.709637 25285 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:11:14.806236 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.807808 25396 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.809644 25317 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.811713 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:14.812837 25396 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:14.828449 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2796) took 2098 ms (client timeout 1704 ms). Trace:
I20260709 13:11:14.831558 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:14.829213 19373 rpcz_store.cc:269] 0709 13:11:12.730021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.745382 (+ 15361us) service_pool.cc:224] Handling call
0709 13:11:14.751505 (+2006123us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:14.828347 (+ 76842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278444416}
I20260709 13:11:14.833961 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:14.833011 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:14.836225 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 149178us
I20260709 13:11:14.836953 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:14.839401 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.840354 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:14.842525 25056 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.859867 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.836843 25435 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:14.860790 25440 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.869506 25440 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.838559 25263 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:14.837154 25214 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:11:14.903959 25428 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.340s	user 0.000s	sys 0.002s
I20260709 13:11:14.899075 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2450) took 1257 ms. Trace:
W20260709 13:11:14.916893 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52728.8us
I20260709 13:11:14.917858 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:14.914891 19224 rpcz_store.cc:276] 0709 13:11:13.642114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.706786 (+ 64672us) service_pool.cc:224] Handling call
0709 13:11:13.707132 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:13.831338 (+124206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:13.831373 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:13.855118 (+ 23745us) log.cc:844] Serialized 52 byte log entry
0709 13:11:13.970002 (+114884us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:14.018204 (+ 48202us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.027367 (+  9163us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.033657 (+  6290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.033747 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:14.261379 (+227632us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18002fd340. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:14.640935 (+379556us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b18002fd340. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240
0709 13:11:14.893804 (+252869us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18002fd340. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:14.898813 (+  5009us) raft_consensus.cc:1685] finished
0709 13:11:14.898839 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:14.898998 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23616,"prepare.queue_time_us":57086,"raft.queue_time_us":65878,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":20022,"spinlock_wait_cycles":93400064,"thread_start_us":219214,"threads_started":2,"wal-append.queue_time_us":171454}
I20260709 13:11:14.842694 25318 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:14.861950 25311 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.861308 25435 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:14.856024 25382 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:14.924129 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 84921.5us
I20260709 13:11:14.842813 25244 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:14.926352 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.901850 25128 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.912503 25317 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:14.898622 25360 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.872071 25079 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:14.927834 19291 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:14.913269 25417 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:14.931663 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:14.935539 19300 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:14.914279 25377 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.929977 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.936030 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.904567 24982 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.938232 19294 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:14.938309 19291 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:14.925911 25435 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:14.936381 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.926538 25382 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.932283 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.935833 19300 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:14.868641 25209 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:11:14.939802 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:14.940531 19224 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.946441 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.946749 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.911038 25233 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.937377 24809 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.950100 25408 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:11:14.951108 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:14.951757 19294 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 7.
I20260709 13:11:14.952942 25396 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:14.953195 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2792) took 2308 ms. Trace:
I20260709 13:11:14.948606 19300 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.953614 19367 rpcz_store.cc:276] 0709 13:11:12.644651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.644797 (+   146us) service_pool.cc:224] Handling call
0709 13:11:13.804254 (+1159457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.939088 (+134834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:14.952952 (+1013864us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400197b50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:14.953102 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590409472}
I20260709 13:11:14.954258 19300 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.963184 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:14.983619 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:14.946060 25382 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:14.939414 25203 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:14.988924 19296 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:14.998800 19224 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
W20260709 13:11:14.993600 25394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.008s	sys 0.041s
I20260709 13:11:15.006920 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:14.990507 25396 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:14.998746 25440 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:15.017838 19366 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:15.004976 25333 raft_consensus.cc:2764] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:11:15.009824 25394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.008s	sys 0.042s
I20260709 13:11:15.014273 25396 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:15.017427 24809 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:15.024538 25124 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.058000 25382 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:15.058519 25442 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:15.068760 25377 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.051617 25396 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.069314 24809 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.085270 25383 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:15.085781 25383 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:15.086644 25383 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.070631 25124 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.087983 25383 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.090683 24982 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.095598 25244 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:15.106932 25203 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.108875 25124 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:15.115316 25391 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:15.116243 24809 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.119278 19218 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:15.128374 19365 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:15.131047 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.139642 19300 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:15.141300 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:15.141911 19298 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:15.144937 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:15.141465 25361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.012s	sys 0.018s
W20260709 13:11:15.153779 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 510047us
I20260709 13:11:15.159627 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:15.160770 19295 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:14.564307 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:15.165656 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:15.172351 25445 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:11:15.172785 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:15.173470 25382 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:15.182678 25435 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:15.171952 25447 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:15.191931 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:15.193032 19895 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEARNER]: Advancing to term 14
W20260709 13:11:15.161695 25361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.013s	sys 0.018s
I20260709 13:11:15.199597 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.201691 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:15.202688 19224 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:15.203794 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.204062 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:15.204469 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.204643 19224 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.205072 19221 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.206884 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:15.208405 19298 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:15.208779 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.209697 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:15.221864 25400 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:15.222429 25400 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.222729 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.224190 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.224501 25400 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:15.230968 19224 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:15.233062 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.233855 25400 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.250670 25272 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:15.251200 25272 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.253659 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.256508 25400 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:15.257282 25400 consensus_queue.cc:1243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:15.257630 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 1080) took 1035 ms. Trace:
I20260709 13:11:15.257723 25400 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:15.258183 25400 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:15.258128 19365 rpcz_store.cc:276] 0709 13:11:14.222510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.228283 (+  5773us) service_pool.cc:224] Handling call
0709 13:11:15.257477 (+1029194us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400298954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:15.257578 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031240960}
I20260709 13:11:15.259123 25400 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:15.262908 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:15.267272 25263 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:15.268294 25263 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.269297 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.271265 25259 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:15.271544 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.272179 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:15.273566 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1085) took 1049 ms. Trace:
I20260709 13:11:15.271852 25259 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:15.252110 25272 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.274971 25272 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.274775 25259 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.275339 25233 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.276718 25196 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:15.277110 25196 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.277958 25196 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.278923 25196 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.281934 25341 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:15.282486 25341 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:15.283632 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.285418 19366 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:15.285567 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.286294 25450 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.286578 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.286839 25450 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.274101 19371 rpcz_store.cc:276] 0709 13:11:14.223743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.273894 (+ 50151us) service_pool.cc:224] Handling call
0709 13:11:14.302716 (+ 28822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.302913 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:14.330098 (+ 27185us) log.cc:844] Serialized 14 byte log entry
0709 13:11:14.903481 (+573383us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:14.952613 (+ 49132us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b1800422a40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a
0709 13:11:15.273231 (+320618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.273284 (+    53us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:15.273329 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.273405 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.273513 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320333,"prepare.queue_time_us":129094,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":323826,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":15804928,"thread_start_us":140403,"threads_started":2,"wal-append.queue_time_us":214491}
I20260709 13:11:15.287590 25361 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:15.288115 25361 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.289266 25450 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:15.289757 25450 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.290167 25361 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:15.290287 25450 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.292661 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.292550 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.297886 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.299391 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.300318 19216 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:15.301059 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.303427 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:15.306427 19371 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:15.218710 25271 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:15.318234 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:15.319033 19895 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:15.168604 25417 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:11:15.321707 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.327452 19221 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
W20260709 13:11:15.329068 25449 log.cc:927] Time spent T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:11:15.330643 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.332103 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:15.332715 19901 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEARNER]: Advancing to term 15
W20260709 13:11:15.333235 25448 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:11:15.333289 25285 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:15.334497 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:15.337558 25328 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.338555 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.330251 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:15.356698 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.357482 19368 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:15.359038 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.360858 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.365754 19898 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:15.366658 19365 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:15.367723 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:15.367746 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:15.373600 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.374269 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.375828 19292 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:15.376147 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.377329 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.378326 19297 raft_consensus.cc:2368] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:15.379458 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.380762 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.381690 19300 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:15.289775 25400 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:15.397781 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.398412 19296 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:15.399539 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:15.400278 19291 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.369349 25207 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:15.403564 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.404639 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.409202 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.382429 25318 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:15.392796 25233 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:15.396209 25327 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:15.393134 25079 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:15.418955 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:15.428020 19297 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.419250 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:15.421325 19901 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEARNER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:15.424654 19291 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:15.429277 19292 raft_consensus.cc:2376] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18. Re-sending same reply.
I20260709 13:11:15.434978 19291 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:15.375018 24809 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:11:15.415671 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:15.410534 25353 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.012s
I20260709 13:11:15.443411 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.444141 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:15.410171 25435 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:15.395802 25056 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:15.398226 25408 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:11:15.396467 25392 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:11:15.403097 25124 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:11:15.411666 25209 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:11:15.463493 19900 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:11:15.464021 19900 pending_rounds.cc:85] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 14
I20260709 13:11:15.464289 19900 pending_rounds.cc:107] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:11:15.464569 19900 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.464461 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:15.447738 25353 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.002s	sys 0.013s
I20260709 13:11:15.468046 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.446693 25327 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:15.478021 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.455907 25410 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:11:15.449690 25318 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.453997 25450 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:15.478161 19297 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:11:15.498607 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:15.499455 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.465644 25263 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:15.468832 25433 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.476946 25124 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:15.481886 25264 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:15.544472 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:15.502120 25355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.005s	sys 0.028s
I20260709 13:11:15.483403 25128 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:15.506655 25360 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.008s
I20260709 13:11:15.584905 25272 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:15.589831 19119 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 8 to 13, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:15.601322 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50291.6us
W20260709 13:11:15.598153 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51927.9us
I20260709 13:11:15.602675 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.506848 24935 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.605245 19368 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:15.510520 25259 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:15.610203 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:15.609537 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.615851 19293 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:15.619726 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.620747 19293 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:15.591861 25355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.006s	sys 0.028s
I20260709 13:11:15.512145 25408 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:15.525599 25124 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:15.631852 24500 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:15.632401 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.614812 19372 raft_consensus.cc:2376] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22. Re-sending same reply.
W20260709 13:11:15.636468 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 137107us
W20260709 13:11:15.654542 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44443.8us
W20260709 13:11:15.639701 25451 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:11:15.644222 24982 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.646308 25466 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:15.639907 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:15.654884 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.591996 25435 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:15.592319 25285 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:15.508785 25396 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.663795 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:15.606864 25261 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.601462 25272 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.610248 25259 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:15.652868 25103 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:15.511863 25436 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 13:11:15.680032 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:15.662801 25452 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 13:11:15.670547 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 236413us
I20260709 13:11:15.663115 25347 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.667526 25466 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.735678 25466 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:15.672811 24982 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.669782 25318 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.738126 24982 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.729920 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.739230 19372 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:15.706672 25130 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:15.705837 25259 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.666575 25433 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:15.741464 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77777.9us
I20260709 13:11:15.741941 19292 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:15.735285 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:15.773710 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93756.3us
I20260709 13:11:15.671983 25246 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:11:15.782027 19297 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:15.774528 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:15.729209 25449 log.cc:927] Time spent T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:11:15.740906 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68223.7us
I20260709 13:11:15.779968 19340 leader_election.cc:400] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:15.662681 25408 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.786211 25384 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:15.682091 25435 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.658802 25327 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.703442 25261 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.794466 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:15.815850 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:15.840098 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50535us
I20260709 13:11:15.841048 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:15.840238 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65803.7us
I20260709 13:11:15.845315 19372 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:15.849085 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2326) took 1164 ms. Trace:
I20260709 13:11:15.849649 19370 rpcz_store.cc:276] 0709 13:11:14.671116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.672447 (+  1331us) service_pool.cc:224] Handling call
0709 13:11:14.672739 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.680381 (+  7642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.680418 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.680850 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.260431 (+579581us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b1800457900. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:15.501915 (+241484us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:15.717982 (+216067us) log.cc:844] Serialized 14 byte log entry
0709 13:11:15.819804 (+101822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.819889 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.819929 (+    40us) raft_consensus.cc:1685] finished
0709 13:11:15.835537 (+ 15608us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.835709 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128456,"raft.queue_time_us":114519,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":7042,"spinlock_wait_cycles":34105600,"thread_start_us":431823,"threads_started":2,"wal-append.queue_time_us":895770}
I20260709 13:11:15.725061 25103 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.875357 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:15.876006 19372 raft_consensus.cc:2376] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18. Re-sending same reply.
I20260709 13:11:15.893757 25192 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:15.894284 25056 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:15.894430 25192 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.894848 25103 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:15.895716 25470 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:11:15.896828 25192 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.894912 25056 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.897933 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:15.898552 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57592.5us
I20260709 13:11:15.897964 25056 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.899144 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:15.899355 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:15.900373 24982 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:15.900749 25465 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:11:15.901052 24982 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:15.902213 19340 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:15.902897 25473 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:15.826028 25384 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:15.904691 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:15.905210 25321 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:15.905007 25384 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.906198 25321 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:15.867421 25241 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:15.907166 25342 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:15.907847 25342 consensus_queue.cc:1243] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:15.907743 25241 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.908438 25342 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:15.908653 25475 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:15.909686 25203 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.910012 25241 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:15.910218 25203 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.876348 25353 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:11:15.911417 25353 consensus_queue.cc:1243] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:15.911863 25353 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:15.912155 25353 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:15.912456 25203 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:15.910564 25241 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:15.912988 25241 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:15.912969 25353 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.914161 25353 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.914984 25241 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.917094 25241 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.814126 25467 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.921628 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:15.928784 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:15.933938 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 139547us
I20260709 13:11:15.852648 25383 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:15.889079 25453 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:11:15.908812 25342 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.868840 25450 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:15.780347 25124 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:15.951388 19225 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:15.978722 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48091.9us
I20260709 13:11:15.980118 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:15.980892 19296 consensus_meta.cc:287] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.004s
I20260709 13:11:15.980495 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:15.819545 25272 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:15.937419 25103 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:15.943377 25394 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:15.983353 19296 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
W20260709 13:11:15.999233 19223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.008s
W20260709 13:11:16.000509 19223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.006s	sys 0.008s
I20260709 13:11:15.962786 25342 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.001572 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:16.006629 25474 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:11:16.007941 25341 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.009104 25341 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.009204 19371 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:16.011708 25435 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:16.013072 25461 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:11:16.013365 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:16.013978 19370 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:11:16.014573 25456 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:11:16.001981 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67056.4us
W20260709 13:11:16.025440 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.025902 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.029934 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.031018 19903 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:16.023617 25124 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:16.015120 25391 consensus_queue.cc:1175] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 17 status { last_received { term: 17 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 17 index: 11 } }
I20260709 13:11:16.050187 19367 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:16.050521 19370 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:16.077140 19119 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 11 to 16, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:16.077203 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 160) took 57302 ms (client timeout 15000 ms). Trace:
I20260709 13:11:16.078984 19119 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:16.082029 25196 consensus_meta.cc:287] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.008s
I20260709 13:11:16.016695 24809 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:11:16.034204 25103 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.046486 25396 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:16.084684 25103 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.089728 25103 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:16.090384 25103 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.090845 25468 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:11:16.079237 19117 rpcz_store.cc:269] 0709 13:10:18.793294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.820457 (+ 27163us) service_pool.cc:224] Handling call
0709 13:11:16.077097 (+57256640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:11.628282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:11.628990 (+   708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:11.629048 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:11:11.629082 (+    34us) tablet.cc:662] Decoding operations
0709 13:11:11.629750 (+   668us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:11.629847 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:11.629876 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:11.630309 (+   433us) tablet.cc:701] Row locks acquired
0709 13:11:11.630355 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:11:11.630530 (+   175us) write_op.cc:270] Start()
0709 13:11:11.630681 (+   151us) write_op.cc:276] Timestamp: P: 1783602671630460 usec, L: 0
0709 13:11:11.630719 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:11:11.633951 (+  3232us) log.cc:844] Serialized 1311 byte log entry
0709 13:11:12.174691 (+540740us) op_driver.cc:464] REPLICATION: finished
0709 13:11:12.584135 (+409444us) write_op.cc:301] APPLY: starting
0709 13:11:12.602678 (+ 18543us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:12.667762 (+ 65084us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:12.667885 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:13.560670 (+892785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:13.560949 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:11:13.561018 (+    69us) write_op.cc:312] APPLY: finished
0709 13:11:13.561312 (+   294us) log.cc:844] Serialized 41 byte log entry
0709 13:11:13.783279 (+221967us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:13.816216 (+ 32937us) write_op.cc:454] Released schema lock
0709 13:11:13.831227 (+ 15011us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:13.908017 (+ 76790us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:13.912903 (+  4886us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3268094,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":333193,"apply.run_cpu_time_us":31956,"apply.run_wall_time_us":1312320,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":105508,"prepare.run_cpu_time_us":24440,"prepare.run_wall_time_us":247189,"raft.queue_time_us":84286,"raft.run_cpu_time_us":13768,"raft.run_wall_time_us":266413,"replication_time_us":543791,"thread_start_us":555541,"threads_started":5,"wal-append.queue_time_us":455182,"wal-append.run_cpu_time_us":32840,"wal-append.run_wall_time_us":2665543}]]}
I20260709 13:11:16.095638 25246 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.096336 25246 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.099548 25246 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.114511 25466 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.115865 19366 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:16.120265 25206 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:16.120837 25206 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:16.033910 25435 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:16.121443 25435 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.122772 25385 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:16.123275 25385 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:16.123601 25435 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:16.124356 25385 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.126068 25385 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:16.130581 25481 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
I20260709 13:11:16.083650 19119 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 14 to 21, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:16.142632 19374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.007s	sys 0.006s
W20260709 13:11:16.147126 19374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.008s	sys 0.006s
I20260709 13:11:16.090859 25103 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.151909 19374 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:16.160571 25408 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:16.162405 25471 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:16.162917 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:16.162977 25471 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.163386 19225 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:16.163709 19223 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:16.165015 19222 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:16.168455 19218 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:16.167659 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:16.155043 25400 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.005s
W20260709 13:11:16.178990 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 156274us
I20260709 13:11:16.180428 19223 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:16.183005 25259 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.184929 19223 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:16.187362 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:16.187997 19221 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:16.188251 25259 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:16.188576 25466 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.189874 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:16.190656 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:16.192997 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:16.193608 25463 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:16.193862 25466 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:11:16.196516 24983 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:16.192282 19119 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.197309 25466 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:16.197665 25466 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:16.197942 19119 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.199332 19119 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 9 to 16, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 16 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.203739 25353 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:16.121874 25206 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.200773 19119 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.210124 19119 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.213265 25497 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:11:16.214404 25497 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:16.213877 19119 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 8 to 10, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 10 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.214772 25497 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:16.215670 19119 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.217279 19119 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.218721 19119 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 4 to 11, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 11 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.215694 25497 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.220405 25497 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:16.207383 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:16.224401 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.225790 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:16.230235 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.233105 19369 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:16.184075 25261 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.220105 19119 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 11 to 14, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.211449 25400 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.232474 25377 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:16.237855 25196 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:11:16.264060 19119 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 10 to 16, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 16 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.227954 25384 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:11:16.266049 19119 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.239733 25206 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:16.267454 19119 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.273147 19119 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 11 to 12, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 12 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.274896 19119 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 2 to 7, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 7 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:16.277304 25342 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.257380 25400 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.282713 25400 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.283434 25342 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:16.285095 25493 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:11:16.257658 25500 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:16.294909 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.295881 19368 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:16.297847 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.298498 19900 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:16.299513 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.198439 25466 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.259800 25377 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.305601 25285 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:16.306046 25377 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.306227 25285 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.305644 25433 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.309499 25433 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.311571 25433 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.311836 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.313347 19372 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:16.313477 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:16.314785 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:16.316250 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:16.333622 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.336023 25384 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:16.337556 25384 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:16.338042 25384 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.323719 25400 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:16.340042 25400 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.340438 25400 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:16.336884 25410 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:16.345981 25384 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.349275 25384 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:16.349037 25400 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.352322 25400 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.368357 25241 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:16.368664 25341 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.369151 25341 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.371325 25341 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:16.291973 25103 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.379388 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.388831 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:16.386157 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49241.2us
I20260709 13:11:16.389477 19901 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:16.335664 25285 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:16.402359 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.403085 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:16.410714 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.411505 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.412144 19298 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:16.411351 19370 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:16.413671 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.405150 19901 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:16.404006 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.406508 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.414754 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:16.422159 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.415005 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.423213 19299 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:16.423331 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.418006 19295 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:16.415328 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.424736 19296 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:16.424903 19368 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:16.414700 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.425657 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:16.426198 19296 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.426031 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:16.419571 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:16.420617 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.432726 19293 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:16.434940 19223 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:16.434689 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.435617 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.439587 19296 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:16.442013 25400 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:16.386766 25207 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:16.450078 25385 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:16.450668 25385 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.434772 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:16.457013 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:16.457239 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:16.457686 19296 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:16.461603 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:16.406950 25410 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:16.456117 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:16.469796 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:16.490026 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 58160.2us
I20260709 13:11:16.485988 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.496212 19895 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:16.485519 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.498636 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:16.471745 25271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.002s	sys 0.033s
W20260709 13:11:16.501353 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45306.4us
I20260709 13:11:16.504369 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:16.509704 25383 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:16.509799 25507 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:11:16.515725 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:16.489424 25505 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:16.516002 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:16.517163 19900 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:16.420755 25342 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:11:16.470229 25103 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.489583 25241 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.528262 19340 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:16.469422 25400 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:16.504436 25271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.002s	sys 0.033s
I20260709 13:11:16.527134 25261 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:16.511133 24908 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:16.523357 24935 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.550591 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:16.538800 25381 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:16.532233 25246 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:16.514596 25436 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:16.536576 25400 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.539572 25261 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:16.576279 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.462808 25196 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:11:16.572712 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:16.600157 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:16.527961 25462 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:11:16.539327 25271 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:16.530256 25383 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:11:16.543995 25263 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:16.584585 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:16.597714 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:16.613847 19218 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:16.616207 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:16.555775 25385 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:16.585024 25261 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:16.540642 25103 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:16.635140 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:16.552914 24935 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.540462 25241 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.621297 19225 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:16.573943 25400 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.587556 25467 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:16.632149 19223 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:11:16.636462 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.603811 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:16.628756 25381 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:16.644699 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.646116 25513 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:16.674228 19371 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:11:16.674665 19371 pending_rounds.cc:85] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 8
I20260709 13:11:16.674955 19371 pending_rounds.cc:107] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:11:16.675241 19371 raft_consensus.cc:2889] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.629387 25382 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.656395 25271 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.657400 25471 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:16.659241 19365 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:16.691915 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1088) took 1287 ms. Trace:
I20260709 13:11:16.692971 19365 rpcz_store.cc:276] 0709 13:11:15.404560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.910438 (+505878us) service_pool.cc:224] Handling call
0709 13:11:16.658800 (+748362us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:16.659013 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.691605 (+ 32592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.691831 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76811648}
I20260709 13:11:16.574011 25246 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.663820 19366 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:16.671085 25079 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:16.671486 25385 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:16.584837 25436 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.676651 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:16.639672 25263 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:16.678872 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:16.669827 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:16.681274 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 234917us
W20260709 13:11:16.717044 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47352.7us
I20260709 13:11:16.666903 25467 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:16.683624 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65952.8us
I20260709 13:11:16.712188 25079 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:16.718603 25467 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:16.554960 25410 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.699302 25209 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:16.764973 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1131) took 1327 ms. Trace:
I20260709 13:11:16.718700 25471 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:16.765985 19898 rpcz_store.cc:276] 0709 13:11:15.437676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.437974 (+   298us) service_pool.cc:224] Handling call
0709 13:11:15.438308 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.091370 (+653062us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:16.091400 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.091446 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:16.091475 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.763855 (+672380us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540049fcd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:16.763933 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.764911 (+   978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8521,"raft.queue_time_us":9342,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":1481443712}
I20260709 13:11:16.722699 25512 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.774534 19903 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:16.691859 25382 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.814874 19367 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:16.749910 25395 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.860383 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46214.8us
W20260709 13:11:16.868639 25475 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:11:16.968904 25517 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:11:17.058759 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 337945us
I20260709 13:11:16.818506 25512 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.770953 25391 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:16.771391 25394 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:16.949303 25263 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.723294 25385 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:16.774286 25377 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:16.761353 25130 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:11:16.772956 25209 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:17.045151 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 319492us
I20260709 13:11:16.733552 25079 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:17.046603 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 322075us
I20260709 13:11:16.889169 25395 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.040277 25237 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:17.092538 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:17.056200 25505 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.242s	user 0.000s	sys 0.007s
I20260709 13:11:17.113917 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:17.062973 25342 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:17.136507 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44063.3us
I20260709 13:11:17.142379 25244 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.143975 25285 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:17.146785 25209 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.146852 25079 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:17.149657 25526 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.166349 25196 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.167824 25128 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:17.123983 25525 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.169240 25450 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:17.172340 25394 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.124253 25360 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.175777 25385 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:17.183732 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.184546 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:17.189522 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:17.048008 25361 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 13:11:17.227110 19374 raft_consensus.cc:2368] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:17.176242 25342 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.239109 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:17.241432 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52163.8us
I20260709 13:11:17.253587 19366 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:17.238977 19367 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:17.185350 25285 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.246411 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.259473 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75060us
I20260709 13:11:17.246317 19365 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:17.095031 25391 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.194250 25471 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:17.194248 25244 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.232779 25450 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:17.294072 25395 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.294236 25512 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.295615 25512 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.242075 25525 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.297580 25206 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:17.298317 25206 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:17.298830 25525 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.265547 25496 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.300892 25496 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.303515 25496 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.306006 25391 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.306434 25382 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.307286 25382 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.307840 25382 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.309839 25128 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.310196 25382 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.237959 24935 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.287163 25241 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.267958 25285 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.259232 24809 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:17.223448 25526 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.274004 25246 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.227903 25196 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.258252 25130 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:11:17.283301 25436 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.240470 25360 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.258386 25419 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:11:17.314694 25103 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.306026 25377 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.310523 25128 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.385691 25244 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.386338 25128 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.386466 25103 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.387015 25103 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.387573 25394 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.388156 25394 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.299496 25206 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.388605 25394 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.389135 25103 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.390702 25394 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.392709 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.392885 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:17.393384 19218 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:17.382547 25360 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.384513 25536 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.392755 19225 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:17.331806 24809 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.395203 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.399544 19220 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:17.378134 25450 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.395913 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.329627 25512 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.442667 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.443353 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.407312 24809 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.443457 19368 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:17.452630 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.453372 19223 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:17.456508 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.424696 25311 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:11:17.461239 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.467677 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.471472 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.471681 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.472919 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.463056 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:17.473799 19217 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.474011 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:17.473807 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.910s (SENT) [suppressed 19 similar messages]
I20260709 13:11:17.474999 19365 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
W20260709 13:11:17.479671 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.484411 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.487854 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.415230 25536 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.489261 25543 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.489358 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.490099 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.490798 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.491106 25417 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:17.491521 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.491736 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.492472 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.457702 25538 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.494701 19295 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
W20260709 13:11:17.495155 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 62705.3us
I20260709 13:11:17.458132 25342 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.496838 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:17.498456 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:17.501070 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.502118 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.442090 25496 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:11:17.505496 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:17.511826 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:17.509523 19224 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:17.515260 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.512403 19297 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:17.517164 19224 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:17.513857 19900 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:17.506006 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:17.520470 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.425519 25471 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.503288 25520 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.494946 25271 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.519708 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:17.497308 25419 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.538825 19217 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:17.540522 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:17.498397 25417 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:17.523563 25261 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.882s	user 0.012s	sys 0.002s
W20260709 13:11:17.556428 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.582229 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.587307 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.587446 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:17.541864 25128 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:11:17.618546 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 78118.5us
I20260709 13:11:17.541769 25196 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.510591 25538 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.577421 25377 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:17.620857 25311 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:17.509745 25543 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.545917 25547 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:11:17.632859 25512 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.577306 24908 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.708511 24908 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.710951 24908 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.637195 25536 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.617784 25261 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.711691 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.712311 19223 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
W20260709 13:11:17.639648 25467 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.906s	user 0.012s	sys 0.000s
I20260709 13:11:17.713178 19370 raft_consensus.cc:2368] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19.
I20260709 13:11:17.713515 25467 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.714293 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:17.715193 19373 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 16. Ops: []
I20260709 13:11:17.715644 25467 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.716285 25467 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:17.537439 25532 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:17.642331 25528 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:11:17.716856 25532 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.717713 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:17.718380 19217 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.718691 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2847) took 1258 ms. Trace:
I20260709 13:11:17.719172 25467 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:17.719630 25467 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:17.675153 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 201369us
I20260709 13:11:17.719059 19371 rpcz_store.cc:276] 0709 13:11:16.460738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.686656 (+225918us) service_pool.cc:224] Handling call
0709 13:11:16.693024 (+  6368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.693555 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.693601 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.694646 (+  1045us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.048789 (+354143us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:17.089822 (+ 41033us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.164616 (+ 74794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.164722 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.641662 (+476940us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:17.718425 (+ 76763us) raft_consensus.cc:1685] finished
0709 13:11:17.718532 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.718640 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74388,"prepare.queue_time_us":42860,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":78375,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":14823,"spinlock_wait_cycles":373636864,"thread_start_us":352604,"threads_started":1,"wal-append.queue_time_us":711688}
W20260709 13:11:17.703053 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 203431us
W20260709 13:11:17.703600 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2343) took 1303 ms (client timeout 1728 ms). Trace:
W20260709 13:11:17.721372 19374 rpcz_store.cc:269] 0709 13:11:16.400651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.403668 (+  3017us) service_pool.cc:224] Handling call
0709 13:11:17.703358 (+1299690us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54000b40d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:17.703521 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817971968}
I20260709 13:11:17.722343 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:17.716135 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:17.526569 25360 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:11:17.625283 25463 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:17.729422 19217 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:17.550064 25271 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.730988 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:17.734496 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:17.723186 25396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.043s
I20260709 13:11:17.737200 19219 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:17.577322 25419 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.675406 25377 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:17.737214 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:17.683058 25526 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:17.686957 25311 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:17.623046 25128 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.733412 24908 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.741701 25396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.043s
I20260709 13:11:17.681005 25196 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:17.713181 25261 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.730526 25436 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:17.542457 25520 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.741339 25463 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:17.755676 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:17.759505 25471 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:17.741796 25512 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:17.776286 25535 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:17.776784 25535 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.777645 25511 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.206s	user 0.005s	sys 0.001s
I20260709 13:11:17.740664 25353 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:17.778807 25353 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:17.779670 25353 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.783263 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1101) took 1489 ms. Trace:
I20260709 13:11:17.783666 19369 rpcz_store.cc:276] 0709 13:11:16.293961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.294090 (+   129us) service_pool.cc:224] Handling call
0709 13:11:16.298728 (+  4638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.398930 (+100202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.398968 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.409931 (+ 10963us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.039333 (+629402us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:17.039387 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.039475 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.783058 (+743583us) raft_consensus.cc:1685] finished
0709 13:11:17.783079 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.783208 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99829,"raft.queue_time_us":100352,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10399,"thread_start_us":387964,"threads_started":1,"wal-append.queue_time_us":1325698}
I20260709 13:11:17.777665 25535 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.786288 25342 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.786767 25342 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.788793 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2461) took 1237 ms. Trace:
I20260709 13:11:17.788802 25342 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.789230 19292 rpcz_store.cc:276] 0709 13:11:16.551656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.551780 (+   124us) service_pool.cc:224] Handling call
0709 13:11:16.552064 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.748129 (+196065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.748199 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.748265 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:16.748318 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.788573 (+1040255us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400031954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:17.788620 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.788738 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434746112}
I20260709 13:11:17.790571 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.794431 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:17.798034 25128 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:17.800285 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 1103) took 1326 ms (client timeout 1628 ms). Trace:
W20260709 13:11:17.800719 19370 rpcz_store.cc:269] 0709 13:11:16.473626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.520725 (+ 47099us) service_pool.cc:224] Handling call
0709 13:11:17.800008 (+1279283us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000938d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:17.800225 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2526672256}
I20260709 13:11:17.737190 25546 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.719066 25532 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.760624 25311 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.770098 25419 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.755653 25377 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.763813 24908 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.775444 25520 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.775977 25471 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.811827 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.813002 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57421.1us
I20260709 13:11:17.722721 25417 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.822502 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:17.769098 25537 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.803311 25410 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.889721 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67323us
I20260709 13:11:17.890817 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:17.797849 25535 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:17.892947 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 98623.2us
I20260709 13:11:17.806548 25436 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:17.836190 25079 consensus_meta.cc:287] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.001s
I20260709 13:11:17.771178 25559 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.120s
I20260709 13:11:17.815946 25382 raft_consensus.cc:2764] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:11:17.836479 25471 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.910966 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:17.813922 25546 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.896364 25124 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:17.912964 19223 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:17.904606 25551 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 13:11:17.897575 25285 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 13:11:17.911550 25532 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:17.906590 25435 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:17.915975 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:17.897776 25512 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:17.910531 25417 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.935149 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:17.939101 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:17.940630 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 218806us
I20260709 13:11:17.898193 25410 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.924567 25124 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:17.943135 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 321816us
I20260709 13:11:17.948230 25512 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:17.927578 25079 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:17.948838 19369 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:17.955566 19374 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:17.950605 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:17.926463 25396 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.925246 25549 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:17.927664 25532 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:17.934142 25400 consensus_meta.cc:287] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.253s	user 0.013s	sys 0.001s
I20260709 13:11:17.940048 25382 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:17.956993 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:17.973387 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.958220 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:17.913677 25463 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.975061 25270 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:17.960317 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.975461 25270 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.975497 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:17.976275 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.947271 25391 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:17.948005 25496 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:17.958932 19869 leader_election.cc:400] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19.
I20260709 13:11:17.981101 19869 leader_election.cc:403] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:11:17.976714 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.895650 25537 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.933655 25285 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:17.973198 25522 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:11:17.960757 25548 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.960748 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.980142 25549 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.000561 19216 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:17.952375 25196 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.001598 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:17.946796 25538 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:17.953683 25124 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.936507 25435 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:17.985222 25496 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:18.006732 25555 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:11:17.994331 25564 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.995036 25535 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.995735 25546 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:17.996431 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.984303 25396 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:17.997113 25382 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:17.954478 25079 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:17.952347 25512 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.960554 25543 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:17.980114 25400 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:17.979506 25562 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.976215 25270 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.975378 19370 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:11:18.009995 25561 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:17.980808 25532 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.989171 24908 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.005177 25271 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:18.026399 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.064226 25512 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.028524 25559 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.039906 25579 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:18.047247 25570 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:18.047958 25285 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:18.070019 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.008224 25196 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:18.069276 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 93854.4us
I20260709 13:11:18.026784 25574 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:18.082115 19221 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:18.089669 25410 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:18.080740 24809 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 13:11:18.112528 19191 leader_election.cc:400] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:18.117766 19191 leader_election.cc:403] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:18.121908 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.123005 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.124732 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.122879 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.126832 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:18.127406 19366 raft_consensus.cc:2376] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21. Re-sending same reply.
I20260709 13:11:18.050266 25382 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.136399 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.137181 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:18.138069 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.138702 19368 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:18.139935 19365 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:18.140362 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.140933 19368 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:18.142534 19366 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:18.116294 25549 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:18.155220 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 122873us
I20260709 13:11:18.155534 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.110834 25436 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.081900 25467 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.158905 25571 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:18.143510 25271 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:18.076049 25562 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.113914 25570 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.110378 25559 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.128751 24809 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:18.186827 25567 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260709 13:11:18.187650 25382 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.159706 25571 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.110129 25579 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.181228 25573 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.184722 25566 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.197177 25584 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:18.197038 25573 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.201043 25571 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.215077 25584 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.199286 25566 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.276868 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.277542 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.278656 19898 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:11:18.279589 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.280721 19896 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:18.282157 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:18.288446 25196 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.283782 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.299170 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:18.302546 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:18.196532 25435 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:18.305279 25576 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:11:18.313230 25566 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.322868 25579 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:18.323000 25586 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:11:18.316493 25395 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:18.328608 25571 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.330603 25463 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.200851 25496 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.356467 25382 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:18.307745 25559 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.367194 25584 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.305336 25570 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.389326 25395 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.392688 25463 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.394685 25395 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.396886 25463 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.389371 25435 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:18.400861 25435 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:18.401468 25435 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:18.371789 25382 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:18.417136 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:18.387611 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 85424.3us
I20260709 13:11:18.418926 19898 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:11:18.410748 25382 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:18.369074 25079 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.422794 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.426568 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:18.371044 25571 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.434103 19901 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:18.436491 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.437071 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.437340 25492 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:18.437803 25492 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:18.438467 25543 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:18.438585 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:18.438812 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.439116 25543 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.439697 25543 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:18.440470 24809 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.448904 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.452921 25259 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:18.455322 25419 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:18.455261 25259 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.456095 25419 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.457821 25259 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.458329 25419 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.458545 25433 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.458961 25419 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:18.459188 25564 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19.
I20260709 13:11:18.460527 25566 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.461274 25566 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.463479 25566 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.459185 25433 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.466687 25433 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.467799 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:18.469442 25400 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.469600 25572 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:18.472251 25467 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.476867 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.482328 25400 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.483645 25550 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.484030 25545 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:18.486815 25549 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:18.490271 19900 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:18.484418 25550 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.486054 25400 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.499671 25400 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.439133 25492 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.459653 25419 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.500020 25550 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.536366 25571 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.619556 25466 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.619784 25419 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.579876 19295 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:18.528874 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:18.579663 19297 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:18.532052 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2841) took 2088 ms. Trace:
I20260709 13:11:18.539422 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.509250 25440 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:11:18.567022 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.676663 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:18.536926 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.573793 25237 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:18.679270 25440 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:18.681669 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.609747 25395 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:18.574363 25377 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.016s
I20260709 13:11:18.516793 25467 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.527544 25463 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.687616 19299 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:18.573459 25341 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.536042 25130 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:18.572821 25192 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.574205 25462 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.572335 25353 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.573208 24908 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.518837 25537 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.687567 25237 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.686614 25395 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.493867 25549 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.714593 25341 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.547601 25545 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.711464 25395 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.673074 19373 rpcz_store.cc:276] 0709 13:11:16.443673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.678577 (+234904us) service_pool.cc:224] Handling call
0709 13:11:16.678979 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.715570 (+1036591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.531457 (+815887us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400425ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:18.531800 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382580608}
I20260709 13:11:18.743237 19223 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.735918 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:18.746866 19297 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.693291 25377 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.702389 25435 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.744720 25192 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.742189 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.752897 25436 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:18.753082 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.753358 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.753468 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:18.765434 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 283749us
I20260709 13:11:18.753784 25341 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.753844 25272 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:18.753887 25270 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.011s
W20260709 13:11:18.755119 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.756414 25353 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:18.758152 25588 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:11:18.761408 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.744747 25327 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.764789 19903 pending_rounds.cc:85] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 13
I20260709 13:11:18.768422 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:18.770109 19299 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:18.753159 25130 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.780603 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.780769 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.783264 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:18.754539 25384 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.733168 25467 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.790962 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.793761 19295 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:18.748632 25463 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.788336 19903 pending_rounds.cc:107] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:11:18.791685 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.791131 19901 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:18.796828 19903 raft_consensus.cc:2889] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.805127 19219 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:18.746104 25462 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.767692 24908 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.828270 25562 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.832259 25436 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.832741 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.833377 19296 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:18.834684 25436 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:18.836237 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56908us
W20260709 13:11:18.846603 25417 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.906s	user 0.001s	sys 0.019s
W20260709 13:11:18.848296 25512 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.009s
I20260709 13:11:18.848809 25512 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:18.849550 25463 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.851094 25512 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.852705 24908 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.854049 25192 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.855790 25467 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:18.860327 25471 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.890s	user 0.021s	sys 0.000s
I20260709 13:11:18.860795 25471 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.862926 25471 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.864596 19222 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:11:18.865408 25353 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.866601 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2527) took 1090 ms. Trace:
I20260709 13:11:18.867314 19217 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:18.866976 19222 rpcz_store.cc:276] 0709 13:11:17.775842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.776013 (+   171us) service_pool.cc:224] Handling call
0709 13:11:17.776346 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.865082 (+1088736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.866302 (+  1220us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400019ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:18.866532 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501751680}
W20260709 13:11:18.869238 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65654.8us
W20260709 13:11:18.870499 25552 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.329s	user 0.009s	sys 0.003s
W20260709 13:11:18.870707 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.873032 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67392.9us
I20260709 13:11:18.787711 25270 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.876451 19291 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:18.816663 25384 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.884580 19223 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
W20260709 13:11:18.898911 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.900000 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.900454 25209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.016s	sys 0.016s
I20260709 13:11:18.900642 25263 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:18.900839 25209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.016s	sys 0.016s
I20260709 13:11:18.903002 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.851106 25549 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:18.907635 25311 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.045s	user 0.019s	sys 0.005s
I20260709 13:11:18.901358 25263 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.810851 25327 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.918216 19224 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:18.919009 25270 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.919844 25311 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.910012 25467 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:18.920107 25395 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.892659 25353 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 13:11:18.931175 25532 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.840s	user 0.007s	sys 0.013s
I20260709 13:11:18.931546 25353 consensus_queue.cc:1243] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:18.932713 25395 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.920593 25384 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.933435 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:18.921020 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:18.933900 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.922226 25311 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.935699 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.936738 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.937109 25462 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.937342 19374 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:11:18.922531 19902 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:18.937951 25462 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:18.938807 25440 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.941097 25594 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:18.941514 25594 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:18.942391 25435 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.922808 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.939261 25462 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:18.937266 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.954105 25377 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.955580 25327 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.928217 19895 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:18.925995 19219 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:18.924005 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.960984 19297 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:18.925320 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:18.964483 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43651.6us
I20260709 13:11:18.942421 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.931679 25532 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.972649 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:18.975594 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.982623 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:18.929973 25263 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:18.966445 25440 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:18.925477 25130 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:18.994114 19216 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:19.003326 19295 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:19.004206 19371 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:19.005366 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:18.968729 25462 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:18.929023 25467 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.008180 19366 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:19.003022 25331 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.014124 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:18.942564 25594 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:18.957809 25382 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:18.994566 25545 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:18.967787 25192 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:19.022544 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.024107 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.024750 19374 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:19.025602 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.021720 25331 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.027031 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.027582 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.028574 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.023159 19370 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 10.
I20260709 13:11:19.039314 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.040504 19218 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 11.
I20260709 13:11:19.046149 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.050594 25462 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.053165 25532 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.058370 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.058959 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.062326 19295 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:19.046183 25192 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.063249 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:19.064304 25124 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.003s	user 0.005s	sys 0.014s
I20260709 13:11:19.064771 25124 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.063329 25450 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:19.044538 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.065778 25410 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:19.050122 25237 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.092710 19370 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:19.089715 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:11:19.108012 25196 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:19.109153 25196 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.111979 25196 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:19.116386 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.117604 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:19.118122 19295 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:19.121035 25573 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.123040 25382 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:19.126982 25593 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
W20260709 13:11:19.130234 25543 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.008s
I20260709 13:11:19.130663 25543 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.132438 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.108127 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.123862 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.136641 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.137663 19216 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:19.150127 19297 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:19.096100 25410 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.256922 19225 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:11:19.280339 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.421360 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 178974us
I20260709 13:11:19.443254 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.444249 19220 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:19.151634 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.270478 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.224639 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.289508 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:19.490046 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.214499 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.528874 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.614084 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.188288 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:19.432019 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3137) took 1459 ms. Trace:
W20260709 13:11:19.440510 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71999.4us
I20260709 13:11:19.225206 19365 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:19.619388 19299 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 10.
I20260709 13:11:19.305701 19222 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:19.619103 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.615537 19217 rpcz_store.cc:276] 0709 13:11:17.972590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.988109 (+ 15519us) service_pool.cc:224] Handling call
0709 13:11:17.988397 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.867809 (+879412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.267667 (+399858us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400136354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:19.431893 (+164226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020495616}
I20260709 13:11:19.627408 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.572785 25124 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.633181 19901 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:19.633759 19896 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:19.457615 25342 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.634245 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:19.220415 25192 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.598129 25410 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:19.558171 25382 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:19.673954 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 526435us
W20260709 13:11:19.676254 19295 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.003s
I20260709 13:11:19.676647 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.686774 19295 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:19.678229 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.688573 19370 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:19.612989 25331 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.633033 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:19.691419 25382 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.692821 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.693454 19223 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:19.693712 25382 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.694239 25382 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.694315 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.694821 25382 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.695431 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.698167 25543 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.698340 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 918) took 1428 ms. Trace:
I20260709 13:11:19.698587 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.698804 25543 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:19.699563 19897 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:19.699373 25543 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.688354 25419 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:19.700724 25419 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.701117 25419 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.681574 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.704329 25342 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.705123 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.705825 19366 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:11:19.706699 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.677513 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.708339 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:19.709000 19297 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:19.710417 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:19.711236 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.568107 25333 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:19.712179 25331 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:19.712323 25391 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.711766 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:19.712927 25391 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.714854 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:19.715108 25391 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.698714 19900 rpcz_store.cc:276] 0709 13:11:18.270418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.281654 (+ 11236us) service_pool.cc:224] Handling call
0709 13:11:19.698165 (+1416511us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400750154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:19.698261 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407290112}
I20260709 13:11:19.715760 25331 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:19.716257 25331 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:19.716325 19222 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:19.716799 25331 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.717450 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.718642 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.719643 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:19.686663 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:19.699978 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.720788 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 937) took 1129 ms. Trace:
I20260709 13:11:19.721238 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:19.711841 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1115) took 1682 ms. Trace:
I20260709 13:11:19.721843 19369 rpcz_store.cc:276] 0709 13:11:18.029436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.029564 (+   128us) service_pool.cc:224] Handling call
0709 13:11:18.029843 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.042247 (+ 12404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.042292 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.046054 (+  3762us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.711171 (+1665117us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540010b1a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7e2c6b8 00007fe8d7eb592b 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c
0709 13:11:19.711275 (+   104us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:19.711320 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.711405 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.711456 (+    51us) raft_consensus.cc:1685] finished
0709 13:11:19.711469 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.711682 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12034,"raft.queue_time_us":14994,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":764361984,"thread_start_us":293534,"threads_started":1,"wal-append.queue_time_us":343594}
I20260709 13:11:19.723817 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.724875 25331 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.721423 25259 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.725991 25259 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.721107 19293 rpcz_store.cc:276] 0709 13:11:18.591187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.591367 (+   180us) service_pool.cc:224] Handling call
0709 13:11:19.699718 (+1108351us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:11:19.720713 (+ 20995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104829696}
I20260709 13:11:19.726310 25543 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.724516 25283 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:19.727276 25331 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.727578 25283 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.728123 25283 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:19.712545 25333 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.725469 19369 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:19.690392 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.257925 25467 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:19.727304 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.728678 25331 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:19.735769 25130 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.744549 25331 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.745010 25331 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:19.744913 25130 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.746258 25333 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.729271 19903 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:19.732900 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:19.734247 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.724814 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:19.748580 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:19.734990 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.750574 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:19.724804 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.736199 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.715694 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.699889 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.752480 25130 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:19.726401 25259 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.754443 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.755158 19295 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:19.755990 19365 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:19.720021 25594 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:19.732420 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.707796 25342 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.757169 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.764762 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2533) took 1236 ms. Trace:
I20260709 13:11:19.755007 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 823) took 1485 ms. Trace:
I20260709 13:11:19.758599 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 928) took 1266 ms. Trace:
I20260709 13:11:19.760046 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.740131 19297 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:19.761379 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 822) took 1639 ms. Trace:
I20260709 13:11:19.757032 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 934) took 1171 ms. Trace:
I20260709 13:11:19.761754 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.762864 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.764432 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:19.763437 25602 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:11:19.766366 19225 rpcz_store.cc:276] 0709 13:11:18.122091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.122597 (+   506us) service_pool.cc:224] Handling call
0709 13:11:19.761142 (+1638545us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400018bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:19.761298 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011062656}
I20260709 13:11:19.767307 19299 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:19.765149 19218 rpcz_store.cc:276] 0709 13:11:18.528569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.538955 (+ 10386us) service_pool.cc:224] Handling call
0709 13:11:19.764588 (+1225633us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001b1f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:19.764705 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842795264}
I20260709 13:11:19.765435 19221 rpcz_store.cc:276] 0709 13:11:18.122317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.326334 (+204017us) service_pool.cc:224] Handling call
0709 13:11:18.327101 (+   767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.396974 (+ 69873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.397003 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.397081 (+    78us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:18.397150 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.607264 (+1210114us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b540039a3d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:19.607312 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.607467 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157225856}
W20260709 13:11:19.772003 25545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.003s	sys 0.047s
I20260709 13:11:19.765789 19292 rpcz_store.cc:276] 0709 13:11:18.483254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.497049 (+ 13795us) service_pool.cc:224] Handling call
0709 13:11:18.497665 (+   616us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:18.498432 (+   767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.498464 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:18.499114 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 13:11:18.783558 (+284444us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:18.783596 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.783665 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.749072 (+965407us) raft_consensus.cc:1685] finished
0709 13:11:19.749092 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.749235 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1420,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"thread_start_us":283968,"threads_started":1,"wal-append.queue_time_us":1227935}
I20260709 13:11:19.777180 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.766425 19300 rpcz_store.cc:276] 0709 13:11:18.585571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.585781 (+   210us) service_pool.cc:224] Handling call
0709 13:11:19.618334 (+1032553us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:11:19.756975 (+138641us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103740160}
I20260709 13:11:19.780833 19223 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:19.778107 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:19.765561 25130 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:19.800588 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 77122.6us
I20260709 13:11:19.806155 19295 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:19.756992 25436 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:19.763620 25283 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:19.778576 25545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.003s	sys 0.047s
I20260709 13:11:19.812470 19294 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:19.810721 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:19.809126 19217 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:19.818763 19295 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:19.813133 19296 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:19.817776 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:19.823808 19224 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:19.828398 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.755091 25410 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:19.810923 25440 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.002s
I20260709 13:11:19.846452 25283 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.847587 19300 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:11:19.848393 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 941) took 1057 ms. Trace:
W20260709 13:11:19.850198 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 548388us
I20260709 13:11:19.848960 19298 rpcz_store.cc:276] 0709 13:11:18.698419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.759703 (+ 61284us) service_pool.cc:224] Handling call
0709 13:11:18.761865 (+  2162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.833610 (+ 71745us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:19.018095 (+184485us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.424583 (+406488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.424650 (+    67us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:19.424707 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.703051 (+278344us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4800150258. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:11:19.752867 (+ 49816us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b54002b8ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:19.752932 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.753072 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183183,"prepare.queue_time_us":211876,"prepare.run_cpu_time_us":1099,"prepare.run_wall_time_us":15598,"raft.queue_time_us":190567,"raft.run_cpu_time_us":11279,"raft.run_wall_time_us":262939,"spinlock_wait_cycles":206905856,"thread_start_us":394370,"threads_started":2,"wal-append.queue_time_us":794761}
W20260709 13:11:19.851421 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.870530 25450 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.001s
I20260709 13:11:19.871553 19367 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:19.874069 25259 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:19.877285 25259 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:19.881421 25419 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:19.811179 25130 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:19.885142 19365 raft_consensus.cc:2410] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:11:19.887645 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3142) took 1109 ms. Trace:
I20260709 13:11:19.893703 19370 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:19.895809 19366 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:19.896874 19293 raft_consensus.cc:2368] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:19.889097 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 920) took 1617 ms. Trace:
I20260709 13:11:19.891058 19216 rpcz_store.cc:276] 0709 13:11:18.778036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.007317 (+229281us) service_pool.cc:224] Handling call
0709 13:11:19.021826 (+ 14509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.151099 (+129273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.887341 (+736242us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000186d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:19.887570 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255600896}
W20260709 13:11:19.892016 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49323.3us
I20260709 13:11:19.898869 19895 rpcz_store.cc:276] 0709 13:11:18.271324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.276805 (+  5481us) service_pool.cc:224] Handling call
0709 13:11:19.888923 (+1612118us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:19.889031 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493663488}
I20260709 13:11:19.911499 19291 raft_consensus.cc:2368] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:19.918062 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:19.928906 19221 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:11:19.898443 25130 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:19.948061 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.953751 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:19.962580 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:19.966169 19370 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:19.961027 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:19.961767 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:19.975703 19900 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:19.974632 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:19.969563 25079 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:19.980820 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:19.978677 19903 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 19: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:19.908069 25545 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:11:19.970057 25382 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:19.978510 19367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2362) took 1827 ms (client timeout 1594 ms). Trace:
I20260709 13:11:19.995287 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:19.988622 19367 rpcz_store.cc:269] 0709 13:11:18.137729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.137855 (+   126us) service_pool.cc:224] Handling call
0709 13:11:19.918147 (+1780292us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400093dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:19.965010 (+ 46863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3984691072}
I20260709 13:11:20.001729 25566 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:20.002509 25566 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:20.005731 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:19.989519 25440 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:20.017546 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.013113 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.037384 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:20.042166 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.044210 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:20.046645 19370 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.048924 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:20.049459 19900 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.052079 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.057502 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:20.058113 19895 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.059062 19373 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:20.048183 25327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.090s	sys 0.166s
W20260709 13:11:20.060211 25327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.090s	sys 0.166s
I20260709 13:11:20.060499 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.061501 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:20.015446 25440 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.066066 19296 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:20.070561 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:20.071475 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:20.003831 25566 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:20.085863 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.086704 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.084050 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.073516 25440 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.093595 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:20.090871 19367 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:20.076086 25377 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:20.114688 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.115593 19367 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:20.121699 25609 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:11:20.129454 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 122138us
I20260709 13:11:20.111765 25410 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:20.135710 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2353) took 1208 ms (client timeout 1594 ms). Trace:
I20260709 13:11:20.136139 19297 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 15. Ops: []
I20260709 13:11:20.136632 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2475) took 1011 ms. Trace:
W20260709 13:11:20.136145 19291 rpcz_store.cc:269] 0709 13:11:18.927193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.991083 (+ 63890us) service_pool.cc:224] Handling call
0709 13:11:20.135509 (+1144426us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b54002b75d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:20.135650 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065710336}
I20260709 13:11:20.140581 19300 rpcz_store.cc:276] 0709 13:11:19.125313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.779816 (+654503us) service_pool.cc:224] Handling call
0709 13:11:19.838010 (+ 58194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.848098 (+ 10088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.135147 (+287049us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b54002e7a50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:20.136568 (+  1421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39322496}
W20260709 13:11:20.145052 25603 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:11:20.154757 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:20.176258 25605 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
W20260709 13:11:20.188313 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.188973 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2468) took 1274 ms. Trace:
I20260709 13:11:20.189499 19297 rpcz_store.cc:276] 0709 13:11:18.914140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.774193 (+860053us) service_pool.cc:224] Handling call
0709 13:11:20.135908 (+361715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.136732 (+   824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.188692 (+ 51960us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54002b75d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:20.188890 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831073024}
I20260709 13:11:20.195876 19222 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:20.137805 25566 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:20.210419 19369 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
W20260709 13:11:20.205777 19866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.014s
W20260709 13:11:20.225761 19866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.013s	sys 0.014s
W20260709 13:11:20.205476 19371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.013s
W20260709 13:11:20.226419 19371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.014s	sys 0.013s
W20260709 13:11:20.227613 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.016s
W20260709 13:11:20.229158 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.013s	sys 0.016s
I20260709 13:11:20.234982 19900 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 11.
I20260709 13:11:20.238076 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:20.248826 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.250730 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.237304 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.028s	sys 0.040s
W20260709 13:11:20.253602 19266 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.028s
W20260709 13:11:20.253871 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.028s	sys 0.040s
W20260709 13:11:20.255303 19266 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.008s	sys 0.028s
I20260709 13:11:20.256150 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2373) took 1145 ms. Trace:
W20260709 13:11:20.257010 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 628189us
I20260709 13:11:20.257843 19365 raft_consensus.cc:2410] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:11:20.256654 19367 rpcz_store.cc:276] 0709 13:11:19.110767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.123601 (+1012834us) service_pool.cc:224] Handling call
0709 13:11:20.135147 (+ 11546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.239705 (+104558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.239751 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.255853 (+ 16102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:20.255908 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.255967 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.256094 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:20.246775 19374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.009s	sys 0.024s
W20260709 13:11:20.264736 19374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.009s	sys 0.025s
W20260709 13:11:20.274253 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 559426us
I20260709 13:11:20.283453 19367 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:11:20.284049 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1125) took 1141 ms. Trace:
I20260709 13:11:20.284514 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:20.284650 19369 rpcz_store.cc:276] 0709 13:11:19.135965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.227215 (+1091250us) service_pool.cc:224] Handling call
0709 13:11:20.227536 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.266191 (+ 38655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.266226 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.276923 (+ 10697us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:20.276976 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.277039 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.277156 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.285526 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:20.286046 19367 pending_rounds.cc:85] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 14
I20260709 13:11:20.286432 19367 pending_rounds.cc:107] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:11:20.286653 19367 raft_consensus.cc:2889] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.265584 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2850) took 1347 ms. Trace:
W20260709 13:11:20.288621 19188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.001s	sys 0.015s
W20260709 13:11:20.292332 19188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.001s	sys 0.015s
I20260709 13:11:20.291883 19370 raft_consensus.cc:2410] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:11:20.295984 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.297253 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:20.299154 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:20.306725 19300 raft_consensus.cc:2368] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:11:20.268023 25419 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.304939 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2375) took 1134 ms. Trace:
I20260709 13:11:20.307380 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:20.308665 19367 rpcz_store.cc:276] 0709 13:11:19.171010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.278625 (+1107615us) service_pool.cc:224] Handling call
0709 13:11:20.278933 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.298266 (+ 19333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.304874 (+  6608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.314438 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:20.315393 19294 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11.
I20260709 13:11:20.315986 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2853) took 1120 ms. Trace:
I20260709 13:11:20.317000 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:20.318837 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 178406us
I20260709 13:11:20.314925 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.316990 19370 rpcz_store.cc:276] 0709 13:11:19.185698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.294349 (+1108651us) service_pool.cc:224] Handling call
0709 13:11:20.294625 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.305820 (+ 11195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.305850 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.305904 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:20.305943 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.306006 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.306108 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.323875 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3128) took 2363 ms. Trace:
I20260709 13:11:20.324714 19220 rpcz_store.cc:276] 0709 13:11:17.952905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.953152 (+   247us) service_pool.cc:224] Handling call
0709 13:11:17.953436 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.673426 (+1719990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.280128 (+606702us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540039b7d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:20.316682 (+ 36554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643014400}
I20260709 13:11:20.329267 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:20.333648 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 347588us
I20260709 13:11:20.335088 19367 raft_consensus.cc:2410] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:20.343256 19369 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:20.344287 19372 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.016s	user 0.010s	sys 0.000s
I20260709 13:11:20.344758 19372 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:20.306902 25512 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.346401 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:20.337193 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.349764 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.351475 25381 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.352295 25381 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.353542 25619 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:20.353751 19370 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:20.355063 25619 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:20.356511 19365 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:20.358614 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:20.364205 25595 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:20.364806 25544 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:20.365217 25544 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:20.366137 25492 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:20.364346 25382 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.371683 19897 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:11:20.373962 25331 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.000s
I20260709 13:11:20.366182 25544 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.374378 25331 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.374954 25544 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.376609 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:20.377449 19897 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:20.307200 25564 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:11:20.380766 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.381950 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.382573 19365 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:20.383442 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:20.389142 19900 raft_consensus.cc:2368] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:11:20.389284 19895 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:20.383955 19365 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.392078 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:20.393580 19190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.013s
W20260709 13:11:20.393934 19190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.007s	sys 0.014s
I20260709 13:11:20.402915 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:20.345299 25463 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.406328 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:20.367858 25130 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.390921 25592 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.416389 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:20.418063 19895 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:20.397490 25450 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:20.395907 25594 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.001s
I20260709 13:11:20.417006 19263 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.400986 25595 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:20.407691 25259 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:20.422986 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.393929 25512 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.432461 19901 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:20.433260 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:20.437119 19366 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:11:20.409373 25196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.027s	sys 0.093s
I20260709 13:11:20.438441 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:20.438288 19292 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:20.453469 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 155614us
I20260709 13:11:20.421139 25450 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:20.426404 25436 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:20.460608 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.460625 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:20.438846 25419 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:20.456890 25196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.027s	sys 0.094s
I20260709 13:11:20.419617 25463 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:20.478449 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.457885 25594 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:20.469465 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.423556 25592 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.459311 25450 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.468318 25518 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:20.500418 25382 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:20.509388 25382 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:20.509240 25520 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:11:20.510090 25382 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:20.511659 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.033s	sys 0.061s
W20260709 13:11:20.512096 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.033s	sys 0.062s
I20260709 13:11:20.513134 25512 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.513654 25622 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.514144 25622 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.495311 25419 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:20.507421 25347 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.467352 25623 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.519557 19896 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:20.470558 25436 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:20.552088 19373 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:20.460690 25259 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.555863 19365 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:20.556932 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2378) took 1385 ms. Trace:
W20260709 13:11:20.537415 25607 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.571s	user 0.002s	sys 0.004s
I20260709 13:11:20.519007 25419 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.558229 25518 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:20.533289 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 63923.7us
I20260709 13:11:20.545760 25381 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:20.495819 25594 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.576445 25594 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.578275 25463 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:20.544694 25347 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.580628 25347 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.581812 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2472) took 1457 ms. Trace:
I20260709 13:11:20.582190 19292 rpcz_store.cc:276] 0709 13:11:19.124367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.777560 (+653193us) service_pool.cc:224] Handling call
0709 13:11:19.777884 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.461550 (+683666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.581592 (+120042us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002e9354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:20.581756 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512689536}
I20260709 13:11:20.582715 25347 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:20.568681 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2369) took 1628 ms. Trace:
I20260709 13:11:20.579636 25450 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:20.583689 19372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2341) took 4183 ms (client timeout 1809 ms). Trace:
W20260709 13:11:20.584195 19372 rpcz_store.cc:269] 0709 13:11:16.400075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.402764 (+  2689us) service_pool.cc:224] Handling call
0709 13:11:20.583430 (+4180666us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54000d34d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:20.583583 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6117503744}
I20260709 13:11:20.585314 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.566519 19222 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:20.586269 19372 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 13: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:20.567094 19220 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:20.587134 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:20.557164 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 204869us
W20260709 13:11:20.527846 25565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.017s	sys 0.023s
I20260709 13:11:20.547165 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:20.588116 25565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.018s	sys 0.024s
W20260709 13:11:20.588768 25617 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:11:20.590781 25592 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.590919 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2852) took 1546 ms. Trace:
I20260709 13:11:20.591449 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.591953 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2377) took 1420 ms. Trace:
I20260709 13:11:20.592644 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.565217 19373 rpcz_store.cc:276] 0709 13:11:19.171926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.992778 (+820852us) service_pool.cc:224] Handling call
0709 13:11:20.556875 (+564097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.593863 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:20.595208 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.287725 19374 rpcz_store.cc:276] 0709 13:11:18.969169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.043610 (+ 74441us) service_pool.cc:224] Handling call
0709 13:11:19.098701 (+ 55091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.098974 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:19.484049 (+385075us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.265261 (+781212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.265312 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:20.265359 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.265422 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.265534 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":740511,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":79,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":20987,"thread_start_us":884082,"threads_started":2}
I20260709 13:11:20.570088 25440 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.592444 19366 rpcz_store.cc:276] 0709 13:11:19.171609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.074684 (+903075us) service_pool.cc:224] Handling call
0709 13:11:20.591774 (+517090us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:20.591898 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776624896}
I20260709 13:11:20.585366 25450 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:20.596375 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:20.615280 19373 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.599426 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.464866 25595 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.516155 25622 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:20.607260 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.618722 19374 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:20.604902 19899 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:20.614359 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.591452 19371 rpcz_store.cc:276] 0709 13:11:19.090569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.103436 (+ 12867us) service_pool.cc:224] Handling call
0709 13:11:19.237146 (+133710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.447434 (+210288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.447475 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.529879 (+ 82404us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.226937 (+697058us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:20.226993 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.227086 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.590663 (+363577us) raft_consensus.cc:1685] finished
0709 13:11:20.590690 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.590854 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13789,"raft.queue_time_us":29300,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":604414,"threads_started":1,"wal-append.queue_time_us":832161}
I20260709 13:11:20.613732 25592 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:20.621251 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.583214 19368 rpcz_store.cc:276] 0709 13:11:18.940480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.953944 (+ 13464us) service_pool.cc:224] Handling call
0709 13:11:18.954392 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:18.968018 (+ 13626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.968054 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:18.995028 (+ 26974us) log.cc:844] Serialized 52 byte log entry
0709 13:11:19.366405 (+371377us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:19.366459 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.366532 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.536820 (+1170288us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:20.568237 (+ 31417us) raft_consensus.cc:1685] finished
0709 13:11:20.568257 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.568500 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11115,"raft.queue_time_us":9723,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":28621,"spinlock_wait_cycles":13275904,"thread_start_us":322944,"threads_started":1,"wal-append.queue_time_us":899902}
I20260709 13:11:20.658972 19371 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:20.653738 19367 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11.
W20260709 13:11:20.663471 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 260651us
I20260709 13:11:20.622125 25585 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.669734 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:20.624183 25623 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:20.661355 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 240918us
I20260709 13:11:20.671979 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:20.543269 25382 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.653976 25492 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:20.675889 19222 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:20.670960 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:20.620498 25545 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:20.660445 25592 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:20.681262 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.663300 25520 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:20.661401 25518 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.685531 19373 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:20.686060 19221 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:20.687253 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.687891 25436 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.692014 25259 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.693264 25595 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:20.693372 25631 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:20.694633 25631 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:20.694989 25631 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:20.695540 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.696794 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.696956 25382 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.697698 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.699558 25463 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:20.700090 19191 leader_election.cc:400] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:20.700351 25381 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:20.699972 25463 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.701290 25463 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.701654 25440 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:20.701390 25622 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:20.704347 19291 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:11:20.704317 25595 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.700431 19191 leader_election.cc:403] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.705042 25631 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.706202 19191 leader_election.cc:400] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:11:20.706496 19191 leader_election.cc:403] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.704476 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.698935 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.708606 25382 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.709565 25492 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:20.710613 25492 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.712458 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.712913 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.713887 25410 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.714347 25410 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:20.714710 25410 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:20.715075 19869 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11.
I20260709 13:11:20.715404 19869 leader_election.cc:403] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.716511 25545 consensus_queue.cc:1243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:20.716711 19340 leader_election.cc:400] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:20.717041 19340 leader_election.cc:403] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.717146 25545 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:20.717548 25545 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:20.706542 25331 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.718451 25545 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.719167 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:20.719756 25628 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:20.720485 25628 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:20.720817 25628 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.721167 25628 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:20.722282 25130 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:20.722890 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.739208 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1150) took 1981 ms. Trace:
W20260709 13:11:20.739774 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66297.2us
I20260709 13:11:20.739648 19899 rpcz_store.cc:276] 0709 13:11:18.757834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.772845 (+ 15011us) service_pool.cc:224] Handling call
0709 13:11:20.739041 (+1966196us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54006c48d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:20.739148 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169720192}
W20260709 13:11:20.742426 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58446.8us
I20260709 13:11:20.749272 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:20.687088 25592 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:20.752425 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.720052 25545 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.748400 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:20.751005 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.751472 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.706605 25631 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:20.759841 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79809.4us
I20260709 13:11:20.760846 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:20.766012 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 67214us
I20260709 13:11:20.768558 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.772353 25331 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:20.772809 25331 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.741799 25620 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:20.778434 25331 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.766593 25450 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.673863 25585 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.791064 25410 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.792244 25615 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.794673 25564 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:20.795598 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.747790 25544 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11.
I20260709 13:11:20.748628 25622 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.750298 25259 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:20.730736 25594 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:20.808895 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57514us
I20260709 13:11:20.753741 25595 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:20.811084 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.811586 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1127) took 1123 ms. Trace:
I20260709 13:11:20.812114 19370 rpcz_store.cc:276] 0709 13:11:19.688422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.328266 (+639844us) service_pool.cc:224] Handling call
0709 13:11:20.328571 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.354348 (+ 25777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.811362 (+457014us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54004268d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:20.811529 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57450880}
W20260709 13:11:20.816632 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64277.6us
I20260709 13:11:20.816816 19869 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 10. Current term is 11.
I20260709 13:11:20.762585 25440 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:11:20.809638 25419 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:20.807747 25283 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:20.803951 25410 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:20.816329 25615 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:20.833448 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:20.832384 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:20.831751 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71008.1us
I20260709 13:11:20.805660 25463 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:20.835040 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 86698.5us
I20260709 13:11:20.835491 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.836129 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:20.840956 25585 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.841388 25594 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:20.842119 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:20.826207 25419 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:20.843060 25419 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.847213 25628 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.849224 25382 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:20.855831 19367 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
W20260709 13:11:20.864902 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.868319 19900 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:20.876693 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:20.877337 25492 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:20.877892 25492 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:20.878885 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:20.880779 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48490us
I20260709 13:11:20.881238 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.883962 19373 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:20.886430 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.887889 25641 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:20.888373 25641 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.888729 25641 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:20.893069 25635 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:20.883297 19295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:20.896996 19295 raft_consensus.cc:606] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.905311 25628 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:20.907002 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 143171us
I20260709 13:11:20.866998 25615 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:20.867414 25382 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:20.833448 25623 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:11:20.874943 25564 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:20.835788 25512 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:11:20.913745 25566 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:20.929474 25638 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:20.929688 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 162853us
I20260709 13:11:20.939568 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:20.930341 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 112728us
I20260709 13:11:20.906153 25628 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:20.932296 25440 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.910980 25381 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:20.932943 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.933974 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:37812
W20260709 13:11:20.935129 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67068.9us
W20260709 13:11:20.935724 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54574.6us
I20260709 13:11:20.930933 25595 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:20.932411 25283 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:20.942420 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 56091.3us
I20260709 13:11:20.944905 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:20.920857 25622 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16.
I20260709 13:11:20.921885 25616 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:20.924284 25382 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.977475 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:20.977767 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:20.979039 19294 raft_consensus.cc:606] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:20.987565 19294 raft_consensus.cc:614] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:20.988642 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:20.989449 19373 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:20.942191 25628 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:20.974196 25620 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:20.990371 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.999747 25628 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.034487 25592 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.036363 25331 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.038589 25331 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.041088 25419 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.043278 25419 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:20.982098 25566 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.044276 25592 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:21.044546 25566 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:21.045188 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.045145 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70297.6us
I20260709 13:11:21.046303 19188 leader_election.cc:400] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:11:21.046670 19188 leader_election.cc:403] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.989480 25382 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:21.019790 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:21.048547 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.049670 19294 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:21.031361 25647 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:11:21.052485 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75531.3us
I20260709 13:11:21.055449 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:20.985858 25640 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.058365 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 124834us
W20260709 13:11:21.058717 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68429.4us
I20260709 13:11:21.059736 19337 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.068567 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.069802 25381 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:20.999475 25450 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:20.983446 25440 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:20.984387 25648 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:21.079046 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:21.079798 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:21.080634 19900 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:21.081962 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1128) took 1373 ms. Trace:
I20260709 13:11:21.057185 25620 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:21.084209 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64485.2us
I20260709 13:11:21.085769 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:21.082958 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.091666 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.070293 25381 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.068265 25545 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:21.094097 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.097678 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:21.099129 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:21.105036 19899 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 11: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:21.091126 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.100620 19300 raft_consensus.cc:2368] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:21.082329 19369 rpcz_store.cc:276] 0709 13:11:19.708518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.344019 (+635501us) service_pool.cc:224] Handling call
0709 13:11:20.395176 (+ 51157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.408176 (+ 13000us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:20.422202 (+ 14026us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.710830 (+288628us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b1800437bc0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:11:20.905867 (+195037us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b1800437bc0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:11:21.081267 (+175400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:21.081321 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:21.081365 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.081536 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.081907 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9976,"prepare.queue_time_us":11596,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":7669,"raft.queue_time_us":157128,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":11755,"spinlock_wait_cycles":26572928,"thread_start_us":211929,"threads_started":2,"wal-append.queue_time_us":302516}
I20260709 13:11:21.075562 25347 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.077793 25450 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:21.113209 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 67072.4us
I20260709 13:11:21.117138 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.117769 19297 raft_consensus.cc:2376] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18. Re-sending same reply.
I20260709 13:11:21.083885 25377 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:21.087483 25620 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:21.086264 25512 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:21.081106 25648 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:21.118851 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:21.098119 25615 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:21.084057 25632 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.124143 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.136943 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.137455 19293 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:21.128806 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:21.138506 19299 raft_consensus.cc:606] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.139590 19220 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:21.128439 19294 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:21.071030 25638 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:11:21.135113 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.102553 25623 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:21.109967 25381 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:21.136430 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.195366 19219 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:21.109391 25492 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:21.197939 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.148017 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.198556 19369 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:21.199219 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51319.6us
I20260709 13:11:21.148491 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.200528 19294 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:21.201327 25419 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:21.201406 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.201773 19294 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:11:21.202086 25419 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:21.202430 25628 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.202908 25419 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:21.203413 25630 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:21.150882 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.204030 25630 consensus_queue.cc:1243] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:21.205215 25630 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.204845 25615 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.205438 25327 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:21.116954 25450 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.153915 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.205896 25327 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.206810 25327 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.155457 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.134467 25512 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:21.209502 25512 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:21.147935 25463 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.158226 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.212353 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:21.213265 25639 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:21.213647 25639 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.213964 25639 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.203042 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.155062 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:21.203081 19294 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:21.134626 25648 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.113291 25595 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:11:21.152884 25616 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:21.117007 25347 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:11:21.162228 25629 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:21.081449 25641 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.172578 25377 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:21.181422 25518 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:21.185724 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.216315 25631 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:21.119211 25650 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:11:21.186606 25622 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:21.089128 25640 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.187353 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.187966 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:21.188089 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.120199 25651 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.189543 25653 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:21.272182 25640 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.191411 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.191540 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.192546 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.153915 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.192941 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.194226 25654 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.075033 25564 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.151496 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:21.196857 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55794.3us
I20260709 13:11:21.203634 25419 consensus_queue.cc:1243] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:21.159744 25440 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:21.158427 25652 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:21.217759 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:21.233201 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.234865 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:21.235348 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.235868 19369 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
W20260709 13:11:21.235016 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 80018.3us
I20260709 13:11:21.216104 25450 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.247918 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.208010 25327 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.254987 19295 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:21.185935 25646 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:11:21.256069 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:21.257272 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:21.234642 25410 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:21.268231 19216 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:21.297086 19297 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:21.297534 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79843us
I20260709 13:11:21.298563 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:21.264361 25622 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:21.255559 25377 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.275415 19221 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:21.305060 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:21.276873 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 88996.5us
I20260709 13:11:21.276757 19373 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:21.285791 19298 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:21.286405 19218 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.287101 19294 raft_consensus.cc:606] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.307296 19294 raft_consensus.cc:614] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:21.256017 25518 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.290545 19219 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:21.261317 25631 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.293232 19900 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:21.275022 25651 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:21.273152 19292 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:21.293098 25654 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.312745 25520 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:21.293514 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.314414 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:21.273072 25641 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.291618 25079 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:21.321642 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:21.333523 25518 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:21.347913 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.304711 25410 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:21.309935 25628 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:21.319109 25631 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.310209 25638 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.288699 25259 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:11:21.331295 25419 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:21.363220 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 170726us
I20260709 13:11:21.380079 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.368432 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:21.329908 25653 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:21.341974 25079 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.341346 25595 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:21.360247 25585 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:21.361138 25410 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.383201 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:21.387377 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 82394.8us
I20260709 13:11:21.363291 25616 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:21.411021 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 126659us
I20260709 13:11:21.386387 25595 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.386941 25079 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:21.390070 25619 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:21.415831 19340 leader_election.cc:400] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:21.420241 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:21.423251 19292 raft_consensus.cc:606] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.423574 19292 raft_consensus.cc:614] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:21.424571 25651 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:21.393338 25518 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.432538 19266 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.424371 25419 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.410423 25643 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:21.412120 25615 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:21.433955 19896 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:11:21.435220 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 43662.7us
I20260709 13:11:21.425841 25595 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.425444 25652 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.443078 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.443413 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.413067 25585 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:21.427198 25619 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:21.436690 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.450671 19370 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.486914 19222 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:11:21.486496 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.495067 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.494071 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.498463 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.433913 25673 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:21.433282 25620 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.483202 25619 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:21.500267 25658 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:11:21.506668 25651 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.507740 25680 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:21.508018 25620 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.508471 25673 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:21.512838 25662 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:21.538497 19370 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:21.522910 19218 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:21.528134 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.539986 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.540154 25669 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.540932 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.542171 25628 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:21.541767 19218 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:21.544322 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.545572 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.547086 19368 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:21.552968 25630 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:21.553406 25630 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.554189 25630 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.483342 25653 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:11:21.569317 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.589625 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45375.5us
I20260709 13:11:21.570231 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:21.591176 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:21.452044 25615 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.596979 19225 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:21.524317 25641 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:21.629614 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.513496 25585 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.597697 19298 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:21.638885 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:21.653172 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 220715us
I20260709 13:11:21.562995 25640 raft_consensus.cc:993] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:21.543388 25629 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:21.596560 25382 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.526s	user 0.003s	sys 0.007s
I20260709 13:11:21.665163 19368 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:21.555464 25630 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.563757 25347 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:21.645176 25666 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:11:21.644336 25658 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:11:21.574769 25628 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:11:21.639950 25638 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:21.648824 25669 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:21.719139 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.726138 19218 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.560056 25680 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.720081 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.640350 25677 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:21.665840 25283 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:21.723133 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.563748 25512 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.566507 25381 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.715390 25545 raft_consensus.cc:1081] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:21.689172 25643 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:21.689646 25450 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.559780 25377 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:21.751963 25665 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260709 13:11:21.690025 25382 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.730796 25652 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.731709 25679 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:21.758864 25669 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:21.546423 25419 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.761550 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:21.737877 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:21.674180 25641 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.743414 25410 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.683951 25639 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.775712 19220 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:21.784785 19299 raft_consensus.cc:2368] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17.
I20260709 13:11:21.648887 25648 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.785990 25639 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.787139 25648 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.773265 25079 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.788318 25196 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:21.788900 25196 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:21.788823 25643 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.789938 25196 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.791118 25671 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:21.545578 25616 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.792217 25382 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.792923 19224 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:21.776644 25623 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.003s
I20260709 13:11:21.776032 25677 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.798699 19225 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.721104 25638 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.725214 25347 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.797712 25615 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.791659 25671 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:21.800673 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 60377.8us
I20260709 13:11:21.807559 19218 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:21.815888 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.817716 19218 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:21.817649 19225 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:21.798823 25623 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 11. Current term is 12.
I20260709 13:11:21.828111 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:21.824994 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 254832us
I20260709 13:11:21.823774 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.825856 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.825999 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.808316 25638 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.833086 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.833873 19294 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:21.834925 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.836095 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.837532 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:21.839676 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.840516 25677 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.841073 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.842417 19368 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:21.827031 25545 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.844590 25545 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.846674 25545 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.849140 25377 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.849373 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.850984 25347 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:21.794265 25679 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.852430 25079 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.854041 19297 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:21.857527 19295 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:21.779206 25652 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.827644 25615 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:21.875758 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.814052 25631 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.879760 19368 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:21.883507 19295 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:11:21.884680 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.854010 25679 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:21.868863 25327 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
W20260709 13:11:21.890965 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 299855us
I20260709 13:11:21.893711 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:21.875242 25620 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.897010 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.897576 25678 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:21.898108 25678 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.898885 25652 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.901211 25631 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:21.902652 25512 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.889379 25615 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.906769 25615 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.912437 25641 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.897020 25620 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:21.920440 25327 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:21.921878 25327 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:21.922297 25327 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:21.923784 25327 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:21.925372 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:21.926298 25620 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.930155 25671 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:21.931424 25381 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.937827 19293 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
W20260709 13:11:21.939639 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46027.4us
I20260709 13:11:21.888648 25680 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.951218 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.943166 25381 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:21.953174 19291 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:21.944213 25678 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.963029 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:21.963366 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:21.964027 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:21.969143 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:21.972983 19218 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:21.975281 19899 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.977607 19901 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:21.947815 25327 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.985181 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:21.986441 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.987515 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:21.989909 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:21.991617 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.993165 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.993337 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:21.994174 19373 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:21.995553 25673 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:21.997033 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.000313 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.002658 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:22.005244 19374 raft_consensus.cc:2368] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17.
I20260709 13:11:22.006259 25699 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:22.007078 25699 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:22.008014 25699 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.008708 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.009364 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.010100 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.010733 25419 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.010926 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:21.963160 25381 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:22.013103 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.010965 19373 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:22.011934 25419 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:22.014636 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.016037 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.016700 19372 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:22.020223 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.021157 19374 raft_consensus.cc:2368] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14.
I20260709 13:11:22.022009 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:21.999540 25595 consensus_meta.cc:287] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:11:22.025736 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.027514 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.026140 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.029193 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.028508 19219 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:22.031349 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.031970 19219 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:22.032778 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.034320 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.034827 19372 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.037066 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:22.018589 25381 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:22.040144 19266 leader_election.cc:400] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17.
I20260709 13:11:22.040704 19266 leader_election.cc:403] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.042028 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.042722 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:22.045004 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.032431 25419 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:22.046528 25690 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:22.039556 25680 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:22.048206 25680 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.048565 25680 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.024677 25463 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:22.050150 25463 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.050807 25696 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:11:22.052019 25696 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:22.052268 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:22.046752 25700 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:22.052954 19218 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:22.054656 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.058876 19292 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:22.059335 25622 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.071802 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.072556 25622 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.073053 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.072988 25638 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.064328 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:22.065119 19367 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.074390 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:22.066694 19370 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:22.067473 25654 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.052388 25696 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:22.081243 19367 pending_rounds.cc:85] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 9
I20260709 13:11:22.081601 19367 pending_rounds.cc:107] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:11:22.081859 19367 raft_consensus.cc:2889] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.081703 25696 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.083153 25696 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.035535 25595 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.044986 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:22.070092 25619 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.002s
I20260709 13:11:22.070513 25680 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.071718 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.084583 19369 raft_consensus.cc:2368] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19.
I20260709 13:11:22.088039 19224 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:11:22.085541 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 946) took 1258 ms. Trace:
I20260709 13:11:22.098065 25619 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.095146 19296 rpcz_store.cc:276] 0709 13:11:20.826718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.830002 (+  3284us) service_pool.cc:224] Handling call
0709 13:11:20.840743 (+ 10741us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:20.882882 (+ 42139us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:20.984078 (+101196us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.140194 (+156116us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:21.188832 (+ 48638us) log.cc:844] Serialized 52 byte log entry
0709 13:11:21.189030 (+   198us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:21.189255 (+   225us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.189530 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.189675 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.189743 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.080796 (+891053us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b240029aa28. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4c4e9c4 00007fe8d4c4cacb 00007fe8d4e07dc9 00007fe8d4e07a55 00007fe8d4e06fb0 00007fe8d7a7d488 00007fe8d7a7dbe8 00007fe8d7a55398 00007fe8d7a5076a 00007fe8d7a4fbb6
0709 13:11:22.085334 (+  4538us) raft_consensus.cc:1685] finished
0709 13:11:22.085354 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.085486 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75032,"prepare.queue_time_us":185703,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":52750,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":15453,"spinlock_wait_cycles":70066944,"thread_start_us":172066,"threads_started":2,"wal-append.queue_time_us":212985}
I20260709 13:11:22.086706 25463 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.187143 19899 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:22.099290 25690 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.104830 25659 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:22.197321 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2514) took 1017 ms. Trace:
I20260709 13:11:22.183401 19373 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:22.184103 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:22.199364 25463 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.199993 25620 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:22.199926 25463 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.200659 25620 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:22.186434 19372 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:22.083370 25638 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:22.201138 25620 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.188237 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.188627 19366 raft_consensus.cc:2368] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20.
I20260709 13:11:22.192220 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:22.193876 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.193926 19900 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:22.195683 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:22.197858 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:22.205770 19895 raft_consensus.cc:2368] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:22.198724 19300 rpcz_store.cc:276] 0709 13:11:21.180430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.208829 (+ 28399us) service_pool.cc:224] Handling call
0709 13:11:21.209161 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:21.313438 (+104277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.313489 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:21.314246 (+   757us) log.cc:844] Serialized 52 byte log entry
0709 13:11:21.393838 (+ 79592us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:21.393883 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.101150 (+707267us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b54002e7a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:22.182801 (+ 81651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.182862 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:22.182873 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.197228 (+ 14355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20827,"raft.queue_time_us":26394,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":9772,"spinlock_wait_cycles":153031040,"thread_start_us":79123,"threads_started":1,"wal-append.queue_time_us":242189}
I20260709 13:11:22.208470 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:22.209476 19903 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:22.209547 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.211462 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.212306 19222 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.214708 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:22.248764 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.248662 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.249604 19218 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:22.254835 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3174) took 1115 ms. Trace:
I20260709 13:11:22.216425 25638 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:22.256009 19188 leader_election.cc:400] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:22.260814 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.255756 19216 rpcz_store.cc:276] 0709 13:11:21.139396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.205682 (+ 66286us) service_pool.cc:224] Handling call
0709 13:11:21.205949 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.304983 (+ 99034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.254569 (+949586us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540039add4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:22.254749 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136939264}
W20260709 13:11:22.258008 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 220261us
W20260709 13:11:22.258829 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74824.8us
I20260709 13:11:22.264657 19266 leader_election.cc:400] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14.
I20260709 13:11:22.265380 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.266189 19188 leader_election.cc:403] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.269227 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.270033 19217 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.271255 19901 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:22.272426 19372 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:22.272521 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.273407 19372 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:22.266115 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.218004 25659 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:22.263857 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.276919 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.279657 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:22.280815 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.281059 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:22.281775 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.285571 19216 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.286363 19294 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:22.286198 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.285640 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.288349 19372 raft_consensus.cc:2368] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:22.294123 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3179) took 1092 ms. Trace:
I20260709 13:11:22.294555 19216 rpcz_store.cc:276] 0709 13:11:21.194052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.280677 (+1086625us) service_pool.cc:224] Handling call
0709 13:11:22.281023 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.286133 (+  5110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.286385 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:22.295413 19222 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:22.296137 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.296541 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.296999 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.297562 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3177) took 1149 ms. Trace:
I20260709 13:11:22.297940 19218 rpcz_store.cc:276] 0709 13:11:21.147802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.282598 (+1134796us) service_pool.cc:224] Handling call
0709 13:11:22.297113 (+ 14515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.297267 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.297292 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:22.297332 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:22.297377 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.297427 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.297515 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:22.298815 19222 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:22.299587 19373 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.299805 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:22.305330 25645 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:22.305738 25702 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:11:22.305816 25645 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.306398 25645 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.278223 25630 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.308902 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.307092 25659 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.262527 25419 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:22.312598 19221 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:11:22.314266 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.295009 25684 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:22.316428 19372 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.317240 19295 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:22.271435 25638 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.319108 19224 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:22.309028 25595 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.311705 25680 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:22.327653 25706 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:11:22.328830 25703 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:11:22.329444 25410 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.330325 25638 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:22.323247 25327 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:22.331252 25327 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:22.311605 25436 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:11:22.341275 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2511) took 1209 ms. Trace:
I20260709 13:11:22.332077 25381 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.356485 19365 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:22.358690 25381 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.359090 19372 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:22.326339 25130 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:11:22.332263 25327 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.361428 25130 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:22.361899 25130 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:22.359927 25436 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:22.361596 25327 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:22.362457 25707 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:11:22.334189 25566 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:11:22.364894 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.345347 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.366282 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.362475 25436 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:22.362857 25130 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.370105 25130 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:22.371109 25619 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:22.327893 25674 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
W20260709 13:11:22.373044 25708 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:22.368058 25436 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.374410 25436 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.355870 19299 rpcz_store.cc:276] 0709 13:11:21.132233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.187093 (+ 54860us) service_pool.cc:224] Handling call
0709 13:11:22.341044 (+1153951us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54001d56d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:22.341204 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195201920}
I20260709 13:11:22.364735 25566 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:22.393715 19217 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:22.399156 19219 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:22.400403 19372 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:11:22.401978 19223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:22.402691 19223 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.402407 25619 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:22.403095 19223 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:22.408821 19119 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 162) took 20679 ms (client timeout 15000 ms). Trace:
W20260709 13:11:22.409283 19119 rpcz_store.cc:269] 0709 13:11:01.600564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.600755 (+   191us) service_pool.cc:224] Handling call
0709 13:11:22.256728 (+20655973us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:16.501826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:16.510034 (+  8208us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:16.510065 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:11:16.510082 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:16.612541 (+102459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:16.612644 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:16.612680 (+    36us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:11:16.650208 (+ 37528us) tablet.cc:701] Row locks acquired
0709 13:11:16.650232 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:11:16.650397 (+   165us) write_op.cc:270] Start()
0709 13:11:16.650519 (+   122us) write_op.cc:276] Timestamp: P: 1783602676650350 usec, L: 0
0709 13:11:16.650551 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:11:16.671193 (+ 20642us) log.cc:844] Serialized 7488 byte log entry
0709 13:11:17.576861 (+905668us) op_driver.cc:464] REPLICATION: finished
0709 13:11:17.989693 (+412832us) write_op.cc:301] APPLY: starting
0709 13:11:17.989815 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:18.398859 (+409044us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:18.399014 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:18.471733 (+ 72719us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb0e28 00007fe8db8eb581 00007fe8db8ead58 00007fe8db8ef9f1 00007fe8db8ef9a9 00007fe8db8ef939 00007fe8db8ef901 00007fe8db8eeb2d 000000000038f354 000000000038f199
0709 13:11:19.068016 (+596283us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:19.455749 (+387733us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:11:19.455851 (+   102us) write_op.cc:312] APPLY: finished
0709 13:11:19.456637 (+   786us) log.cc:844] Serialized 172 byte log entry
0709 13:11:20.201064 (+744427us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d4dab0ac 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b
0709 13:11:20.588760 (+387696us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:20.589182 (+   422us) write_op.cc:454] Released schema lock
0709 13:11:20.589292 (+   110us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:20.589973 (+   681us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:20.590017 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":755502,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":405995,"apply.run_cpu_time_us":82043,"apply.run_wall_time_us":2600186,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83471,"num_ops":19,"prepare.queue_time_us":205360,"prepare.run_cpu_time_us":91468,"prepare.run_wall_time_us":1983190,"raft.queue_time_us":367324,"raft.run_cpu_time_us":47888,"raft.run_wall_time_us":428525,"replication_time_us":880667,"spinlock_wait_cycles":392145536,"thread_start_us":1943731,"threads_started":5,"wal-append.queue_time_us":1539688,"wal-append.run_cpu_time_us":98438,"wal-append.run_wall_time_us":2277307}]]}
I20260709 13:11:22.415148 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.415578 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.415941 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:22.417642 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.320204 25684 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:22.419677 25595 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:22.419672 25689 raft_consensus.cc:993] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:22.327240 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:22.577263 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 250085us
W20260709 13:11:22.577441 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 305002us
I20260709 13:11:22.390156 25566 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:22.429553 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.581864 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 397404us
I20260709 13:11:22.440985 25660 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.445977 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:22.587087 19373 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:22.454973 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:22.512476 19371 raft_consensus.cc:2368] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:22.520828 25690 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17.
I20260709 13:11:22.569072 25684 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.578707 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:22.593907 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 139054us
I20260709 13:11:22.600208 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:22.583050 25436 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:22.592458 25660 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.608011 25660 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:22.593129 25643 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.609311 25643 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.591271 25680 raft_consensus.cc:1081] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:22.591002 25130 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:11:22.614626 25695 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.614740 25450 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:22.615378 25695 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:22.584821 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:22.514428 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.616683 19217 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.615661 25450 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:22.523280 25645 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.504786 19223 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.615952 25695 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.655511 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:22.664124 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:22.602258 25419 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.665254 19223 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:22.585914 25620 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.667542 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:22.611995 25643 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:22.668977 19900 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.672202 19266 leader_election.cc:400] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19.
I20260709 13:11:22.672729 19266 leader_election.cc:403] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.662441 25436 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:22.676280 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:22.677309 25436 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.634088 25622 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:11:22.623847 25630 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:11:22.680871 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3175) took 1541 ms. Trace:
I20260709 13:11:22.684114 19220 rpcz_store.cc:276] 0709 13:11:21.139636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.319453 (+179817us) service_pool.cc:224] Handling call
0709 13:11:21.342779 (+ 23326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.784324 (+441545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.680641 (+896317us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000e4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:22.680818 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992367488}
I20260709 13:11:22.675940 25327 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:22.676123 25410 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.690066 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.665980 19217 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:22.686834 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:22.693786 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.684515 25673 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.694406 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.702119 19224 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:22.687829 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.399s	user 0.017s	sys 0.006s
W20260709 13:11:22.700184 19370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.010s
I20260709 13:11:22.673369 25694 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:11:22.699445 19217 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:22.710731 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.704375 19371 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:22.713119 25620 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:22.662731 25566 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.715113 25566 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.692129 25450 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:22.711376 19370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.010s	sys 0.010s
I20260709 13:11:22.708843 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.703724 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.726092 19224 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:22.725304 19217 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.712184 19900 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:22.725615 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.432s	user 0.018s	sys 0.006s
I20260709 13:11:22.699612 25327 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:22.730769 25690 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:11:22.731621 25653 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:22.734724 25660 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.733201 19337 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:22.737246 25592 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.737893 25712 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:22.746202 19897 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:22.747761 25327 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.730458 19220 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:22.735674 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:22.777683 19224 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:22.763019 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:22.764416 19901 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.781260 19296 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:22.783675 19293 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:22.784049 19293 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:22.785112 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:22.785701 19298 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:22.775432 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 171305us
W20260709 13:11:22.793915 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.800525 19224 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:22.782728 19868 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.553s (SENT) [suppressed 23 similar messages]
I20260709 13:11:22.806298 25130 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.816902 19299 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:22.797403 19293 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.820816 19293 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:22.809955 19217 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:22.810954 19895 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:22.813784 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:22.807523 25712 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.814468 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:22.838428 19900 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.840400 25712 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:22.841146 19895 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:22.846387 19900 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:11:22.846853 19900 pending_rounds.cc:85] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 11
I20260709 13:11:22.847158 19900 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:11:22.847414 19900 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.846681 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2566) took 1398 ms. Trace:
I20260709 13:11:22.848111 19216 rpcz_store.cc:276] 0709 13:11:21.447880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.323494 (+875614us) service_pool.cc:224] Handling call
0709 13:11:22.333722 (+ 10228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.351160 (+ 17438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.351196 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.351764 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.691368 (+339604us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:22.691433 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.691500 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.846462 (+154962us) raft_consensus.cc:1685] finished
0709 13:11:22.846488 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.846626 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17025,"raft.queue_time_us":17154,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"thread_start_us":339236,"threads_started":1,"wal-append.queue_time_us":459855}
I20260709 13:11:22.851083 19217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:22.851627 19217 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.852037 19217 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:22.852623 25130 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.867785 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2564) took 1420 ms. Trace:
W20260709 13:11:22.872421 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53696.5us
I20260709 13:11:22.873584 19340 leader_election.cc:400] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17.
I20260709 13:11:22.874011 19340 leader_election.cc:403] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.867785 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2565) took 1420 ms. Trace:
I20260709 13:11:22.732983 25663 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:11:22.824222 19298 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:22.815074 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:22.829427 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:22.833788 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:22.833691 25419 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:22.835248 19220 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:22.807547 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 134617us
I20260709 13:11:22.776530 25650 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:22.735795 25694 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:11:22.868314 19218 rpcz_store.cc:276] 0709 13:11:21.447466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.313268 (+865802us) service_pool.cc:224] Handling call
0709 13:11:22.313541 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.322195 (+  8654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.322287 (+    92us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.424852 (+102565us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.681718 (+256866us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:22.681780 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.681911 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.867601 (+185690us) raft_consensus.cc:1685] finished
0709 13:11:22.867620 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.867725 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":493,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1429,"thread_start_us":256418,"threads_started":1,"wal-append.queue_time_us":440569}
I20260709 13:11:22.794721 25653 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:22.915402 19293 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:11:22.915836 19293 pending_rounds.cc:85] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 10
I20260709 13:11:22.807790 25659 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:22.916056 19293 pending_rounds.cc:107] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:11:22.922694 19293 raft_consensus.cc:2889] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:22.890349 19217 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.876700 19221 rpcz_store.cc:276] 0709 13:11:21.447628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.321138 (+873510us) service_pool.cc:224] Handling call
0709 13:11:22.323035 (+  1897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.324326 (+  1291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.324359 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.342150 (+ 17791us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.679934 (+337784us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:22.679985 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.680072 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.867570 (+187498us) raft_consensus.cc:1685] finished
0709 13:11:22.867591 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.867718 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14340,"raft.queue_time_us":2178,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":17280,"thread_start_us":337333,"threads_started":1,"wal-append.queue_time_us":523369}
W20260709 13:11:22.937536 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 122537us
I20260709 13:11:22.938352 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:22.789333 25592 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.795888 25660 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:22.941430 19217 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.923218 25663 consensus_queue.cc:1243] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:22.940552 25725 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:22.944625 25650 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:22.957719 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 175026us
W20260709 13:11:22.960760 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87375.6us
I20260709 13:11:22.923437 25130 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.941067 25645 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:22.951627 25712 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.945286 25722 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.984527 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 153841us
I20260709 13:11:22.966426 25696 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17.
I20260709 13:11:23.054314 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:22.725291 25283 consensus_queue.cc:1175] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 17 status { last_received { term: 17 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:23.055701 25680 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:23.056900 25726 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:11:23.058652 25724 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:11:23.060405 25592 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:23.060779 25715 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:23.050045 25436 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.061825 25436 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.056478 25680 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.065874 25680 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:23.067152 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.067922 25737 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:23.068383 25680 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:23.069653 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.069765 25680 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.071285 19221 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:22.948345 25616 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:11:23.074468 25616 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:23.075161 25616 consensus_queue.cc:1243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:23.071071 25629 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:23.080022 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:23.089923 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 151655us
I20260709 13:11:23.090091 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.090732 19298 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:23.091094 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.093048 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:23.050247 25653 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.994109 25638 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:22.952574 25725 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:23.097249 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 200232us
I20260709 13:11:23.097635 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:23.103925 25450 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:23.104408 25450 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.104743 25450 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.063942 25436 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:22.953480 25650 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.108863 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.108089 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1147) took 1107 ms. Trace:
I20260709 13:11:23.109869 19365 rpcz_store.cc:276] 0709 13:11:22.000962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.060505 (+ 59543us) service_pool.cc:224] Handling call
0709 13:11:22.060799 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.356914 (+296115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.107839 (+750925us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54003471d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:23.108023 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679578496}
I20260709 13:11:23.112228 19902 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:23.113435 19217 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:23.115149 19370 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:23.116736 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:23.117336 19371 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:23.117570 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:23.120723 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:23.097021 25719 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.104s	user 0.005s	sys 0.000s
I20260709 13:11:23.122187 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:23.095211 25410 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19.
I20260709 13:11:23.141183 19298 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:23.138972 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.143139 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:23.143411 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.143855 19299 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.144721 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.144873 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:22.991405 25130 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:11:23.145931 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:23.146396 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:23.146737 19369 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:23.140342 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:23.102308 25696 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:23.152149 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:23.152405 19225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2563) took 1705 ms (client timeout 2060 ms). Trace:
I20260709 13:11:23.152864 19897 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:23.153218 19222 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:22.993351 25722 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:22.997511 25712 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.149010 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.111332 25638 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:23.152881 19225 rpcz_store.cc:269] 0709 13:11:21.447298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.638618 (+191320us) service_pool.cc:224] Handling call
0709 13:11:23.152224 (+1513606us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003c87d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:23.152347 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316014336}
I20260709 13:11:23.174275 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.178217 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.176968 19295 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:23.141819 25347 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.148895 19298 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:23.139003 25659 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:23.190569 19370 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:11:23.220090 19266 leader_election.cc:336] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.544s (SENT)
I20260709 13:11:23.220866 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.152616 25696 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:23.187326 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:23.180435 25684 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.563s	user 0.016s	sys 0.000s
W20260709 13:11:23.285341 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 107212us
I20260709 13:11:23.286710 25130 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:23.287060 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67039.2us
I20260709 13:11:23.180826 25595 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:23.302734 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 341588us
I20260709 13:11:23.327842 19297 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:23.278052 25616 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.189860 25731 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:23.178006 25410 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.126s
I20260709 13:11:23.282609 25696 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:23.286934 25730 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:23.327018 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:23.299316 25436 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:23.273169 25630 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 13:11:23.347934 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 942) took 1144 ms. Trace:
W20260709 13:11:23.355085 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 208654us
W20260709 13:11:23.364915 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 225913us
I20260709 13:11:23.368531 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:23.361183 19898 rpcz_store.cc:276] 0709 13:11:22.194647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.196142 (+  1495us) service_pool.cc:224] Handling call
0709 13:11:22.213482 (+ 17340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.213707 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:22.749878 (+536171us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.338226 (+588348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:23.338290 (+    64us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:23.338345 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.338574 (+   229us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.339098 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":551573,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":14812,"raft.queue_time_us":70315,"raft.run_cpu_time_us":3251,"raft.run_wall_time_us":17254,"thread_start_us":1084595,"threads_started":3,"wal-append.queue_time_us":239685}
I20260709 13:11:23.362846 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:23.374486 25638 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.376948 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:23.378530 25659 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.381098 25712 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.343324 25727 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.381767 25712 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:23.382413 25712 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:23.382467 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.385057 25722 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:23.385540 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:23.386377 25695 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.000s
I20260709 13:11:23.386803 25695 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.387539 19225 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:23.329356 25713 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:11:23.387912 19225 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:23.388602 25680 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:23.388828 19225 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.304531 25684 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.357437 25436 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:23.340045 25544 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:23.346335 25736 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:23.401069 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:23.387848 19899 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:23.393046 19217 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:11:23.356525 25694 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:23.394553 19896 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.326438 25592 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:11:23.343185 25731 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:23.414466 25684 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.414894 25731 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:23.416409 25733 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:11:23.416478 25749 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.387962 25450 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.417240 25749 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.419549 25749 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.346032 25660 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:23.399513 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.327854 25629 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:11:23.390177 25685 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.341029 25595 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:23.406611 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:23.449666 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.407492 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:23.408566 25745 raft_consensus.cc:2764] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:23.362960 25730 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.412746 25746 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:23.383500 25712 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.428926 25731 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.400588 25381 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:11:23.413362 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:23.420428 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.425413 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.426668 19373 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:11:23.382422 25727 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:23.430526 19299 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:23.498385 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:23.438215 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.499733 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.442735 25739 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.407421 25619 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:11:23.439944 25695 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:23.446798 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47406.7us
I20260709 13:11:23.448738 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:23.383525 25725 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.517841 19291 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:23.517733 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.405555 25564 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 13:11:23.460546 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.462721 19296 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:23.463625 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.468880 19294 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:23.470779 25440 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:23.498597 25727 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:23.479296 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 848) took 1421 ms (client timeout 1641 ms). Trace:
I20260709 13:11:23.515950 25739 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:23.481160 19224 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:23.495337 19217 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:23.429615 25694 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:23.565793 25739 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.565572 25694 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:23.562171 19219 rpcz_store.cc:269] 0709 13:11:22.057979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.072809 (+ 14830us) service_pool.cc:224] Handling call
0709 13:11:23.479028 (+1406219us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54000780d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:23.479209 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695855872}
W20260709 13:11:23.567478 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.516848 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.451993 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.568886 19298 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:23.523794 25436 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.519491 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.569880 25436 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:23.570050 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50647.6us
I20260709 13:11:23.452080 25685 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.570931 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.524062 25745 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.522470 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:23.497848 25463 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:23.515431 25419 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.579548 19898 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.536284 25738 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.536509 25696 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:23.540690 19221 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:23.476770 25673 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:23.455845 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 277592us
I20260709 13:11:23.584803 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:23.573055 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.585681 19220 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:23.525687 19295 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:23.577970 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55576.1us
I20260709 13:11:23.548979 25440 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:23.586041 19220 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:23.594441 19221 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:23.616456 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:23.586961 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 231427us
I20260709 13:11:23.616966 19370 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:23.618686 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.618817 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:23.620389 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:23.575943 25450 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:23.622658 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 245788us
I20260709 13:11:23.623214 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.627079 19368 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:23.629765 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.632579 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:23.632979 19371 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:23.633014 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:23.633968 19370 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.588399 25673 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.579569 25668 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.616153 25725 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:23.636379 19366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2890) took 1647 ms (client timeout 1544 ms). Trace:
I20260709 13:11:23.575856 25744 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.582631 25629 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:23.621441 19220 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.645249 19368 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:11:23.648568 19366 rpcz_store.cc:269] 0709 13:11:21.988917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.989563 (+   646us) service_pool.cc:224] Handling call
0709 13:11:23.636124 (+1646561us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54004268d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:23.636296 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279898496}
I20260709 13:11:23.649005 19220 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.586341 25690 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:23.650310 25754 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.651073 25754 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.651648 25730 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:23.652441 25741 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:11:23.654613 25754 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.650449 19369 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:23.626235 25751 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:23.639703 25743 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.656428 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:23.657346 19371 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:23.630663 25752 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:23.658038 25752 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:23.658525 25752 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.645707 25738 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:23.663590 19370 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:23.665781 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:23.668578 25751 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:23.662659 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:23.673229 25747 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:11:23.636302 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.677533 25685 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.681756 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:23.630473 25327 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.637545 25749 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:23.684023 19220 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:23.688236 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:23.712013 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:23.714003 25673 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.712468 19368 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:23.576960 25595 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.691875 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.699640 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2581) took 1024 ms. Trace:
I20260709 13:11:23.734707 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.709281 25696 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:23.697832 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:23.713759 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:23.683537 25690 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.699056 25741 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:23.639986 25727 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.710690 25740 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:23.698346 25751 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.697494 25689 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.728854 19370 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:11:23.728866 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 99196.7us
I20260709 13:11:23.639410 25440 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.757514 25440 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:23.757792 25564 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.741325 25660 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.730964 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:23.734462 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46355.6us
I20260709 13:11:23.723214 19371 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:23.742535 19217 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:23.742640 19220 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:23.742178 19216 rpcz_store.cc:276] 0709 13:11:22.675562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.850576 (+175014us) service_pool.cc:224] Handling call
0709 13:11:22.850864 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.992918 (+142054us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:22.992952 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.993872 (+   920us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.276113 (+282241us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:23.276159 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.276255 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.699412 (+423157us) raft_consensus.cc:1685] finished
0709 13:11:23.699440 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.699582 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100504,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":337951,"threads_started":2,"wal-append.queue_time_us":327703}
I20260709 13:11:23.745651 19369 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.756318 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2901) took 1753 ms. Trace:
I20260709 13:11:23.746989 25659 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:23.749847 25741 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.749078 25727 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:23.768508 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 132252us
I20260709 13:11:23.770814 19191 leader_election.cc:400] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:23.741142 25730 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.749058 25740 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.744372 25327 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.788475 19367 rpcz_store.cc:276] 0709 13:11:22.002974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.074824 (+ 71850us) service_pool.cc:224] Handling call
0709 13:11:22.081037 (+  6213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:22.082618 (+  1581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.082646 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:22.083145 (+   499us) log.cc:844] Serialized 52 byte log entry
0709 13:11:22.279020 (+195875us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:22.294457 (+ 15437us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.715958 (+1421501us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18003ba340. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf 00007fe8d7ecf038
0709 13:11:23.716175 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.745215 (+ 29040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.745291 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.756096 (+ 10805us) raft_consensus.cc:1685] finished
0709 13:11:23.756115 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.756261 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1394890,"prepare.queue_time_us":1438118,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1962,"raft.queue_time_us":1691,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":24742,"spinlock_wait_cycles":31441280,"thread_start_us":216885,"threads_started":2,"wal-append.queue_time_us":199978,"wal-append.run_cpu_time_us":2665,"wal-append.run_wall_time_us":1146593}
I20260709 13:11:23.794442 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.794754 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.795270 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:23.795928 19217 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.734688 25739 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.767861 25689 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.790288 25741 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.798461 25750 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:23.791503 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60622.5us
W20260709 13:11:23.765239 25450 consensus_queue.cc:1175] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0316f581086f40549fea44a772fc2dec" responder_term: 21 status { last_received { term: 20 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:23.733927 25743 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:11:23.804417 25750 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.805318 19369 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:23.791612 19191 leader_election.cc:403] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.791698 25696 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.824007 25696 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.828630 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.830402 25746 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:23.835655 25684 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:23.804059 19216 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:23.807132 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:23.812565 19868 leader_election.cc:336] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.641s (SENT)
I20260709 13:11:23.818518 25760 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:23.771209 25685 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:11:23.793123 25712 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:23.822789 25673 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.823377 25731 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:23.821753 25564 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:23.874832 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.799587 25690 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:23.879261 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:23.791097 25659 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.890326 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:23.890492 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52062.3us
I20260709 13:11:23.891528 25673 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.913995 19217 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:23.800616 25730 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.827342 25752 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:23.915381 25620 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:11:23.922268 25766 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:23.889124 25566 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:23.935024 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44765.2us
I20260709 13:11:23.937857 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.940307 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:23.957649 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:23.962532 25720 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.227s	user 0.001s	sys 0.003s
I20260709 13:11:23.938359 25685 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:24.005734 25653 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:24.006871 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49313.3us
W20260709 13:11:23.979803 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.992195 19294 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:23.995147 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:23.995867 25745 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:23.996192 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:24.012212 19292 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:24.012557 19292 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:23.976275 25668 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:23.996943 25723 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.939695 25566 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.000286 25768 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:24.000798 25440 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.946105 25780 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:11:24.011643 19296 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:11:24.015443 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:23.997834 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:24.028451 19298 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:24.028896 19298 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:24.018803 19191 leader_election.cc:400] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:23.984450 25690 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.013510 19292 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.032864 19292 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:24.134102 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 118732us
I20260709 13:11:24.031845 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:24.138710 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.136458 25780 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:24.145397 25780 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:24.146593 25780 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.149082 25780 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:24.047070 19298 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.154191 19298 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:24.155436 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 123684us
I20260709 13:11:24.157560 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:24.133541 25410 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.161126 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.163551 19294 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:11:24.166165 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:24.290660 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105034us
I20260709 13:11:24.299520 19296 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:24.302150 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.304719 19293 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:24.138357 25650 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.133386 25689 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:24.133647 25564 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:24.286332 25410 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.286690 25744 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:24.335964 25781 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:24.336735 25765 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
W20260709 13:11:24.337561 25776 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.354s	user 0.000s	sys 0.000s
I20260709 13:11:24.341624 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:24.023948 25440 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.357405 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:24.556855 19217 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.161363 25694 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:24.335649 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:24.382769 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 224898us
I20260709 13:11:24.566325 19868 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:24.136035 25690 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:24.532070 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.584201 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.144294 25668 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.199s
I20260709 13:11:24.026432 25723 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.555919 19220 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 12: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:24.300884 25739 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:24.603334 19263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.045s	sys 0.102s
W20260709 13:11:24.614281 19263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.045s	sys 0.102s
W20260709 13:11:24.614611 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 605620us
I20260709 13:11:24.564801 19216 raft_consensus.cc:2376] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15. Re-sending same reply.
I20260709 13:11:24.391758 25689 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:24.613546 25781 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.667404 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:24.667955 25776 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:24.604226 25740 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:24.671250 25752 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:24.609292 25744 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:24.704836 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:24.313313 25653 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.296s
I20260709 13:11:24.550053 25645 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.107s
I20260709 13:11:24.381283 25785 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:24.714464 19292 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.000s
I20260709 13:11:24.748392 19292 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:24.540952 19298 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
W20260709 13:11:24.739127 25685 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.000s
I20260709 13:11:24.738991 25440 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:24.740175 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.754354 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.740532 25410 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:24.695631 25564 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.383984 25650 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.722579 19217 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:24.742295 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1170) took 2087 ms. Trace:
W20260709 13:11:24.755892 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.728590 25787 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 13:11:24.803053 25410 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:24.803856 25410 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.806607 25410 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:24.807269 25410 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.812641 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.813517 19216 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:24.814298 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.053s	sys 0.114s
I20260709 13:11:24.742095 25723 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:24.773468 19896 rpcz_store.cc:276] 0709 13:11:22.654650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.654816 (+   166us) service_pool.cc:224] Handling call
0709 13:11:22.655138 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.404045 (+748907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.741986 (+1337941us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54004f0954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:24.742211 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691019136}
I20260709 13:11:24.820729 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:24.815580 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.053s	sys 0.114s
I20260709 13:11:24.823489 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:24.824301 19298 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:24.762827 19218 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:24.851101 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3207) took 1328 ms. Trace:
I20260709 13:11:24.851567 19218 rpcz_store.cc:276] 0709 13:11:23.522949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.533200 (+ 10251us) service_pool.cc:224] Handling call
0709 13:11:24.759540 (+1226340us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:24.759793 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.850804 (+ 91011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.851038 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785664}
I20260709 13:11:24.854367 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:24.757787 25685 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:24.859166 19867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.024s	sys 0.040s
W20260709 13:11:24.859793 19867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.024s	sys 0.040s
I20260709 13:11:24.861044 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.723603 25689 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.862123 19218 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
W20260709 13:11:24.863785 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.865803 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.863520 19263 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:24.867280 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:24.867535 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:24.868134 19298 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.807780 25410 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.853816 25723 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.863845 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.853933 25752 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:24.881621 19298 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:24.883087 19292 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:24.877597 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:24.868777 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.887065 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.888026 19218 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:24.898193 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:24.899067 19217 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:24.884832 25668 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:24.892864 25685 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:24.812659 25744 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.891525 25690 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:24.921509 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 355298us
I20260709 13:11:24.884994 25723 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.924031 19868 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:24.916626 25780 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.000s
I20260709 13:11:24.892215 25752 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.935921 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:24.945456 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:24.918025 25685 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.915723 25746 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:24.923295 25798 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.923147 25793 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.940073 25668 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:25.028268 25668 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:24.939620 25690 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:25.031960 25659 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.034057 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2922) took 1917 ms. Trace:
I20260709 13:11:25.050091 19373 rpcz_store.cc:276] 0709 13:11:23.116663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.116788 (+   125us) service_pool.cc:224] Handling call
0709 13:11:23.142448 (+ 25660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.499495 (+357047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.033725 (+1534230us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54000942d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:25.033982 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652799744}
W20260709 13:11:25.032037 25788 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:11:24.971552 19225 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:24.950575 25685 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.059405 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:24.974852 25594 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:25.060359 25594 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:25.060504 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.061116 19372 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:25.061259 25594 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:24.995841 25750 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:24.998298 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 853) took 2935 ms. Trace:
W20260709 13:11:25.001833 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2525) took 1901 ms (client timeout 2080 ms). Trace:
I20260709 13:11:25.006533 25696 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.034261 25781 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:24.971365 25786 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:11:25.065088 25630 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:25.012660 25802 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:25.016074 25620 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.022070 25410 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.065622 25630 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.066067 25594 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:25.066258 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.067049 19368 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:25.067729 25630 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.026726 25752 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.036154 25566 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:24.955494 25727 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.162s	user 0.011s	sys 0.000s
I20260709 13:11:25.068610 25463 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.069350 19216 raft_consensus.cc:2410] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:11:25.069280 25463 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.042232 25730 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:24.952876 25660 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.180s	user 0.008s	sys 0.005s
I20260709 13:11:25.071830 25660 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.032083 25793 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.072611 25727 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.073276 25727 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.074044 25793 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:24.954253 25746 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.075572 19225 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:11:25.032380 25670 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:11:25.055676 25690 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.057727 25440 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.014649 25723 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.025612 25712 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:25.032780 25801 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260709 13:11:25.071033 19297 rpcz_store.cc:269] 0709 13:11:23.100905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.113025 (+ 12120us) service_pool.cc:224] Handling call
0709 13:11:25.001647 (+1888622us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b540034fb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:25.001769 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58698496}
I20260709 13:11:24.934307 25796 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.064467 19224 rpcz_store.cc:276] 0709 13:11:22.063322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.802438 (+739116us) service_pool.cc:224] Handling call
0709 13:11:23.480693 (+678255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.563126 (+ 82433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.998083 (+1434957us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54000780d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:24.998233 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559033088}
W20260709 13:11:25.004976 25794 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:24.966564 25798 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.106253 19366 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:25.095625 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:25.114392 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 857) took 1727 ms. Trace:
W20260709 13:11:25.077414 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.116078 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:25.116748 19225 rpcz_store.cc:276] 0709 13:11:23.387009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.387140 (+   131us) service_pool.cc:224] Handling call
0709 13:11:23.387428 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.971323 (+1583895us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b5800707fd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:11:25.114095 (+142772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.114329 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69723008}
I20260709 13:11:25.090766 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:25.091598 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:25.120536 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:25.120719 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.079908 25694 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.121985 25734 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:25.121430 25629 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.082672 25782 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:25.121995 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:25.123176 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 59009.4us
I20260709 13:11:25.075829 25727 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:24.950939 25436 consensus_meta.cc:287] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 1.381s	user 0.013s	sys 0.000s
I20260709 13:11:24.958698 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:25.048076 25791 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:11:25.071918 25463 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.132563 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:25.199230 19223 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:11:25.132099 19217 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:25.172891 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 299839us
I20260709 13:11:25.181030 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:25.201120 25727 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:25.182387 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:25.202314 19298 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:11:25.183758 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:25.193337 19297 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:25.132970 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:25.194346 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:25.203953 19373 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.116662 25793 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:25.044809 25130 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:11:25.196522 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 237911us
I20260709 13:11:25.076087 25746 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.035192 25689 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.115949 25259 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:25.195783 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.033500 25650 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.125595 25785 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:25.320600 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.323454 25798 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:25.311757 25741 consensus_meta.cc:287] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.503s	user 0.013s	sys 0.000s
I20260709 13:11:25.324990 25741 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.327229 25741 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.327533 25735 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.211726 19373 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
W20260709 13:11:25.232657 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47775.6us
I20260709 13:11:25.233685 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:25.328717 25622 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.328933 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:25.329423 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 95876.7us
I20260709 13:11:25.329237 25622 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.130785 25616 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:25.330137 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.330487 25616 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:25.331408 25622 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.331375 25616 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.131863 25660 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.332787 25660 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:25.130522 25678 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:11:25.335005 25660 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.335672 25743 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:25.116580 25690 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:25.336256 25743 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:25.337255 25743 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.241575 25130 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:25.340353 25746 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:25.341104 25130 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.341956 25746 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:25.342654 25130 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:25.122087 25694 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.345647 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1168) took 1329 ms. Trace:
I20260709 13:11:25.345914 25694 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.311039 25630 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:11:25.349563 19223 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:25.232631 25410 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:11:25.350085 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:25.350733 19218 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:25.192592 25674 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:25.350958 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:25.351280 25674 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.351722 25674 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:25.122993 25752 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:11:25.195412 25754 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:25.327963 19365 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:25.349980 19223 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:25.351755 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:25.240870 25566 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.199723 25782 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:25.129454 25440 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.198909 25796 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.352843 19373 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:25.346127 19369 rpcz_store.cc:276] 0709 13:11:24.016245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.016769 (+   524us) service_pool.cc:224] Handling call
0709 13:11:24.022327 (+  5558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:24.026147 (+  3820us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:24.286610 (+260463us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.730093 (+443483us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:24.750442 (+ 20349us) log.cc:844] Serialized 52 byte log entry
0709 13:11:24.750587 (+   145us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:24.761816 (+ 11229us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.856876 (+ 95060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.856973 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.987117 (+130144us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4800042858. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:11:25.047287 (+ 60170us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:25.345404 (+298117us) raft_consensus.cc:1685] finished
0709 13:11:25.345429 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.345584 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211074,"prepare.queue_time_us":292104,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":50789,"raft.queue_time_us":104772,"raft.run_cpu_time_us":3001,"raft.run_wall_time_us":965350,"spinlock_wait_cycles":42892160,"thread_start_us":430350,"threads_started":1,"wal-append.queue_time_us":590893}
W20260709 13:11:25.402283 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.030s	sys 0.011s
W20260709 13:11:25.402760 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.030s	sys 0.011s
W20260709 13:11:25.313161 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 112471us
I20260709 13:11:25.130317 25734 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.353910 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.364181 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.196748 25673 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.125s
W20260709 13:11:25.403095 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 529423us
I20260709 13:11:25.471695 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:25.471203 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.479663 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.328028 25735 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.480379 19369 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:25.350091 25630 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:25.332084 25622 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.481877 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.482620 19223 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.320453 25653 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.469404 19867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.018s	sys 0.023s
W20260709 13:11:25.489310 19867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.019s	sys 0.023s
I20260709 13:11:25.195436 25629 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.311972 25793 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.318271 25799 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.486208 19368 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:25.320966 25670 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:11:25.492733 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 141044us
I20260709 13:11:25.493359 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.500597 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.501303 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.496492 19901 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:25.497100 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:25.500883 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:25.393394 25754 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:25.320178 25259 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.501209 19368 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:25.513372 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.485652 25630 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:25.517900 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.518960 19368 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:25.413784 25566 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.508104 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.512238 19372 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 12.
I20260709 13:11:25.499274 25673 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:25.529423 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.506167 25799 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.534049 19369 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:25.535588 25799 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.501610 25619 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:25.507995 25752 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:25.536821 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.537071 25752 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:25.536996 25619 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.537634 25752 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.501775 25640 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:25.540807 19901 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:25.531329 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.505440 25782 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.539884 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:25.543094 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.543848 19368 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:25.545012 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:25.547205 19368 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:25.547325 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.416265 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:25.490285 25622 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.505748 25806 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.562022 19900 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:25.507174 25754 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.563786 19368 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:25.571784 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:25.572403 19897 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:25.497411 25653 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.568601 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:25.526849 25798 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:25.577430 19368 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:25.579888 19902 pending_rounds.cc:85] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 10
I20260709 13:11:25.587524 25734 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.588901 25619 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.588967 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:25.590368 25283 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.590938 25283 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.591799 25629 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.593231 25283 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.571025 25640 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.598245 25640 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.593274 25259 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.600077 25694 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.600625 25694 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.605405 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3189) took 3550 ms. Trace:
I20260709 13:11:25.606268 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1167) took 1592 ms. Trace:
I20260709 13:11:25.607402 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 1080) took 2832 ms. Trace:
I20260709 13:11:25.607892 19899 rpcz_store.cc:276] 0709 13:11:22.774723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.774878 (+   155us) service_pool.cc:224] Handling call
0709 13:11:22.775192 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.402239 (+627047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.607098 (+2204859us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54005d2854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:25.607290 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408531328}
I20260709 13:11:25.609767 25734 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.610414 25734 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.607023 19365 rpcz_store.cc:276] 0709 13:11:24.013836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.014007 (+   171us) service_pool.cc:224] Handling call
0709 13:11:24.014313 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.473406 (+1459093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.605951 (+132545us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400197154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:25.606198 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020478848}
I20260709 13:11:25.605932 19222 rpcz_store.cc:276] 0709 13:11:22.055277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.405536 (+350259us) service_pool.cc:224] Handling call
0709 13:11:23.152975 (+747439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.153733 (+   758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.605136 (+2451403us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54003c87d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:25.605318 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718141824}
W20260709 13:11:25.654525 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 86021.1us
W20260709 13:11:25.571674 25564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.027s
W20260709 13:11:25.588778 25807 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:25.515208 25727 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:11:25.585510 19902 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 13.11
I20260709 13:11:25.685540 19902 raft_consensus.cc:2917] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Aborting config change with OpId 13.11: Aborted: Op aborted by new leader
I20260709 13:11:25.715145 19902 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:25.706166 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.716270 19899 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:25.620713 25782 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:25.672747 25638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.295s	user 0.018s	sys 0.024s
I20260709 13:11:25.668051 25744 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.658629 25564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.027s
I20260709 13:11:25.685686 25712 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:25.718983 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 551470us
I20260709 13:11:25.734953 19897 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:25.532231 25785 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.748067 19296 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:25.574324 25806 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:25.725337 25638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.347s	user 0.018s	sys 0.024s
I20260709 13:11:25.660393 25798 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.739589 25727 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.661836 25630 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.742951 25259 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.743790 25712 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:25.778420 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:25.792326 25440 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.743310 25744 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.810789 25796 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
W20260709 13:11:25.827070 19374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.028s	sys 0.021s
I20260709 13:11:25.798087 25712 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:25.830740 19374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.028s	sys 0.021s
I20260709 13:11:25.805043 25630 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.801657 25694 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.803933 25793 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.796458 25727 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.852937 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.808154 25735 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:25.790591 25673 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:25.802130 25259 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:25.858302 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 320092us
I20260709 13:11:25.890825 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.855039 25793 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.899889 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.900537 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.861512 25814 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.904871 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 126568us
I20260709 13:11:25.910631 25673 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:25.911556 25813 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:11:25.912863 25685 consensus_meta.cc:287] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.000s
I20260709 13:11:25.913251 25685 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.914372 19216 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:25.916734 19868 leader_election.cc:336] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 2.103s (SENT)
I20260709 13:11:25.920943 25259 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.921583 25259 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.896457 25622 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.924898 25798 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.889638 25799 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.926281 25799 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.926712 25801 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:25.927456 25811 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:11:25.928373 25799 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:25.931109 25674 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.001s
I20260709 13:11:25.931526 25674 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.855525 25566 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:25.935016 25690 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:11:25.935361 19292 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:11:25.935679 25130 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
W20260709 13:11:25.936331 25810 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:11:25.956941 19300 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:25.937263 25685 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.940260 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:25.958323 19899 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:25.954993 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:25.954943 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:25.905417 25814 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.961238 19898 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:25.907089 25793 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:25.982353 25793 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.962353 25694 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.983960 25694 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:25.986060 25694 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.992093 25674 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:25.993870 25799 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:25.994369 25799 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:25.994453 25814 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:25.994868 25799 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:25.999468 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.900851 25653 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:26.002810 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 96216.9us
I20260709 13:11:26.004379 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.005389 19899 raft_consensus.cc:2393] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:11:25.961167 25595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.202s	user 0.008s	sys 0.027s
W20260709 13:11:26.020799 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.028084 25818 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:11:26.033488 25327 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.035053 25347 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.035642 25347 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.037936 25347 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.038802 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.040729 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.041589 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.041848 19220 raft_consensus.cc:2376] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20. Re-sending same reply.
I20260709 13:11:26.042254 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.042837 19899 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:26.043104 19895 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:26.044487 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:26.043113 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 867) took 1740 ms (client timeout 2103 ms). Trace:
I20260709 13:11:26.045089 19900 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
W20260709 13:11:26.045306 19220 rpcz_store.cc:269] 0709 13:11:24.302478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.646363 (+343885us) service_pool.cc:224] Handling call
0709 13:11:26.042958 (+1396595us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400437e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:26.043065 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3056086400}
I20260709 13:11:26.045619 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:26.049381 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.053535 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:26.014639 25595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.253s	user 0.008s	sys 0.027s
I20260709 13:11:26.055256 19894 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:26.059973 19373 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 21. Current term is 22. Ops: []
W20260709 13:11:26.067672 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 718848us
I20260709 13:11:26.009517 25685 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:25.963146 25690 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:26.061580 25752 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.523s	user 0.002s	sys 0.010s
I20260709 13:11:26.099701 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.092589 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.097963 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.098181 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.082506 25751 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:11:26.098308 25622 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:26.110267 25622 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:26.110656 25622 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.114809 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.116074 19895 raft_consensus.cc:2410] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:11:26.116356 25327 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.050339 25814 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:11:26.116930 25327 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.117959 25814 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:26.118324 25814 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:26.119199 25327 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.074928 25731 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:26.050470 25410 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:26.124495 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:26.126581 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.130940 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:26.143934 19294 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:26.146492 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46879.1us
I20260709 13:11:26.156430 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.179713 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.180975 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2416) took 1075 ms. Trace:
I20260709 13:11:26.181538 19374 rpcz_store.cc:276] 0709 13:11:25.105704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.105833 (+   129us) service_pool.cc:224] Handling call
0709 13:11:25.106179 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.106408 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:25.122218 (+ 15810us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.180534 (+1058316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:26.180595 (+    61us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:26.180659 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.180729 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.180895 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298178,"prepare.queue_time_us":15624,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":37,"thread_start_us":716820,"threads_started":1,"wal-append.queue_time_us":1004560}
W20260709 13:11:26.146718 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 138311us
I20260709 13:11:26.179558 25327 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:26.192796 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.067684 25754 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.196152 19373 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:11:26.200840 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.196714 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.201759 19370 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:26.198604 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.203241 19368 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:26.204559 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.193140 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3220) took 1099 ms. Trace:
I20260709 13:11:26.205142 19368 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:26.205192 19216 rpcz_store.cc:276] 0709 13:11:25.094119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.094295 (+   176us) service_pool.cc:224] Handling call
0709 13:11:26.192933 (+1098638us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400438354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:26.193079 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633585536}
I20260709 13:11:26.206019 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.206631 19368 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:26.136808 25668 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:26.190570 19340 connection.cc:256] RPC call timeout handler was delayed by -1.9731047630000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 13:11:26.230238 19372 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:26.207345 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.091542 25685 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.224324 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.240985 19368 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:26.237519 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:26.243302 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 86962.1us
I20260709 13:11:26.246057 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.185931 25744 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.274062 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.185422 25731 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:26.275187 25731 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.275664 25731 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.276031 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:26.248215 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62765.6us
I20260709 13:11:26.277379 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.184252 25674 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.183472 25653 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.184033 25823 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.258423 25723 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:26.191998 25327 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:26.260964 25815 log.cc:927] Time spent T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:26.297613 25685 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.240149 25668 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:26.298524 25668 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:26.299052 25812 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.472s	user 0.001s	sys 0.010s
I20260709 13:11:26.300287 25327 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:26.263381 25840 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:11:26.264730 25450 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:26.265017 25771 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.977s	user 0.001s	sys 0.007s
I20260709 13:11:26.265211 25629 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.265643 25741 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.267434 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43505.5us
W20260709 13:11:26.268013 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.268491 25793 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.271430 25690 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.272393 19291 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:26.334893 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2400) took 2045 ms. Trace:
I20260709 13:11:26.230737 25727 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.335412 19294 rpcz_store.cc:276] 0709 13:11:24.289280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.312550 (+ 23270us) service_pool.cc:224] Handling call
0709 13:11:25.324970 (+1012420us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b58001c2f98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:25.325159 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.155764 (+830605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.334583 (+178819us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54003f25d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:26.334808 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894876160}
I20260709 13:11:26.273053 25754 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.272989 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.304885 25805 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:26.274884 19369 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:26.280774 19265 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:26.349424 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 68745.8us
I20260709 13:11:26.280736 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.285382 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.123428 25752 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.289762 25674 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.290728 25678 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:26.119298 25814 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.292613 25734 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.292083 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:26.139353 25410 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.294569 25712 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.295595 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:26.318073 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 72158.4us
I20260709 13:11:26.338515 25595 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:26.340324 25659 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:26.340867 25751 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.193848 25828 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:11:26.346688 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.304790 25730 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:11:26.358162 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.350625 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:26.399515 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48957.8us
I20260709 13:11:26.400575 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:26.304721 25823 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.401711 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:26.358773 25723 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:26.360016 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.393846 25799 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.408501 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:26.409168 19372 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.410221 25799 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.410553 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.411357 19300 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:26.367841 25678 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:26.396112 25440 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:26.412950 25678 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.381633 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:26.353482 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.326581 25842 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:26.307049 25653 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.360888 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:26.391829 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.420250 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2534) took 2972 ms. Trace:
I20260709 13:11:26.420660 19299 rpcz_store.cc:276] 0709 13:11:23.448086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.520158 (+ 72072us) service_pool.cc:224] Handling call
0709 13:11:23.520945 (+   787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.578640 (+ 57695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.578685 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.687044 (+108359us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.887061 (+200017us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:23.887099 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.887170 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.264476 (+2377306us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:26.414396 (+149920us) raft_consensus.cc:1685] finished
0709 13:11:26.414416 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.420137 (+  5721us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43323,"raft.queue_time_us":48195,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"spinlock_wait_cycles":19827968,"thread_start_us":199618,"threads_started":1,"wal-append.queue_time_us":330740}
W20260709 13:11:26.422467 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.422420 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.423557 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.424923 19299 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
W20260709 13:11:26.424945 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64151.9us
I20260709 13:11:26.425804 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.426254 19372 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:26.428421 19225 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:26.404739 25730 consensus_queue.cc:1243] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:26.404838 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 2926) took 1281 ms. Trace:
I20260709 13:11:26.403167 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.405402 25659 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.434984 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:26.406080 25751 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.408366 25638 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:26.413007 25440 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.334367 25793 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:26.416872 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.443230 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.443856 19295 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:26.329057 25450 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.365793 25838 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.432365 19371 rpcz_store.cc:276] 0709 13:11:25.123064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.123192 (+   128us) service_pool.cc:224] Handling call
0709 13:11:25.779234 (+656042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.779463 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.779486 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.779543 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:25.779589 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.779663 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.404631 (+624968us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400297f50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:26.404773 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508057856}
I20260709 13:11:26.405113 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:26.449332 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.433233 19373 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:26.348179 25737 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:11:26.348570 25629 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.441025 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.348263 25741 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.413998 25660 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:26.425113 25754 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:26.448252 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.457647 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.448596 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.430473 25805 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:26.430873 25678 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:26.455837 25713 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.067s	user 0.017s	sys 0.029s
I20260709 13:11:26.471125 19368 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:26.450004 19297 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:26.473095 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.433773 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.435431 25799 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:26.454278 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.454593 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:26.442826 25544 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:11:26.455506 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.458360 25754 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.441726 25638 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:26.460726 25805 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:26.447513 25793 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.469777 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.452093 25838 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.474745 19300 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:26.502354 25823 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.481578 19371 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:26.500093 25668 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.505774 19219 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:26.455317 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53678.9us
I20260709 13:11:26.509953 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:26.482004 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.510382 25668 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.510780 19219 raft_consensus.cc:2368] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:26.480859 25842 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:26.485920 25744 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.455590 19365 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:26.461369 25419 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:26.527091 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51016.7us
I20260709 13:11:26.479089 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:26.476989 25713 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.089s	user 0.017s	sys 0.029s
I20260709 13:11:26.447925 25814 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:26.533957 25832 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:11:26.533794 25695 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:26.460584 25660 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.512918 25805 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.500381 25741 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.477795 25673 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:26.542712 25673 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.543778 25660 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.507745 25838 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.457190 25735 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:11:26.485702 19894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1179) took 1001 ms. Trace:
I20260709 13:11:26.510082 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:26.519447 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.526012 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:26.528647 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49614.6us
I20260709 13:11:26.493784 25754 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.532312 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.583747 19219 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:26.584851 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.585383 25735 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:26.586179 25735 consensus_queue.cc:1243] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:26.477032 25347 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.551986 25731 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.586747 25347 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:26.587182 25347 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.569888 19894 rpcz_store.cc:276] 0709 13:11:25.484792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.484953 (+   161us) service_pool.cc:224] Handling call
0709 13:11:26.485523 (+1000570us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54006702d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:26.485639 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175098240}
I20260709 13:11:26.536109 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.588510 19218 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:26.588893 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.589398 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.590346 19218 raft_consensus.cc:2410] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:11:26.591096 19337 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:26.591149 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.555724 25327 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.590282 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.592778 19218 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:26.593482 25799 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:26.593959 25327 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.594007 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.595453 19218 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:26.596112 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:26.498457 25752 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.535079 25650 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:26.544920 25410 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.544515 25638 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.597646 25650 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:26.597787 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:26.598452 25638 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:26.598948 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.598722 25650 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.545348 25673 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.484283 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:26.546160 25751 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.546880 25839 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.603137 25839 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.603624 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.604532 19221 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:26.605437 25839 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.549659 25712 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.605664 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:26.606376 25836 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:11:26.550748 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.501435 25653 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.608273 19296 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:26.608485 19117 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.553735 25622 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.523913 25842 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:26.610332 19117 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.611186 25842 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.556574 25674 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.558483 25450 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.559603 25440 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.619242 25839 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.590322 25805 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.527592 25419 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.527909 25744 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.565269 25629 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:26.577101 25827 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.581243 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.626909 19220 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:26.583037 19339 leader_election.cc:400] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:26.585721 19219 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 13: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:26.501834 25659 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.595398 25741 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:26.594043 19294 raft_consensus.cc:2368] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:26.607465 19221 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:26.596824 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.530201 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:26.642647 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 112547us
I20260709 13:11:26.643100 19221 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:26.643338 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:26.617007 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 106996us
I20260709 13:11:26.644548 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:26.600059 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.620330 19216 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:11:26.645454 19216 pending_rounds.cc:85] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 13
I20260709 13:11:26.645713 19216 pending_rounds.cc:107] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:11:26.645968 19216 raft_consensus.cc:2889] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:26.623821 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 238883us
I20260709 13:11:26.647083 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.647574 25793 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.648025 25659 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:26.648512 25659 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:26.648877 25659 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:26.650599 25347 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.652367 19218 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:26.652279 25827 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.653862 19218 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:26.654534 25827 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.655225 19218 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:26.649750 25793 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:26.624349 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.627828 19339 leader_election.cc:403] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:26.657128 25741 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:26.657473 25629 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:26.614245 19117 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.656214 25842 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.658262 25741 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:26.636878 25744 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.589386 25731 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.660784 19295 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:26.662289 25754 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.662861 25638 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.626284 25419 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.663987 25805 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:26.657198 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 74367.6us
I20260709 13:11:26.655287 25827 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.666211 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.666661 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.659854 25347 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.640950 19220 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:26.683439 19300 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:26.662470 25842 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.667465 19373 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:26.636525 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.682981 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.637813 19223 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.668473 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.682533 19218 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:26.666822 19371 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:26.665391 25827 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.684921 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:26.662390 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.695355 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:26.689437 19374 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:26.690738 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.697546 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:26.693801 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:26.665482 25754 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.692684 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.696192 19369 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:26.695775 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.702772 19223 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:11:26.703650 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 870) took 1355 ms. Trace:
I20260709 13:11:26.705111 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.705931 19220 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:26.706754 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.709672 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.731273 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.748413 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:26.659245 19117 catalog_manager.cc:5697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 9 to 16, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.760658 19901 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:26.758770 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61340.2us
I20260709 13:11:26.704890 19223 rpcz_store.cc:276] 0709 13:11:25.347850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.349155 (+  1305us) service_pool.cc:224] Handling call
0709 13:11:25.349458 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.603755 (+254297us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5800873bd0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:11:26.637246 (+1033491us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002a6aa0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2aa1d 00007fe8d7e111a4 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419
0709 13:11:26.703328 (+ 66082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.703581 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554948736}
I20260709 13:11:26.732625 19894 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:26.762380 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:26.713454 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:26.688977 25629 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.662518 25838 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:26.730801 25663 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:11:26.731950 25751 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:26.706852 25410 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:26.767331 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52497.5us
I20260709 13:11:26.730746 25440 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:26.781445 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.781934 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:26.684623 25630 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:26.711380 25347 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.786499 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.750976 25805 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:26.731789 25450 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.764104 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.793654 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.813932 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.761407 25660 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.814271 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:26.814417 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:26.730985 25744 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:26.731228 25674 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.778885 25650 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:26.765367 25801 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:26.764535 25622 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:26.761250 25852 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.802320 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.803936 19299 raft_consensus.cc:2368] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:26.803992 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.731618 25595 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:11:26.731118 25678 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.788954 25751 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.832249 25751 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.817037 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.796056 25814 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:11:26.778729 25754 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:26.818290 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:26.818353 25450 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:26.795603 25440 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:26.805830 25347 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.800079 25630 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.825470 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.827392 19374 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:26.805364 25805 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.817963 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.821986 25744 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.815469 25674 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.815912 25566 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:26.819754 25638 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:26.820775 25650 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.872071 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:26.842788 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:26.919075 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102121us
I20260709 13:11:26.845332 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.837463 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:26.924266 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 98940.7us
I20260709 13:11:26.903467 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:26.911163 25855 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:26.858767 25848 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.864739 25450 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.948536 19219 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:26.940200 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:26.948894 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.923676 25630 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.836304 25660 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:26.923558 25440 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.923316 25805 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:26.836081 25659 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:26.950640 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105441us
I20260709 13:11:26.904412 25419 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.924849 25595 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:26.939760 25622 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.952037 25674 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.952538 25744 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.939419 25801 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:26.952572 19297 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:26.842077 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:26.956400 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.956950 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2544) took 1004 ms. Trace:
I20260709 13:11:26.903820 25827 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.963502 25327 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:26.955646 25806 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.909058 25838 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:26.959965 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.988870 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:26.836778 25730 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:26.926466 25566 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.981076 19296 rpcz_store.cc:276] 0709 13:11:25.952953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.609091 (+656138us) service_pool.cc:224] Handling call
0709 13:11:26.609368 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.609698 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:26.699503 (+ 89805us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.956458 (+256955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:26.956515 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:26.956569 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.956713 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.956893 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305,"prepare.queue_time_us":190058,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":198,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":5752,"thread_start_us":278120,"threads_started":2}
I20260709 13:11:26.990074 25566 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.991418 19296 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:11:26.963390 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 149056us
I20260709 13:11:26.993094 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:26.946767 25650 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.968647 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:26.992149 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2552) took 1006 ms. Trace:
I20260709 13:11:27.001127 19219 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.001250 19296 rpcz_store.cc:276] 0709 13:11:25.985976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.990616 (+1004640us) service_pool.cc:224] Handling call
0709 13:11:26.990996 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.991878 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.992082 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:26.950666 25643 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.942286 25678 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:26.938242 25347 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.963718 25660 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:27.012445 25660 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.016886 19223 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:26.989148 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.004637 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:27.027557 25678 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:27.040851 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51783.4us
I20260709 13:11:26.838507 19117 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 18, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.024814 19894 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:27.038295 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45275.1us
I20260709 13:11:26.962344 25848 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.040200 19219 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:27.044116 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.049098 19901 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:27.046211 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:26.982786 25801 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:26.987775 25595 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.056149 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.076031 19219 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:27.065151 25678 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:26.984022 25492 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:11:27.080778 25659 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.081015 25492 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:27.081393 25492 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:27.082191 25492 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.083112 25410 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.083424 25492 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.055410 25838 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.084532 25838 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:27.084992 25838 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.077072 25654 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.088548 25654 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:27.088671 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.088944 25654 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.005766 25819 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:27.089779 25819 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.090175 25819 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.055311 25801 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:27.092693 25678 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.094934 25678 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.047180 25780 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:11:27.005861 25730 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:27.095866 25730 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.037564 25814 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.096812 25814 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.097249 25814 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.097667 25814 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.099413 25751 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.100862 25852 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:27.028414 25754 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:11:27.102910 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.051246 25735 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:27.045516 25638 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:11:27.107556 25848 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.109020 19296 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:27.111842 25450 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.112529 25863 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:27.116415 25419 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.118486 19117 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.983366 25622 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.121783 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.140498 19218 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:27.142633 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:27.128894 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 83111.8us
I20260709 13:11:27.130417 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.145535 19219 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.148855 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.137048 25638 consensus_queue.cc:1243] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:11:27.154443 19296 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:27.147794 25852 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:27.167944 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.168737 19218 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.174163 19219 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:27.175616 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.149850 25660 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.186842 19219 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:27.194770 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.195485 19219 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:27.155653 25347 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.198531 19219 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:27.169667 25852 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:27.199393 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 153262us
I20260709 13:11:27.180088 25436 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.201792 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 157782us
I20260709 13:11:27.163681 25730 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.212373 19219 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:27.213413 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.213711 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.222153 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.222779 19374 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:27.224375 19371 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:27.223754 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.224903 19219 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:27.228860 25830 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.741s	user 0.000s	sys 0.006s
I20260709 13:11:27.228688 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.232331 19371 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.233851 19219 raft_consensus.cc:1240] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:27.233258 19218 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:27.239930 19218 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:27.240409 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 251948us
I20260709 13:11:27.245929 25283 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:27.252295 25283 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.253383 25283 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.253780 25819 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.254609 25283 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.211489 25436 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.257714 25436 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.259929 25735 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.244081 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 947) took 1681 ms. Trace:
I20260709 13:11:27.246652 25751 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.251291 25440 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.260242 19117 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 18, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 18 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:27.262964 25805 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.264005 25852 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.265424 25622 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.255867 25819 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.272030 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:27.289263 19902 rpcz_store.cc:276] 0709 13:11:25.563154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.563306 (+   152us) service_pool.cc:224] Handling call
0709 13:11:25.579611 (+ 16305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:25.716188 (+136577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.716234 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:25.718245 (+  2011us) log.cc:844] Serialized 52 byte log entry
0709 13:11:25.861782 (+143537us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:25.861825 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.861907 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.228310 (+1366403us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:27.232098 (+  3788us) raft_consensus.cc:1685] finished
0709 13:11:27.232117 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.244013 (+ 11896us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117,"raft.queue_time_us":171,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5466,"spinlock_wait_cycles":32716544,"thread_start_us":143240,"threads_started":1,"wal-append.queue_time_us":736350}
I20260709 13:11:27.298599 19901 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.235746 19219 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:27.236109 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.304193 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.305238 19374 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.307464 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.308261 19219 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:27.311002 19219 pending_rounds.cc:85] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 8
I20260709 13:11:27.311419 19219 pending_rounds.cc:107] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:11:27.311775 19219 raft_consensus.cc:2889] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.306553 25751 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260709 13:11:27.316773 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 172010us
W20260709 13:11:27.323700 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.322438 19901 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:27.290606 25871 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:27.323220 25870 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.324569 25852 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.292871 25801 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.332962 19371 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:27.321739 25867 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:27.299286 25814 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.336539 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2424) took 1055 ms. Trace:
I20260709 13:11:27.341470 19368 rpcz_store.cc:276] 0709 13:11:26.281195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.281312 (+   117us) service_pool.cc:224] Handling call
0709 13:11:26.289310 (+  7998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.471541 (+182231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.336315 (+864774us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400357354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:27.336485 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417360768}
I20260709 13:11:27.336602 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.344691 19371 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:27.345870 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.337873 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2545) took 1374 ms. Trace:
I20260709 13:11:27.346642 19300 rpcz_store.cc:276] 0709 13:11:25.963277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.609973 (+646696us) service_pool.cc:224] Handling call
0709 13:11:26.610919 (+   946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.689174 (+ 78255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.337612 (+648438us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54002e9854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:27.337813 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130462464}
W20260709 13:11:27.330003 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 108862us
I20260709 13:11:27.358194 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.359048 19368 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:27.367493 25880 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.368619 25817 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.393s	user 0.000s	sys 0.009s
I20260709 13:11:27.368343 25880 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.369038 19368 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:27.371260 25440 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.377959 25814 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.333580 25870 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.381495 25870 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.381098 25566 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.383460 25730 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.326248 25650 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.389063 19368 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:11:27.390336 25650 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.351737 25867 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.392895 25801 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.394765 25867 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.396677 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 875) took 1827 ms. Trace:
I20260709 13:11:27.397063 19224 rpcz_store.cc:276] 0709 13:11:25.569446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.569606 (+   160us) service_pool.cc:224] Handling call
0709 13:11:25.570036 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.570475 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.570518 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.578910 (+  8392us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.195927 (+1617017us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b18002cfc20. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:27.288979 (+ 93052us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:27.289030 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.289571 (+   541us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.396370 (+106799us) raft_consensus.cc:1685] finished
0709 13:11:27.396392 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.396615 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9513,"spinlock_wait_cycles":169580800,"thread_start_us":92835,"threads_started":1,"wal-append.queue_time_us":1753745}
I20260709 13:11:27.355786 25654 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.398950 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.400455 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2418) took 2282 ms. Trace:
I20260709 13:11:27.400555 25654 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.400892 19366 rpcz_store.cc:276] 0709 13:11:25.118025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.123459 (+  5434us) service_pool.cc:224] Handling call
0709 13:11:25.123850 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:25.192254 (+ 68404us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:25.232346 (+ 40092us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.029786 (+797440us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b18004346e0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8dbd8958f 00007fe8d4dc8571 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd
0709 13:11:26.130961 (+101175us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:26.158199 (+ 27238us) log.cc:844] Serialized 52 byte log entry
0709 13:11:26.158338 (+   139us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:26.158382 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.158447 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.327448 (+1169001us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:27.400220 (+ 72772us) raft_consensus.cc:1685] finished
0709 13:11:27.400243 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.400367 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398013,"prepare.queue_time_us":48416,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":397892,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":78354,"spinlock_wait_cycles":214813184,"thread_start_us":451923,"threads_started":1,"wal-append.queue_time_us":557848}
I20260709 13:11:27.403118 19366 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:27.405320 19366 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:27.405808 25630 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:27.398227 25864 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:27.393784 19117 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 9 to 18, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 18 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:27.415758 19224 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:27.413794 19296 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:11:27.413161 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.420915 19366 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:27.421746 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.383903 25566 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:27.422578 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.423115 19374 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:27.423028 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.432355 19224 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.389340 25805 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.433686 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.435266 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.436296 19374 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:27.438380 25622 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:27.439232 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:27.439801 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.414316 25838 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.448702 19296 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.451776 25622 consensus_queue.cc:1243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:27.465452 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.459342 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.466775 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.467166 19372 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:27.453608 19224 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:27.460326 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2423) took 1184 ms. Trace:
I20260709 13:11:27.459604 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.467466 19366 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:27.468603 19365 rpcz_store.cc:276] 0709 13:11:26.275997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.280500 (+  4503us) service_pool.cc:224] Handling call
0709 13:11:27.460129 (+1179629us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540012ded4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:27.460267 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240103808}
I20260709 13:11:27.461055 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.470618 19218 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.471498 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.472388 25673 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:27.472891 25827 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:27.455374 25880 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.473625 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 879) took 1040 ms. Trace:
I20260709 13:11:27.474056 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.474843 19222 raft_consensus.cc:2368] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14.
I20260709 13:11:27.475229 25827 raft_consensus.cc:2764] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:11:27.475652 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.476609 25827 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:27.465389 25678 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:27.478049 19222 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.478502 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.459877 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.460593 19369 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:27.463339 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.474086 19216 rpcz_store.cc:276] 0709 13:11:26.432760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.433302 (+   542us) service_pool.cc:224] Handling call
0709 13:11:26.445211 (+ 11909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.646394 (+201183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.473379 (+826985us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000762d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:27.473571 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401522048}
I20260709 13:11:27.480136 19374 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:27.482159 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.482738 19224 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:27.489483 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.477620 25678 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:27.502868 19117 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.493495 25838 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.454527 25805 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.495085 19374 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:27.511379 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:27.512267 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.513180 19374 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:27.514070 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.514585 19374 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:27.501338 25845 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.021s	user 0.000s	sys 0.003s
I20260709 13:11:27.510262 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.455253 25630 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.523590 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.460420 25737 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:27.497910 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.528503 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.529107 19224 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.530454 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.531402 19216 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:27.492903 19222 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:27.521668 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:27.533051 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.510550 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.518530 19218 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:27.534844 19365 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.522374 19339 leader_election.cc:400] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14.
I20260709 13:11:27.523939 19374 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:27.535856 19339 leader_election.cc:403] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.535356 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.536751 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.529124 19366 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.527791 25880 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:11:27.538547 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.538969 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.539114 19372 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.505448 25678 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.539856 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.541584 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.542996 19219 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.544672 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.522406 25887 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:11:27.547907 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.535883 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.550221 19374 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:27.551110 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.528301 25793 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:27.553042 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:27.554919 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:27.555299 19374 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.553711 19366 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:27.556536 25883 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:27.556069 19218 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:11:27.559046 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.559129 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.557902 19366 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:27.559983 19218 raft_consensus.cc:2368] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15.
I20260709 13:11:27.528896 25737 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:27.556623 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60143.3us
I20260709 13:11:27.560971 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.561055 19219 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:27.561882 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.542366 25838 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.565481 19374 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:27.569290 19365 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:27.565675 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.570629 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.570712 19372 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:27.570855 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.572059 19224 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:27.571893 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.547806 25622 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:27.574517 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2538) took 2156 ms. Trace:
I20260709 13:11:27.574977 19292 rpcz_store.cc:276] 0709 13:11:25.415850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.415976 (+   126us) service_pool.cc:224] Handling call
0709 13:11:27.571758 (+2155782us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000492d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:27.571891 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872790784}
I20260709 13:11:27.523746 25805 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.558286 25883 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.554620 25630 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:27.583580 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.573971 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.554987 25793 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:27.576058 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.567817 25801 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:27.573280 25867 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.621309 25867 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.623513 25867 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:27.558286 25754 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:11:27.624595 25754 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:27.625178 25754 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.625787 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 871) took 2277 ms. Trace:
I20260709 13:11:27.578341 25737 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.626904 25737 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.632985 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.633693 19297 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:27.634685 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.635289 19297 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:27.636375 25730 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:27.637300 25730 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.638394 25730 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.639972 19117 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.641841 25592 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:27.642230 25592 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:27.642269 19117 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 22, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 22 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:27.643159 25592 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.585417 19296 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:27.574700 25622 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:27.643936 19117 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 13 to 17, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 17 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:27.600400 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.601815 19292 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:27.558444 25259 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:11:27.645069 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.648872 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.636106 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.649855 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.645792 19898 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:27.647192 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.554224 25673 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:27.604996 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.603335 25793 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.609257 25678 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.652346 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.652756 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:27.653417 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.653831 25678 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.654229 19292 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:27.644369 25801 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.626220 25754 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.657377 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:27.626209 19217 rpcz_store.cc:276] 0709 13:11:25.348193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.349460 (+  1267us) service_pool.cc:224] Handling call
0709 13:11:26.043584 (+694124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.043930 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.043959 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.044445 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.184605 (+140160us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:26.456326 (+271721us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.457879 (+  1553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.457968 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.500612 (+1042644us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:27.540728 (+ 40116us) raft_consensus.cc:1685] finished
0709 13:11:27.546100 (+  5372us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.625599 (+ 79499us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400437e50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:27.625728 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11503,"prepare.queue_time_us":350409,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1950,"raft.run_cpu_time_us":3686,"raft.run_wall_time_us":22930,"spinlock_wait_cycles":1652843776,"thread_start_us":389181,"threads_started":2,"wal-append.queue_time_us":397016}
I20260709 13:11:27.652002 19297 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:11:27.616760 25883 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.636452 25630 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.639254 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:27.658967 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.660552 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.660635 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 973) took 1915 ms. Trace:
I20260709 13:11:27.646443 19117 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:27.646543 25824 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 1.160s	user 0.003s	sys 0.000s
I20260709 13:11:27.665068 19296 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:27.664734 19117 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:27.666036 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.602437 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:27.663743 19293 rpcz_store.cc:276] 0709 13:11:25.744859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.745502 (+   643us) service_pool.cc:224] Handling call
0709 13:11:25.745826 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.798232 (+ 52406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.798277 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.798334 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:25.798377 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.660436 (+1862059us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b54001d2254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:27.660480 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.660585 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119928576}
I20260709 13:11:27.646202 25892 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:27.644143 25592 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.666936 25892 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:27.667099 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.667659 19293 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.646905 25805 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:27.644563 25891 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:27.645066 25868 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:27.661520 25867 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:11:27.672468 25868 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:27.673183 19299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2555) took 1686 ms (client timeout 2187 ms). Trace:
W20260709 13:11:27.673580 19299 rpcz_store.cc:269] 0709 13:11:25.986758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.425601 (+438843us) service_pool.cc:224] Handling call
0709 13:11:27.672988 (+1247387us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54003f16d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:27.673126 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867687296}
I20260709 13:11:27.674546 25868 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:27.661358 25492 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:11:27.680068 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:27.683424 19293 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:27.647684 19218 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:27.612035 19216 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:27.584460 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.644855 25622 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.685004 19219 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:11:27.702939 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.706135 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.667379 25892 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:27.685778 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 101432us
I20260709 13:11:27.674595 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.686641 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.711874 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.686259 19117 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 15 to 19, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 19 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:27.688465 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.714339 19299 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:27.714295 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.715307 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.715909 19292 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:27.717598 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.718307 19299 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:27.712925 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.721004 19117 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 15 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 20 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:27.725998 19297 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:27.728183 19297 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:27.729672 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.730816 19293 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:11:27.731750 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.681371 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.662894 25754 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.702397 25259 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:27.725016 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.735142 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:27.735950 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.736783 19297 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:27.738483 19296 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:27.740417 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.740231 19117 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:27.742540 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.744809 19117 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:27.743407 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94849.3us
I20260709 13:11:27.748687 19117 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.759517 19117 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 16 to 19, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 19 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:27.745870 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 98770.5us
I20260709 13:11:27.720471 25678 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:27.733795 25805 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:27.745239 25842 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:27.667315 25630 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.775157 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1178) took 2357 ms. Trace:
I20260709 13:11:27.763228 19117 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:27.779359 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.751107 25566 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:27.762859 25640 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:27.676456 25801 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.734599 25838 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:11:27.763159 25259 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.797696 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 970) took 2058 ms. Trace:
I20260709 13:11:27.801826 19291 rpcz_store.cc:276] 0709 13:11:25.739516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.739856 (+   340us) service_pool.cc:224] Handling call
0709 13:11:25.740265 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.335097 (+594832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.796882 (+1461785us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54001bf654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:27.797614 (+   732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223315840}
I20260709 13:11:27.772686 25678 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:27.801357 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.782688 25805 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.803287 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:27.785291 19903 rpcz_store.cc:276] 0709 13:11:25.417350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.417519 (+   169us) service_pool.cc:224] Handling call
0709 13:11:25.482077 (+ 64558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.495989 (+ 13912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.496018 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.503426 (+  7408us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.787371 (+283945us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:25.787428 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.787520 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.627900 (+1840380us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:27.772132 (+144232us) raft_consensus.cc:1685] finished
0709 13:11:27.772176 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.775071 (+  2895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13554,"raft.queue_time_us":15474,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9127,"spinlock_wait_cycles":43914624,"thread_start_us":250901,"threads_started":1,"wal-append.queue_time_us":932641}
I20260709 13:11:27.744205 25673 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.789719 19117 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 9, term changed from 11 to 14, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to <none>, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added, now has a pending config: VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194), VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 14 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:27.790233 25842 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.802639 25640 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.796212 25566 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:27.817705 19117 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.830097 25900 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:11:27.868129 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 302490us
I20260709 13:11:27.839607 19117 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 13, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 13 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:27.869110 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:27.874238 19263 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:27.882304 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 196305us
I20260709 13:11:27.883282 19293 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:27.884284 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:27.881562 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:27.900111 19117 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:27.884786 25896 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:11:27.907971 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102774us
I20260709 13:11:27.908666 19117 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 12 to 13, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 13 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:27.911540 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:27.899389 25838 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:27.928500 19266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.866s (SENT) [suppressed 9 similar messages]
I20260709 13:11:27.935436 25674 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:27.901440 25640 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.865343 25678 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:27.950572 25347 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:27.952860 25906 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:11:27.953406 25712 raft_consensus.cc:2764] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:11:27.956007 25851 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.421s	user 0.004s	sys 0.000s
I20260709 13:11:27.958555 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3230) took 1281 ms. Trace:
I20260709 13:11:27.959149 19223 rpcz_store.cc:276] 0709 13:11:26.676778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.939269 (+262491us) service_pool.cc:224] Handling call
0709 13:11:27.958258 (+1018989us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b54001d5454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:27.958474 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131880320}
I20260709 13:11:27.961127 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:27.962270 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 2954) took 1763 ms (client timeout 1866 ms). Trace:
W20260709 13:11:27.962776 19370 rpcz_store.cc:269] 0709 13:11:26.199147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.960775 (+1761628us) service_pool.cc:224] Handling call
0709 13:11:27.962193 (+  1418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:27.964588 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1169) took 3948 ms. Trace:
I20260709 13:11:27.967233 19367 rpcz_store.cc:276] 0709 13:11:24.016601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.016868 (+   267us) service_pool.cc:224] Handling call
0709 13:11:24.020570 (+  3702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.024548 (+  3978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.024595 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.608936 (+1584341us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18004b3280. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a
0709 13:11:26.294913 (+685977us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b2c001323f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:26.295566 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.452751 (+157185us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:26.452790 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.452853 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.955278 (+1502425us) spinlock_profiling.cc:243] Waited 904 us on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:27.964283 (+  9005us) raft_consensus.cc:1685] finished
0709 13:11:27.964317 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.964509 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3539,"spinlock_wait_cycles":30368640,"thread_start_us":156758,"threads_started":1,"wal-append.queue_time_us":238652}
W20260709 13:11:27.980842 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 79334.8us
I20260709 13:11:27.868458 25259 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.983471 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:27.985476 25663 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:11:27.988430 25741 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:27.925892 25685 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.896373 25805 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:27.991535 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:27.997155 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 99461.1us
I20260709 13:11:27.965363 25780 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.991212 19896 raft_consensus.cc:2376] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21. Re-sending same reply.
I20260709 13:11:27.936082 25674 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:27.904121 25842 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:28.003054 19896 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1183) took 1930 ms (client timeout 1968 ms). Trace:
W20260709 13:11:28.004199 19896 rpcz_store.cc:269] 0709 13:11:26.073073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.983139 (+1910066us) service_pool.cc:224] Handling call
0709 13:11:28.002994 (+ 19855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:27.990715 25492 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:27.984210 25907 raft_consensus.cc:2764] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:11:27.997992 25741 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:27.912086 25566 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:28.006366 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 94924.2us
I20260709 13:11:28.008466 25492 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:28.005679 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.033118 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:28.035954 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:28.009104 25793 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:28.040402 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53786.3us
W20260709 13:11:28.035197 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 106738us
I20260709 13:11:28.043498 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.044875 25916 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:11:28.048563 25905 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:11:28.038990 25910 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:28.060494 25910 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:28.060925 25910 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:28.064281 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.065666 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.008105 25780 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.072108 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:28.080323 25912 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:28.080966 19296 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:28.081037 25912 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:28.081838 25912 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:28.086905 25663 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.087576 25663 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.088053 25663 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.011708 25801 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:11:28.092657 25805 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:28.093091 25805 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.094060 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.093981 25805 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.095135 25907 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:28.095647 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.095153 25805 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.097383 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.098489 25909 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:28.099382 25909 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:28.049094 25685 raft_consensus.cc:2764] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:28.099535 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.111773 25883 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:28.113687 25868 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.113574 25883 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.114229 25907 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.114187 25868 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.114560 25915 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:28.115286 25741 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.116566 25868 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.115823 25883 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.114883 25907 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:28.117076 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.128540 25907 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.129575 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.055769 25892 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.132449 25892 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.133374 25911 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:28.133993 25911 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.134403 25911 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.116621 25741 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.136667 25909 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:28.137212 25909 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.137612 25909 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:28.118160 25780 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.077138 25918 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:28.140579 25918 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.140954 25918 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.123670 25793 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.147256 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.125169 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:28.118304 25492 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.049242 25674 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:28.127942 19899 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.162837 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.114301 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.164465 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.123749 25663 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:28.166978 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52767us
I20260709 13:11:28.169308 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:28.169942 19224 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:28.173677 25674 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.146399 25912 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.177203 25912 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.177336 25827 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.178153 25917 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.180759 25663 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.184576 25780 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:28.185137 25780 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:28.186002 25780 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.188762 25868 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:28.190249 19295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36770 (request call id 978) took 2391 ms (client timeout 2715 ms). Trace:
W20260709 13:11:28.190626 19294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2542) took 2250 ms (client timeout 1927 ms). Trace:
W20260709 13:11:28.191175 19294 rpcz_store.cc:269] 0709 13:11:25.939986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.404850 (+464864us) service_pool.cc:224] Handling call
0709 13:11:28.190371 (+1785521us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003f20d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:28.190541 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331108736}
I20260709 13:11:28.196491 19297 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:28.198086 25880 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:28.198516 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:28.198604 25880 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:28.200343 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 678096us
I20260709 13:11:28.203156 19370 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:28.204955 19371 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:28.205437 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.206874 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:28.207695 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.209977 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.215936 19371 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:28.199852 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:28.190666 19295 rpcz_store.cc:269] 0709 13:11:25.798649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.444555 (+645906us) service_pool.cc:224] Handling call
0709 13:11:28.190056 (+1745501us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002b7ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:28.190193 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420489472}
I20260709 13:11:28.221660 19373 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:11:28.223513 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55078.5us
W20260709 13:11:28.227670 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.227777 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:28.228478 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.224802 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.231403 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:28.233235 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:28.233779 19370 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.237950 19899 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:28.242693 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.247818 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.166631 25892 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.171646 25907 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.258226 25909 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.272820 25912 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:28.226174 25595 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:28.266065 19371 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:28.226542 25852 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 13. Current term is 14.
I20260709 13:11:28.274394 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:28.226840 25663 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.277094 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:28.289597 19224 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:28.279973 19222 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:28.280694 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.293704 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 60763us
I20260709 13:11:28.294246 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.246496 25917 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.275497 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.297158 19217 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:28.294329 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:28.297514 19295 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.266467 25839 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:28.230123 25638 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:28.246698 25678 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.264310 19294 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:28.274880 25673 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:28.305063 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102905us
I20260709 13:11:28.199826 25880 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.312557 25880 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.246496 25440 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:11:28.287304 19370 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:28.264992 25654 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:11:28.319000 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:28.311146 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.264932 25650 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:28.248085 25801 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:28.331210 19294 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:11:28.342553 19370 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:28.273969 25685 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:11:28.342025 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:28.344280 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.353826 19217 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:28.355249 19294 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 22. Ops: []
I20260709 13:11:28.350905 19295 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:28.293497 25827 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:11:28.358085 19295 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:28.292759 25892 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:11:28.299526 25595 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.359117 25347 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:28.340490 25915 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:11:28.366288 25660 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:28.368703 25928 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:28.371552 25595 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.343408 25678 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:28.319545 25663 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:11:28.364123 25805 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:28.372612 25842 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:11:28.369578 25926 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:28.374471 25744 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:28.305401 25903 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:28.321547 25917 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:11:28.370211 25347 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.373137 25842 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.367841 25630 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:28.369925 19295 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:28.352348 25852 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:28.374854 25744 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:28.344447 25544 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:28.385591 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2539) took 2969 ms. Trace:
I20260709 13:11:28.387310 19340 leader_election.cc:400] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:28.299901 25911 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.405980 19340 leader_election.cc:403] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:28.405849 19298 rpcz_store.cc:276] 0709 13:11:25.416147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.416445 (+   298us) service_pool.cc:224] Handling call
0709 13:11:25.416750 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.473833 (+ 57083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.473865 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.938687 (+1464822us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b180046a7a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a
0709 13:11:28.193347 (+1254660us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b2c0000e678. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:28.193963 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.247274 (+ 53311us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:28.247334 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.247433 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.385305 (+137872us) raft_consensus.cc:1685] finished
0709 13:11:28.385335 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.385517 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70873,"raft.queue_time_us":59306,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":535,"spinlock_wait_cycles":16964096,"thread_start_us":52908,"threads_started":1,"wal-append.queue_time_us":102805}
I20260709 13:11:28.315171 25638 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.391142 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:28.364388 25622 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.651s	user 0.014s	sys 0.001s
I20260709 13:11:28.407189 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:28.412390 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.413658 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.393821 25347 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.417876 19298 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:28.419282 19340 leader_election.cc:400] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:28.422063 19903 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:11:28.422739 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:28.423470 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:28.421864 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:28.424769 19217 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:28.433149 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.436281 19219 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:28.425992 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:28.441229 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 147056us
I20260709 13:11:28.401005 25678 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:28.442611 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:28.401307 25892 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:28.443828 19218 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:11:28.370245 25910 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.449486 19295 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:28.440428 25852 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:28.442552 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:28.421375 25327 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:28.429705 25751 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19.
I20260709 13:11:28.423847 25798 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:28.442461 25259 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.460583 25630 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.462769 25544 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:28.403527 25938 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:11:28.546850 25824 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:11:28.565644 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 123097us
I20260709 13:11:28.460301 25892 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:28.463692 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.565698 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.594425 19295 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:28.594511 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.425293 25622 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.550235 19221 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:28.567888 25630 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:28.465507 25918 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.545025 25915 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:28.573107 25650 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:28.577261 25933 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:11:28.581077 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2430) took 1090 ms. Trace:
I20260709 13:11:28.613152 19293 rpcz_store.cc:276] 0709 13:11:27.491090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.744885 (+253795us) service_pool.cc:224] Handling call
0709 13:11:27.746765 (+  1880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.884064 (+137299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.580828 (+696764us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002b7fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:28.581011 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313368832}
I20260709 13:11:28.614787 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.567708 25544 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.581655 25911 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.545332 25653 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:11:28.556754 25924 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:11:28.464092 25660 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:28.586745 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.507918 25327 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:28.566550 25817 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:28.606645 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:28.602281 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 140048us
I20260709 13:11:28.647589 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.607481 19295 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
W20260709 13:11:28.601594 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 211385us
W20260709 13:11:28.649546 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.574189 25754 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.002s
I20260709 13:11:28.588734 25492 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.582459 25793 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:28.632115 25450 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:28.616722 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2606) took 2050 ms. Trace:
I20260709 13:11:28.586724 25909 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.576922 25938 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:28.591871 25678 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.562217 25685 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:11:28.608147 25913 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:28.677104 25913 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:28.601485 25630 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.667471 25903 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:11:28.679551 25903 consensus_queue.cc:1243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:28.608352 25915 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.611280 25592 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:28.686949 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:28.687692 19896 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:28.651477 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44995.3us
I20260709 13:11:28.679536 25918 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:28.688642 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.688771 25566 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:28.689965 19339 leader_election.cc:400] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15.
I20260709 13:11:28.690321 19339 leader_election.cc:403] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:11:28.616278 25801 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.633395 25544 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.694783 25936 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:28.695390 25936 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:28.695495 25751 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15.
I20260709 13:11:28.655979 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.696338 25936 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.697506 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.699694 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:28.569187 25931 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.082s
I20260709 13:11:28.616118 25939 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.543503 25899 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:11:28.702580 25622 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.659866 19368 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:28.702852 25899 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:28.703313 25899 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:28.662081 19292 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:28.662097 19221 rpcz_store.cc:276] 0709 13:11:26.566176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.656236 (+ 90060us) service_pool.cc:224] Handling call
0709 13:11:28.549740 (+1893504us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:28.550011 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.607544 (+ 57533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.616653 (+  9109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58781568}
I20260709 13:11:28.704591 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:28.705199 19897 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.545854 25744 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.647149 25327 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.588752 25852 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.664397 25908 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.708868 25908 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.657312 25793 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.655887 25440 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.671485 25638 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.672474 25910 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.727553 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:28.684628 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:28.729251 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 988) took 1068 ms. Trace:
I20260709 13:11:28.683722 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:28.686362 25915 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:28.687044 25592 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.648545 19371 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:28.689482 25566 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.556636 25842 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.691246 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:28.715607 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.659114 25814 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:28.732142 19894 raft_consensus.cc:2368] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
W20260709 13:11:28.737160 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.733884 19897 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:28.649830 25660 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.667899 25938 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:28.739724 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48545.1us
I20260709 13:11:28.725795 25754 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.723513 25801 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.731730 25805 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:28.746129 25946 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:11:28.750671 25347 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.752766 25947 consensus_queue.cc:1059] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:28.768981 25947 raft_consensus.cc:3055] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:28.769899 25947 raft_consensus.cc:740] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.771035 25947 consensus_queue.cc:260] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.754012 25566 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.755209 25660 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.756352 25938 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.773571 25938 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.773926 25347 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.772040 25544 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.740971 25638 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.776183 25544 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.757500 25793 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.777603 25793 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.778017 25650 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:28.778971 25883 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:28.747479 25630 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.743711 25754 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:28.780836 25754 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.782395 25883 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:28.782805 25883 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.783521 25883 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.761168 25908 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.738008 25814 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.784483 25883 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.785373 25814 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.761811 25915 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.704125 25899 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.790656 25899 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.789535 25915 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.796351 25814 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.796891 25947 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:28.708276 19221 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:28.656567 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.713346 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:28.842790 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 129354us
I20260709 13:11:28.844034 19293 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:28.845355 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:28.846383 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:28.729830 19294 rpcz_store.cc:276] 0709 13:11:27.660390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.356156 (+695766us) service_pool.cc:224] Handling call
0709 13:11:28.356739 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.357030 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:28.368699 (+ 11669us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.728762 (+360063us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.728836 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:28.728906 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.729001 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.729175 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5749,"prepare.queue_time_us":11929,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":34432,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10623,"thread_start_us":353791,"threads_started":2,"wal-append.queue_time_us":306096}
I20260709 13:11:28.851706 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:28.852053 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.852731 19295 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.738164 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:28.856492 19902 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23. Ops: [22.18-22.18]
W20260709 13:11:28.856742 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 118470us
I20260709 13:11:28.762617 25592 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.860859 25685 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:28.861655 25685 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:28.867581 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2415) took 1409 ms. Trace:
I20260709 13:11:28.868234 19292 rpcz_store.cc:276] 0709 13:11:27.458417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.731420 (+273003us) service_pool.cc:224] Handling call
0709 13:11:28.867109 (+1135689us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54001bfb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:28.867335 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136967936}
I20260709 13:11:28.869732 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:28.871893 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:28.872010 25674 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:28.873217 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:28.873915 25595 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:28.874482 25595 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:28.875001 25595 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.876929 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:28.878078 19894 raft_consensus.cc:2368] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:28.881479 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:28.882541 19221 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.883860 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:28.885457 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.885332 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:28.886277 19217 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:28.890457 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.890854 25638 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.893648 25638 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:28.897203 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:28.892771 25566 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:28.863562 25685 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:28.898964 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1176) took 2073 ms. Trace:
I20260709 13:11:28.900835 19292 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:28.902310 25630 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:28.908805 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:28.873250 19220 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:28.881481 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2440) took 1387 ms. Trace:
I20260709 13:11:28.914973 19221 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:28.917730 25566 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.920676 25566 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.918444 19369 rpcz_store.cc:276] 0709 13:11:26.825744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.825965 (+   221us) service_pool.cc:224] Handling call
0709 13:11:27.460260 (+634295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.479765 (+ 19505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.898406 (+1418641us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540012ded0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:28.898689 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382791936}
I20260709 13:11:28.925958 25592 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:28.919485 19296 rpcz_store.cc:276] 0709 13:11:27.493763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.747905 (+254142us) service_pool.cc:224] Handling call
0709 13:11:27.749969 (+  2064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.081654 (+331685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.880784 (+799130us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400049cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:28.881245 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760705792}
W20260709 13:11:28.932765 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47591.6us
I20260709 13:11:28.936220 19369 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:28.950181 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 1110) took 1308 ms. Trace:
I20260709 13:11:28.950827 19899 rpcz_store.cc:276] 0709 13:11:27.637029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.638974 (+  1945us) service_pool.cc:224] Handling call
0709 13:11:28.934011 (+1295037us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540056d454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:28.945187 (+ 11176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067903872}
I20260709 13:11:28.953701 25663 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.954322 25663 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:28.954847 25663 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.936149 25130 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:28.918707 25640 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:11:28.972287 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:28.964979 25130 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:28.969053 25638 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:28.991693 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:28.993496 25130 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:28.998505 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 89979.1us
I20260709 13:11:29.006227 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:29.009397 25909 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:29.010512 25909 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:29.011288 25909 consensus_queue.cc:1243] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:29.013036 19221 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:29.014405 19188 leader_election.cc:400] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:29.015051 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.015975 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:29.017304 25903 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:29.018031 25903 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:29.018577 19188 leader_election.cc:400] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:29.018973 19188 leader_election.cc:403] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:29.020594 25678 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:29.020677 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:29.021104 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.028636 19369 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:29.019294 25903 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.030685 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.032078 25130 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:29.034261 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.034492 19899 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:29.035784 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:29.036115 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 139394us
I20260709 13:11:29.036550 25901 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:29.037038 25901 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:29.037488 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:29.038443 25638 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:29.038255 25901 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:29.043330 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.044075 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 103576us
I20260709 13:11:29.044358 25938 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.004262 25595 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.050424 19372 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:29.049278 25592 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:29.051338 25592 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:29.052098 25912 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:29.052623 25912 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:29.039959 25901 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.064097 25674 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.067195 19373 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:29.053169 25592 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:29.071331 25592 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:29.071575 19368 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:29.072831 25592 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.074555 25592 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:29.074856 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:29.076489 25938 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:29.076865 19369 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:29.077116 25938 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:29.078861 25695 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:29.078617 25938 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.080541 25640 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:29.081357 25640 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.045306 25868 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:29.087939 25868 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:29.088256 19291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2576) took 1304 ms (client timeout 1506 ms). Trace:
W20260709 13:11:29.088799 19291 rpcz_store.cc:269] 0709 13:11:27.783907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.803046 (+ 19139us) service_pool.cc:224] Handling call
0709 13:11:29.087725 (+1284679us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54002e9354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:29.088016 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913877888}
I20260709 13:11:29.090709 25868 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.064124 25907 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.066599 25754 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.099803 19368 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:29.101058 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.102011 25754 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:29.106685 25839 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:29.107327 25839 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:29.091336 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 981) took 2263 ms. Trace:
I20260709 13:11:29.110740 19300 rpcz_store.cc:276] 0709 13:11:26.829159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.348013 (+518854us) service_pool.cc:224] Handling call
0709 13:11:27.372585 (+ 24572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.375026 (+1002441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.375059 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.375098 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:28.375134 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.090781 (+715647us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540028ad54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:29.090857 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.091123 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304899328}
I20260709 13:11:29.112416 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:29.113507 19902 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:11:29.053951 25912 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.118561 25892 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.087020 19217 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:29.122689 19295 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:29.119976 25892 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:29.136873 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.079991 25695 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:29.102330 19222 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:29.145865 19222 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:29.150027 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.129769 25638 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.156637 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.158401 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:29.159171 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57181.6us
I20260709 13:11:29.161175 19265 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.161530 25659 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:29.163110 25659 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:29.163517 25659 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:29.164352 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:29.164621 25814 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:29.165227 25814 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:29.161168 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:29.167043 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.167459 19294 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 23: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:29.168501 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.169283 19294 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:29.169409 25909 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:29.169670 25948 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.170302 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:29.170146 25909 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.170984 19294 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:29.170746 25948 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.172221 25744 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:29.174239 25566 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.159778 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:29.133508 25640 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.176932 19300 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:29.175199 25622 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:29.145524 25695 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:29.178457 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48374.6us
I20260709 13:11:29.183545 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.184108 19366 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:29.184696 19291 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.185251 25622 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:29.186321 25922 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.051s	user 0.003s	sys 0.015s
I20260709 13:11:29.186195 25839 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.187808 25622 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.188973 19292 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23. Ops: [19.11-22.13]
I20260709 13:11:29.166424 25814 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.190012 25839 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.191699 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:29.202852 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.202447 19291 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:29.204037 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.204530 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.192245 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:29.183458 25659 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:29.193601 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44686.6us
I20260709 13:11:29.213163 25659 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:29.213271 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.214195 19292 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:29.216522 19369 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:29.216634 25867 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:29.217259 25867 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:29.218494 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.218307 25867 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.219183 19339 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:29.220486 25737 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:29.221668 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.223531 19368 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.209012 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.225498 19373 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:29.226874 19370 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:29.226665 25638 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.224555 19222 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.228813 19293 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: [18.13-20.14]
I20260709 13:11:29.228875 19222 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:29.230172 19293 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.235828 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.237066 19291 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:11:29.238067 25947 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:29.238507 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:29.240653 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48584us
I20260709 13:11:29.242093 25909 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.242522 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.242767 19374 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:29.244540 19365 raft_consensus.cc:2410] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260709 13:11:29.242444 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.248479 25920 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.252511 19294 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
W20260709 13:11:29.242408 25961 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:11:29.229123 25638 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:29.255976 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:29.263728 19293 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:11:29.250792 25793 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:11:29.271163 25566 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.267527 19291 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:29.262710 25659 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:29.292613 25798 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.013s	sys 0.011s
I20260709 13:11:29.302774 19294 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:29.280210 25938 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:29.303814 25798 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.014s	sys 0.011s
I20260709 13:11:29.301600 25595 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:29.296535 25909 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:29.331523 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 95268.3us
I20260709 13:11:29.338109 19370 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:29.345017 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.316617 25798 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:29.327569 25901 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:11:29.353454 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.332337 25793 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:29.357779 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:29.320088 25695 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.357688 25595 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.358999 25327 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.012s
I20260709 13:11:29.358243 25909 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.380285 25965 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:29.380930 25450 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.381337 25968 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:29.381829 25909 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:29.382856 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.383500 19374 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.384137 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:29.384222 25798 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.386749 19366 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:11:29.388268 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.388361 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.388525 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.389034 19373 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.390444 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.392043 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.392776 19370 raft_consensus.cc:2368] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:29.393000 25938 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:29.381515 25450 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.393802 25938 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:29.395121 25450 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:29.395880 25450 consensus_queue.cc:1059] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:29.393745 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.397372 25650 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:29.397835 25650 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:29.399000 25650 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:29.403378 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.409025 25654 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:29.410120 25900 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:29.410689 19903 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:29.411552 19219 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:11:29.378015 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57612.1us
I20260709 13:11:29.413599 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:29.410555 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:29.421721 19374 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:29.422740 19220 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:11:29.379858 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.352231 25663 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.429666 19370 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:11:29.431774 25440 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:29.432271 25440 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:29.433804 25935 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.838s	user 0.002s	sys 0.000s
I20260709 13:11:29.433455 25440 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.434100 25868 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:29.435051 25440 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.437443 25638 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:29.438218 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.438568 25938 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:29.439558 25870 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:29.440356 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.442695 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:29.447887 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.448977 25327 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.449693 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.450904 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.451213 25327 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.452559 19296 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:11:29.438215 25638 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:11:29.414429 25595 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.438300 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2451) took 1236 ms. Trace:
I20260709 13:11:29.461488 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.468928 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:29.451928 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:29.474085 19374 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:29.475319 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:29.475910 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.440474 25870 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:29.479242 19371 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.499771 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:29.504809 19224 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:29.457882 19367 rpcz_store.cc:276] 0709 13:11:28.201624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.201913 (+   289us) service_pool.cc:224] Handling call
0709 13:11:28.202216 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.292921 (+ 90705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.292951 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.293381 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.438953 (+145572us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:28.438989 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.439049 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.432955 (+993906us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:29.437842 (+  4887us) raft_consensus.cc:1685] finished
0709 13:11:29.437862 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.438124 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116469,"raft.queue_time_us":102095,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6813,"spinlock_wait_cycles":23720832,"thread_start_us":144917,"threads_started":1,"wal-append.queue_time_us":268190}
I20260709 13:11:29.506119 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.507620 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.414839 25793 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.517998 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.481694 25870 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:29.486207 25595 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:29.521488 19370 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:11:29.543256 19373 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:29.480964 25938 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:11:29.544589 19367 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.511098 25909 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.545111 19371 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:29.546923 19374 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:11:29.549479 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 112201us
I20260709 13:11:29.546517 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:29.551991 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52320.5us
I20260709 13:11:29.552800 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:29.555522 19368 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:29.557482 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3261) took 1197 ms. Trace:
I20260709 13:11:29.519376 25327 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:29.557796 19222 rpcz_store.cc:276] 0709 13:11:28.352637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.352930 (+   293us) service_pool.cc:224] Handling call
0709 13:11:28.353307 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.102078 (+748771us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5400154620. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb71c0 00007fe8d7eb8231 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c
0709 13:11:29.534721 (+432643us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:29.534787 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:29.534840 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:29.534883 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.545615 (+ 10732us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.550153 (+  4538us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3528,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":13295,"spinlock_wait_cycles":154144000}
I20260709 13:11:29.562304 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.564915 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.566766 19218 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.555162 25938 consensus_queue.cc:1243] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:29.567514 19223 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:29.568840 25946 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:11:29.570444 25440 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:29.571687 25891 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:11:29.574854 25916 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:11:29.561437 25659 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.556753 25901 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.577610 25901 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:29.580930 25827 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:11:29.581941 25870 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.583719 25870 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:29.584594 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 106336us
I20260709 13:11:29.586709 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:29.587787 25867 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:29.558642 25347 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.587988 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:29.604579 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.592306 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44667.4us
I20260709 13:11:29.594157 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.630250 19903 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:29.630052 25327 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:29.636420 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.636998 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.637401 19223 raft_consensus.cc:2410] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:11:29.638293 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.639443 19300 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.641266 25650 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:29.644021 25852 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.588228 25867 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.589389 25793 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:29.597337 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.684518 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.696695 25852 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.698021 19222 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 13:11:29.689512 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 131374us
I20260709 13:11:29.697084 25867 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.561902 25909 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.708146 25852 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:29.709048 19300 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:11:29.704718 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116856us
W20260709 13:11:29.710083 25977 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:11:29.712010 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.714135 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.716722 19370 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:29.721117 19370 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:29.706110 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.707496 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:29.694981 25901 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:29.628525 25891 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:11:29.631181 25946 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:11:29.732656 19218 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:29.736248 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.738155 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:29.729058 19370 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:29.738204 19218 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:11:29.745736 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.746192 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.748656 19300 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:29.749579 19295 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:29.726465 25868 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:29.753474 25868 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:29.727615 25663 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:29.755590 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.754330 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.744599 25852 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.763876 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:29.768136 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.768959 19223 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:29.773988 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.734064 25622 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:29.780260 19298 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:11:29.760213 25868 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:29.759596 25678 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:29.784457 19218 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.777333 25920 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.889005 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:29.896088 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 122209us
I20260709 13:11:29.886204 25653 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.922482 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 358017us
I20260709 13:11:29.924122 19218 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:29.888132 25814 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.781440 25685 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
W20260709 13:11:29.942605 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53429.5us
I20260709 13:11:29.936957 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.938686 19265 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.933624 25805 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.899734 25948 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:29.886682 25622 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.965466 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.900848 25920 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:29.969415 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:29.970475 25685 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.934198 25695 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.942088 25900 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.895905 25678 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.975003 19216 pending_rounds.cc:85] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 11
I20260709 13:11:29.904642 25852 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:29.969559 25978 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:11:29.963765 19223 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 9: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:29.971189 25685 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:29.968716 25592 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.012s
I20260709 13:11:29.982511 19216 pending_rounds.cc:107] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:11:29.973433 25327 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:30.024686 19216 raft_consensus.cc:2889] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:30.055496 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.989609 25685 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:29.987540 25903 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:30.035723 25983 log.cc:927] Time spent T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 13:11:30.069636 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 156004us
W20260709 13:11:30.070251 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 104893us
W20260709 13:11:30.082733 25994 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:11:29.979831 25867 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.101792 25867 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:30.085035 25978 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:11:30.085667 25984 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:29.967115 25653 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:29.989404 25805 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.084453 25998 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:30.105948 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 169080us
I20260709 13:11:30.108837 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:29.989329 25900 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:30.104490 25744 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.932s	user 0.006s	sys 0.007s
I20260709 13:11:30.122080 25805 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.134867 25805 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.135294 19370 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:30.134914 19191 leader_election.cc:400] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:30.135926 25998 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:30.136387 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.136744 25685 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.129694 25916 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:30.138151 25685 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:30.139727 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45735.2us
I20260709 13:11:30.141798 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:30.143062 19265 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:30.146353 25955 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.146903 25955 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.147871 25916 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.148579 25916 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:30.149015 25916 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:30.150668 25678 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.150072 25916 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.145615 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:30.137063 19370 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:30.149070 25955 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.182375 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.184783 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:30.183168 19370 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:30.137037 25998 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.144086 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:30.183929 25654 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:30.201665 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57644.1us
I20260709 13:11:30.203706 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:30.122485 25984 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:30.206795 25984 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.207958 25544 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.208588 25544 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.209335 25900 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.210157 25622 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.210539 25544 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.210657 25798 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:30.211411 25798 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:30.216665 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71166.5us
I20260709 13:11:30.217984 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:30.219048 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:30.220317 25650 consensus_meta.cc:287] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.002s
I20260709 13:11:30.196646 25955 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.221524 25955 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:30.224795 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 105956us
I20260709 13:11:30.226106 26000 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:30.226960 26000 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:30.227264 26000 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:30.228340 26000 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.229537 26000 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.226114 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:30.231827 25653 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:30.232525 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.233539 25908 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:30.234098 25908 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:30.234954 25908 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.235822 25654 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.236317 25592 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:30.237413 25915 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:30.237847 25915 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:30.203280 25867 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:30.239056 25915 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.240722 25915 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:30.237953 25654 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.244597 25544 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:30.245303 25544 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.190927 25805 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.247329 19224 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:30.198329 25744 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:30.188588 25678 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.247792 25663 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.254341 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.260350 25744 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:30.264353 25653 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.247466 25805 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.253985 25622 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:30.248127 25868 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.247438 25544 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.254835 25955 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.292076 25622 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:30.256621 25663 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.267124 25678 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.297230 25737 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:30.282819 25948 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:11:30.328743 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 125143us
W20260709 13:11:30.322809 25870 consensus_meta.cc:287] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
W20260709 13:11:30.333912 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.340754 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.341744 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:30.322608 25622 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:30.316293 25653 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.355937 19223 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
W20260709 13:11:30.353904 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 115030us
I20260709 13:11:30.347788 25852 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.359297 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:30.361150 19373 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:30.361346 19216 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:30.365682 25965 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:30.366220 25965 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:30.366446 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 48025.1us
I20260709 13:11:30.370523 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:30.370726 26009 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:11:30.372910 19291 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:30.373960 25891 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:30.376542 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:30.377218 19293 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:30.378438 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:30.348623 25737 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.379601 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:30.380266 19292 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:30.380821 25867 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:30.382038 25965 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.382575 25737 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.383596 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.385010 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.350672 25955 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:11:30.386407 19369 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:11:30.386890 25867 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:30.357841 25744 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.370540 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:30.389936 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.393114 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.393669 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:30.394393 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.396077 19292 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 8.
I20260709 13:11:30.390883 19373 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:30.392438 19369 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:11:30.396981 19369 pending_rounds.cc:85] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 17
I20260709 13:11:30.397440 19369 pending_rounds.cc:107] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:11:30.397730 19369 raft_consensus.cc:2889] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.349356 25798 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:30.398798 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.400094 19371 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:11:30.398115 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:30.401618 19294 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:30.403023 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.399205 19223 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:30.403613 19371 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:30.406136 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:30.389493 25908 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.390434 25965 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:30.409097 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.409191 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.397583 25891 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.411443 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:30.398684 25948 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:30.412492 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:30.412079 19223 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 9.
I20260709 13:11:30.410053 19371 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:30.413381 19365 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:30.389601 25998 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:11:30.403309 25737 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.416201 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49022 (request call id 1184) took 1384 ms. Trace:
W20260709 13:11:30.408480 25992 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:11:30.404317 25695 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:30.416564 19372 rpcz_store.cc:276] 0709 13:11:29.029121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.033796 (+  4675us) service_pool.cc:224] Handling call
0709 13:11:30.413099 (+1379303us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54000956d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:30.413286 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35054848}
I20260709 13:11:30.419498 25805 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.420678 25908 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.431813 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.433279 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:30.434124 19223 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:30.411440 25891 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.409034 25915 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 13:11:30.438629 19370 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:30.440748 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:30.424870 25965 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.423153 25948 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:30.430886 25798 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:30.430500 25695 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:30.435590 25868 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.444446 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.452634 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3004) took 1005 ms. Trace:
I20260709 13:11:30.461477 19372 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:30.422405 25737 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.455291 19366 rpcz_store.cc:276] 0709 13:11:29.447120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.455107 (+  7987us) service_pool.cc:224] Handling call
0709 13:11:29.455442 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.455903 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.455931 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.484599 (+ 28668us) log.cc:844] Serialized 26 byte log entry
0709 13:11:29.690577 (+205978us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:29.690627 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.690696 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.452437 (+761741us) raft_consensus.cc:1685] finished
0709 13:11:30.452463 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.452580 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":338,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3796,"thread_start_us":179811,"threads_started":1,"wal-append.queue_time_us":686911}
I20260709 13:11:30.534754 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:30.543457 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:30.449380 25965 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.556269 26014 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.556931 26014 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.558838 25965 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.559142 26014 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.553918 25805 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:11:30.564872 25622 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.566829 25622 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.569180 25891 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.569836 25695 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.572480 25901 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.573262 25901 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.454766 25798 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.576645 25901 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.578022 25798 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:30.581557 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.582288 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.583338 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:30.585933 25997 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.586603 25997 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:30.589534 25920 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.596475 25492 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.597009 25492 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.599285 25492 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:30.604655 26012 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:11:30.604893 25912 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:30.614019 25909 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.543556 25678 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.617478 25948 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.620489 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3271) took 1113 ms. Trace:
I20260709 13:11:30.620891 19224 rpcz_store.cc:276] 0709 13:11:29.506560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.507278 (+   718us) service_pool.cc:224] Handling call
0709 13:11:30.620292 (+1113014us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54001554d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:30.620408 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546754432}
I20260709 13:11:30.622133 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:30.623440 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:30.628640 19224 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:11:30.638929 25622 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:30.639506 25622 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:30.639743 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 185666us
I20260709 13:11:30.624696 25868 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:30.624533 25595 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:30.664316 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 57752.8us
I20260709 13:11:30.662933 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:30.667137 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 135248us
I20260709 13:11:30.665494 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:30.666369 25903 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:30.667680 19899 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
W20260709 13:11:30.673157 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 224956us
I20260709 13:11:30.669500 19903 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 9.
I20260709 13:11:30.628458 25915 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:30.685313 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44331.7us
I20260709 13:11:30.689162 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:30.664283 25997 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.666862 25595 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:30.689908 19894 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:30.691509 26016 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.681546 25450 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.671833 25909 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:30.709251 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:30.721793 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2647) took 1332 ms. Trace:
I20260709 13:11:30.711258 25744 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:30.692565 25685 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.728374 25685 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.730566 25685 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.731557 25713 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.732092 25713 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.725014 25744 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.742372 26016 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.750439 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:30.751466 19897 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEARNER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:11:30.731572 25259 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:30.752617 26017 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:30.752513 25259 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.753242 26017 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.755261 25663 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.697942 25997 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.764412 19901 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:30.764796 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:30.765599 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2649) took 1347 ms. Trace:
I20260709 13:11:30.765877 19217 rpcz_store.cc:276] 0709 13:11:29.418339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.448230 (+ 29891us) service_pool.cc:224] Handling call
0709 13:11:30.764650 (+1316420us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:11:30.765544 (+   894us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17613056}
I20260709 13:11:30.766839 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:30.767863 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:30.710750 25622 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.688215 25903 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.692269 25915 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.773303 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2638) took 1592 ms. Trace:
W20260709 13:11:30.749644 26000 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.006s
I20260709 13:11:30.760740 19373 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:30.787058 19220 rpcz_store.cc:276] 0709 13:11:29.180834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.180973 (+   139us) service_pool.cc:224] Handling call
0709 13:11:29.192205 (+ 11232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.427399 (+235194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.773052 (+1345653us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001c3754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:30.773246 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518036224}
I20260709 13:11:30.796741 19217 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:30.733855 25450 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.801415 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:30.802798 19223 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:30.722884 19221 rpcz_store.cc:276] 0709 13:11:29.388885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.389050 (+   165us) service_pool.cc:224] Handling call
0709 13:11:29.389390 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.389683 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:29.549823 (+160140us) log.cc:844] Serialized 14 byte log entry
0709 13:11:29.748619 (+198796us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.618016 (+869397us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b1800460360. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:11:30.721015 (+102999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:30.721148 (+   133us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:30.721274 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.721478 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.721686 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27742,"prepare.queue_time_us":21986,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":42397,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":30486,"spinlock_wait_cycles":15482496,"thread_start_us":416640,"threads_started":3,"wal-append.queue_time_us":637748}
I20260709 13:11:30.817068 25915 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.787068 25965 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.784572 25678 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:30.832319 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 145725us
I20260709 13:11:30.824245 25903 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.800798 26022 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:30.897847 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.746433 25909 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.870338 19223 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:11:30.910661 25909 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.911515 19223 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:30.836390 19265 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.567s (SENT)
I20260709 13:11:30.866640 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:30.915576 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.881678 25868 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.884042 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.893395 25920 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:30.932921 25920 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.933832 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.937973 25450 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.830039 25737 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.939218 25259 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.894096 25913 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.897464 25744 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.942531 25913 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.943341 25744 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:30.943920 25744 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.944597 26016 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.946148 25744 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.903414 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3012) took 1454 ms. Trace:
I20260709 13:11:30.946884 25744 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.946810 19367 rpcz_store.cc:276] 0709 13:11:29.449300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.506536 (+ 57236us) service_pool.cc:224] Handling call
0709 13:11:29.543946 (+ 37410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.549388 (+  5442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.903186 (+1353798us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400313b50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:30.903343 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85330688}
I20260709 13:11:30.906026 25908 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.948997 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2456) took 1568 ms. Trace:
I20260709 13:11:30.949400 25713 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.949342 19365 rpcz_store.cc:276] 0709 13:11:29.380355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.382893 (+  2538us) service_pool.cc:224] Handling call
0709 13:11:30.413248 (+1030355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.415685 (+  2437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.948819 (+533134us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000956d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:30.948941 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368827776}
I20260709 13:11:30.872713 25678 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.950600 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.951730 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.908211 19299 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:30.952296 25899 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:30.952674 25899 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:30.953693 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2411) took 3499 ms. Trace:
I20260709 13:11:30.953477 25899 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.954041 19299 rpcz_store.cc:276] 0709 13:11:27.454239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.718992 (+264753us) service_pool.cc:224] Handling call
0709 13:11:27.719306 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.907877 (+3188571us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54002b6720. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb71c0 00007fe8d7eb8231 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c
0709 13:11:30.952372 (+ 44495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.953434 (+  1062us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54001d4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:30.953630 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4221097728}
I20260709 13:11:30.954700 25899 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:30.955806 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:30.870015 26000 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.956648 19901 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:30.956753 26000 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.959053 26000 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.959837 19365 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:30.935691 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:30.916330 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49789.8us
W20260709 13:11:30.967479 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.928247 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.929288 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:30.931200 26004 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.536s	user 0.001s	sys 0.003s
I20260709 13:11:30.836217 25492 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:30.951817 25678 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:30.926952 19369 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:11:30.920603 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.960116 19902 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:30.935739 25920 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:30.965891 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.978102 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.979271 26016 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:30.979995 19371 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:11:30.992587 19371 pending_rounds.cc:85] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 10
I20260709 13:11:30.976874 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:30.992911 19371 pending_rounds.cc:107] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:11:30.993278 19371 raft_consensus.cc:2889] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.981062 25492 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:30.979995 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 143638us
I20260709 13:11:30.995900 19365 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:11:30.983572 19369 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:30.984339 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1199) took 1271 ms. Trace:
I20260709 13:11:30.988656 26009 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:30.989040 25997 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:30.991000 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:30.982461 25595 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:30.999249 19367 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:30.997112 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.002831 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:30.998880 26009 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:30.996847 19368 rpcz_store.cc:276] 0709 13:11:29.712864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.713026 (+   162us) service_pool.cc:224] Handling call
0709 13:11:29.713356 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.759084 (+ 45728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.759119 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.772528 (+ 13409us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.294055 (+521527us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:30.294112 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.294206 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.930516 (+636310us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:30.983942 (+ 53426us) raft_consensus.cc:1685] finished
0709 13:11:30.983971 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.984268 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22549,"raft.queue_time_us":27905,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":17131,"spinlock_wait_cycles":3192192,"thread_start_us":385457,"threads_started":1,"wal-append.queue_time_us":536704}
I20260709 13:11:31.006819 26009 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.007308 25492 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.008005 26009 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.997767 25965 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:30.999799 25908 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:31.011868 25908 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.012348 25908 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.972631 26022 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.014436 26022 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.015630 25965 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.018172 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2585) took 1879 ms. Trace:
I20260709 13:11:31.018883 25653 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.018723 19296 rpcz_store.cc:276] 0709 13:11:29.138916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.147178 (+  8262us) service_pool.cc:224] Handling call
0709 13:11:29.165391 (+ 18213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.453015 (+287624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.017871 (+1564856us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540034fb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:31.018101 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659804928}
I20260709 13:11:31.024408 25130 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.024580 25805 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:31.025384 25805 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.032967 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.025108 25130 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:31.046006 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 55113.4us
I20260709 13:11:31.050081 26017 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.053931 25130 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.002290 25259 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:11:31.055583 25892 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:31.059293 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:31.059134 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:31.060817 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:31.052580 26009 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:31.061445 25327 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:31.063378 26009 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:31.063768 26009 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.059633 25653 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:11:31.064087 26009 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.064411 25912 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:31.064815 25912 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:31.062408 25892 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:31.065166 25912 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:31.066286 25909 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.066802 25909 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.068529 25892 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:31.068979 25892 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.069396 25892 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.070163 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:31.071170 19225 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:31.071300 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71258.1us
I20260709 13:11:31.060894 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:31.074105 25130 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:31.074611 25130 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.075088 25130 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.071046 26000 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:11:31.079733 26009 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.082548 26009 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.083220 25852 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.083846 25852 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.086143 25852 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.087145 25909 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.088032 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3265) took 1583 ms. Trace:
I20260709 13:11:31.088555 19225 rpcz_store.cc:276] 0709 13:11:29.504697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.756401 (+251704us) service_pool.cc:224] Handling call
0709 13:11:29.778297 (+ 21896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.071949 (+1293652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.087724 (+ 15775us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000186d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:31.087959 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970817920}
I20260709 13:11:31.090240 25595 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:31.092886 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:31.093760 25653 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:31.094158 25653 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.094480 25653 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.096382 25909 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:31.096915 25909 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:31.097739 25909 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.099512 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.099990 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.101399 19902 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:31.099545 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:31.103650 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.104347 19373 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:31.100812 19368 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:31.106034 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.107441 19902 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 9.
I20260709 13:11:31.109771 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:31.113557 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.113721 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:31.028568 25805 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.117053 19216 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:31.117447 19216 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:31.117654 19216 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:31.117882 19216 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:31.156656 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.158792 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:31.159093 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48457.8us
I20260709 13:11:31.159621 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.160061 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:31.161036 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.164074 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.165066 19368 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:31.160327 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 52074us
I20260709 13:11:31.157537 19216 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:31.160223 19901 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:31.173095 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.178344 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:31.189337 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:31.189970 19219 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:31.192284 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.192930 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.201053 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.201445 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.201707 19899 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:31.202190 19367 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:11:31.193526 19903 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:31.203719 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.209918 19368 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:31.218057 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:31.218972 19371 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.220055 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.139240 26000 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:31.222189 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.140894 25737 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:31.221323 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:31.225415 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.226730 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.229652 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.200918 25852 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:11:31.177681 25654 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:11:31.169281 25814 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:31.232601 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.191454 25685 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.157907 25640 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:11:31.227669 26000 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.155457 26023 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:31.235559 25912 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.258406 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.259171 19223 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:31.260237 25130 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.264009 19369 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:31.263407 25663 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:31.363267 25663 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.363706 25663 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:31.368604 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:31.369531 19216 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.359638 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.373088 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:31.374596 19368 raft_consensus.cc:2410] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:11:31.203063 25997 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.391381 19225 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:31.317173 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.390686 25916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.032s	sys 0.053s
I20260709 13:11:31.177454 25713 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:11:31.400641 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.249780 25737 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:31.411775 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.427641 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:31.427902 25130 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:31.396970 25916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.032s	sys 0.054s
I20260709 13:11:31.265882 26000 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.255333 25440 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.435184 19225 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:31.267102 25868 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:31.436488 19372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.016s	sys 0.012s
W20260709 13:11:31.446362 19372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.012s
W20260709 13:11:31.265266 25674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.044s	sys 0.059s
I20260709 13:11:31.447834 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.453573 19225 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:31.448513 25130 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:31.455852 25130 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.456267 25130 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.449995 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:31.265568 25685 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.398723 25659 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:31.263808 25920 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.181s
I20260709 13:11:31.403172 25678 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.460850 19370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.002s	sys 0.029s
I20260709 13:11:31.440349 25737 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:31.454653 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:31.449458 25985 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.011s	sys 0.019s
I20260709 13:11:31.359019 25814 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:31.465699 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.015s	sys 0.028s
W20260709 13:11:31.490008 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.016s	sys 0.028s
W20260709 13:11:31.474448 19370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.002s	sys 0.029s
I20260709 13:11:31.446043 25868 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:31.497238 19224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.019s
W20260709 13:11:31.497664 19224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.009s	sys 0.019s
I20260709 13:11:31.484967 19225 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:31.395226 26023 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.481150 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3262) took 2077 ms. Trace:
I20260709 13:11:31.402781 25997 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.442198 25793 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:11:31.525615 19219 rpcz_store.cc:276] 0709 13:11:29.414175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.414581 (+   406us) service_pool.cc:224] Handling call
0709 13:11:29.454345 (+ 39764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.190413 (+1736068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.462725 (+272312us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400136854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:31.481089 (+ 18364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3990777728}
I20260709 13:11:31.538159 25674 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:31.465826 25622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.013s	sys 0.020s
W20260709 13:11:31.540354 25622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.013s	sys 0.020s
I20260709 13:11:31.540938 25622 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.541409 25622 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.541918 25674 consensus_queue.cc:1059] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:31.485528 25985 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.011s	sys 0.019s
I20260709 13:11:31.444818 25965 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:11:31.473469 25659 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.553536 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:31.551680 19366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.018s	sys 0.032s
W20260709 13:11:31.566751 19366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.019s	sys 0.032s
I20260709 13:11:31.452968 25440 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.494417 26024 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:31.591149 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.525418 25868 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:31.596498 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2476) took 1203 ms. Trace:
I20260709 13:11:31.596982 19366 rpcz_store.cc:276] 0709 13:11:30.393004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.542882 (+149878us) service_pool.cc:224] Handling call
0709 13:11:30.560570 (+ 17688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.560838 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:30.708501 (+147663us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.594355 (+885854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.594436 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:31.594501 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.596257 (+  1756us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.596424 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200763,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":964205,"threads_started":2}
I20260709 13:11:31.523726 25640 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:31.595008 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.590886 26026 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.637880 19222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.003s	sys 0.007s
W20260709 13:11:31.638667 19222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.003s	sys 0.007s
I20260709 13:11:31.544684 25678 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:31.592612 25916 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:31.637509 25695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.002s	sys 0.010s
I20260709 13:11:31.651342 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:31.629156 25989 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.628046 25827 raft_consensus.cc:3055] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:31.568035 25653 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.663328 25347 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.639200 25630 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.006s	sys 0.018s
W20260709 13:11:31.646626 25891 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.012s	sys 0.015s
I20260709 13:11:31.666056 19223 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:31.664106 26029 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:31.632929 25450 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:31.649330 25852 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:31.684759 19220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.014s	sys 0.024s
I20260709 13:11:31.633101 25640 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.666474 25912 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.703982 25852 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.706734 25852 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:31.697929 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:31.696955 25891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.013s	sys 0.016s
W20260709 13:11:31.695197 25630 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.006s	sys 0.018s
I20260709 13:11:31.709404 25640 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:31.709909 19220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.014s	sys 0.024s
I20260709 13:11:31.711447 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2650) took 2241 ms. Trace:
I20260709 13:11:31.702142 25996 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:31.700676 25347 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:31.703186 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.007s
I20260709 13:11:31.691435 25827 raft_consensus.cc:740] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:31.645694 26026 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.712564 26050 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:31.719269 26050 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:31.720273 26050 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.721609 26050 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.702689 26024 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:31.724623 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:31.725638 25912 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:31.726046 25912 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.726423 25912 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:31.726773 25653 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.715296 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3289) took 1274 ms. Trace:
I20260709 13:11:31.728919 25997 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.718400 25814 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.730763 26023 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:31.715114 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.004s	sys 0.007s
I20260709 13:11:31.733551 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1213) took 1057 ms. Trace:
I20260709 13:11:31.714517 19222 rpcz_store.cc:276] 0709 13:11:29.470250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.734986 (+264736us) service_pool.cc:224] Handling call
0709 13:11:29.752549 (+ 17563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:29.762211 (+  9662us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:29.784817 (+ 22606us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.029479 (+1244662us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18003120a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:11:31.701786 (+672307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.701876 (+    90us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:31.701943 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.711220 (+  9277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.711371 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65604,"prepare.queue_time_us":22581,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":63487,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":45589376,"thread_start_us":609464,"threads_started":1}
I20260709 13:11:31.724634 26024 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.693727 25989 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.728555 19218 rpcz_store.cc:276] 0709 13:11:30.441241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.876725 (+435484us) service_pool.cc:224] Handling call
0709 13:11:30.877173 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.877659 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.877704 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.878317 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.490517 (+612200us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:31.490573 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.490662 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.715082 (+224420us) raft_consensus.cc:1685] finished
0709 13:11:31.715104 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.715236 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65540,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"thread_start_us":611762,"threads_started":1,"wal-append.queue_time_us":816906}
I20260709 13:11:31.737867 25659 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:31.738123 25989 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:31.718212 19225 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:31.726042 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:31.700153 25695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.003s	sys 0.010s
I20260709 13:11:31.745213 19225 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:31.745481 19868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.014s	sys 0.030s
W20260709 13:11:31.745424 19902 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.022s
I20260709 13:11:31.733968 19372 rpcz_store.cc:276] 0709 13:11:30.676035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.903928 (+227893us) service_pool.cc:224] Handling call
0709 13:11:30.904394 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.904893 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.904936 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.905558 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.449192 (+543634us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:31.449252 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.449365 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.733327 (+283962us) raft_consensus.cc:1685] finished
0709 13:11:31.733349 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.733491 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":543150,"threads_started":1,"wal-append.queue_time_us":825795}
W20260709 13:11:31.741708 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.006s
W20260709 13:11:31.748998 19902 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.022s
W20260709 13:11:31.748593 19868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.014s	sys 0.030s
W20260709 13:11:31.742033 19265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.005s
W20260709 13:11:31.750241 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 578125us
W20260709 13:11:31.752530 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.006s	sys 0.006s
W20260709 13:11:31.752985 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 574672us
W20260709 13:11:31.701993 26017 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.011s
W20260709 13:11:31.750627 19265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.005s	sys 0.006s
W20260709 13:11:31.762625 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 573327us
I20260709 13:11:31.768756 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.728981 25440 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:31.741849 25903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.002s	sys 0.009s
W20260709 13:11:31.716952 25908 consensus_meta.cc:287] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
I20260709 13:11:31.772292 25130 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.803294 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:31.804198 19295 raft_consensus.cc:2368] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
I20260709 13:11:31.804529 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:31.764146 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:31.798033 19903 raft_consensus.cc:1240] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:31.800020 19340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.016s	sys 0.037s
W20260709 13:11:31.806418 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.806447 19340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.017s	sys 0.037s
I20260709 13:11:31.714299 25678 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:31.740631 25630 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.718700 26026 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:31.715749 25347 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:31.818382 25130 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:31.808817 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 669825us
I20260709 13:11:31.803709 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:31.819847 19901 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:31.760525 25653 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:31.801823 25892 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.000s
I20260709 13:11:31.807521 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:31.834313 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:31.813196 19365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.016s	sys 0.026s
W20260709 13:11:31.768603 26017 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.012s
W20260709 13:11:31.801463 25903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.002s	sys 0.010s
I20260709 13:11:31.825698 19899 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:11:31.826860 19371 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:11:31.857615 19371 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:31.859051 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:31.840677 19365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.016s	sys 0.026s
I20260709 13:11:31.799676 25989 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.862803 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.863642 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:31.864533 19295 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
W20260709 13:11:31.871126 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.003s	sys 0.015s
W20260709 13:11:31.871806 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.003s	sys 0.015s
I20260709 13:11:31.747999 25912 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.819468 25814 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:31.875698 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:31.877928 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:31.879954 19295 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:31.880059 19294 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:31.835059 25653 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:31.868633 25492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.065s	sys 0.095s
I20260709 13:11:31.810640 25908 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.841802 26024 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:31.985608 19216 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:11:32.016450 19216 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:31.715977 25827 consensus_queue.cc:260] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.881278 25654 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:31.819053 25663 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:31.908346 25347 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.857545 26026 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.139s
I20260709 13:11:31.858001 25892 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:31.873052 25989 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:32.039183 19263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.005s
W20260709 13:11:32.039677 19263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.006s	sys 0.005s
W20260709 13:11:31.996557 25492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.066s	sys 0.096s
W20260709 13:11:31.980599 25259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.003s	sys 0.017s
I20260709 13:11:32.023923 25654 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.987478 25653 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:32.070662 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.070168 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:32.019016 26014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.016s	sys 0.044s
I20260709 13:11:31.992905 26028 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.997390 26039 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.910140 25640 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:11:32.044047 19222 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:31.878805 25630 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.051326 19300 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:32.052037 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.024580 26024 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.909914 25814 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.057118 19219 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:32.027590 25948 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:32.078552 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.078886 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.079454 19291 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:32.052632 25259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.003s	sys 0.017s
I20260709 13:11:32.089097 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.091840 19292 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:32.094761 19296 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:32.075947 26014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.016s	sys 0.044s
I20260709 13:11:32.069456 25654 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:32.102450 19293 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:32.104141 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.069082 25805 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:32.040364 25347 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:32.122110 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:32.107550 19369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.018s	sys 0.022s
I20260709 13:11:32.114648 19295 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:11:32.118286 19292 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:32.106027 25440 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:32.110860 25659 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:32.106732 26037 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:11:32.110776 26023 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:32.120769 19300 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:32.121399 19224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.027s
W20260709 13:11:32.143643 19224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.005s	sys 0.028s
I20260709 13:11:32.123466 19297 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:32.125159 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.018s	sys 0.022s
I20260709 13:11:32.095824 25814 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:32.121047 19373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.007s	sys 0.013s
W20260709 13:11:32.145378 19373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.007s	sys 0.013s
I20260709 13:11:32.148620 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.149323 19293 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:32.156175 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.156919 19294 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
W20260709 13:11:32.128996 25327 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.004s	sys 0.016s
W20260709 13:11:32.129336 26009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.002s	sys 0.017s
I20260709 13:11:32.142632 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:32.196758 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54230.9us
I20260709 13:11:32.197165 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:32.126176 25737 consensus_meta.cc:287] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.004s
I20260709 13:11:32.209198 25130 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:32.209916 25130 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:32.151320 26026 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:32.194141 25327 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.004s	sys 0.016s
W20260709 13:11:32.227180 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.007s	sys 0.022s
W20260709 13:11:32.235526 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.023s
W20260709 13:11:32.233743 19338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.022s	sys 0.033s
W20260709 13:11:32.236406 19338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.022s	sys 0.033s
W20260709 13:11:32.196200 26009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.018s
W20260709 13:11:32.235908 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 719355us
I20260709 13:11:32.241674 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.242385 19294 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:32.211664 25891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.004s	sys 0.017s
I20260709 13:11:32.240873 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:32.112752 25948 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:32.104749 26039 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.244776 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.095131 26028 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:32.218281 25955 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.019s	sys 0.015s
W20260709 13:11:32.215490 26025 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.015s	sys 0.007s
I20260709 13:11:32.107465 26024 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.270172 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:32.275759 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 984) took 1143 ms. Trace:
W20260709 13:11:32.284613 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.249254 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:32.242383 25793 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.012s	sys 0.032s
I20260709 13:11:32.300475 19296 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:32.152465 25440 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.152261 25659 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.303857 19898 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:11:32.346186 19898 pending_rounds.cc:85] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 15
I20260709 13:11:32.346454 19898 pending_rounds.cc:107] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:11:32.346719 19898 raft_consensus.cc:2889] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.148260 25805 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:32.159330 26023 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:32.326084 25955 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.019s	sys 0.015s
I20260709 13:11:32.313102 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.245366 25997 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:32.287653 25130 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.342180 19371 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:32.363484 19294 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:32.340309 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:32.324779 26038 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:11:32.333460 19902 rpcz_store.cc:276] 0709 13:11:31.109624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.109779 (+   155us) service_pool.cc:224] Handling call
0709 13:11:31.110039 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.110335 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:31.751559 (+641224us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.246340 (+494781us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.252259 (+  5919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.252330 (+    71us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:32.252389 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.252475 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.252627 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2061,"raft.queue_time_us":395,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":39648,"spinlock_wait_cycles":19121408,"thread_start_us":1066049,"threads_started":2}
W20260709 13:11:32.326864 26025 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.016s	sys 0.007s
I20260709 13:11:32.313261 25685 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:32.306792 26027 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:32.345999 26033 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
W20260709 13:11:32.365065 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.025s	sys 0.059s
I20260709 13:11:32.365754 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:32.344892 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 74787us
W20260709 13:11:32.332886 25909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.008s	sys 0.027s
W20260709 13:11:32.369053 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.030s
I20260709 13:11:32.369179 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:32.226052 26036 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.140s
W20260709 13:11:32.341810 25793 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.012s	sys 0.032s
I20260709 13:11:32.246855 26026 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:32.310989 25965 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.011s	sys 0.021s
I20260709 13:11:32.472765 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:32.473428 19368 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:32.364995 19866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.021s
W20260709 13:11:32.457072 25909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.010s	sys 0.029s
I20260709 13:11:32.226369 25737 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:32.347002 25908 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:32.389164 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:32.349006 26063 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:32.409838 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.413115 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:32.488742 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75716.7us
I20260709 13:11:32.489712 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:32.490017 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:32.490316 19902 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:32.491619 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:32.412623 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.028s	sys 0.062s
W20260709 13:11:32.492377 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 906246us
I20260709 13:11:32.347126 25892 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:32.414294 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:32.493669 19372 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:32.459342 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83250.3us
I20260709 13:11:32.375079 25595 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:32.375065 25997 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:32.474030 19866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.021s
W20260709 13:11:32.378721 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 276434us
W20260709 13:11:32.478873 26045 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:11:32.481416 25622 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:32.481496 25659 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:32.482887 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.411912 25912 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:32.466951 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.036s
W20260709 13:11:32.473058 25965 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.011s	sys 0.021s
I20260709 13:11:32.464850 25916 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:32.502221 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:32.506219 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.506335 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.481021 26028 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:32.617981 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 116320us
W20260709 13:11:32.506536 26050 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.010s
I20260709 13:11:32.495978 25327 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.629544 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1210) took 2226 ms. Trace:
I20260709 13:11:32.627771 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:32.668484 19300 raft_consensus.cc:2410] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:11:32.496053 25685 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:32.626410 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:32.507635 25909 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:32.411101 26027 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.510345 25891 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:32.690163 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:32.679518 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60680.4us
I20260709 13:11:32.694060 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:32.506742 25989 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:32.666407 19370 rpcz_store.cc:276] 0709 13:11:30.390069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.531371 (+141302us) service_pool.cc:224] Handling call
0709 13:11:30.555553 (+ 24182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.660238 (+104685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.660295 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.672904 (+ 12609us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.537211 (+864307us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:31.537254 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.537318 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.616400 (+1079082us) raft_consensus.cc:1685] finished
0709 13:11:32.616420 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.616557 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":809,"raft.queue_time_us":31809,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":757596,"threads_started":1,"wal-append.queue_time_us":1170769}
W20260709 13:11:32.698155 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 205178us
I20260709 13:11:32.703806 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:32.495834 25595 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.709190 19299 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:32.721566 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.723050 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:32.622568 25630 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:32.723604 19217 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:32.628669 25640 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:32.724496 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:32.725391 19217 raft_consensus.cc:2410] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:11:32.722285 19298 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 8.
I20260709 13:11:32.724828 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:32.732968 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:32.679211 26063 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.680133 25892 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.743567 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:32.721709 25946 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:32.710134 25347 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:32.708835 25909 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:32.724431 25659 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:32.691568 25327 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.704465 26017 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:11:32.824502 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 99756.1us
I20260709 13:11:32.825263 19370 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:32.826768 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:32.830168 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:32.751997 25948 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:32.823258 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 79758us
I20260709 13:11:32.860694 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:32.842180 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:32.861958 19298 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:32.862161 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:32.852787 26076 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:11:32.854071 25909 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:32.855451 26081 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:11:32.856139 26053 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 13:11:32.835965 25868 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.207s	user 0.010s	sys 0.002s
I20260709 13:11:32.824105 26039 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:32.856520 26074 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:11:32.841617 26091 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:32.763170 25892 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.841269 25347 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:32.892115 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:32.891004 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:32.884575 19370 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:32.856546 26052 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:32.868399 25450 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:32.751794 26063 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:32.889727 25989 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:32.897022 26056 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:11:32.906603 25805 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:32.900156 26091 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.857617 25659 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:32.954668 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 336598us
I20260709 13:11:32.893587 25868 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:32.888757 26075 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.031076 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3038) took 1836 ms. Trace:
I20260709 13:11:32.893687 26066 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:32.963034 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:32.964991 26073 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:11:32.965370 26044 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.532s	user 0.001s	sys 0.000s
I20260709 13:11:32.966534 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2656) took 1847 ms. Trace:
I20260709 13:11:33.036444 19221 rpcz_store.cc:276] 0709 13:11:31.118711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.118837 (+   126us) service_pool.cc:224] Handling call
0709 13:11:31.178341 (+ 59504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.588894 (+410553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.588940 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.588998 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:31.589043 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.966319 (+1377276us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:32.966366 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.966482 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898100608}
W20260709 13:11:32.967069 25653 consensus_meta.cc:287] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.000s
I20260709 13:11:32.967813 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:32.968587 19223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2657) took 1795 ms (client timeout 2160 ms). Trace:
W20260709 13:11:33.039841 19368 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.002s
W20260709 13:11:33.001617 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.040303 19368 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:32.908028 25347 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.893805 26024 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.009264 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.041863 19292 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
W20260709 13:11:33.010315 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.047132 26070 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
I20260709 13:11:33.047523 19191 leader_election.cc:400] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15.
W20260709 13:11:33.048324 26059 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.501s	user 0.001s	sys 0.001s
I20260709 13:11:33.048633 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.049031 26065 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.049577 25891 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:33.049844 26078 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:33.050273 26078 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.050208 25891 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.050694 26078 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.034160 26063 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.052424 25891 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:33.054118 26000 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.588s	user 0.007s	sys 0.005s
I20260709 13:11:33.054641 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3288) took 2613 ms. Trace:
I20260709 13:11:33.054565 26000 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.055956 19900 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 10: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:33.055184 19220 rpcz_store.cc:276] 0709 13:11:30.440955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.869719 (+428764us) service_pool.cc:224] Handling call
0709 13:11:30.927232 (+ 57513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.964471 (+ 37239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.964505 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.964986 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.710324 (+745338us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:31.710366 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.710430 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.054373 (+1343943us) raft_consensus.cc:1685] finished
0709 13:11:33.054397 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.054540 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1319,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":18424,"thread_start_us":744974,"threads_started":1,"wal-append.queue_time_us":2087662}
I20260709 13:11:33.057174 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:33.057881 19220 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:33.058126 26027 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.058646 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.059239 19220 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:32.908378 26052 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:32.914181 25450 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:33.067479 19372 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 13:11:33.068044 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:33.068327 19372 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
W20260709 13:11:33.019879 19869 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 1.645s (SENT) [suppressed 29 similar messages]
W20260709 13:11:33.021311 19325 heartbeater.cc:646] Failed to heartbeat to 127.17.171.254:34425 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.17.171.254:34425 timed out after 15.000s (SENT)
I20260709 13:11:33.007334 26026 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.025760 25892 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.026860 25595 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.026718 26092 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:33.003003 26074 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:33.031550 19369 rpcz_store.cc:276] 0709 13:11:31.194211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.375618 (+181407us) service_pool.cc:224] Handling call
0709 13:11:31.376006 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.439960 (+ 63954us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:31.452440 (+ 12480us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.163751 (+711311us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.195263 (+ 31512us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.195439 (+   176us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:32.195488 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.195581 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.030830 (+835249us) raft_consensus.cc:1685] finished
0709 13:11:33.030852 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.031011 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9222,"prepare.queue_time_us":13389,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":42278,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":34094,"spinlock_wait_cycles":816384,"thread_start_us":638269,"threads_started":1,"wal-append.queue_time_us":1467832}
W20260709 13:11:33.033994 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 64506.6us
I20260709 13:11:33.011977 25737 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.008364 25948 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:33.039793 19223 rpcz_store.cc:269] 0709 13:11:31.173646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.544408 (+370762us) service_pool.cc:224] Handling call
0709 13:11:32.968415 (+1424007us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400136354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:32.968527 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251585920}
I20260709 13:11:33.009723 19294 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:33.059268 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2477) took 1964 ms. Trace:
I20260709 13:11:32.874867 26054 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.483s
I20260709 13:11:33.061015 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.062076 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.072324 25450 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:33.018481 26091 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:33.067022 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.072093 19897 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:33.085985 19365 rpcz_store.cc:276] 0709 13:11:31.095421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.096881 (+  1460us) service_pool.cc:224] Handling call
0709 13:11:31.097317 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.097751 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.097786 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.098394 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.861604 (+763210us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:31.861663 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.861961 (+   298us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.059076 (+1197115us) raft_consensus.cc:1685] finished
0709 13:11:33.059094 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.059219 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5148,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":34428,"thread_start_us":762736,"threads_started":1,"wal-append.queue_time_us":1177967}
I20260709 13:11:33.096875 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:33.081625 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.061580 25347 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.099913 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.069669 26052 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.091934 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.093791 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.108502 19216 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:33.073829 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 53980.8us
I20260709 13:11:33.098214 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.100796 19221 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
W20260709 13:11:33.062320 19902 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.004s
I20260709 13:11:33.111349 19902 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:33.114542 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.114838 19895 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:33.115289 19299 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:33.119092 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.119987 26027 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:33.121361 26063 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:33.114337 25948 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.123816 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.126515 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.127377 19299 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
W20260709 13:11:33.126227 19295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.010s	sys 0.009s
I20260709 13:11:33.086109 25997 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.061504 25653 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:33.132150 19295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.010s	sys 0.009s
I20260709 13:11:33.131461 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.135234 19298 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:33.099521 26022 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:33.102905 25913 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:33.140549 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.141211 19298 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:33.141994 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.035261 26075 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.139711 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.147477 19299 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:33.043022 26066 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.147774 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.049645 26065 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.130766 25891 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:33.150486 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.154305 25948 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.155227 26075 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.155747 25965 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:33.160643 19898 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:33.141755 25913 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:33.147248 25955 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:33.164319 26000 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.165169 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.171948 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.175532 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:33.184927 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.175932 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:33.160751 26083 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:33.170626 25891 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.180934 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.193313 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.181572 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.184044 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.162555 26065 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.194622 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.195681 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.179291 25965 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.196525 25891 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:33.196839 26050 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:33.197309 26025 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:33.197865 25793 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:33.201930 25654 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.073s	user 0.012s	sys 0.000s
I20260709 13:11:33.202229 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2602) took 1155 ms. Trace:
I20260709 13:11:33.202545 25868 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.203147 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 907) took 2804 ms. Trace:
I20260709 13:11:33.229115 19297 rpcz_store.cc:276] 0709 13:11:32.046393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.046568 (+   175us) service_pool.cc:224] Handling call
0709 13:11:32.072422 (+ 25854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.144501 (+ 72079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.201986 (+1057485us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54002e7a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:33.202172 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116956416}
I20260709 13:11:33.204706 19902 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:11:33.205367 25965 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:33.190361 26036 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:11:33.186429 26009 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:11:33.182096 26087 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.243593 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.183035 25805 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.182848 25913 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:33.190140 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:33.207728 26047 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.715s	user 0.000s	sys 0.001s
I20260709 13:11:33.208474 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.228735 25630 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:33.186973 19368 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:33.227578 25793 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:33.211565 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.213706 26066 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.214293 25659 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:33.185222 25814 consensus_meta.cc:287] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.975s	user 0.001s	sys 0.010s
W20260709 13:11:33.226307 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 356474us
I20260709 13:11:33.229022 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1215) took 1368 ms. Trace:
I20260709 13:11:33.231808 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:33.236908 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.240960 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.184914 25955 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.229462 19224 rpcz_store.cc:276] 0709 13:11:30.398824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.657435 (+258611us) service_pool.cc:224] Handling call
0709 13:11:30.668083 (+ 10648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.799853 (+131770us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:30.841301 (+ 41448us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.144021 (+1302720us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.144094 (+    73us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:32.144152 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.202909 (+1058757us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540013db54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:33.202963 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.203088 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41429,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":17115,"raft.queue_time_us":43498,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":302399232,"thread_start_us":1273424,"threads_started":2,"wal-append.queue_time_us":987738}
I20260709 13:11:33.245411 19297 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.227679 26025 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.209039 25663 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.277911 25955 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.250078 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.280576 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.281752 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.282811 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.283360 19298 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:33.254071 25653 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.243479 26009 consensus_queue.cc:1243] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:33.179615 26027 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:33.269027 19292 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:33.268590 25450 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.286753 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.239807 26050 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:33.288141 26050 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.278398 25814 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.289453 26023 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.290932 25814 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.248395 26087 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.246516 25948 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:33.292546 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3298) took 2133 ms. Trace:
I20260709 13:11:33.292392 25948 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.293380 26087 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.294550 25948 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.285331 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.295270 25827 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.284150 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.287865 25450 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.299033 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.292941 19218 rpcz_store.cc:276] 0709 13:11:31.158940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.737632 (+578692us) service_pool.cc:224] Handling call
0709 13:11:31.738067 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.738470 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.738502 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.758933 (+ 20431us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.291917 (+1532984us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b180033ebc0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1
0709 13:11:33.292064 (+   147us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:33.292102 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.292196 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.292252 (+    56us) raft_consensus.cc:1685] finished
0709 13:11:33.292269 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.292485 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1395,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6895,"spinlock_wait_cycles":9920512,"thread_start_us":657604,"threads_started":1,"wal-append.queue_time_us":698779}
W20260709 13:11:33.296010 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 64318.2us
I20260709 13:11:33.272346 25793 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:33.300755 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.305647 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.304456 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.274492 19901 rpcz_store.cc:276] 0709 13:11:31.860654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.860822 (+   168us) service_pool.cc:224] Handling call
0709 13:11:31.878183 (+ 17361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.983907 (+105724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.983952 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.965329 (+981377us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b2c000474b8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:32.965741 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.035009 (+ 69268us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:33.035053 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.035153 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.222700 (+187547us) raft_consensus.cc:1685] finished
0709 13:11:33.222720 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.228959 (+  6239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105324,"raft.queue_time_us":133939,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":8775,"spinlock_wait_cycles":10675968,"thread_start_us":68937,"threads_started":1,"wal-append.queue_time_us":237270}
I20260709 13:11:33.239671 25654 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.307513 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.311571 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.310168 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.305476 26009 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.316886 25654 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.311022 26075 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:33.318816 26078 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.320282 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.320701 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.321007 26078 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.321802 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.322054 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.322461 19293 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:33.322702 19298 raft_consensus.cc:2376] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21. Re-sending same reply.
I20260709 13:11:33.323359 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.323288 26052 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.323870 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.320856 25347 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.261070 25805 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.296784 26025 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:33.338109 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3306) took 1136 ms. Trace:
I20260709 13:11:33.355975 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:33.358530 19225 rpcz_store.cc:276] 0709 13:11:32.201464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.090504 (+889040us) service_pool.cc:224] Handling call
0709 13:11:33.090933 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.091203 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.091239 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.102357 (+ 11118us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.210292 (+107935us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:33.210331 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.210408 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.337693 (+127285us) raft_consensus.cc:1685] finished
0709 13:11:33.337724 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.338045 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":96205,"threads_started":1,"wal-append.queue_time_us":181877}
I20260709 13:11:33.298738 25678 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:33.330296 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.337644 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:33.345867 19298 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:33.363044 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.332641 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.368912 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:33.365911 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.364526 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.373210 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.368551 19225 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:33.409511 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3309) took 1201 ms. Trace:
I20260709 13:11:33.408682 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:33.410162 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.410630 19298 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
W20260709 13:11:33.409201 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44749.5us
I20260709 13:11:33.412367 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:33.410193 19220 rpcz_store.cc:276] 0709 13:11:32.208132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.133662 (+925530us) service_pool.cc:224] Handling call
0709 13:11:33.146384 (+ 12722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.146635 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:33.232689 (+ 86054us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.409177 (+176488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.409251 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:33.409292 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.409357 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.409460 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141817,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":114,"thread_start_us":238617,"threads_started":2}
I20260709 13:11:33.413950 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.357517 25920 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.379070 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.357594 26009 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.416927 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:33.420248 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:33.420881 19225 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.366616 26075 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:33.310972 25814 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:11:33.430054 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:33.426707 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.412056 25868 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.423651 25713 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:33.452464 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:33.458247 19218 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:33.450305 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:33.427810 26075 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.460851 19220 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 10: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:33.445040 25695 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.462538 19895 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 14.
I20260709 13:11:33.459671 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.426245 26104 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:33.464800 19298 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:33.470710 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.471794 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:33.472987 19869 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:33.467806 25695 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.474867 19220 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:33.476257 25347 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.464025 26075 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.478166 26022 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:33.480711 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2616) took 1170 ms. Trace:
I20260709 13:11:33.481096 19300 rpcz_store.cc:276] 0709 13:11:32.310872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.311024 (+   152us) service_pool.cc:224] Handling call
0709 13:11:33.480518 (+1169494us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400031954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:33.480653 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698117376}
I20260709 13:11:33.482367 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.483456 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.484701 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:33.485260 19902 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:33.476492 25868 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:33.425675 26009 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.488241 19901 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:33.494899 25955 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.495347 25440 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.496680 19299 raft_consensus.cc:2368] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19.
I20260709 13:11:33.498056 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.462616 26091 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.508425 19369 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:11:33.508916 26091 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.510571 25996 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.511181 25996 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.512463 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:33.513248 19898 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:33.516716 26113 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:33.469542 26104 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.517485 26104 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:33.519086 19297 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:33.520038 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 994) took 1760 ms. Trace:
I20260709 13:11:33.525789 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.520097 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.527881 19297 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:33.527335 19293 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.520434 19900 rpcz_store.cc:276] 0709 13:11:31.760043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.760309 (+   266us) service_pool.cc:224] Handling call
0709 13:11:33.519810 (+1759501us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400612954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:33.519974 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875977088}
I20260709 13:11:33.557510 19225 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:33.462350 25965 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.571918 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.614895 19902 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:33.560999 25630 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:33.622421 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.568005 26036 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:33.630384 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.637815 19300 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:33.647411 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.630216 26058 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:33.659824 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.660647 19263 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:33.662099 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.636560 26026 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:33.667320 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.664999 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.668000 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:33.665868 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.664757 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.664832 25903 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:33.656652 25327 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.673597 19191 leader_election.cc:400] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19.
I20260709 13:11:33.677170 19191 leader_election.cc:403] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.663673 25827 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:33.680341 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.670171 26116 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:33.706754 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2481) took 1355 ms. Trace:
I20260709 13:11:33.707301 19296 rpcz_store.cc:276] 0709 13:11:32.351627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.352076 (+   449us) service_pool.cc:224] Handling call
0709 13:11:32.375230 (+ 23154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.412831 (+ 37601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.412859 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.459223 (+ 46364us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.257234 (+798011us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4800150258. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:11:33.494066 (+236832us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b18004a6200. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:33.616127 (+122061us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.616204 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.617199 (+   995us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.706471 (+ 89272us) raft_consensus.cc:1685] finished
0709 13:11:33.706502 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.706681 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50059,"raft.queue_time_us":37734,"raft.run_cpu_time_us":3741,"raft.run_wall_time_us":842223,"spinlock_wait_cycles":16432640,"thread_start_us":121835,"threads_started":1,"wal-append.queue_time_us":1194857}
I20260709 13:11:33.708825 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.709357 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:33.709543 19894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1217) took 1840 ms (client timeout 1834 ms). Trace:
W20260709 13:11:33.709897 19894 rpcz_store.cc:269] 0709 13:11:31.869377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.869517 (+   140us) service_pool.cc:224] Handling call
0709 13:11:33.708672 (+1839155us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800221a98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:11:33.709479 (+   807us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34923904}
I20260709 13:11:33.710834 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.711383 19894 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:33.712152 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.713796 19221 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:33.714423 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 914) took 1215 ms. Trace:
I20260709 13:11:33.714753 19221 rpcz_store.cc:276] 0709 13:11:32.498612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.713328 (+1214716us) service_pool.cc:224] Handling call
0709 13:11:33.713633 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.714195 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.714374 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.717095 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3046) took 1249 ms. Trace:
I20260709 13:11:33.716156 19894 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:11:33.717468 19367 rpcz_store.cc:276] 0709 13:11:32.467309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.841940 (+374631us) service_pool.cc:224] Handling call
0709 13:11:32.842324 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.180118 (+337794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.180152 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.180214 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:33.180250 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.716895 (+536645us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400137ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:33.716938 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.717046 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776413568}
I20260709 13:11:33.718713 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:33.719717 25630 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.722445 25996 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.685325 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.656821 26036 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.689340 19898 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:33.681036 26022 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.677268 25903 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:33.696734 26117 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:33.681289 25793 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:33.697422 26118 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:11:33.697728 25827 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:33.698485 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:33.703277 25913 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.749429 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.700068 26025 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.674198 25744 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:33.724768 25955 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.781227 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3311) took 1565 ms. Trace:
I20260709 13:11:33.783267 19292 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:33.725566 26009 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.729080 26104 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.716032 26075 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:33.732383 25965 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.738601 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.798628 19293 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:33.696426 26078 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:33.664764 25814 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:11:33.768559 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.773979 25793 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.774950 25827 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.743247 25903 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.778223 26036 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.780256 25744 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.789067 19900 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:33.676071 26026 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.781680 19223 rpcz_store.cc:276] 0709 13:11:32.215835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.227825 (+1011990us) service_pool.cc:224] Handling call
0709 13:11:33.238807 (+ 10982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.239316 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.239347 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.239783 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.462307 (+222524us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.470618 (+  8311us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.470847 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.470924 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.504779 (+ 33855us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180047f080. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:33.780910 (+276131us) raft_consensus.cc:1685] finished
0709 13:11:33.781035 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.781169 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61551,"prepare.queue_time_us":8027,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1075,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":7289,"spinlock_wait_cycles":4843392,"thread_start_us":193743,"threads_started":1,"wal-append.queue_time_us":300202}
I20260709 13:11:33.802807 19296 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:33.801733 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:33.813272 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.814273 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.814868 19300 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:33.815721 19896 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:33.816885 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:33.820804 19219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2659) took 2554 ms (client timeout 2478 ms). Trace:
W20260709 13:11:33.821208 19219 rpcz_store.cc:269] 0709 13:11:31.261542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.690367 (+428825us) service_pool.cc:224] Handling call
0709 13:11:33.815400 (+2125033us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540013e054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:33.815525 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768606592}
I20260709 13:11:33.821653 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.805639 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3312) took 1553 ms. Trace:
W20260709 13:11:33.806131 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 145552us
I20260709 13:11:33.809783 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.807255 26078 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:33.825129 19263 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:33.822973 19220 rpcz_store.cc:276] 0709 13:11:32.251854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.488742 (+1236888us) service_pool.cc:224] Handling call
0709 13:11:33.488973 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.489111 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:33.656100 (+166989us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.805324 (+149224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.805375 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:33.805424 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.805482 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.805587 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":79043,"prepare.run_cpu_time_us":5792,"prepare.run_wall_time_us":49568,"raft.queue_time_us":89,"spinlock_wait_cycles":7761792,"thread_start_us":238269,"threads_started":2}
I20260709 13:11:33.810536 25744 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:33.817040 26023 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:33.828538 19263 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:33.826975 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.829246 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:33.829577 19220 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:33.832052 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3313) took 1499 ms. Trace:
I20260709 13:11:33.843393 19225 rpcz_store.cc:276] 0709 13:11:32.333154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.558302 (+1225148us) service_pool.cc:224] Handling call
0709 13:11:33.558645 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.567615 (+  8970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.567654 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.572279 (+  4625us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.678961 (+106682us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.767457 (+ 88496us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.767746 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.767859 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.831832 (+ 63973us) raft_consensus.cc:1685] finished
0709 13:11:33.831859 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.831994 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101131,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":10916,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":20416,"thread_start_us":45187,"threads_started":1,"wal-append.queue_time_us":206248}
I20260709 13:11:33.844931 25913 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.833191 26104 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.835184 19219 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:11:33.848480 19219 pending_rounds.cc:85] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 13
I20260709 13:11:33.848805 19219 pending_rounds.cc:107] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:11:33.849027 19219 raft_consensus.cc:2889] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:33.849905 26023 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:33.850875 26023 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.835572 19300 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:33.852108 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:33.841329 26075 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:33.852768 19300 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:11:33.853762 19300 pending_rounds.cc:85] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 10
I20260709 13:11:33.854001 19300 pending_rounds.cc:107] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:11:33.854226 19300 raft_consensus.cc:2889] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:33.825875 25891 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.003s
I20260709 13:11:33.857614 25891 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:33.858141 19300 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:33.859288 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 926) took 1006 ms. Trace:
I20260709 13:11:33.859712 19220 rpcz_store.cc:276] 0709 13:11:32.852770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.827664 (+974894us) service_pool.cc:224] Handling call
0709 13:11:33.827919 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.859052 (+ 31133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.859228 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.862866 19300 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:33.872859 19292 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 10.
I20260709 13:11:33.861480 26128 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:33.876698 25948 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:33.876785 26128 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.878991 26026 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.876824 26078 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:33.881873 26103 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.786s	user 0.003s	sys 0.004s
I20260709 13:11:33.883069 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1223) took 1547 ms. Trace:
I20260709 13:11:33.858938 25814 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.880019 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 989) took 2140 ms. Trace:
I20260709 13:11:33.884680 19897 rpcz_store.cc:276] 0709 13:11:31.739352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.739499 (+   147us) service_pool.cc:224] Handling call
0709 13:11:31.758987 (+ 19488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.096490 (+1337503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.879766 (+783276us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54006c48d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:33.879935 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994969856}
I20260709 13:11:33.883422 19373 rpcz_store.cc:276] 0709 13:11:32.336029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.336156 (+   127us) service_pool.cc:224] Handling call
0709 13:11:32.336544 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.499243 (+162699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.499283 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.732863 (+233580us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.897776 (+164913us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:32.897816 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.897883 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.881310 (+983427us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:33.882810 (+  1500us) raft_consensus.cc:1685] finished
0709 13:11:33.882831 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.883015 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20001,"raft.queue_time_us":280766,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":44740,"spinlock_wait_cycles":15162752,"thread_start_us":314642,"threads_started":2,"wal-append.queue_time_us":325337}
I20260709 13:11:33.888016 19294 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:33.892205 19293 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:33.865589 25913 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:11:33.901252 26095 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.821s	user 0.003s	sys 0.000s
I20260709 13:11:33.889663 25793 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:33.887364 25630 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:33.884318 25814 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.910480 26025 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:33.912122 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2665) took 2467 ms. Trace:
I20260709 13:11:33.912569 19222 rpcz_store.cc:276] 0709 13:11:31.444966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.739011 (+294045us) service_pool.cc:224] Handling call
0709 13:11:31.740742 (+  1731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.090812 (+350070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.911856 (+1821044us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54000780d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:33.912063 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696805248}
I20260709 13:11:33.916575 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2480) took 1588 ms. Trace:
I20260709 13:11:33.917001 19291 rpcz_store.cc:276] 0709 13:11:32.328548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.328725 (+   177us) service_pool.cc:224] Handling call
0709 13:11:32.349016 (+ 20291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.408827 (+ 59811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.411309 (+  2482us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.411792 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.782188 (+1370396us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b1800393ac0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:33.893609 (+111421us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:33.893654 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.893726 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.916238 (+ 22512us) raft_consensus.cc:1685] finished
0709 13:11:33.916266 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.916512 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22833,"raft.queue_time_us":46807,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":45889,"spinlock_wait_cycles":11739904,"thread_start_us":111105,"threads_started":1,"wal-append.queue_time_us":1442257}
I20260709 13:11:33.918305 25891 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:33.875813 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47347.3us
W20260709 13:11:33.968889 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.905148 26022 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19.
I20260709 13:11:33.975543 26128 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.984824 25891 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:33.986914 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:33.987486 25891 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:33.988684 26128 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:33.989779 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 66236.3us
I20260709 13:11:33.990224 25891 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:33.993081 26128 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:33.997434 25678 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:33.998076 25678 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.013144 25678 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.016709 25130 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.022454 25630 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.015432 26052 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.023910 25630 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.025220 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3315) took 1166 ms. Trace:
I20260709 13:11:34.026424 25630 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.025619 19225 rpcz_store.cc:276] 0709 13:11:32.859131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.846064 (+986933us) service_pool.cc:224] Handling call
0709 13:11:33.846355 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:33.846687 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.846713 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:33.847262 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 13:11:33.927319 (+ 80057us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.927374 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.927589 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.024960 (+ 97371us) raft_consensus.cc:1685] finished
0709 13:11:34.024996 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.025160 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6027,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":79622,"threads_started":1,"wal-append.queue_time_us":174086}
I20260709 13:11:34.031536 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.033918 25814 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.019508 25130 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.038375 25130 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.010429 25903 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.041198 19221 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:34.041498 25640 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:34.041929 25640 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:34.042375 25903 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.042775 25640 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.043807 25640 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:34.043885 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 922) took 1192 ms. Trace:
I20260709 13:11:34.044288 19221 rpcz_store.cc:276] 0709 13:11:32.851333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.715445 (+864112us) service_pool.cc:224] Handling call
0709 13:11:33.715723 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.041616 (+325893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.043662 (+  2046us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54000e3154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:34.043829 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748097280}
I20260709 13:11:34.045845 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.046584 19296 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.053208 26096 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.048588 19265 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:34.058902 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:34.087567 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1216) took 2224 ms. Trace:
I20260709 13:11:34.039716 25744 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.093968 19373 raft_consensus.cc:1240] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:34.095467 25130 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:34.088840 19899 rpcz_store.cc:276] 0709 13:11:31.863441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.863639 (+   198us) service_pool.cc:224] Handling call
0709 13:11:31.977982 (+114343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.992608 (+ 14626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.992637 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.904086 (+1911449us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b2c000474b8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:33.904778 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.052420 (+147642us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:34.052478 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.052581 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.054558 (+  1977us) raft_consensus.cc:1685] finished
0709 13:11:34.054588 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.087503 (+ 32915us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45166,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10427,"spinlock_wait_cycles":20815616,"thread_start_us":146665,"threads_started":1,"wal-append.queue_time_us":145771}
I20260709 13:11:34.095877 25130 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:34.092481 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 818106us
W20260709 13:11:34.097452 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 764596us
I20260709 13:11:34.105130 25347 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:34.107887 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:34.112519 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.120620 19299 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:34.121783 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.122438 19299 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.089066 25908 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:34.124949 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.125555 19297 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.093097 26066 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.127275 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:34.098282 25814 raft_consensus.cc:2804] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:34.131122 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.137456 19373 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.135507 25130 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:34.144269 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47600.5us
I20260709 13:11:34.144304 26108 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:34.146103 25595 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:34.146509 25595 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:34.147292 25595 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.148376 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.149816 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.150014 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3043) took 1693 ms. Trace:
I20260709 13:11:34.150115 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:34.150568 19339 connection.cc:256] RPC call timeout handler was delayed by -1.9934752080000635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:11:34.151345 19339 connection.cc:256] RPC call timeout handler was delayed by -1.627850507000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24780000000000002s for a response
I20260709 13:11:34.152311 25450 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.152607 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.152853 25450 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.153434 19224 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:11:34.154372 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.155026 25450 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:34.155537 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:34.155791 25654 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.156243 19902 raft_consensus.cc:2368] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:11:34.156522 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:34.157351 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:34.157685 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 45655.9us
I20260709 13:11:34.158049 19372 raft_consensus.cc:2393] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:34.148479 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.152303 19222 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:34.159210 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:34.159721 19297 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:34.151280 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.161283 19369 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:11:34.161671 19369 pending_rounds.cc:85] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 12
I20260709 13:11:34.162029 19369 pending_rounds.cc:107] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:11:34.162321 19369 raft_consensus.cc:2889] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.163815 19897 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:34.161713 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:34.163621 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.150473 19366 rpcz_store.cc:276] 0709 13:11:32.456797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.615604 (+158807us) service_pool.cc:224] Handling call
0709 13:11:32.615912 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.760483 (+144571us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:33.060323 (+299840us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.150273 (+ 89950us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.150323 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:33.150364 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.980409 (+830045us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18002e36c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419
0709 13:11:34.149804 (+169395us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400357854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:34.149859 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.149966 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":139199,"prepare.run_cpu_time_us":2960,"prepare.run_wall_time_us":23511,"raft.queue_time_us":200,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8733,"spinlock_wait_cycles":334589056,"thread_start_us":293054,"threads_started":2,"wal-append.queue_time_us":178888}
I20260709 13:11:34.169930 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.170083 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.170601 19225 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:34.170527 19366 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:34.171514 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.173434 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.174775 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.175952 19369 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:11:34.178604 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.179045 19366 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:34.179487 19369 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:34.180272 19216 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:34.180688 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.181397 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.182291 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.183597 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:34.188397 25903 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:34.184203 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:34.258728 19903 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:34.176844 25913 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:11:34.186048 19297 raft_consensus.cc:1240] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:34.187145 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.140729 25915 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:11:34.140887 25891 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.163877 26087 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.163750 25654 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.198591 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.199579 19896 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:11:34.144326 25868 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:11:34.137012 26092 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:11:34.199947 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.201133 25948 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:34.178884 25814 raft_consensus.cc:697] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:34.202628 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:34.185758 25595 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.137297 26066 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.204373 25678 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.205689 25695 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.137598 26122 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:11:34.206652 25805 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.168305 26091 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:34.208532 25744 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.208437 26096 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:34.210083 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2476) took 2083 ms. Trace:
I20260709 13:11:34.141268 25997 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:11:34.213780 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:34.355386 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 141679us
I20260709 13:11:34.356036 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:34.215972 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:34.216965 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:34.228976 25659 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.230058 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.237049 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.237835 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.238950 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2486) took 1351 ms. Trace:
I20260709 13:11:34.360913 19225 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:34.239955 19373 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:34.361044 19292 rpcz_store.cc:276] 0709 13:11:32.880284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.286476 (+406192us) service_pool.cc:224] Handling call
0709 13:11:34.231062 (+944586us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54001d3154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:34.231176 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140421888}
I20260709 13:11:34.240927 19899 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:34.156584 26075 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:11:34.241511 19369 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:34.245313 19296 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:34.264614 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.267261 25891 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:34.240222 25713 consensus_queue.cc:1059] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:11:34.273932 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:34.376600 19297 raft_consensus.cc:606] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.376983 19297 raft_consensus.cc:614] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:34.262789 26061 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.266147 25903 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:34.287559 26136 log.cc:927] Time spent T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:11:34.241318 26058 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.288136 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.263653 25989 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:34.404981 19218 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
W20260709 13:11:34.293502 26141 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:11:34.295514 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 131979us
I20260709 13:11:34.296241 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.297410 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3040) took 1907 ms. Trace:
W20260709 13:11:34.299347 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 96797us
W20260709 13:11:34.301852 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 101998us
I20260709 13:11:34.307364 19299 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:34.317628 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.363510 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.313546 26023 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.312640 25653 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:34.367798 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.373736 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.426280 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.425676 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.426964 19373 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:34.427081 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.354022 19295 rpcz_store.cc:276] 0709 13:11:32.127100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.127304 (+   204us) service_pool.cc:224] Handling call
0709 13:11:32.162229 (+ 34925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.380454 (+218225us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:32.455125 (+ 74671us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.150864 (+695739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.151024 (+   160us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:33.151166 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.189231 (+1038065us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b1800254620. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419
0709 13:11:34.209866 (+ 20635us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400346554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:34.209911 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.210028 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10386,"prepare.queue_time_us":98848,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":13053,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":81,"spinlock_wait_cycles":546219008,"thread_start_us":681810,"threads_started":1,"wal-append.queue_time_us":711142,"wal-append.run_cpu_time_us":929,"wal-append.run_wall_time_us":1000985}
I20260709 13:11:34.294176 26087 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.360872 26096 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.361732 26128 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:34.373270 25659 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.407553 25989 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:34.377460 26135 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.062s	user 0.007s	sys 0.000s
W20260709 13:11:34.408857 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.375219 25891 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.427273 19366 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:34.432035 19216 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:11:34.443769 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 206646us
I20260709 13:11:34.435657 26016 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:34.438916 26128 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.434177 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.425597 19371 rpcz_store.cc:276] 0709 13:11:32.390055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.412446 (+ 22391us) service_pool.cc:224] Handling call
0709 13:11:32.412747 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.412939 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:34.103634 (+1690695us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b18002fa820. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf
0709 13:11:34.103774 (+   140us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.297095 (+193321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.297147 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:34.297192 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.297251 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.297360 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":446722,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":5917,"spinlock_wait_cycles":15334272,"thread_start_us":624114,"threads_started":2,"wal-append.queue_time_us":303054}
I20260709 13:11:34.449183 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.449276 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.434846 19263 leader_election.cc:400] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:11:34.449736 19371 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:34.449769 19373 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:34.406704 26058 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:34.430428 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66986.9us
I20260709 13:11:34.366735 25695 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.488153 26058 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.493093 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.406957 25713 raft_consensus.cc:3055] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:11:34.438429 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76261us
W20260709 13:11:34.441854 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 334021us
I20260709 13:11:34.431247 25653 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:34.372959 25908 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:34.404096 26061 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.432485 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:34.435113 26151 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:34.511394 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.354537 26091 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.519584 26078 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.521457 26091 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:34.450726 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.428386 19188 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:34.452348 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.443120 25989 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.452548 26128 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.458844 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.461015 25654 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:34.436193 25948 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:11:34.448503 26075 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:34.467000 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 924) took 1615 ms. Trace:
I20260709 13:11:34.468787 26066 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.469664 25659 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:34.473295 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:34.469656 25903 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:34.474977 19372 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:34.477294 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.532465 19293 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.477982 26087 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:34.448100 26152 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:34.479691 26036 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:34.480413 19337 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:34.539397 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:34.481003 26143 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:11:34.440060 25814 consensus_queue.cc:237] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.482214 25891 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.494091 19374 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:34.451280 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:34.500211 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.567827 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.505118 26058 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.510032 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:34.511010 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 78639.2us
I20260709 13:11:34.570401 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:34.449942 19263 leader_election.cc:403] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:34.500810 25713 raft_consensus.cc:740] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:34.517498 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.517707 26061 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.518190 25450 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:34.518364 26151 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:34.519491 26150 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 13:11:34.585158 26023 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:34.523106 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 94792.1us
W20260709 13:11:34.523636 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71453.1us
I20260709 13:11:34.525070 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.526901 19366 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:34.527575 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.587713 19219 raft_consensus.cc:2393] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:34.587849 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.528549 19223 rpcz_store.cc:276] 0709 13:11:32.852032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.810927 (+958895us) service_pool.cc:224] Handling call
0709 13:11:33.817687 (+  6760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.818033 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.818052 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.820482 (+  2430us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.092429 (+271947us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:34.092477 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.092555 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:34.286952 (+194397us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:34.466707 (+179755us) raft_consensus.cc:1685] finished
0709 13:11:34.466728 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.466943 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":368,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2287,"spinlock_wait_cycles":39794560,"thread_start_us":227677,"threads_started":1,"wal-append.queue_time_us":281125}
I20260709 13:11:34.587950 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.508942 25653 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.588464 19371 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:34.588653 19366 raft_consensus.cc:3060] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.589308 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.525880 26078 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:34.591572 25713 consensus_queue.cc:260] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.510505 25908 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:34.537845 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.592780 25908 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.538453 26075 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:34.593770 26075 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:34.594871 26075 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.549015 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2348394564c140f3aec293661379e650"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:34.596470 19293 raft_consensus.cc:606] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Received request to transfer leadership to TS c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:34.574299 26026 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:11:34.596886 19293 raft_consensus.cc:614] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:34.598238 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.599710 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:34.556419 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 76065.8us
I20260709 13:11:34.559299 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.568248 19373 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.502220 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:34.570690 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:34.571956 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 137298us
W20260709 13:11:34.602692 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100550us
I20260709 13:11:34.547703 26016 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:34.579588 25891 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:34.580564 26128 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.567610 26152 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.583837 19217 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:34.569464 26087 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:34.584491 25659 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:34.586761 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:34.592824 25713 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.556077 26036 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:34.603194 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:34.575066 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57616.3us
I20260709 13:11:34.603313 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.604249 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.571462 26096 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.605095 26078 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:34.607640 25913 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:34.609036 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:34.656077 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52829.9us
I20260709 13:11:34.610888 26039 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:34.612561 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.656697 19300 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:11:34.613655 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.628746 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:34.594866 26151 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.656934 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.630810 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.638506 19373 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:34.658670 19372 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.659806 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.657016 19374 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:34.605504 26023 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:34.656220 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:34.608400 25654 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.664294 19371 raft_consensus.cc:2393] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:34.661675 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:34.690392 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.690830 19374 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.661432 19373 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:34.688086 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:34.695104 19901 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:34.696221 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 67537.8us
I20260709 13:11:34.698771 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.699100 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:34.699659 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 90688.4us
W20260709 13:11:34.700037 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43907.6us
I20260709 13:11:34.700811 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.701246 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.702045 25595 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:34.702360 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.702672 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.702841 25595 consensus_queue.cc:1243] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:34.703480 25595 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:34.703574 19373 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:11:34.704084 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.703691 19218 raft_consensus.cc:1240] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:34.712512 19372 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:34.655258 26026 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:34.715219 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.715461 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:34.715864 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.716238 19293 raft_consensus.cc:606] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.715147 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:34.708199 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.717692 19293 raft_consensus.cc:614] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:34.630385 26087 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:34.719251 26087 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.660764 26066 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:34.724313 19369 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:34.724604 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.728138 19219 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.661082 26159 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.631498 25891 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.731976 19366 raft_consensus.cc:2468] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:34.730851 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 229592us
I20260709 13:11:34.738597 19366 raft_consensus.cc:1240] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:11:34.736313 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:34.707747 25913 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:34.705191 25450 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:34.735028 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.697598 25654 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:34.750869 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.751479 19225 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:34.714447 25678 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.707966 25744 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.753567 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.713059 26151 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.758873 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.722923 26026 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.765344 19299 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.765998 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.766567 19374 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:34.759409 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.716405 26156 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:34.714674 25347 raft_consensus.cc:2764] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:34.736394 26159 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.725839 25659 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.761807 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.789580 19300 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.762847 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.763124 19224 raft_consensus.cc:2368] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
I20260709 13:11:34.763021 19366 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:34.662868 26091 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:11:34.764348 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.768658 19374 pending_rounds.cc:85] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 11
I20260709 13:11:34.771013 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.792738 19374 pending_rounds.cc:107] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:11:34.793150 19374 raft_consensus.cc:2889] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.759215 26023 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:34.772492 19297 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:34.752537 26022 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:34.776283 19902 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:11:34.746218 26039 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.794551 19222 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:34.754415 25654 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.745635 25913 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:34.771159 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.770287 26066 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:34.797598 19224 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:34.826457 19224 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:34.800112 26146 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.361s	user 0.003s	sys 0.000s
I20260709 13:11:34.760941 25678 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.761672 25997 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:34.805258 19221 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:34.765193 26151 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.820834 19372 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:34.822104 19220 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:34.809343 19299 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:34.770509 26156 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:34.771648 26026 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.827435 19224 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.857533 19224 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:34.849061 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 133795us
I20260709 13:11:34.788822 26159 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.859547 25678 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.859798 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.860669 25595 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:34.861044 25595 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:34.861405 25595 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:34.861441 26128 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:34.862085 26151 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.805614 25450 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:34.865973 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc8043164d78443493704a95fae3b832"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:34.866793 19299 raft_consensus.cc:606] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.867223 19299 raft_consensus.cc:614] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:34.868314 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.738198 26036 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.775184 25989 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:34.870049 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 131782us
I20260709 13:11:34.873478 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.810635 26023 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:34.894186 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:34.848367 26066 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:34.900549 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 184744us
I20260709 13:11:34.904450 26023 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.904886 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.921170 19300 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:34.922951 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.928591 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:34.929728 19220 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:34.933166 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:34.934880 19370 raft_consensus.cc:2368] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:34.921231 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:34.938620 19369 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:34.944352 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:34.945652 19369 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:34.820137 26022 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:34.909915 25130 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.853204 25997 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:34.911633 25450 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.911403 26066 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.935726 26108 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.958207 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.958901 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.938505 25659 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.959856 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.960460 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.961695 19295 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:34.962366 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.975567 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.811558 26078 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:34.946189 26091 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:34.966742 19224 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:11:34.907902 19339 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:34.970721 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.982853 19224 pending_rounds.cc:85] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:34.983649 19224 pending_rounds.cc:107] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:11:34.959666 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.984081 19224 raft_consensus.cc:2889] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.005234 19298 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:35.006683 26092 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:35.007114 26092 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:34.965749 25997 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:35.010289 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 102559us
I20260709 13:11:35.013504 19223 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:35.026036 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:34.905638 25913 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.017259 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:35.036844 19298 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.032240 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:34.952567 26104 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:11:34.972301 26152 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.042850 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.045179 19292 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:34.984606 26096 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:35.033020 26087 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:35.071278 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.074874 19298 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:35.075516 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.048126 25450 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:35.063939 25913 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:35.088557 25653 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.090704 25653 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.091316 19216 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:35.066080 26087 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.091971 26087 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:35.063675 26152 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.956952 26156 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.031401 26159 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.101898 19339 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.081115 26108 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.118767 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:35.120337 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 518322us
W20260709 13:11:35.122417 26133 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:35.123164 26168 consensus_queue.cc:1059] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:11:35.124683 26176 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.124931 26173 raft_consensus.cc:3055] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:35.125563 26173 raft_consensus.cc:740] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:35.125268 26176 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.126720 26173 consensus_queue.cc:260] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.127563 26176 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:35.128367 26165 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:11:35.128862 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:35.157444 19219 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
W20260709 13:11:35.160977 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 262364us
I20260709 13:11:35.079020 25908 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:35.124677 26153 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.607s	user 0.001s	sys 0.002s
I20260709 13:11:35.167987 19902 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 13:11:35.165436 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43540.4us
I20260709 13:11:35.175174 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:35.165601 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46962.2us
I20260709 13:11:35.171682 26152 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:35.180366 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:35.183565 19224 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:35.166113 19901 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:35.154459 26108 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.181957 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:35.188413 19219 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:35.218603 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:35.219172 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.219478 19895 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:35.221415 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:35.222260 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:35.223644 19899 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:11:35.223697 19368 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:35.161885 26174 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.226821 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:35.228765 26180 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:11:35.232674 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:35.217082 26162 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:35.163354 26170 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:11:35.255553 25989 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:35.242270 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.309610 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:35.310051 26174 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:35.318037 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:35.309693 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 66627.6us
I20260709 13:11:35.320760 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:35.234184 26151 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:35.326045 26167 log.cc:927] Time spent T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.505s	user 0.000s	sys 0.009s
I20260709 13:11:35.327478 25440 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:35.327868 25440 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:35.328662 25440 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.329797 25440 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.244480 26023 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.333535 26023 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:35.340634 25908 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:35.320811 26075 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:35.341961 26075 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.237095 26169 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:11:35.354365 25130 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:35.354913 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 98157us
I20260709 13:11:35.354907 25130 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.356304 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:35.381031 19373 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:35.316953 26177 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:35.383577 26177 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.385174 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:35.385823 26177 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.386691 26177 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:35.387352 26177 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:35.388789 26177 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.392943 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:35.351078 26026 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.399468 26026 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.400141 25908 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.400976 25908 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.402475 26170 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:35.403110 26170 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:35.403311 25908 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:35.397380 26169 consensus_queue.cc:1243] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:11:35.407199 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2505) took 1224 ms. Trace:
I20260709 13:11:35.409248 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2497) took 1247 ms. Trace:
I20260709 13:11:35.409751 19373 rpcz_store.cc:276] 0709 13:11:34.162096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.717475 (+555379us) service_pool.cc:224] Handling call
0709 13:11:34.717887 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.381763 (+663876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.408999 (+ 27236us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:35.409187 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524156800}
I20260709 13:11:35.410852 26174 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:35.412833 26172 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:11:35.415130 26151 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:35.415820 26067 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:35.407634 19372 rpcz_store.cc:276] 0709 13:11:34.183142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.716836 (+533694us) service_pool.cc:224] Handling call
0709 13:11:34.717219 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.853514 (+136295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.406956 (+553442us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400313b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:35.407136 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237470080}
I20260709 13:11:35.315965 25654 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.421381 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.350455 26162 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:35.353464 25653 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:35.377238 25989 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:35.354022 25891 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:35.407704 26087 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.416309 26067 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:35.421207 26026 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:35.425523 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.429394 19369 raft_consensus.cc:1240] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:35.416116 26151 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:35.395893 26163 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.431578 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:35.433830 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.436245 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.445216 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.428298 26075 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:35.457998 19901 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:35.431370 26151 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:35.459919 25595 consensus_meta.cc:287] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.024s
I20260709 13:11:35.458192 26159 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:35.457026 25678 consensus_meta.cc:287] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.597s	user 0.004s	sys 0.006s
W20260709 13:11:35.480988 19222 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.015s
W20260709 13:11:35.481513 19222 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.006s	sys 0.015s
I20260709 13:11:35.484120 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2493) took 1326 ms. Trace:
I20260709 13:11:35.484690 19370 rpcz_store.cc:276] 0709 13:11:34.157317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.169350 (+ 12033us) service_pool.cc:224] Handling call
0709 13:11:35.483868 (+1314518us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400298e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:35.484047 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528331520}
I20260709 13:11:35.457309 25915 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:35.432206 26026 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.458336 26022 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:35.438102 25891 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.404048 26170 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.529547 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:35.496639 26152 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:11:35.479822 25595 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.488803 25678 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.558588 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:35.558841 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:35.560623 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:35.567092 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:35.543076 26183 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:11:35.586426 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:35.591106 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:35.591632 19372 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.597129 19218 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:35.598305 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.602274 25678 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:35.604725 26190 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:11:35.605255 26108 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:35.605688 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.608806 26108 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.609930 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.610786 19218 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:35.616668 26193 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.617368 26193 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.620577 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:35.621342 19218 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
W20260709 13:11:35.633643 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 276207us
I20260709 13:11:35.643143 19372 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:35.645548 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:35.646277 19292 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:35.645167 25997 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.002s
I20260709 13:11:35.527510 26162 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.532269 26151 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.637475 26186 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:35.643574 25654 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.666776 19372 raft_consensus.cc:1240] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:35.653689 26066 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 13:11:35.660641 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:35.646080 26108 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:35.659454 26087 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.677811 19292 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:11:35.678540 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3058) took 1378 ms. Trace:
I20260709 13:11:35.679296 19374 rpcz_store.cc:276] 0709 13:11:34.300243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.768111 (+467868us) service_pool.cc:224] Handling call
0709 13:11:34.768444 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.796117 (+ 27673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.796150 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:34.824683 (+ 28533us) log.cc:844] Serialized 52 byte log entry
0709 13:11:35.043586 (+218903us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:35.043643 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.043737 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.678188 (+634451us) raft_consensus.cc:1685] finished
0709 13:11:35.678222 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.678456 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1993,"raft.queue_time_us":4552,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":46,"thread_start_us":146745,"threads_started":1,"wal-append.queue_time_us":363010}
I20260709 13:11:35.658006 26194 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.683874 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 236845us
I20260709 13:11:35.684105 19218 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:35.647921 26193 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:35.691908 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:35.716429 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:35.657840 25997 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.679738 25989 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:35.671726 26186 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.690130 26151 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.691216 26087 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:35.721917 25891 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:35.697974 25653 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:35.723552 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:35.728039 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.679193 26066 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.690522 26194 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.744517 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:35.686080 26108 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.752883 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:35.755563 26192 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:35.761832 26066 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:35.763013 19373 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.728310 26026 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:35.728859 26087 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:35.766625 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:35.748754 26188 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:35.780350 25798 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.764580 25713 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.003s
I20260709 13:11:35.748201 25891 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.867480 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:35.869693 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.785063 26067 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.789664 19896 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:35.872153 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:35.790589 19901 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:11:35.876371 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 109821us
W20260709 13:11:35.864190 26196 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
W20260709 13:11:35.864621 26133 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:11:35.805032 26173 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:35.807288 25130 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.810763 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1241) took 1181 ms. Trace:
I20260709 13:11:35.885249 19369 rpcz_store.cc:276] 0709 13:11:34.629156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.947409 (+318253us) service_pool.cc:224] Handling call
0709 13:11:34.947690 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:35.431042 (+483352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.810435 (+379393us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54004268d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:35.810683 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107352960}
I20260709 13:11:35.814550 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3323) took 1117 ms. Trace:
I20260709 13:11:35.881773 25130 consensus_queue.cc:1059] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:35.888502 25130 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:35.888856 25130 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.889175 25130 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:35.889400 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:35.890298 19219 raft_consensus.cc:2368] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:35.824618 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:35.882295 25347 consensus_queue.cc:1175] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "56df67425e6f45d3b2b42441e3c143ba" responder_term: 20 status { last_received { term: 19 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:35.795856 25595 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:35.881296 25891 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:35.825018 25744 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:35.827453 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.831686 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:35.894526 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62901.6us
W20260709 13:11:35.839071 19371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2512) took 1654 ms (client timeout 2163 ms). Trace:
W20260709 13:11:35.895099 19371 rpcz_store.cc:269] 0709 13:11:34.185136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.589091 (+403955us) service_pool.cc:224] Handling call
0709 13:11:35.838856 (+1249765us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54000938d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:35.839008 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166311808}
I20260709 13:11:35.895776 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:35.896193 19895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:35.832073 25659 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:11:35.896924 19895 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:35.899438 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:35.873436 25793 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.846580 19899 raft_consensus.cc:1240] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:35.854297 25948 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:35.855688 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:35.856320 25903 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:35.858525 26181 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:35.782213 26036 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.726686 25989 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.775128 26022 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.872583 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:35.877483 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:35.791386 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:35.960088 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 92447.2us
I20260709 13:11:35.792256 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:35.961014 19903 raft_consensus.cc:3060] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:35.878388 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:35.961877 19297 raft_consensus.cc:2410] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:11:35.868361 25798 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.862951 26087 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.986253 25798 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.986856 25798 raft_consensus.cc:3055] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:35.987179 25798 raft_consensus.cc:740] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:35.886957 19216 rpcz_store.cc:276] 0709 13:11:34.697583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.698868 (+  1285us) service_pool.cc:224] Handling call
0709 13:11:35.814348 (+1115480us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54000e4554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:35.814479 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900535680}
I20260709 13:11:35.988318 19895 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:11:35.821003 25909 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:35.989343 25909 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:35.989768 25909 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:35.990321 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:35.991145 19295 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:35.990970 25909 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:35.882558 26067 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:35.992753 26179 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.753s	user 0.002s	sys 0.002s
I20260709 13:11:35.993206 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:35.994038 26168 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:35.994493 26168 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.994921 26168 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:35.894601 25595 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:35.996366 25595 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.901482 25695 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:35.996833 25595 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:35.997283 25695 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:35.998421 25695 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:35.989775 19895 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:35.840370 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1234) took 1711 ms. Trace:
W20260709 13:11:35.931437 26202 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:35.949504 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.942269 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:35.919706 19373 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
W20260709 13:11:35.849098 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.936506 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:35.957288 19368 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:35.900085 26175 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.731s	user 0.003s	sys 0.000s
I20260709 13:11:35.914502 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:35.904304 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.922633 19900 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEARNER]: Advancing to term 18
I20260709 13:11:36.074146 19903 raft_consensus.cc:2468] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:36.078848 19339 leader_election.cc:400] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:36.079265 19339 leader_election.cc:403] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:11:36.079931 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.961966 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:35.963599 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:35.966090 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:35.956658 26181 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:35.927510 26108 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:35.976523 25678 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:36.084065 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 423464us
I20260709 13:11:35.977083 26169 consensus_queue.cc:1059] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:35.977871 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:35.992187 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 114771us
I20260709 13:11:35.992309 25948 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:35.896109 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:35.905737 26178 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.675s	user 0.001s	sys 0.000s
I20260709 13:11:35.886474 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.033614 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:35.884104 26147 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.422s	user 0.015s	sys 0.004s
I20260709 13:11:35.929139 26186 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.075841 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:36.073200 25130 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.076241 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:36.028669 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.142839 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:36.085206 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:36.085881 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:36.087329 19293 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 15: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:36.087218 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2691) took 1557 ms. Trace:
I20260709 13:11:36.144719 19217 rpcz_store.cc:276] 0709 13:11:34.530217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.530350 (+   133us) service_pool.cc:224] Handling call
0709 13:11:34.530613 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.608966 (+ 78353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.086965 (+1477999us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54003d1b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:36.087164 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121949568}
I20260709 13:11:35.929978 25997 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:36.089234 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3341) took 1220 ms. Trace:
I20260709 13:11:36.074141 25908 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.146938 19222 rpcz_store.cc:276] 0709 13:11:34.867943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.900932 (+ 32989us) service_pool.cc:224] Handling call
0709 13:11:34.919224 (+ 18292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.919441 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:34.954885 (+ 35444us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.735838 (+780953us) log.cc:844] Serialized 14 byte log entry
0709 13:11:36.083121 (+347283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.083170 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:36.083214 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.088239 (+  5025us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.088397 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7075,"prepare.queue_time_us":52290,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":4835,"raft.queue_time_us":102685,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":15026,"thread_start_us":1105103,"threads_started":3}
I20260709 13:11:36.087144 26199 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:36.086588 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:36.156790 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:36.156939 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 70432.3us
I20260709 13:11:36.098553 19902 raft_consensus.cc:2393] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:35.895810 25713 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.110548 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.169441 19371 raft_consensus.cc:2393] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:36.112016 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.128564 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:36.083475 26022 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:11:36.130342 26174 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:36.131209 25347 consensus_queue.cc:1059] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:35.909746 26096 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.200s
I20260709 13:11:35.987979 25798 consensus_queue.cc:260] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.135227 25891 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:36.113400 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:36.180727 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67440.2us
I20260709 13:11:36.181447 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:36.183296 19222 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:11:36.145690 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 69614.1us
I20260709 13:11:36.146008 19292 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 19. Ops: []
I20260709 13:11:35.928385 26066 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.216s
I20260709 13:11:36.000335 19367 rpcz_store.cc:276] 0709 13:11:34.128594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.128842 (+   248us) service_pool.cc:224] Handling call
0709 13:11:34.129171 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:34.440679 (+311508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.440699 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:34.509228 (+ 68529us) log.cc:844] Serialized 52 byte log entry
0709 13:11:34.689939 (+180711us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:34.724003 (+ 34064us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.896504 (+172501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.839888 (+943384us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400197154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:35.839945 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.839998 (+    53us) raft_consensus.cc:1685] finished
0709 13:11:35.840122 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.840307 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34251,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":162590,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":5474,"spinlock_wait_cycles":523461888,"thread_start_us":388195,"threads_started":3,"wal-append.queue_time_us":215569}
I20260709 13:11:36.139034 25744 consensus_queue.cc:1059] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:11:36.074111 25659 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:36.150063 19900 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:11:36.192716 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.150492 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:36.152944 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.087742 25678 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:36.087538 25654 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:36.129603 19337 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:36.146893 26202 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:36.171834 19369 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:35.965061 25793 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.175886 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:36.150511 25913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.024s	sys 0.020s
I20260709 13:11:36.175911 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.145140 25948 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:35.926177 25653 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.206112 25678 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.207370 25678 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:36.000373 26092 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.208940 26092 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:36.148466 25909 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.215353 26168 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.146786 26207 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:36.189623 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:36.231660 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:36.171360 26152 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.150192 25130 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.197803 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:36.197840 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68320.7us
I20260709 13:11:36.201579 19368 raft_consensus.cc:2393] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:36.202543 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.230410 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1233) took 2122 ms. Trace:
I20260709 13:11:36.202698 19902 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:11:36.191263 26096 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:36.217031 25948 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.189811 26156 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:36.221395 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70975.7us
I20260709 13:11:36.204809 25737 raft_consensus.cc:2804] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:36.221854 25595 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.168010 25908 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.173900 25713 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.224201 26016 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:36.203987 25798 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.257907 25908 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.231803 19367 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:36.234997 19365 rpcz_store.cc:276] 0709 13:11:34.108113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.108259 (+   146us) service_pool.cc:224] Handling call
0709 13:11:34.108557 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.108762 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.108787 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.119920 (+ 11133us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.375664 (+255744us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:34.375698 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.375758 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.690162 (+1314404us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:36.204011 (+513849us) raft_consensus.cc:1685] finished
0709 13:11:36.204039 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.230341 (+ 26302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28032384,"thread_start_us":196050,"threads_started":1,"wal-append.queue_time_us":312707}
I20260709 13:11:36.270467 26108 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:36.270974 26108 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:36.273252 25989 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:36.221895 26209 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.274327 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:36.275450 25793 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:36.235483 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.238161 25903 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:11:36.276379 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:36.262873 26087 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.276710 25737 raft_consensus.cc:697] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:36.196934 26188 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:36.199631 25659 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.277840 25737 consensus_queue.cc:237] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.279191 19373 raft_consensus.cc:2410] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:11:36.280277 25659 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:36.198424 26194 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.202276 26022 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:36.240535 19371 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:11:36.281558 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:36.281746 25595 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:36.282415 19371 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:36.282791 19300 raft_consensus.cc:2410] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:11:36.282908 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:36.203450 25913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.025s	sys 0.020s
I20260709 13:11:36.283699 19902 raft_consensus.cc:2393] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:36.242487 19374 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:36.285745 26022 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:36.286942 26022 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.288645 26188 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:36.242985 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1033) took 1607 ms. Trace:
I20260709 13:11:36.289757 26188 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.289609 19294 rpcz_store.cc:276] 0709 13:11:34.635546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.635654 (+   108us) service_pool.cc:224] Handling call
0709 13:11:34.635973 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.665115 (+ 29142us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:34.724666 (+ 59551us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.979791 (+255125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:35.031702 (+ 51911us) log.cc:844] Serialized 26 byte log entry
0709 13:11:35.031925 (+   223us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:35.031973 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.032059 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.899504 (+867445us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:36.231150 (+331646us) raft_consensus.cc:1685] finished
0709 13:11:36.242755 (+ 11605us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:36.242907 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29128,"prepare.queue_time_us":61987,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":25650,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":68707,"spinlock_wait_cycles":7883136,"thread_start_us":210710,"threads_started":1,"wal-append.queue_time_us":334730}
I20260709 13:11:36.149271 26186 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.244853 26207 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:36.293402 26207 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.272007 26108 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.245426 19366 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:36.253176 19896 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:36.254102 25713 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:36.283707 19371 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:36.233582 26023 raft_consensus.cc:3055] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:36.256455 26016 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:36.300231 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 425523us
I20260709 13:11:36.259348 25908 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:36.317919 19294 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:36.332353 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 298836us
I20260709 13:11:36.296480 26203 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:36.296702 26087 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:36.334122 19299 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:36.334805 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:36.376659 19297 raft_consensus.cc:2368] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:36.377899 19297 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:36.337742 19265 leader_election.cc:400] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 9 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 9. Current term is 10.
W20260709 13:11:36.385331 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47726.5us
I20260709 13:11:36.387188 19265 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:36.348347 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:36.349218 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:36.297961 26023 raft_consensus.cc:740] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:36.510296 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 123192us
I20260709 13:11:36.510842 19295 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:36.511106 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2635) took 1567 ms. Trace:
I20260709 13:11:36.511436 19300 rpcz_store.cc:276] 0709 13:11:34.943863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.944048 (+   185us) service_pool.cc:224] Handling call
0709 13:11:36.510897 (+1566849us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400031e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:36.511049 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075716992}
I20260709 13:11:36.349993 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:36.351070 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.357069 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:36.412518 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 284064us
I20260709 13:11:36.513324 25130 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:36.514796 19297 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:36.467589 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.332134 25713 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.519363 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:36.521754 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:36.523813 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:36.333350 26078 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:36.515726 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:36.565147 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 216873us
I20260709 13:11:36.566227 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:36.572054 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 388054us
I20260709 13:11:36.566146 25130 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:36.576411 25130 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:36.576864 25130 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:36.577673 25130 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.571216 19265 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:36.581183 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:36.583694 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:36.584586 19297 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:36.586086 19295 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:11:36.587446 19300 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:36.587791 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:36.589327 19296 raft_consensus.cc:2368] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
W20260709 13:11:36.588181 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.375818 26173 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.350126 26203 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:36.375818 26036 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:36.593943 19298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.042s	sys 0.050s
W20260709 13:11:36.607903 19298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.042s	sys 0.050s
W20260709 13:11:36.605019 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.515496 26208 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:36.609625 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:36.617302 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:36.617734 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:36.599815 19367 raft_consensus.cc:2468] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:36.610771 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:36.619328 19219 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:36.612377 19297 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:36.624704 26194 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.625228 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:36.625617 25913 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:36.627902 26174 raft_consensus.cc:3055] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:36.628335 26174 raft_consensus.cc:740] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:36.629158 26174 consensus_queue.cc:260] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.630337 25595 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:36.631292 19340 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:36.632134 25595 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.632941 26171 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:36.633639 26171 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.636622 25913 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:36.636574 26171 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:36.377032 25908 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:36.701227 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 73923.3us
W20260709 13:11:36.664357 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 468936us
I20260709 13:11:36.702847 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:36.707850 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.592108 26170 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.592597 26087 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:36.575013 25713 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.723572 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:36.585326 26078 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:36.733709 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:36.665431 26067 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.005s
I20260709 13:11:36.731925 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:36.750543 19297 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:11:36.711954 25913 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.708278 25793 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:36.769538 19901 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:36.616344 26173 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.652004 26036 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.650846 26016 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.742053 26170 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.773341 25695 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:36.775480 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:36.712289 26208 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 13:11:36.780982 25653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.047s	sys 0.037s
I20260709 13:11:36.708491 26219 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:36.755504 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:36.756206 25948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.034s	sys 0.034s
I20260709 13:11:36.838305 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:36.869227 19297 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
W20260709 13:11:36.869796 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 94410.4us
I20260709 13:11:36.842559 19896 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:11:36.842785 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 260717us
I20260709 13:11:36.870998 19297 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:11:36.776753 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.663789 26023 consensus_queue.cc:260] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.870078 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:36.838395 19295 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:36.872948 19297 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:36.874022 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:36.874542 19340 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:36.876852 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 153365us
I20260709 13:11:36.879417 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:36.778993 25793 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:36.880334 19367 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:36.840534 26168 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:36.880831 19297 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:36.829509 26087 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.767719 26186 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 13:11:36.899875 19297 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:11:36.886432 25909 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.000s
W20260709 13:11:36.872011 25798 consensus_meta.cc:287] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.607s	user 0.001s	sys 0.009s
W20260709 13:11:36.863200 25653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.048s	sys 0.038s
W20260709 13:11:36.874891 25948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.034s	sys 0.034s
I20260709 13:11:36.880694 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:36.903164 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 326949us
I20260709 13:11:36.879062 25891 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:36.905526 26222 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:36.928834 25891 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:36.929364 25891 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.905409 26226 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:36.932653 26226 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.935873 26226 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.941610 26078 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.781956 25913 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.879925 25695 consensus_queue.cc:1243] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:11:36.889021 26092 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.004s
I20260709 13:11:36.914304 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:36.915383 19216 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:11:36.953989 19216 pending_rounds.cc:85] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 12
I20260709 13:11:36.954268 19216 pending_rounds.cc:107] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:11:36.954504 19216 raft_consensus.cc:2889] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:36.887635 25793 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.727286 26203 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:36.916193 19219 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:36.922803 26214 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:11:36.922694 26223 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.923600 26036 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:36.906428 26217 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:11:36.891180 25989 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:36.969014 25913 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:36.929059 25798 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:36.969667 25798 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:36.970188 25798 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.970455 26173 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:36.908725 26023 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.973680 25713 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:36.975322 26156 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.002s
W20260709 13:11:36.957195 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.978909 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:36.862404 26199 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 13:11:36.960603 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46382.4us
I20260709 13:11:36.963765 26171 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.980584 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:36.982095 19219 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:36.981375 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:36.967293 26168 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:36.968362 26036 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.984030 19216 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:36.979938 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:36.985991 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:36.989238 19217 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.000222 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:36.907075 26087 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:36.962410 26078 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.961936 25695 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:36.976586 26067 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.985188 26186 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.985415 25989 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:36.985829 26092 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.988777 26168 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.998536 25913 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.052574 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.084189 19300 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:37.061751 19291 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:37.011255 25653 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.984970 26223 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:36.977828 26194 consensus_queue.cc:1175] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d50eb2dab6754df8bcbed1445f2e8430" responder_term: 21 status { last_received { term: 18 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.16-20.16]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:37.124239 19217 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
W20260709 13:11:37.126904 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.083035 26168 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:36.997561 26171 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:37.151295 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 272767us
I20260709 13:11:37.007496 26036 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.153409 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2652) took 1192 ms. Trace:
I20260709 13:11:37.022853 26078 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.157882 19292 rpcz_store.cc:276] 0709 13:11:35.961158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.963746 (+  2588us) service_pool.cc:224] Handling call
0709 13:11:35.964054 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.187165 (+223111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.153159 (+965994us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540004d3d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:37.153341 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418023680}
I20260709 13:11:37.084664 25909 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:37.110682 26169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.017s	sys 0.020s
I20260709 13:11:37.084012 25908 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:37.160338 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 210968us
I20260709 13:11:37.163527 19340 leader_election.cc:400] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20.
I20260709 13:11:37.047607 26067 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.060030 26186 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.169525 19868 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:37.154330 26221 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:37.162528 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 290445us
I20260709 13:11:37.179785 19340 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:37.166502 26169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.017s	sys 0.020s
I20260709 13:11:37.110561 25913 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.185963 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:37.189376 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 315411us
W20260709 13:11:37.273653 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.385218 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.281924 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 99528.7us
I20260709 13:11:37.386121 19372 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:11:37.386628 19372 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 9
I20260709 13:11:37.386883 19372 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:11:37.387151 19372 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.122571 25653 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:37.418954 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.023s	sys 0.054s
W20260709 13:11:37.419414 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.023s	sys 0.054s
W20260709 13:11:37.420130 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 550062us
W20260709 13:11:37.390535 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 210809us
I20260709 13:11:37.391359 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:37.422430 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:37.170495 26170 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:37.465816 19369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.018s
W20260709 13:11:37.479732 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.005s	sys 0.018s
W20260709 13:11:37.431918 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 431801us
I20260709 13:11:36.762804 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:37.170945 25909 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:37.487784 25130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.015s	sys 0.009s
I20260709 13:11:37.178536 26092 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.291s
I20260709 13:11:37.387908 25908 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:37.492751 25130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.016s	sys 0.012s
I20260709 13:11:37.495398 25130 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:37.383726 26210 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.500644 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:37.497696 25130 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.502504 25130 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.424675 26238 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:37.471853 26208 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:37.465764 26240 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:37.427759 26222 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:37.491462 25713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.030s
I20260709 13:11:37.424486 25737 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:11:37.505903 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 385134us
I20260709 13:11:37.544081 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:37.471635 26226 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.417256 25695 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.101s
I20260709 13:11:37.503365 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:37.497802 19371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.033s	sys 0.050s
I20260709 13:11:37.184754 25654 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.309s
W20260709 13:11:37.547503 19371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.033s	sys 0.050s
I20260709 13:11:37.561007 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.561839 19217 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:37.564335 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61066.6us
I20260709 13:11:37.500108 25908 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.383333 26221 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.580209 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.584041 19217 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:11:37.551209 25713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.030s
I20260709 13:11:37.425055 26229 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.163s
I20260709 13:11:37.506963 26170 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:37.559096 25891 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.002s
I20260709 13:11:37.586966 25130 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.613183 25130 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:37.547122 26240 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:37.618240 25130 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:37.611814 26258 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:37.563010 26226 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.607988 26259 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:11:37.583468 26220 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:37.637252 26259 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:37.637887 26216 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.905s	user 0.009s	sys 0.007s
I20260709 13:11:37.638033 25913 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:37.641165 26254 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:11:37.641728 26244 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.642457 26244 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.623960 26162 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:37.643949 26162 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:37.644412 26162 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:37.648307 26218 log.cc:927] Time spent T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.622s	user 0.001s	sys 0.001s
I20260709 13:11:37.650005 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1037) took 1687 ms. Trace:
I20260709 13:11:37.612970 26087 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:37.584826 26022 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:37.651372 26022 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.653540 26159 raft_consensus.cc:3055] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:37.653837 26022 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:37.653975 26159 raft_consensus.cc:740] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:37.470948 25989 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.623029 19868 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:37.650362 19298 rpcz_store.cc:276] 0709 13:11:35.962468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.962610 (+   142us) service_pool.cc:224] Handling call
0709 13:11:35.988557 (+ 25947us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:35.988910 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:35.988939 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:35.989548 (+   609us) log.cc:844] Serialized 78 byte log entry
0709 13:11:36.608500 (+618952us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:37.114956 (+506456us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.497812 (+382856us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.498002 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.498085 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.649748 (+151663us) raft_consensus.cc:1685] finished
0709 13:11:37.649771 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.649944 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10329,"prepare.queue_time_us":587538,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":34103,"raft.queue_time_us":626152,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":8902,"thread_start_us":1399826,"threads_started":3,"wal-append.queue_time_us":974427}
I20260709 13:11:37.595173 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.550539 25737 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:37.583851 25908 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:37.509449 26210 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.619043 25891 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.669912 19217 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:11:37.674388 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:37.695294 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.576985 25695 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:37.698210 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 275843us
I20260709 13:11:37.557425 26222 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.701020 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:37.708781 19300 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:37.702592 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.712539 19292 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:37.713501 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.714485 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.715132 19292 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 10.
I20260709 13:11:37.631223 26240 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:37.706694 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.612685 26208 consensus_queue.cc:1059] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:11:37.709671 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:37.668467 25737 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:37.585216 26236 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.150s
W20260709 13:11:37.740033 19299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.005s	sys 0.011s
I20260709 13:11:37.740553 19292 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:11:37.740543 19299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.006s	sys 0.011s
I20260709 13:11:37.745182 26256 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:37.750305 26256 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.750727 26256 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:37.723956 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 538162us
I20260709 13:11:37.678750 26162 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.736868 25654 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.745309 26022 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:37.759788 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 266) took 21120 ms (client timeout 15000 ms). Trace:
I20260709 13:11:37.737855 26186 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:37.735214 19300 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 25.
I20260709 13:11:37.742501 26170 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.785720 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2544) took 1158 ms. Trace:
W20260709 13:11:37.767730 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 202529us
I20260709 13:11:37.741969 26036 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:37.747072 26087 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.797405 19297 rpcz_store.cc:276] 0709 13:11:36.627110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.903000 (+275890us) service_pool.cc:224] Handling call
0709 13:11:36.903258 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.903437 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:37.429214 (+525777us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.772720 (+343506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.785410 (+ 12690us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:37.785464 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.785534 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.785658 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9713,"prepare.queue_time_us":516548,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4628,"thread_start_us":801385,"threads_started":2}
W20260709 13:11:37.800287 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.005s	sys 0.012s
W20260709 13:11:37.801995 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.005s	sys 0.012s
I20260709 13:11:37.804970 26186 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:37.804558 25654 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.805513 26186 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.807503 25654 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:37.807525 26186 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.804509 19869 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:37.809661 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.769467 25695 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:37.792434 19117 rpcz_store.cc:269] 0709 13:11:16.638769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.639016 (+   247us) service_pool.cc:224] Handling call
0709 13:11:37.759534 (+21120518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:28.614548 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:28.680019 (+ 65471us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:28.680070 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:11:28.680087 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:28.750532 (+ 70445us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:28.750647 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:28.750680 (+    33us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:11:28.754133 (+  3453us) tablet.cc:701] Row locks acquired
0709 13:11:28.754180 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:11:28.754345 (+   165us) write_op.cc:270] Start()
0709 13:11:28.754490 (+   145us) write_op.cc:276] Timestamp: P: 1783602688754279 usec, L: 0
0709 13:11:28.754512 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:28.915965 (+161453us) log.cc:844] Serialized 10566 byte log entry
0709 13:11:29.174167 (+258202us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb0e28 00007fe8db8eb581 00007fe8db8ead58 00007fe8db8ef9f1 00007fe8db8ef9a9 00007fe8db8ef939 00007fe8db8ef901 00007fe8db8eeb2d 000000000038f354 000000000038f199
0709 13:11:29.504989 (+330822us) op_driver.cc:464] REPLICATION: finished
0709 13:11:29.697799 (+192810us) write_op.cc:301] APPLY: starting
0709 13:11:29.697928 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:30.378212 (+680284us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:30.378267 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:30.807387 (+429120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:30.807799 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:11:30.807860 (+    61us) write_op.cc:312] APPLY: finished
0709 13:11:30.808392 (+   532us) log.cc:844] Serialized 228 byte log entry
0709 13:11:31.595656 (+787264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.705633 (+109977us) write_op.cc:454] Released schema lock
0709 13:11:31.705731 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:31.706227 (+   496us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:31.706275 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10281,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":191465,"apply.run_cpu_time_us":73514,"apply.run_wall_time_us":2008415,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112703,"num_ops":26,"prepare.queue_time_us":273239,"prepare.run_cpu_time_us":47847,"prepare.run_wall_time_us":602645,"raft.queue_time_us":236374,"raft.run_cpu_time_us":20171,"raft.run_wall_time_us":66648,"replication_time_us":750255,"spinlock_wait_cycles":362147200,"thread_start_us":1028034,"threads_started":5,"wal-append.queue_time_us":1062040,"wal-append.run_cpu_time_us":32312,"wal-append.run_wall_time_us":2308359}]]}
I20260709 13:11:37.797374 26170 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:37.811950 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 118639us
W20260709 13:11:37.814574 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 269770us
W20260709 13:11:37.817481 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.819155 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.810827 25695 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:37.825701 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 72281.1us
I20260709 13:11:37.826977 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2657) took 1312 ms. Trace:
W20260709 13:11:37.821228 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.736027 26159 consensus_queue.cc:260] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.836725 26159 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:37.838165 26221 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.811126 26078 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.801931 26234 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:37.768905 26096 consensus_queue.cc:1059] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:11:37.831184 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:37.814074 26162 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:37.835834 26279 raft_consensus.cc:2804] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:37.843575 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:37.803126 26236 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:11:37.827379 19299 rpcz_store.cc:276] 0709 13:11:36.514360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.515446 (+  1086us) service_pool.cc:224] Handling call
0709 13:11:36.515690 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.515894 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:36.988663 (+472769us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.741482 (+752819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.741541 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:37.741601 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.741815 (+   214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.826914 (+ 85099us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75581,"prepare.queue_time_us":651283,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":15588,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":1136354,"threads_started":2}
I20260709 13:11:37.792454 26022 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.826001 25695 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:37.811342 26087 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:37.852802 26249 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:11:37.853425 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:37.863890 26225 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:11:37.865070 26252 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:37.865411 26222 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:37.887234 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83106.2us
I20260709 13:11:37.809913 26256 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:37.850080 26231 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:11:37.853434 26250 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:11:37.911230 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.911931 19297 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:37.912917 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.912343 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.908677 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.914127 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.914312 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.914848 19297 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:37.914964 19222 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:37.915333 19299 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:37.915650 19299 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:37.905249 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.916109 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:37.909701 19292 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:37.845032 25909 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:37.855098 26096 consensus_queue.cc:1243] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:11:37.918848 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.919536 19217 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:37.919920 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:37.920486 19218 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:37.921198 19220 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:11:37.856634 26279 raft_consensus.cc:697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:37.922883 19265 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:37.868755 26152 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:37.904456 26039 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:37.925913 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:37.868440 26264 raft_consensus.cc:2764] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:37.938684 26170 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:37.917692 26186 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.940332 26233 raft_consensus.cc:2764] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:37.940536 26256 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.917889 26078 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.931069 26036 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:11:37.941390 26078 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:37.942485 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.943581 26078 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.935989 19224 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:37.911132 26244 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:37.948823 26276 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:37.949388 26276 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.950856 26210 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.950977 19900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1238) took 1717 ms. Trace:
I20260709 13:11:37.944034 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.951459 19900 rpcz_store.cc:276] 0709 13:11:36.234023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.234150 (+   127us) service_pool.cc:224] Handling call
0709 13:11:36.246164 (+ 12014us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:36.720966 (+474802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.720998 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:36.721550 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:11:37.153096 (+431546us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:37.153144 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.153248 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.950761 (+797513us) raft_consensus.cc:1685] finished
0709 13:11:37.950781 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.950921 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15899,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":785904,"threads_started":2,"wal-append.queue_time_us":829123}
I20260709 13:11:37.940639 26186 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.954886 26186 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.928227 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.903611 26252 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.929327 19217 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:11:37.956230 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.956440 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.956872 19220 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:37.926642 19297 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:37.918370 26275 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:37.958026 19220 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:37.926962 19299 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.933552 19221 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:37.952558 19216 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:37.921355 25891 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.965250 19216 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:37.933013 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:37.917258 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:37.966125 19222 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
W20260709 13:11:37.966928 26273 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:11:37.967154 26248 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:11:37.965646 19216 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:37.957707 26278 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:37.969409 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2531) took 1864 ms. Trace:
I20260709 13:11:37.969926 26278 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.969934 19369 rpcz_store.cc:276] 0709 13:11:36.104989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.287873 (+182884us) service_pool.cc:224] Handling call
0709 13:11:36.288183 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.295428 (+  7245us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:36.334572 (+ 39144us) log.cc:844] Serialized 14 byte log entry
0709 13:11:36.904624 (+570052us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800104020. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:11:37.813206 (+908582us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.813524 (+   318us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:37.814297 (+   773us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.814524 (+   227us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:37.814789 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.814994 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.816654 (+  1660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.968258 (+151604us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800104020. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8522 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:37.969176 (+   918us) raft_consensus.cc:1685] finished
0709 13:11:37.969201 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.969350 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6296,"prepare.queue_time_us":177144,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":6684,"raft.queue_time_us":151148,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":42990,"spinlock_wait_cycles":42505856,"thread_start_us":906618,"threads_started":3,"wal-append.queue_time_us":1302565}
I20260709 13:11:37.973093 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:37.973788 19369 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:37.968981 19216 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.975993 19216 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:37.976298 25678 consensus_meta.cc:287] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 1.768s	user 0.016s	sys 0.000s
I20260709 13:11:37.951481 26276 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:37.978155 25913 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.935745 26039 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:37.966969 25798 consensus_meta.cc:287] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.996s	user 0.012s	sys 0.000s
I20260709 13:11:37.979423 19218 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:37.979493 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2533) took 1874 ms. Trace:
I20260709 13:11:37.963099 19224 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:37.929266 26242 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:11:37.983991 26279 consensus_queue.cc:237] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:37.984054 26233 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:37.985877 26233 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:37.986708 26233 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:37.987941 26233 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:37.991014 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58068.6us
I20260709 13:11:37.980760 19371 rpcz_store.cc:276] 0709 13:11:36.105400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.298194 (+192794us) service_pool.cc:224] Handling call
0709 13:11:36.298574 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.298998 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.299036 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.301488 (+  2452us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.840016 (+538528us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:36.879365 (+ 39349us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.557235 (+677870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.557341 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.979282 (+421941us) raft_consensus.cc:1685] finished
0709 13:11:37.979302 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.979413 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6008,"prepare.queue_time_us":39147,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":98506,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":24727,"thread_start_us":975986,"threads_started":2,"wal-append.queue_time_us":1129216}
W20260709 13:11:37.959466 26168 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
I20260709 13:11:38.001935 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:38.006660 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.006937 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.005499 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:37.963878 26152 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:37.980043 26278 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.009116 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2523) took 2447 ms. Trace:
I20260709 13:11:38.017170 19374 rpcz_store.cc:276] 0709 13:11:35.561747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.682304 (+120557us) service_pool.cc:224] Handling call
0709 13:11:35.682619 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.285395 (+602776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.545644 (+260249us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b54000fb2a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb8a02 00007fe8d7eb4dd6 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:38.008882 (+1463238us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400298e54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:38.009059 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311200384}
I20260709 13:11:38.017951 19216 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:38.018335 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.018563 19216 pending_rounds.cc:85] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:38.019001 19374 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:38.011018 26220 raft_consensus.cc:3055] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:38.012986 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2524) took 2451 ms. Trace:
I20260709 13:11:38.007318 19218 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:38.023166 19372 rpcz_store.cc:276] 0709 13:11:35.562025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.696637 (+134612us) service_pool.cc:224] Handling call
0709 13:11:35.720091 (+ 23454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.387670 (+1667579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.012780 (+625110us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400357354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:38.012935 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3830296832}
I20260709 13:11:37.977986 26240 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.014272 19371 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:38.014556 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.005501 26092 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:38.019052 19216 pending_rounds.cc:107] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:38.019945 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.021430 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.028687 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.030387 19374 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:38.030467 19367 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:11:38.029520 19216 raft_consensus.cc:2889] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:38.030848 19297 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:38.031275 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.031387 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.031800 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:37.982613 25793 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.995s	user 0.010s	sys 0.001s
W20260709 13:11:38.034166 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.034122 25793 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.034600 26170 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:38.035048 26170 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.035424 26170 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.035589 26240 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.036275 25793 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.026710 26277 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.024322 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.037041 26277 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.038262 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.039147 26277 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.039222 19372 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:37.955657 26252 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.013298 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:38.032027 19367 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:38.032388 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:38.041036 26283 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:38.041129 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:38.041757 26283 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:38.041872 26252 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.043112 26279 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:38.041399 19292 raft_consensus.cc:2368] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:38.043752 26279 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:38.027081 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.044124 26279 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:38.044533 26265 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:38.049701 26265 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.050091 26265 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.052632 25737 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.053135 19292 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:38.054168 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.054746 25737 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.055207 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.042673 26283 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.032830 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.044687 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.056967 26152 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.040192 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.057708 19371 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:38.058830 19372 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:38.048821 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:38.059592 19371 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.022480 25713 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:38.060024 25713 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.060395 25713 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:38.061491 26244 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:38.061757 26203 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.062448 25737 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:38.057359 19339 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.064286 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:38.027174 26036 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:38.022265 26229 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:11:38.065026 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2535) took 1959 ms (client timeout 1743 ms). Trace:
I20260709 13:11:38.065425 26036 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:38.065526 19373 rpcz_store.cc:269] 0709 13:11:36.105811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.138927 (+ 33116us) service_pool.cc:224] Handling call
0709 13:11:38.064833 (+1925906us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002d0354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:38.064966 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279226752}
I20260709 13:11:38.066939 19373 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:38.022265 26220 raft_consensus.cc:740] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:38.061918 26244 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.067569 26036 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.067777 26244 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.068073 26220 consensus_queue.cc:260] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.064828 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.070111 26209 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:38.070598 26209 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:38.071182 26274 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:38.071647 26274 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.072022 26274 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.072340 25654 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:38.033268 26092 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.074121 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:38.074426 26092 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.074801 19224 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.075882 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:38.077100 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.077509 19265 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:38.077680 19221 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:38.077831 26170 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.078781 26240 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:38.079587 26240 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:37.982837 25913 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.080861 26240 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:38.081341 26240 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:38.082159 26240 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.082449 25913 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.084460 26257 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:38.084828 26257 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:38.085354 26244 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.085632 26257 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.086716 26257 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.087498 26022 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.088021 26265 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.046273 26039 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.089267 26039 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.088979 26181 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.090396 26181 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:37.988847 25798 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.071430 26209 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.098136 19265 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:38.095649 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.099347 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.100310 19371 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:38.102365 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.102909 19371 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.104832 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.105072 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.106098 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:38.064885 19292 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.108595 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.109596 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.110204 19373 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:38.112798 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:38.113524 19216 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:38.113699 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.114035 19224 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:38.107376 26245 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.116346 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.117149 19373 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:38.117964 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:38.096778 19191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.194:37985 timed out after 2.242s (SENT) [suppressed 12 similar messages]
I20260709 13:11:38.014067 26168 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:38.120152 19191 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.743s (SENT)
I20260709 13:11:38.120625 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.079977 26170 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.123035 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:38.124913 19224 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.128968 19216 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:38.131392 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.132436 25654 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:38.132977 25654 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:38.134235 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:38.134667 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.133882 25654 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.107841 25913 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.119913 26277 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:38.144533 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:38.148631 19371 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:38.150368 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.150475 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.155946 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.157321 19369 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.150648 25798 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.153483 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:38.160223 26170 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:38.136924 25909 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:38.169289 19292 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:38.173858 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:38.189407 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.200100 19366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2521) took 2604 ms (client timeout 2358 ms). Trace:
W20260709 13:11:38.200592 19366 rpcz_store.cc:269] 0709 13:11:35.560198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:35.560337 (+   139us) service_pool.cc:224] Handling call
0709 13:11:38.164138 (+2603801us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540012e3d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:38.164280 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468984576}
I20260709 13:11:38.202000 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.202833 19366 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:38.205148 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.206049 19366 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:38.210986 19369 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:38.155278 26265 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.154606 26277 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:38.221308 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 43582.1us
I20260709 13:11:38.222705 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.161789 25695 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.238704 19224 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:38.121387 26245 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:38.308091 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.152652 25913 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.213672 26170 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:38.212787 26236 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:38.308650 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.221189 26087 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:38.305192 26219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.008s	sys 0.016s
W20260709 13:11:38.224032 25908 consensus_meta.cc:287] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
I20260709 13:11:38.314584 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1243) took 2451 ms. Trace:
I20260709 13:11:38.323364 19368 rpcz_store.cc:276] 0709 13:11:35.863188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.241222 (+378034us) service_pool.cc:224] Handling call
0709 13:11:36.241560 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:36.275836 (+ 34276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.275868 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:36.275910 (+    42us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:36.275940 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.313917 (+2037977us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b54001626d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:38.313963 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.314527 (+   564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78377216}
W20260709 13:11:38.315032 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.315639 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.325834 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.223192 26283 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:38.326679 19372 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:38.288918 26022 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:38.319900 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 199759us
I20260709 13:11:38.225500 26229 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 13:11:38.327428 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:38.328644 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:38.330163 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:38.331091 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.330941 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.301385 26277 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:38.353320 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.332631 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.319185 26236 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.337185 19224 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.316685 26162 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:38.334774 19902 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:38.340052 26265 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.370069 26265 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.356585 26263 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.338162 26022 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.327994 26283 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:38.353003 26286 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:11:38.364960 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.331415 25908 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:38.360690 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.326363 25737 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:38.332032 26219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.008s	sys 0.016s
I20260709 13:11:38.372538 19368 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:38.394960 19224 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:38.425752 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60862.4us
I20260709 13:11:38.427634 26302 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.428022 26301 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:38.431663 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:38.435191 26219 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:38.436548 26279 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.448937 26219 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.449357 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:38.450220 19296 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:38.450911 26279 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.371770 26263 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.318061 26274 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.447613 26256 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:38.447992 26292 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:11:38.372795 26087 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.465732 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.376721 26236 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.442170 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.466266 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.471309 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.422483 25989 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.434495 26283 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.437155 26294 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:38.466650 19224 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:38.469838 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:38.482465 19292 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:38.435443 26162 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.442358 26244 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.444831 26168 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.477982 19373 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 20: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:38.481040 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:38.493656 19294 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:38.472556 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.436378 25737 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.489634 19296 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:38.478545 25744 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:38.491739 26290 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:11:38.504619 19292 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:38.499660 26198 raft_consensus.cc:2764] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:38.510027 26198 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:38.506376 25744 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.512760 25744 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.514420 25737 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.507470 26023 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:38.515604 26023 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.516265 26188 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:38.486289 26294 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:38.512353 19219 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:11:38.506083 26251 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.485586 26265 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.441974 26170 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.483652 25695 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.473706 26087 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.466799 26301 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.535169 26301 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.537400 26270 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:38.537885 26270 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:38.538560 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.539391 19371 raft_consensus.cc:2393] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:38.516065 26023 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.539783 26087 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.540676 19368 raft_consensus.cc:1275] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:38.479416 25989 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.544582 26263 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.545429 25989 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.466980 26302 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.546584 26092 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.547647 26302 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.547479 26023 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.522677 26294 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:38.532895 26245 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.554865 26162 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.555697 26022 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.556093 26023 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:38.558241 26227 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.612s	user 0.002s	sys 0.009s
I20260709 13:11:38.538774 26270 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.497844 25913 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:38.526353 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.560124 26270 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:38.527904 26295 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:11:38.549700 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.561060 19369 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:38.561872 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.562426 26067 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.563449 26277 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.564090 19369 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:11:38.565426 19369 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 13:11:38.522289 26159 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:38.566633 26159 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.568678 26159 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.569516 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.570719 26297 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:38.571043 19900 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:38.572775 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:38.573123 26224 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 1.527s	user 0.002s	sys 0.000s
I20260709 13:11:38.574255 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.575486 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.576062 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.551545 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.576133 19371 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:38.581406 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:38.580157 19368 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.581035 19294 raft_consensus.cc:2468] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:38.576702 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.583801 26213 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.584736 26246 consensus_queue.cc:1048] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:38.586102 19369 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:38.552512 26251 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.586443 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.587405 19373 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:38.588415 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.589579 26251 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.589782 25908 leader_election.cc:290] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.591430 26274 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.593736 26223 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.596488 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.597000 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.597801 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.598155 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:38.598685 26181 consensus_meta.cc:287] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.001s
I20260709 13:11:38.599025 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.599390 19895 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:38.599783 19225 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:38.600108 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.600517 19895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 1014) took 2572 ms. Trace:
I20260709 13:11:38.601030 19222 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:11:38.601684 26232 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.602162 26232 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.603200 25695 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.604100 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1248) took 2532 ms. Trace:
I20260709 13:11:38.599020 19220 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 13:11:38.599525 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.605507 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.606125 19898 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:38.606314 26232 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.607250 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2529) took 2277 ms. Trace:
I20260709 13:11:38.607569 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.603740 25695 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.607641 19291 rpcz_store.cc:276] 0709 13:11:36.330004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.331572 (+  1568us) service_pool.cc:224] Handling call
0709 13:11:36.331888 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.085695 (+753807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.607042 (+1521347us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002b89d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:38.607194 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677972352}
I20260709 13:11:38.609114 19894 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:38.604475 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.610208 19899 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:38.608834 26234 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:38.611541 26234 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.611588 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.610117 25695 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:38.615406 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.616715 19899 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:11:38.617632 26171 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.618367 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.619380 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.619536 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.620078 19222 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:38.620616 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.604467 19365 rpcz_store.cc:276] 0709 13:11:36.071684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.262996 (+191312us) service_pool.cc:224] Handling call
0709 13:11:38.092311 (+1829315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.092491 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.092516 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.092554 (+    38us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:38.092593 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.092646 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.603947 (+511301us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54002d0350. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:38.604047 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4206186240}
I20260709 13:11:38.622018 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:38.622680 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.623168 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.622823 19365 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:38.624306 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.624583 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.603077 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.626520 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.627486 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:38.629807 19219 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:38.630858 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.631484 19219 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:38.631438 19223 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:38.631845 19216 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:38.633441 19901 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 13: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:38.617743 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.633723 19221 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.634222 19899 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:38.624814 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:38.635298 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:38.635622 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:38.600909 19895 rpcz_store.cc:276] 0709 13:11:36.027813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.027969 (+   156us) service_pool.cc:224] Handling call
0709 13:11:36.028359 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.599788 (+2571429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.600321 (+   533us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b54006ddb54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:38.600467 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5912012032}
I20260709 13:11:38.635902 19220 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.636997 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:38.596515 25653 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:38.641305 19901 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:38.641690 26277 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.641687 26246 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:38.639655 26171 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:11:38.645457 26257 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
W20260709 13:11:38.646019 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.646418 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.647375 26263 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:38.647780 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:38.650220 26233 consensus_meta.cc:287] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.640s	user 0.004s	sys 0.004s
I20260709 13:11:38.650029 25948 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:38.651158 25948 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:38.651799 25948 consensus_queue.cc:1243] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:11:38.652503 26223 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:38.652922 26223 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:38.653198 19339 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.653736 26223 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.654192 25450 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:38.655041 26223 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:38.655268 19339 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.655534 26067 raft_consensus.cc:2804] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:38.657087 26092 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.657500 26303 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:38.657898 26303 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:38.657722 26092 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:38.658540 26092 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.658987 26092 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:38.658666 26303 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.647567 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:38.578383 25713 consensus_meta.cc:287] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 13:11:38.660959 25713 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.661619 19897 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:38.646386 19895 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.662959 19897 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:38.662278 19900 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 11: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:38.663201 25713 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.661509 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:38.656102 26067 raft_consensus.cc:697] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:38.659993 26303 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.665174 26297 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:38.666468 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:38.666642 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.670892 26301 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:38.672786 26301 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:38.673859 26301 consensus_queue.cc:1243] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 25.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:11:38.687673 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:38.697351 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61889.4us
I20260709 13:11:38.695290 19898 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:38.697547 19219 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.701582 19368 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:38.715283 19371 raft_consensus.cc:2468] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:38.674417 25989 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:38.720209 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 72716.9us
I20260709 13:11:38.742224 19266 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:38.742642 19219 raft_consensus.cc:2468] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
W20260709 13:11:38.745771 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 105606us
I20260709 13:11:38.744877 19339 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.741500 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:38.617911 26283 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.708962 26219 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:38.751086 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 250645us
W20260709 13:11:38.752027 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.752991 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:38.665371 26067 consensus_queue.cc:237] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.755662 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.700994 26188 consensus_queue.cc:1059] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:11:38.735051 26263 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:38.759220 25793 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:11:38.772679 19896 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:38.754927 25989 raft_consensus.cc:2804] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:38.760301 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:38.751756 26219 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.785965 19366 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.768461 26299 raft_consensus.cc:2804] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:38.787933 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:38.790313 19371 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:38.768802 26264 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:38.767055 26238 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.816634 26238 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:38.796768 26304 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:38.797343 26263 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.783015 26219 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.789911 26181 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.824472 26181 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.767899 26257 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:11:38.767419 26246 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:11:38.826560 26181 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.826833 26246 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:38.794409 26236 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.827617 26246 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:38.827926 19902 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 12: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:38.828809 26236 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.759498 25798 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:11:38.780506 26188 consensus_queue.cc:1243] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer d50eb2dab6754df8bcbed1445f2e8430 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:38.811897 26294 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:38.752876 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:38.831429 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 78616.9us
I20260709 13:11:38.793664 26299 raft_consensus.cc:697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:38.843336 26226 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:38.842957 26299 consensus_queue.cc:237] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.832715 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.841712 26188 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:38.844509 26188 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:38.844393 26238 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.845103 26188 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.846673 26238 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:38.854779 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:38.856096 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:38.860396 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.876574 26194 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.813570 26297 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.813239 26264 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.790752 25989 raft_consensus.cc:697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:38.879554 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.888027 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:38.827973 26246 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:38.882890 26308 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:11:38.853960 26294 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:38.933324 19370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2528) took 2829 ms (client timeout 2009 ms). Trace:
W20260709 13:11:38.933907 19370 rpcz_store.cc:269] 0709 13:11:36.104280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.197486 (+ 93206us) service_pool.cc:224] Handling call
0709 13:11:38.926305 (+2728819us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54000956d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:38.933229 (+  6924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797058816}
I20260709 13:11:38.914644 19371 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:38.885514 25909 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:38.945546 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.849473 25744 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:39.025488 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.108587 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.109189 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.948077 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53819.4us
I20260709 13:11:39.110430 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:38.979748 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.884341 26223 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.900678 26244 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:38.894564 26264 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:38.857237 26219 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:38.929219 25654 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.901461 26194 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:38.894057 26245 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.925479 25913 raft_consensus.cc:2764] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:11:39.117547 19903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.027s	sys 0.022s
W20260709 13:11:39.139402 19220 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
W20260709 13:11:39.150796 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.160045 19220 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:39.161654 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.158666 19903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.027s	sys 0.022s
I20260709 13:11:39.165448 19225 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:39.175876 26016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.250s	user 0.030s	sys 0.045s
W20260709 13:11:39.197475 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.174988 26270 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.005s
I20260709 13:11:39.164541 26294 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:39.157958 26194 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:39.206333 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 446096us
I20260709 13:11:39.226220 19901 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
W20260709 13:11:39.193429 26308 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:39.238543 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:39.282299 19220 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:39.246340 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:39.302029 19896 pending_rounds.cc:85] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 13
I20260709 13:11:39.302501 19896 pending_rounds.cc:107] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:11:39.302789 19896 raft_consensus.cc:2889] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.232200 26174 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:39.169464 26245 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.281131 26194 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:39.116024 26234 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.128559 26244 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.164474 25654 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.295636 26283 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.308694 26108 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:39.172312 25989 consensus_queue.cc:237] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:39.334235 26036 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.026s	sys 0.052s
I20260709 13:11:39.283968 26294 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:39.195115 26016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.269s	user 0.032s	sys 0.045s
W20260709 13:11:39.340430 19368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.013s	sys 0.033s
W20260709 13:11:39.368881 19368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.013s	sys 0.033s
I20260709 13:11:39.325340 19220 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:39.315225 25798 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.360711 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.377416 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 336256us
I20260709 13:11:39.377578 25130 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.348469 26309 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:11:39.379434 25130 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:39.353178 26036 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.026s	sys 0.052s
I20260709 13:11:39.187348 26246 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.442469 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2555) took 1347 ms. Trace:
I20260709 13:11:39.346388 26270 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.347766 25744 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.357271 26283 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.462075 26311 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 13:11:39.463616 26314 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:11:39.462966 25450 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:39.464496 25450 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:39.467093 26257 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:39.467545 26257 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:39.470001 25130 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.466290 25450 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.441430 25798 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.471318 26283 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.468490 26270 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.439301 19293 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:39.450630 19372 rpcz_store.cc:276] 0709 13:11:38.095218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.138575 (+ 43357us) service_pool.cc:224] Handling call
0709 13:11:39.442194 (+1303619us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:39.442396 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389481216}
W20260709 13:11:39.518455 26316 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:11:39.762163 26270 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.763002 25798 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.640298 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3091) took 1086 ms. Trace:
W20260709 13:11:39.636448 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.764122 19369 rpcz_store.cc:276] 0709 13:11:38.565592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.566074 (+   482us) service_pool.cc:224] Handling call
0709 13:11:38.585922 (+ 19848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.586613 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.639762 (+1053149us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b540018a450. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:39.640054 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44963712}
W20260709 13:11:39.562537 26297 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.001s
I20260709 13:11:39.766108 26087 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:39.766391 26297 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.766815 26087 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:39.505074 26325 log.cc:927] Time spent T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:11:39.495002 26257 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.508536 26244 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:39.772099 26087 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.774240 26087 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:39.774748 26246 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:39.775043 26244 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.625159 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.639971 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3101) took 1013 ms. Trace:
I20260709 13:11:39.507063 26234 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.799659 26301 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:39.690166 25653 raft_consensus.cc:3055] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:39.800707 26302 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:39.504004 26294 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.802299 26283 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.775890 26244 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:39.665506 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.630215 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3089) took 1078 ms. Trace:
I20260709 13:11:39.681378 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 1020) took 1067 ms. Trace:
W20260709 13:11:39.608796 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.505388 26313 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:11:39.684278 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1248) took 1241 ms. Trace:
W20260709 13:11:39.613677 19263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.016s	sys 0.011s
W20260709 13:11:39.811767 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.621264 19298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2666) took 1924 ms (client timeout 1523 ms). Trace:
W20260709 13:11:39.813803 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.642922 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:39.690620 25654 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:39.683151 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 1028) took 1039 ms. Trace:
W20260709 13:11:39.536679 26326 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.183s	user 0.004s	sys 0.000s
W20260709 13:11:39.506222 26188 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.003s
I20260709 13:11:39.809976 25653 raft_consensus.cc:740] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:39.818076 19898 rpcz_store.cc:276] 0709 13:11:38.614120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.615765 (+  1645us) service_pool.cc:224] Handling call
0709 13:11:38.665728 (+ 49963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.698336 (+ 32608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.680837 (+982501us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400612950. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:39.681158 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114162432}
I20260709 13:11:39.816016 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:39.825978 19263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.017s	sys 0.028s
I20260709 13:11:39.510888 26229 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:39.823100 19901 rpcz_store.cc:276] 0709 13:11:38.643199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.647576 (+  4377us) service_pool.cc:224] Handling call
0709 13:11:39.682633 (+1035057us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400780fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:39.682900 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328531200}
I20260709 13:11:39.646701 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:39.830714 19370 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:39.605918 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 471189us
W20260709 13:11:39.607949 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 419819us
W20260709 13:11:39.819988 19298 rpcz_store.cc:269] 0709 13:11:37.696134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.698690 (+  2556us) service_pool.cc:224] Handling call
0709 13:11:39.620624 (+1921934us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54002e7a54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:39.620919 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866166528}
I20260709 13:11:39.540622 26245 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:39.819679 19902 rpcz_store.cc:276] 0709 13:11:38.442701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.442897 (+   196us) service_pool.cc:224] Handling call
0709 13:11:39.683737 (+1240840us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400560254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:39.684013 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820377984}
W20260709 13:11:39.839365 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.840397 19369 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:39.498560 26219 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.487473 25909 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:39.847863 26302 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:39.857595 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 215134us
I20260709 13:11:39.798233 19368 rpcz_store.cc:276] 0709 13:11:38.626406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.703116 (+ 76710us) service_pool.cc:224] Handling call
0709 13:11:38.706242 (+  3126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.708279 (+  2037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.708321 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.731379 (+ 23058us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.369308 (+637929us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:39.369348 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.369425 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.639296 (+269871us) raft_consensus.cc:1685] finished
0709 13:11:39.639335 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.639729 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6009,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":19666,"spinlock_wait_cycles":117120,"thread_start_us":637446,"threads_started":1,"wal-append.queue_time_us":748722}
I20260709 13:11:39.860698 25130 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:39.866364 25130 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.868518 26208 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.869378 26321 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.869258 26208 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.870055 26321 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.872551 26340 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.873483 26340 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.825129 26301 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.817589 19367 rpcz_store.cc:276] 0709 13:11:38.551021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.564126 (+ 13105us) service_pool.cc:224] Handling call
0709 13:11:38.564425 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.564766 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.564794 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.565258 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.933111 (+367853us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:38.933169 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.933258 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.629451 (+696193us) raft_consensus.cc:1685] finished
0709 13:11:39.629509 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.629897 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4724,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":367478,"threads_started":1,"wal-append.queue_time_us":781665}
I20260709 13:11:39.849473 26257 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.553277 26264 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:39.884235 19337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.004s	sys 0.009s
I20260709 13:11:39.906791 19222 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:11:39.908550 19219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.044s
W20260709 13:11:39.910852 19337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.004s	sys 0.012s
I20260709 13:11:39.601213 19118 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 19 to 20, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 20 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:11:39.914155 19219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.012s	sys 0.044s
I20260709 13:11:39.901667 26229 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:39.902328 26208 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:39.917071 19371 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:39.914687 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 1.15899e+06us
I20260709 13:11:39.908424 26321 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.926239 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:39.927930 26244 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:39.917624 25654 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:39.917078 25653 consensus_queue.cc:260] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:39.930946 26092 consensus_meta.cc:287] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.271s	user 0.009s	sys 0.005s
I20260709 13:11:39.931713 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:39.944502 19223 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:39.933039 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:39.933935 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.947471 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.949429 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.949757 26283 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.950105 26299 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:39.950433 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:39.951116 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:39.941054 19221 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:11:39.935487 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.937536 26301 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:39.937233 25909 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:39.958755 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2524) took 3639 ms. Trace:
I20260709 13:11:39.928527 26340 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:39.940328 26302 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:39.934218 19224 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:11:39.944206 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.924336 25130 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:39.960278 26229 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.961951 19293 rpcz_store.cc:276] 0709 13:11:36.318774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.320741 (+  1967us) service_pool.cc:224] Handling call
0709 13:11:36.321124 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.768603 (+3447479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.957350 (+188747us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b54002ce820. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb8a02 00007fe8d7eb4dd6 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:39.958290 (+   940us) spinlock_profiling.cc:243] Waited 3.12 s on lock 0x7b540008f554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:39.958513 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7290417280}
I20260709 13:11:39.975122 19217 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:39.975821 26223 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:39.976660 26220 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:39.977296 26223 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:39.977733 26223 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:39.979030 26223 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.980715 26302 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.981402 26302 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.982210 25450 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:39.986282 19299 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.987771 19369 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 25.
I20260709 13:11:39.950556 26283 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:39.990653 26283 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:39.991645 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75355.3us
I20260709 13:11:39.983963 26302 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:39.998937 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:39.997663 19221 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:39.967217 25654 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:39.999706 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:39.950960 26299 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:40.032424 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.032440 19367 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:40.034514 26213 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:39.999209 26188 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.035944 25793 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:40.038115 26188 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:40.038332 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.967067 26092 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.039497 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:40.041247 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:40.042227 26347 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:40.026620 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:40.045122 26039 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:40.045176 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43506.4us
I20260709 13:11:40.045686 26039 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.046128 26039 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:40.053191 25793 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.054721 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:40.055473 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.064363 26302 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:40.071084 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.079322 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.080139 19219 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:40.055142 25793 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.056030 26188 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:40.088876 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:40.092519 19901 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:40.094718 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:40.095458 19223 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:40.095803 25989 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:40.097600 25989 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:40.097955 25989 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.098269 25989 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:40.100381 26244 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:40.100816 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:40.102685 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:40.103087 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.104472 25948 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:40.077898 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:40.073132 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.105392 19118 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:40.074091 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:40.065162 26302 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.055454 26036 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:40.110565 26092 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.110739 26339 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.068069 26223 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:40.088119 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.111397 19372 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:40.113243 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48324.7us
I20260709 13:11:40.115195 26299 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.115638 25909 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:40.085325 26229 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:40.131119 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:40.120730 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.123800 19365 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
W20260709 13:11:40.129616 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 177644us
I20260709 13:11:40.104497 26337 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:40.132884 19216 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:40.132438 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.108570 26188 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:40.139524 19221 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:40.134254 25948 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.144578 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:40.150913 26261 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:40.130999 26301 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:40.150950 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 1021) took 1523 ms. Trace:
I20260709 13:11:40.146976 26188 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:40.170609 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 143844us
I20260709 13:11:40.169968 26261 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.174603 26036 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.176489 26213 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:40.176690 26036 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.177354 26245 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:11:40.167513 19118 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 14 to 15, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 15 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:40.179032 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 144577us
I20260709 13:11:40.178844 25948 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.180275 26348 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:40.180404 26230 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:40.181246 25948 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.181070 26348 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:40.181113 26230 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.167421 19219 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:40.183871 26230 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.183852 26306 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:40.186386 26267 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.187089 26267 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:40.188989 26194 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.008s
I20260709 13:11:40.189460 26194 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.190609 19218 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:40.192546 26194 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.192230 25654 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.176590 26261 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:40.199734 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55266.9us
I20260709 13:11:40.200716 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:40.204528 26261 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.205324 26333 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:40.205822 26209 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.206104 26333 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:40.205407 26261 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.204779 26156 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:40.207046 26156 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.207268 26264 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.207484 26156 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:40.208055 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 104019us
I20260709 13:11:40.205407 25595 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:40.179606 19118 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:40.206542 26067 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:40.141080 26244 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:40.143837 26299 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.192767 26302 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:40.217010 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49164.3us
I20260709 13:11:40.149056 26220 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:40.232244 19220 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:40.232618 26220 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:40.233752 26220 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.238210 19118 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:40.241748 19869 leader_election.cc:304] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:40.219756 19217 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:11:40.220377 26306 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:40.220335 26301 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.222677 26261 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.213447 25653 raft_consensus.cc:3060] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:40.206615 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.171913 19903 rpcz_store.cc:276] 0709 13:11:38.614410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.614526 (+   116us) service_pool.cc:224] Handling call
0709 13:11:38.614912 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.615318 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:38.615346 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.615802 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.162781 (+546979us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:39.162849 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.162989 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.120816 (+957827us) raft_consensus.cc:1685] finished
0709 13:11:40.126714 (+  5898us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.138100 (+ 11386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18568,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1633,"thread_start_us":546517,"threads_started":1,"wal-append.queue_time_us":683940}
I20260709 13:11:40.229693 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.138545 26339 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.231581 25737 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:11:40.206624 26333 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:40.221370 26039 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.223779 26259 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:11:40.268105 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 141288us
I20260709 13:11:40.215917 26267 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.276911 19370 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:11:40.224359 26194 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:11:40.240077 19118 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:40.284454 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.277825 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.285854 19299 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:40.228646 26348 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.212349 25450 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:40.287205 19370 pending_rounds.cc:85] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 15
I20260709 13:11:40.295483 19224 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 18: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:40.298381 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56718.4us
I20260709 13:11:40.302103 19898 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:40.302574 26108 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.956s	user 0.013s	sys 0.002s
I20260709 13:11:40.302878 26244 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.306340 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2549) took 2397 ms. Trace:
I20260709 13:11:40.303599 26299 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.248785 26036 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:11:40.317796 19901 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:11:40.318135 26194 consensus_queue.cc:1243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:40.319367 26337 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.322491 19368 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:40.311344 19299 rpcz_store.cc:276] 0709 13:11:37.909330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.914974 (+  5644us) service_pool.cc:224] Handling call
0709 13:11:37.915222 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.619295 (+1704073us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b180028b540. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7ef0646 00007fe8d7e2a58e 00007fe8d7eabf9e 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:11:39.868729 (+249434us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5800495ed0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:11:39.985586 (+116857us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b58006836d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb7b49 00007fe8d7eb8416 00007fe8d7eb4d8f 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4
0709 13:11:40.289999 (+304413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.306288 (+ 16289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064184192}
I20260709 13:11:40.307134 19370 pending_rounds.cc:107] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:11:40.275995 26264 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:40.348198 19370 raft_consensus.cc:2889] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:40.353251 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.360339 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:40.281303 26283 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
W20260709 13:11:40.365509 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 154147us
I20260709 13:11:40.263933 26067 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.366580 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.271414 26209 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.376019 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.378819 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.382704 19293 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:40.383483 19298 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:40.385263 26156 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.385769 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.386473 19291 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:40.387542 26156 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.388502 26213 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:40.389158 26213 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.388744 19118 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 12 to 13, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 13 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.390478 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:40.391237 26213 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.390547 19118 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 8 to 14, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 14 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:40.391830 26213 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.392707 19368 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:40.392992 26261 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:40.393405 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.393800 26209 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.394697 19903 raft_consensus.cc:1275] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:40.395244 26297 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:40.395682 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.396061 26174 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 1.041s	user 0.008s	sys 0.008s
I20260709 13:11:40.396186 19365 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:40.398010 26067 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:40.400337 26207 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:11:40.402767 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.403415 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.404062 26219 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.404949 19371 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:40.403829 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.406261 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:40.310205 26364 raft_consensus.cc:2804] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:40.344379 26348 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:40.410349 19369 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:40.405308 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.350903 25450 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.420446 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:40.367362 26267 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:40.420270 26257 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
I20260709 13:11:40.449184 26213 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.439494 26340 consensus_queue.cc:1059] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:11:40.451653 26299 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.437239 19118 catalog_manager.cc:5697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 9 to 11, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 11 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:40.420372 26283 consensus_queue.cc:1243] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:11:40.377527 26264 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:40.456813 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.413148 26108 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:40.459985 19297 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:40.452148 19300 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
W20260709 13:11:40.465620 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.465873 19367 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:40.473357 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.451735 26213 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.467584 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.427820 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.476445 19291 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:40.481735 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.471083 19373 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
W20260709 13:11:40.486510 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.483327 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.485487 19366 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:40.488752 19298 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:40.492956 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:40.468220 25793 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.501031 19901 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:40.483210 26340 consensus_queue.cc:1243] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:40.502791 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.502400 26306 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.504360 26039 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.504542 26306 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.505964 26223 raft_consensus.cc:1064] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:11:40.506855 26306 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:40.508361 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 196288us
W20260709 13:11:40.512512 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.514961 26274 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.518124 26251 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.518633 26251 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.521386 25450 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.522289 26352 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:40.522742 26352 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.523157 26352 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:40.528355 19371 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
W20260709 13:11:40.528687 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47115.2us
I20260709 13:11:40.536036 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:40.499013 19374 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 13.
I20260709 13:11:40.536804 19372 raft_consensus.cc:2368] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:40.515553 26274 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.477514 26219 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.480897 26267 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.495652 19118 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:40.547250 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.551211 19291 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:11:40.552423 19222 raft_consensus.cc:2410] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:11:40.560946 19902 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:40.502848 26108 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.561462 19902 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:40.563195 26108 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.562652 19902 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.563956 19366 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:40.564648 19902 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:40.565907 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:40.571346 26352 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.552826 26194 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:40.576650 26194 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.577026 26194 raft_consensus.cc:3060] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:40.578372 19902 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:40.581146 26267 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.584537 26357 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:40.585214 26264 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.588958 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.590700 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:40.591157 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:40.590764 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:40.591885 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.604632 19297 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:40.607162 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.607374 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.609229 19369 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
W20260709 13:11:40.610203 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 96673.8us
I20260709 13:11:40.611581 19371 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:11:40.615881 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47997us
I20260709 13:11:40.608006 19292 raft_consensus.cc:2376] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15. Re-sending same reply.
W20260709 13:11:40.618669 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 261770us
I20260709 13:11:40.622509 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.622809 19898 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:40.623250 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:40.626286 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.556263 26301 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:40.623829 19291 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:40.638278 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.639349 19297 raft_consensus.cc:2410] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:11:40.640700 19367 raft_consensus.cc:2468] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:40.644272 19191 leader_election.cc:400] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:40.644626 19191 leader_election.cc:403] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:40.645347 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.646246 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.648854 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.650395 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.648945 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.653301 19296 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:40.653748 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.649765 19225 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:40.654968 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.658711 19291 raft_consensus.cc:2410] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:11:40.659294 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:40.659353 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 145841us
I20260709 13:11:40.610355 26283 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:11:40.663707 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.670498 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.671532 19296 raft_consensus.cc:2393] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:40.672732 26188 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.674901 26188 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.676470 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.680243 26162 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.680879 26162 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.681806 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.682273 26333 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.683131 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:40.684320 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:40.688838 26198 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:40.690063 19299 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:40.692030 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75021.3us
W20260709 13:11:40.692817 19374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2549) took 2958 ms (client timeout 2097 ms). Trace:
W20260709 13:11:40.693236 19374 rpcz_store.cc:269] 0709 13:11:37.734093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.031030 (+296937us) service_pool.cc:224] Handling call
0709 13:11:40.692593 (+2661563us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54000b3bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:40.692734 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5334977408}
I20260709 13:11:40.695606 19222 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:40.692047 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:40.696676 19220 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:40.700973 26369 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:11:40.700911 26194 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.702093 26294 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:40.702492 26294 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:40.703341 26219 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.703447 26194 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:40.669507 25989 consensus_meta.cc:287] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 13:11:40.706660 25989 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.708814 25989 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:40.669749 19217 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:40.734516 19300 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:40.710417 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:40.739725 19220 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:40.751989 19901 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:40.758669 19225 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:40.758917 26352 leader_election.cc:290] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:40.763283 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:40.775612 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:40.776325 19296 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:40.703363 26294 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:40.788839 26294 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:40.791250 26259 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:40.791678 26259 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:40.792665 26259 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:40.824820 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 228270us
I20260709 13:11:40.827235 19297 raft_consensus.cc:3055] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:40.827689 19297 raft_consensus.cc:740] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:40.827425 19896 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:40.828668 19297 consensus_queue.cc:260] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:40.829679 19297 raft_consensus.cc:3060] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:40.837218 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 200430us
I20260709 13:11:40.852809 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:40.853669 19293 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:40.877030 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:40.881318 19896 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 16: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:40.890354 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:40.927597 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.962128 26380 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:40.963035 26380 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:40.971202 19297 raft_consensus.cc:1275] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:11:40.981725 26375 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:40.996537 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:40.997391 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 95773.9us
I20260709 13:11:40.998108 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:40.999039 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.999444 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:40.999709 19297 pending_rounds.cc:85] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 10
I20260709 13:11:41.006170 19297 pending_rounds.cc:107] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:11:41.006737 19297 raft_consensus.cc:2889] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.001526 26251 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:41.013284 19291 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:11:41.016988 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.017560 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.014446 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.019249 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.020749 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.021469 19292 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:41.022471 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.023126 19292 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:41.024109 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.027050 19292 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:40.998215 26333 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:41.019884 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:41.033975 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:41.039621 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.036576 19899 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:41.042691 19293 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:11:41.028462 26375 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:41.043511 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.029194 26259 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:41.043977 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:41.044286 19293 pending_rounds.cc:85] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 9
I20260709 13:11:41.046119 19293 pending_rounds.cc:107] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:11:41.046041 19297 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:41.046461 19293 raft_consensus.cc:2889] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:41.044476 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 45131.2us
I20260709 13:11:41.044551 19296 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:41.044674 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.050097 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.047600 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.049656 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:41.052134 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.053596 19292 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
W20260709 13:11:41.045687 26364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.032s
I20260709 13:11:41.057596 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.048401 26306 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:41.044812 26339 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:41.043994 26371 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:41.064941 19869 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:41.070567 26349 log.cc:927] Time spent T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 1.031s	user 0.004s	sys 0.001s
W20260709 13:11:41.073192 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.049431 26274 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:41.004761 26380 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:41.062979 26364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.033s
W20260709 13:11:41.079993 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.076069 26244 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:41.065249 26306 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.082206 26306 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.079778 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.082216 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.098757 19297 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:41.100795 19899 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:41.100772 26270 raft_consensus.cc:2804] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:41.109614 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.113479 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.102314 26374 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:41.097842 26364 raft_consensus.cc:697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:41.068730 26223 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.120011 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.120721 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.122013 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.121222 19296 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:41.110541 26207 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.125738 26207 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:41.127105 19373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3098) took 2559 ms (client timeout 1898 ms). Trace:
W20260709 13:11:41.127493 19373 rpcz_store.cc:269] 0709 13:11:38.567609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.588095 (+ 20486us) service_pool.cc:224] Handling call
0709 13:11:41.126880 (+2538785us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400298954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:41.127043 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4270619520}
I20260709 13:11:41.130151 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:41.104077 26371 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.136602 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.099651 26251 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:41.116154 26374 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:41.135609 19292 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:41.122134 26264 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:41.139159 19292 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.122407 26270 raft_consensus.cc:697] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:41.142606 19293 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:41.145423 19291 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:41.128028 26207 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:41.148918 26378 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:41.150231 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:41.139642 26374 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.153056 26386 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:41.154330 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:41.103111 26375 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.149789 26264 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.152557 19292 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.168825 19292 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.175658 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.164059 26352 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:41.175658 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.181080 19373 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
W20260709 13:11:41.184648 26382 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:41.188989 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.203737 19367 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:41.199180 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.205458 19374 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:41.212587 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3377) took 1971 ms. Trace:
I20260709 13:11:41.212992 19218 rpcz_store.cc:276] 0709 13:11:39.241660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.241838 (+   178us) service_pool.cc:224] Handling call
0709 13:11:39.242155 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.191002 (+948847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.212281 (+1021279us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54001b2454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:41.212513 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180459904}
I20260709 13:11:41.224377 26270 consensus_queue.cc:237] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:41.226610 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.227360 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.228082 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.230886 26372 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.658s	user 0.002s	sys 0.002s
I20260709 13:11:41.239471 19295 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 11.
I20260709 13:11:41.240505 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:41.247334 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.245023 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2757) took 1032 ms. Trace:
I20260709 13:11:41.255772 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:41.224393 26230 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:11:41.257710 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.259374 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:41.260010 19899 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:41.261454 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 61293.9us
I20260709 13:11:41.261504 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:41.264617 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:41.264729 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.265235 19370 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.268488 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.269230 19894 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:41.249449 19221 rpcz_store.cc:276] 0709 13:11:40.212927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.213043 (+   116us) service_pool.cc:224] Handling call
0709 13:11:40.227605 (+ 14562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:40.258724 (+ 31119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:40.258770 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:40.344819 (+ 86049us) log.cc:844] Serialized 26 byte log entry
0709 13:11:40.483005 (+138186us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:40.483078 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.484564 (+  1486us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:41.230079 (+745515us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:41.236036 (+  5957us) raft_consensus.cc:1685] finished
0709 13:11:41.236063 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.244963 (+  8900us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19596,"raft.queue_time_us":119039,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":55367,"spinlock_wait_cycles":73313152,"thread_start_us":67032,"threads_started":1,"wal-append.queue_time_us":196521}
I20260709 13:11:41.208069 26386 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:11:41.253288 26268 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:41.269714 26207 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:41.283567 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:41.274966 26377 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:41.262574 26244 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:41.197593 26364 consensus_queue.cc:237] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.278458 26352 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:41.296317 26377 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.275861 26230 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:11:41.313490 26371 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:41.317215 26306 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.319568 26306 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:41.320788 26389 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:11:41.325606 26233 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:11:41.326161 26233 consensus_queue.cc:1059] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:41.285905 26301 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:11:41.329185 26207 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.312847 26268 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.329835 26207 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.331475 26268 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:41.332755 26230 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:41.333148 26230 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:41.284832 26274 consensus_queue.cc:1048] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:11:41.269572 26264 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:41.348353 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83673us
I20260709 13:11:41.349267 19899 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:41.356675 19370 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:41.311069 26377 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.332010 26207 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:41.357633 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:41.309497 26348 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:11:41.308696 26244 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.333959 26268 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:11:41.378875 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.379971 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.407657 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:41.380988 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.381918 26352 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.408510 19295 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:41.356597 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:41.384406 26219 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:41.393452 26162 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:41.396370 26368 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.816s	user 0.002s	sys 0.001s
W20260709 13:11:41.396910 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 640117us
I20260709 13:11:41.398713 26198 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:41.416461 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:41.416932 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 129449us
I20260709 13:11:41.403604 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.373836 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:41.381104 26207 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:41.412418 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.410238 26352 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.414407 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.421324 19221 raft_consensus.cc:3060] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:41.403496 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 355935us
I20260709 13:11:41.420306 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.420058 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.415174 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.416455 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:41.422852 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49133us
I20260709 13:11:41.417331 19300 raft_consensus.cc:3060] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.424537 26374 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.426501 26162 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:41.426767 26374 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:41.423868 19291 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
W20260709 13:11:41.428056 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.428959 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.426918 26162 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.428989 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.432029 19218 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:41.405503 26268 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.435552 19216 raft_consensus.cc:2393] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:41.435958 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 79458.1us
I20260709 13:11:41.436738 19219 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:41.430125 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.422964 26207 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:41.441023 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 156630us
I20260709 13:11:41.437978 26162 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.440474 26207 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:41.446507 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61237.3us
I20260709 13:11:41.447642 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:41.449365 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:41.446871 19224 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:41.456858 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:41.454773 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.461629 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.462373 19370 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:41.462155 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:41.471549 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.472198 19219 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:41.476105 19300 raft_consensus.cc:2468] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:41.478539 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.480794 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.486899 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.488319 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.492210 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.489182 19224 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:41.500056 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 194700us
I20260709 13:11:41.500065 19223 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:41.456833 26251 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:41.502684 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 88256us
I20260709 13:11:41.502568 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.504323 19222 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:41.469990 26306 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.453347 26400 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:41.504866 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.525579 19217 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:41.505110 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 47245.1us
I20260709 13:11:41.517850 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:41.470377 26223 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.530805 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.531562 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:41.532291 19300 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.522116 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:41.536799 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.539362 19869 leader_election.cc:304] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.432758 26230 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.489832 26381 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:41.486287 26398 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:41.547737 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:41.548322 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.548739 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.549342 19370 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:41.550127 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.550812 19370 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 22 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:41.551442 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:41.552389 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.553589 19370 raft_consensus.cc:2410] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:11:41.547224 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.505538 26251 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.544324 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:41.556001 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.531893 26400 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.608073 19219 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:41.609946 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.610605 19220 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:41.611101 19300 raft_consensus.cc:2468] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:41.555315 26375 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:41.612223 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 131003us
I20260709 13:11:41.555546 26373 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:41.553776 26398 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:41.613252 26373 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:41.613544 26398 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.613858 19265 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:41.614394 26373 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.614961 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:41.542654 26223 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.616281 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:41.616650 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:41.617781 26223 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:41.618749 26377 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.619925 19894 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:41.620566 26244 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:41.612697 26339 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:41.564574 26251 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:41.614341 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 49393.5us
I20260709 13:11:41.622422 19366 raft_consensus.cc:1240] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:41.532184 26306 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.575398 26374 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:41.641044 19370 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:41.578898 26357 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:41.589185 26403 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:41.578438 26400 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:41.685381 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 161805us
W20260709 13:11:41.701193 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 275062us
I20260709 13:11:41.590130 26270 raft_consensus.cc:2804] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:11:41.704968 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 243675us
I20260709 13:11:41.553979 26381 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.621923 26375 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:41.710672 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:41.712553 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.715595 19292 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
I20260709 13:11:41.709329 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:41.629040 26339 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.684149 26333 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:41.720803 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 104213us
I20260709 13:11:41.724152 19292 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:41.730119 19220 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:41.579700 26268 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.717312 26375 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:41.741863 19219 raft_consensus.cc:3055] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:41.742396 19219 raft_consensus.cc:740] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:41.745178 26340 raft_consensus.cc:2764] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:11:41.745980 26340 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:41.746681 26340 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:41.747467 26340 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:41.754161 19266 leader_election.cc:400] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:41.757874 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:41.731256 26321 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
W20260709 13:11:41.803231 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.806941 26431 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:41.731649 26414 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:11:41.810662 19224 raft_consensus.cc:1240] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:41.812373 26415 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:41.812870 26425 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:41.792774 19219 consensus_queue.cc:260] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.838003 19219 raft_consensus.cc:3060] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:41.807551 26405 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:41.781461 26340 consensus_queue.cc:1059] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:11:41.835198 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 107619us
I20260709 13:11:41.817480 26301 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:41.816867 26268 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.838119 19292 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:11:41.824796 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 106938us
I20260709 13:11:41.781910 26270 raft_consensus.cc:697] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:41.829771 26259 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.006s
I20260709 13:11:41.833797 19869 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:41.860795 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:41.862246 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:41.864354 26340 consensus_queue.cc:1243] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 21.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:41.864944 26340 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:41.864809 26270 consensus_queue.cc:237] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.865227 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:41.866508 25948 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:41.867193 25948 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:41.793397 25989 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:41.836290 26415 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.868434 26259 raft_consensus.cc:3055] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:41.868888 26259 raft_consensus.cc:740] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.869155 26415 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.869819 26259 consensus_queue.cc:260] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.868533 26400 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.865350 26340 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:41.817239 26374 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:41.872933 19297 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
W20260709 13:11:41.841670 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 83916.1us
I20260709 13:11:41.878855 19266 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:41.890223 19219 raft_consensus.cc:1275] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:41.871196 26259 raft_consensus.cc:3060] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:41.893764 19221 raft_consensus.cc:2468] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:41.843855 26301 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.877038 26408 raft_consensus.cc:2804] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:41.843842 26377 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:41.906088 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.893714 26357 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:41.878407 26403 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:41.909690 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 200410us
I20260709 13:11:41.820108 26339 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.901870 26417 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:41.911655 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 105211us
I20260709 13:11:41.902923 26301 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:41.907829 26414 raft_consensus.cc:2804] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:41.921013 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:41.922516 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:41.926874 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 62759.5us
W20260709 13:11:41.929306 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64154.7us
W20260709 13:11:41.932646 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54936.3us
I20260709 13:11:41.921576 26162 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.953658 19899 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 LEARNER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:11:41.956785 26410 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:41.957223 25948 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:41.968854 19371 raft_consensus.cc:2368] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:41.969367 26162 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:41.957543 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:41.969611 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.969987 26162 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:41.958534 19221 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:41.970376 26162 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:41.970767 26162 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:41.971297 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.971894 19221 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:41.972811 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.972487 26403 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.973407 19221 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:41.974268 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.970376 19219 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:41.975826 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.975900 26433 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.976593 19219 raft_consensus.cc:2368] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23.
I20260709 13:11:41.976557 26433 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.977527 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.978145 19219 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:41.978916 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.979413 19219 raft_consensus.cc:3060] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:41.974963 19223 raft_consensus.cc:1275] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
W20260709 13:11:41.957231 26207 consensus_meta.cc:287] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.003s
I20260709 13:11:41.980700 19223 pending_rounds.cc:85] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 14
I20260709 13:11:41.980952 19223 pending_rounds.cc:107] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:11:41.980903 26207 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:41.983199 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55618.6us
I20260709 13:11:41.960716 19216 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:41.984651 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.985410 19216 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:41.985747 19292 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:41.986119 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.986665 26251 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.987123 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.988291 26364 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:41.961747 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:41.990113 19217 raft_consensus.cc:2368] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23.
I20260709 13:11:41.961704 26374 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:41.962838 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.967060 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:41.981338 19223 raft_consensus.cc:2889] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.982996 26207 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:41.959364 26381 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:41.963373 26400 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:41.930356 26340 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:41.917672 26357 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:41.992280 26408 raft_consensus.cc:697] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:41.979020 26433 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.026724 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:41.921155 26306 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:41.967360 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46584.1us
I20260709 13:11:41.919669 26417 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:42.033972 26417 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.923382 26377 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.988116 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:42.014719 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47747.8us
I20260709 13:11:42.040489 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:42.015898 19221 raft_consensus.cc:2368] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21.
I20260709 13:11:41.928591 19265 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:42.030485 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:41.962040 26264 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.033370 19219 raft_consensus.cc:2468] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 25.
I20260709 13:11:42.036398 19365 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:42.036767 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:42.038589 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.997416 26414 raft_consensus.cc:697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:42.045655 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 117131us
I20260709 13:11:42.013091 26340 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.043262 19216 raft_consensus.cc:2393] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:42.045694 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.051302 19217 raft_consensus.cc:2393] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:42.042076 19372 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:42.044198 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:42.048887 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:42.012828 26339 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:42.052564 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.031129 26400 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.052500 19266 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:42.015439 26357 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.058964 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:42.054597 19339 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:42.061959 19365 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:11:42.068442 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.069157 19219 raft_consensus.cc:2376] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 25. Re-sending same reply.
I20260709 13:11:42.045748 26207 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.075917 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.001142 26429 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:11:42.046694 26264 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:42.074327 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:42.076836 19217 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:42.053881 26259 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:42.099896 26259 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.100358 26259 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:42.047847 26377 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.084482 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.104709 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.061218 26435 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:42.095896 26417 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.105825 26377 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.014199 26408 consensus_queue.cc:237] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.107026 26417 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:42.063215 26432 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 13:11:42.111361 26431 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:42.111841 26431 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:42.112828 26431 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.116360 26404 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:42.074414 26407 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:11:42.128340 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.041599 26301 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.130585 26301 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:42.131342 26264 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:42.138695 26416 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:11:42.060432 26433 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:42.139760 26433 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:42.140766 26433 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.096794 26207 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.144374 26207 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.144888 26207 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.145627 19298 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:42.146765 26399 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:42.148540 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:42.149204 19295 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
I20260709 13:11:42.060793 26400 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:42.098034 26414 consensus_queue.cc:237] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.105587 26435 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.082402 26251 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.097167 26446 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:42.088413 26439 raft_consensus.cc:2804] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:42.152240 19365 raft_consensus.cc:1240] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:42.152285 19368 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:42.152976 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 1037) took 1528 ms. Trace:
W20260709 13:11:42.084784 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44747.8us
I20260709 13:11:42.160503 19372 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
I20260709 13:11:42.167016 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:42.196563 19898 rpcz_store.cc:276] 0709 13:11:40.624452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.624663 (+   211us) service_pool.cc:224] Handling call
0709 13:11:42.108844 (+1484181us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54006702d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:42.152896 (+ 44052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623032064}
I20260709 13:11:42.193567 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.204236 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.172583 26348 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:42.205265 26348 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:42.206239 26352 consensus_meta.cc:287] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
I20260709 13:11:42.206668 26352 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.207368 26348 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:42.176241 26377 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:11:42.174453 26446 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.212497 26446 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.216212 26358 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:42.216833 26358 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.218904 26358 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.219659 26358 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:42.169486 26431 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:42.168823 26400 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.199683 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:42.222277 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.224475 19221 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:42.201584 19373 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:11:42.224112 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 171662us
I20260709 13:11:42.119942 26375 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.228129 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:42.220177 26358 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:42.229795 19191 connection.cc:256] RPC call timeout handler was delayed by -2.5442518080000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 13:11:42.224233 26439 raft_consensus.cc:697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:42.247965 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:42.230926 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.270104 19219 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:42.260076 19373 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:42.272109 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:42.275110 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.239220 26432 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:42.237679 26294 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:42.278455 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:42.283339 19300 raft_consensus.cc:3060] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:42.279439 19266 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:42.284317 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:42.287961 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.288802 19221 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.269048 26268 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:42.291453 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.297214 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.300619 19373 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:42.290048 26398 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
W20260709 13:11:42.314646 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.315088 26233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.025s	sys 0.043s
W20260709 13:11:42.315653 26233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.025s	sys 0.044s
I20260709 13:11:42.293771 26268 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.287626 26432 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:42.296350 26357 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:42.341575 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.322327 26352 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.351850 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.388581 19366 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:42.353677 26418 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.427s	user 0.000s	sys 0.002s
I20260709 13:11:42.355597 19300 raft_consensus.cc:2468] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:42.356767 26430 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:42.392715 19221 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:42.297021 26453 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.289846 26294 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:42.355602 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 114482us
I20260709 13:11:42.300613 26339 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:11:42.389140 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 119213us
I20260709 13:11:42.369864 26268 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.427872 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.366056 26251 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:42.430089 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.433904 26449 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:11:42.434511 26294 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.388820 26357 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:42.322790 26398 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.512560 26398 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:42.435787 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.515195 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.465431 26432 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.469322 26358 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.418448 26430 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.476801 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.519620 19365 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 23: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:42.478631 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:42.484658 26294 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:42.489588 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3133) took 1030 ms. Trace:
I20260709 13:11:42.493119 19218 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:42.495195 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:42.530947 19300 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:42.495596 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.532881 19869 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:42.499107 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1270) took 1030 ms. Trace:
I20260709 13:11:42.530578 19371 rpcz_store.cc:276] 0709 13:11:41.458845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.547985 (+ 89140us) service_pool.cc:224] Handling call
0709 13:11:42.489369 (+941384us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400298954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:42.489517 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964982656}
I20260709 13:11:42.500389 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:42.501379 26375 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.506234 26357 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:42.508122 26333 consensus_meta.cc:287] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.780s	user 0.006s	sys 0.006s
I20260709 13:11:42.426321 26162 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.509196 26435 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.510316 26339 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.431027 26439 consensus_queue.cc:237] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.540725 19373 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:42.491782 26259 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.545692 26333 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:42.540241 26294 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.538491 26430 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:42.547308 26406 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.713s	user 0.000s	sys 0.002s
I20260709 13:11:42.547652 26162 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.548178 19369 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:42.417521 26207 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.549005 19292 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:42.549841 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.551937 26373 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.553290 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.543148 26442 raft_consensus.cc:2804] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:11:42.543284 26413 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.718s	user 0.000s	sys 0.006s
I20260709 13:11:42.591248 26358 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.557286 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3125) took 1102 ms. Trace:
W20260709 13:11:42.560740 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.562274 26456 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.127s	user 0.001s	sys 0.001s
W20260709 13:11:42.565070 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 508226us
I20260709 13:11:42.571518 19300 raft_consensus.cc:2468] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:42.536063 19902 rpcz_store.cc:276] 0709 13:11:41.468594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.481565 (+ 12971us) service_pool.cc:224] Handling call
0709 13:11:41.503333 (+ 21768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.544751 (+ 41418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.544802 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.580571 (+ 35769us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.828762 (+248191us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:41.898938 (+ 70176us) log.cc:844] Serialized 14 byte log entry
0709 13:11:41.902041 (+  3103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.902120 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.496770 (+594650us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b18004d8900. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:42.498770 (+  2000us) raft_consensus.cc:1685] finished
0709 13:11:42.498886 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.499043 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2774,"prepare.queue_time_us":226894,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":25390,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":13549,"spinlock_wait_cycles":68166400,"thread_start_us":271454,"threads_started":2,"wal-append.queue_time_us":493936}
I20260709 13:11:42.529455 26321 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.588789 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:42.582712 26339 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.537272 26446 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.581912 26357 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:42.599396 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 168372us
I20260709 13:11:42.605330 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:42.590998 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:42.502987 26264 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.615061 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.636504 26207 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.637373 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.711325 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.638034 19370 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:42.640422 26230 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:42.641203 26404 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:42.644510 19297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2706) took 1536 ms (client timeout 1820 ms). Trace:
I20260709 13:11:42.718015 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.647318 19366 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:42.718501 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:42.598685 26400 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.648236 26373 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.648865 26268 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.583894 26402 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.741178 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.556664 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.634384 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:42.660451 19368 rpcz_store.cc:276] 0709 13:11:41.454763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.454944 (+   181us) service_pool.cc:224] Handling call
0709 13:11:42.104597 (+649653us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90eee 0000000000375939 00007fe8dce041e0 00007fe8dcecd0c4 00007fe8dcecd131 00007fe8dce7b0a0 00007fe8dce7a984 00007fe8d63f56d4 00007fe8d63f5662
0709 13:11:42.557077 (+452480us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400313654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:42.557200 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110336128}
I20260709 13:11:42.585587 26259 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:42.670692 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.750316 19291 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:42.706525 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.687168 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1268) took 1226 ms. Trace:
I20260709 13:11:42.750931 19372 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:42.716717 19292 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:42.752048 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:42.716349 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 125499us
I20260709 13:11:42.752800 19371 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.753343 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:42.718142 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:42.729153 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:42.659919 26442 raft_consensus.cc:697] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:42.765228 19368 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:11:42.765969 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:42.738508 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.766911 19366 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.739969 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.771888 19373 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:11:42.742463 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 108174us
I20260709 13:11:42.744405 19220 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 13.
I20260709 13:11:42.746616 19902 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:42.727072 26414 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.749076 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.750204 19869 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:42.759553 19224 raft_consensus.cc:1275] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:11:42.776571 19367 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.756623 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:42.718035 19297 rpcz_store.cc:269] 0709 13:11:41.107649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.113203 (+  5554us) service_pool.cc:224] Handling call
0709 13:11:42.644335 (+1531132us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54001d4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:42.644448 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744938240}
I20260709 13:11:42.758194 19219 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:11:42.766525 19894 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:42.779356 19219 pending_rounds.cc:85] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:42.779760 19219 pending_rounds.cc:107] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:11:42.780071 19219 raft_consensus.cc:2889] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:42.781098 19217 raft_consensus.cc:1240] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:42.781836 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:42.782516 19218 raft_consensus.cc:1275] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:42.782826 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:42.783633 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:42.697911 26358 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.770121 19903 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:42.784915 19221 raft_consensus.cc:3055] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:42.803738 19221 raft_consensus.cc:740] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:42.751271 19901 rpcz_store.cc:276] 0709 13:11:41.460444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.460621 (+   177us) service_pool.cc:224] Handling call
0709 13:11:41.482806 (+ 22185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.483261 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.483301 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.496978 (+ 13677us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.666707 (+169729us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:41.666782 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.666915 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.353143 (+686228us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:42.658814 (+305671us) raft_consensus.cc:1685] finished
0709 13:11:42.658843 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.687101 (+ 28258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14414,"spinlock_wait_cycles":7998720,"thread_start_us":119593,"threads_started":1,"wal-append.queue_time_us":373739}
I20260709 13:11:42.799930 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2765) took 1398 ms. Trace:
I20260709 13:11:42.808996 19217 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:42.720070 26437 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
W20260709 13:11:42.820648 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67385.4us
I20260709 13:11:42.759353 26244 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:42.825523 19266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.054s
I20260709 13:11:42.815900 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:42.804694 19225 rpcz_store.cc:276] 0709 13:11:41.402025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.402158 (+   133us) service_pool.cc:224] Handling call
0709 13:11:41.402561 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.413226 (+ 10665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.413258 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:41.416001 (+  2743us) log.cc:844] Serialized 26 byte log entry
0709 13:11:41.666139 (+250138us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:41.666204 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.666295 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.511911 (+845616us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:42.783974 (+272063us) raft_consensus.cc:1685] finished
0709 13:11:42.784003 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.799859 (+ 15856us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3832,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":98,"spinlock_wait_cycles":6527360,"thread_start_us":213196,"threads_started":1,"wal-append.queue_time_us":302058}
W20260709 13:11:42.826921 19266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.008s	sys 0.054s
I20260709 13:11:42.825769 19894 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:42.716308 26321 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.809553 19217 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:42.828548 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:42.783551 26435 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.813710 19221 consensus_queue.cc:260] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.832852 19371 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
W20260709 13:11:42.812844 26467 log.cc:927] Time spent T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:42.842756 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:42.843621 19292 raft_consensus.cc:2368] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21.
I20260709 13:11:42.840883 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:42.835793 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:42.840969 19221 raft_consensus.cc:3060] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:42.844831 19901 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:42.840176 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:42.765570 26408 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 13:11:42.783674 26162 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:42.845746 19217 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:42.882525 19217 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.842857 26435 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.868873 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:42.825874 26268 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.884856 19297 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:42.884768 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:42.868618 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.873116 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:42.883136 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.813215 26414 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:42.842810 26259 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:42.886171 19298 raft_consensus.cc:2393] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:42.842835 26244 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:42.869503 26294 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:42.901311 26347 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.884408 26435 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.919716 26347 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.929126 26347 raft_consensus.cc:3060] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:42.929241 26474 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:42.915092 26321 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.930629 26446 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.916693 26414 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.932365 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:42.939076 19366 raft_consensus.cc:2468] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:42.940308 19367 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:42.946063 19221 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:11:42.962519 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.898515 26259 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:42.997545 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57030.2us
W20260709 13:11:43.000764 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.915674 26437 raft_consensus.cc:2764] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:11:43.005789 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 169180us
I20260709 13:11:43.006528 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.007642 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.009790 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:42.899240 26375 raft_consensus.cc:2804] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:42.915338 26373 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:43.003552 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.004374 19367 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:42.916600 26358 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.053388 19292 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:42.997761 26294 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:43.064479 19291 raft_consensus.cc:1240] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:11:43.067811 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.046777 26417 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:43.045693 25654 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:43.046350 26339 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:42.918902 26442 consensus_queue.cc:237] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.083730 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:42.901535 26244 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.061480 26375 raft_consensus.cc:697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:43.068063 26357 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:43.079909 26400 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.096944 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:43.112289 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 362132us
I20260709 13:11:43.116724 19221 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:43.116987 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.113118 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 318537us
I20260709 13:11:43.111243 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.129503 19295 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.111937 19291 raft_consensus.cc:1240] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:11:43.081024 26373 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:43.082705 25654 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.080479 26417 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:43.161099 26430 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.001s
I20260709 13:11:43.161320 26417 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.161679 26430 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.162753 26400 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.163236 26400 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.163712 26430 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.165293 26400 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.175495 19298 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:43.179108 19292 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:43.193742 19217 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:11:43.195114 19217 pending_rounds.cc:85] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 15
I20260709 13:11:43.195415 19217 pending_rounds.cc:107] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:11:43.195259 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.195735 19217 raft_consensus.cc:2889] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:43.175494 26446 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:43.197125 26446 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.198894 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.199513 26446 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.201354 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.202471 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.204072 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:43.206179 19298 raft_consensus.cc:606] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.081463 26264 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:43.075915 26348 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:11:43.208539 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.208716 26400 consensus_queue.cc:1048] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:11:43.213085 26432 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:43.213496 26432 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:43.214363 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 378650us
I20260709 13:11:43.215342 19868 leader_election.cc:400] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23.
I20260709 13:11:43.215477 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54008 (request call id 2566) took 1035 ms. Trace:
I20260709 13:11:43.216413 19374 rpcz_store.cc:276] 0709 13:11:42.179928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.180051 (+   123us) service_pool.cc:224] Handling call
0709 13:11:43.215297 (+1035246us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b5400313154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:43.215413 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676000640}
I20260709 13:11:43.217141 26482 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:43.214378 26432 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.217857 19374 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:43.217656 26482 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.218277 26432 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.128743 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:43.220669 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 92005.9us
W20260709 13:11:43.220906 26475 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:43.075302 26433 consensus_queue.cc:1048] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:43.088017 26358 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:11:43.223205 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.223825 26358 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:43.224385 26358 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:43.224467 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.225585 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.226117 19218 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:43.226842 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:43.227484 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1291) took 1158 ms. Trace:
I20260709 13:11:43.227339 26347 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.228468 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:43.229102 19902 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:43.229417 26347 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.140759 26380 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:43.220795 26408 consensus_queue.cc:1048] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:11:43.230067 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:43.230686 26380 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:43.231029 26380 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:43.231410 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:43.231930 26380 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.233163 26380 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.124274 26259 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.138628 26375 consensus_queue.cc:237] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.146428 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.237841 19221 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 23: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:43.100739 19297 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:43.147069 19300 pending_rounds.cc:85] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 10
I20260709 13:11:43.147509 19294 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:11:43.148515 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.149379 19296 raft_consensus.cc:1240] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:43.149958 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.148025 26373 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.241559 26437 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.242041 26437 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.242374 26373 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.239285 19300 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 13.11
I20260709 13:11:43.243120 19300 raft_consensus.cc:2917] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Aborting config change with OpId 13.11: Aborted: Op aborted by new leader
I20260709 13:11:43.243549 19300 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:43.243902 19300 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:11:43.153075 25654 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.154426 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2779) took 1066 ms. Trace:
W20260709 13:11:43.156684 26473 log.cc:927] Time spent T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:11:43.244424 19223 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:43.225270 26358 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.244473 19220 rpcz_store.cc:276] 0709 13:11:42.088049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.478234 (+390185us) service_pool.cc:224] Handling call
0709 13:11:43.154219 (+675985us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001b1f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:43.154361 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514952576}
I20260709 13:11:43.138634 19216 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:43.140636 26386 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:11:43.234084 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:43.222008 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.219844 26482 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.227851 19370 rpcz_store.cc:276] 0709 13:11:42.069561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.069909 (+   348us) service_pool.cc:224] Handling call
0709 13:11:42.081650 (+ 11741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.712037 (+630387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.227288 (+515251us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540012ded4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:43.227431 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279080320}
I20260709 13:11:43.112602 26477 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:43.150975 26471 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:11:43.244136 19300 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:43.244649 19225 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:43.270032 19374 raft_consensus.cc:1275] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:43.200042 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:43.247264 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.252794 19296 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:43.275260 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.276038 19296 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 11.
I20260709 13:11:43.253641 19291 raft_consensus.cc:1240] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:43.239435 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.290588 19297 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:43.259218 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.167143 26333 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:43.303403 19293 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:43.318459 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.319162 19299 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:43.320298 19299 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:11:43.320741 19370 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:43.303129 26340 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.321291 26404 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:43.321925 26373 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:43.266389 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44460.3us
I20260709 13:11:43.266775 19868 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:43.304363 26377 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:43.136988 26294 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:43.324337 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.266748 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.323012 26404 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:11:43.343932 26377 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:43.372999 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1295) took 1144 ms. Trace:
I20260709 13:11:43.376106 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:43.261353 19295 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:43.366261 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:43.367148 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 100438us
I20260709 13:11:43.260221 26348 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.321481 26340 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.375953 19371 rpcz_store.cc:276] 0709 13:11:42.228471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.841112 (+612641us) service_pool.cc:224] Handling call
0709 13:11:42.841384 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.841578 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:43.060540 (+218962us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.372515 (+311975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:43.372592 (+    77us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:43.372655 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.372757 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.372923 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":303437,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":18011,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"thread_start_us":525595,"threads_started":2}
I20260709 13:11:43.377712 19293 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:43.268193 26477 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:43.396718 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.402166 19295 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:11:43.395288 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.344414 26294 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:43.406258 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.407281 26488 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:43.410440 26488 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:43.410933 26488 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.410461 26402 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.415495 26402 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.415897 26435 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.417238 19372 raft_consensus.cc:1240] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:11:43.418253 26402 leader_election.cc:290] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:43.401443 26487 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.419251 26487 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.420197 26373 consensus_queue.cc:1059] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:11:43.421068 26373 raft_consensus.cc:3055] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:43.421394 26373 raft_consensus.cc:740] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:43.421927 26487 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.422318 26373 consensus_queue.cc:260] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.423314 26340 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.423390 26333 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:43.424224 26333 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.419787 26435 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:43.402539 26489 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:43.428781 26489 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.429229 26489 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:43.405488 26348 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.431382 26348 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:43.431669 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.432343 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.436807 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.409755 19297 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:43.437472 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.443012 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.443601 19216 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.446877 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:43.448539 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.444321 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:43.449162 19219 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:43.450147 19219 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:43.450518 19219 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:43.450385 19265 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.451303 19219 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.474366 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.477559 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.480345 19297 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:43.379766 26437 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.481505 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.405249 26477 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.407684 26294 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:43.483937 19219 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:43.485468 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 427336us
W20260709 13:11:43.490285 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.497792 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.498615 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.493590 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.499163 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.455250 26482 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.449782 26374 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:43.531527 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:43.532568 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.522428 19297 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:43.457192 26306 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:43.501772 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:43.484872 26268 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:43.476121 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:43.529251 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:43.469022 26487 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:43.471441 26340 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:43.540037 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46562.8us
I20260709 13:11:43.541455 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:43.543712 19374 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.544246 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:43.544880 19298 raft_consensus.cc:606] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.455593 26400 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:11:43.479462 26486 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:43.549751 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.526646 19266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.195:46545 timed out after 1.556s (SENT) [suppressed 23 similar messages]
I20260709 13:11:43.519922 26373 raft_consensus.cc:3060] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.548774 19371 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:11:43.520144 26207 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.505486 26348 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:43.485013 26347 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:11:43.534096 26402 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:43.530099 26386 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:43.557514 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.520723 26357 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:43.541482 26306 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.555859 19218 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:43.537784 26432 consensus_queue.cc:1048] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:11:43.568205 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.542589 26264 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:43.544423 26476 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:43.574018 19219 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:43.548254 26439 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:43.534687 26364 consensus_queue.cc:1059] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:11:43.551443 26482 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:43.589804 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 331456us
I20260709 13:11:43.590020 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:43.597919 19370 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:43.590986 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.557379 26487 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:43.578584 26306 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:43.611581 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.614727 26433 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:43.615309 26433 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:43.615752 26433 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:43.592489 26347 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:43.607451 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.575352 26446 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:43.587953 26476 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.618417 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.620456 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b95788528f474a568f6df71dd9018575"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:43.629952 19294 raft_consensus.cc:606] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.630406 19294 raft_consensus.cc:614] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:43.594481 26402 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.603516 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1296) took 1352 ms. Trace:
I20260709 13:11:43.606877 26386 raft_consensus.cc:3055] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:43.633476 19366 rpcz_store.cc:276] 0709 13:11:42.251167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.997178 (+746011us) service_pool.cc:224] Handling call
0709 13:11:43.048603 (+ 51425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.048860 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:43.245967 (+197107us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.603095 (+357128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:43.603165 (+    70us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:43.603224 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.603311 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.603446 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96392,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3175,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":13739,"thread_start_us":533906,"threads_started":2}
I20260709 13:11:43.578516 26357 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.576694 26348 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.643399 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:43.594939 26417 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.601524 26400 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:11:43.595350 26264 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.648552 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.624076 26347 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:43.608788 26482 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:43.625152 26446 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:43.632946 26476 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:43.671707 19294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:43.674968 19294 raft_consensus.cc:606] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.675328 19294 raft_consensus.cc:614] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:43.675398 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:43.658526 19370 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:43.659077 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:43.662263 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 135650us
I20260709 13:11:43.663331 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.640036 26386 raft_consensus.cc:740] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:43.665839 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:43.627074 26439 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:11:43.670392 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:43.690564 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:43.672642 19368 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:43.654520 26435 raft_consensus.cc:2764] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:43.696031 19266 leader_election.cc:400] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:43.696424 19266 leader_election.cc:403] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:43.687573 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.650246 26499 raft_consensus.cc:2764] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:11:43.698035 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 221996us
I20260709 13:11:43.698298 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:43.700585 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.705796 19900 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:43.695396 26414 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.711778 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:43.668375 26442 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:43.713044 19899 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:43.665944 26333 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.738641 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.740126 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.671514 26487 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.738377 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.819269 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.743916 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.820546 19291 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 12.
I20260709 13:11:43.821642 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.747041 19299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f43f1e515be64813bb797fabd579621f"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:43.707343 26414 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.737035 26347 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.725723 26400 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:43.681018 26493 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:43.789579 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 93660.1us
I20260709 13:11:43.840000 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:43.817471 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.744234 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.841214 19292 raft_consensus.cc:2368] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21.
I20260709 13:11:43.829892 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.841320 19370 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:43.832929 19216 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:43.765654 26358 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:43.767282 26491 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.449s	user 0.000s	sys 0.006s
I20260709 13:11:43.823086 26442 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.853598 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.815953 26435 raft_consensus.cc:2764] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:11:43.856725 19291 raft_consensus.cc:2393] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 23: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:43.857123 19292 raft_consensus.cc:2393] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:43.736917 26505 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 13:11:43.867539 19374 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:43.873868 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.868683 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.869424 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.876232 19298 raft_consensus.cc:2368] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16.
I20260709 13:11:43.865108 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:43.864703 26414 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.877027 19370 raft_consensus.cc:3060] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.877110 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.877854 19298 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:43.878175 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 48374.1us
I20260709 13:11:43.878705 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.879546 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:43.882685 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 146676us
I20260709 13:11:43.886801 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.864816 26358 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:43.789084 26482 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.874929 26400 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:43.871754 26494 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:43.882927 26347 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.865221 26207 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.884042 25654 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.002s
I20260709 13:11:43.755939 26446 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:43.896853 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56984.9us
I20260709 13:11:43.898115 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.899868 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:43.904691 26496 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:11:43.916426 19265 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:43.917363 19292 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:43.885648 26357 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:43.896055 26498 log.cc:927] Time spent T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:11:43.936090 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3140) took 1622 ms. Trace:
W20260709 13:11:43.936308 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:43.936784 19191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.936451 19373 rpcz_store.cc:276] 0709 13:11:42.314115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.142541 (+828426us) service_pool.cc:224] Handling call
0709 13:11:43.142830 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.143164 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.143191 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.143647 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.575696 (+432049us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:43.575770 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.575863 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.935914 (+360051us) raft_consensus.cc:1685] finished
0709 13:11:43.935932 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.936040 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5971,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":431631,"threads_started":1,"wal-append.queue_time_us":517973}
I20260709 13:11:43.938547 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:43.939412 19373 raft_consensus.cc:2368] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
W20260709 13:11:43.940663 26502 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:11:43.942010 26446 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.948051 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2793) took 1096 ms. Trace:
I20260709 13:11:43.948479 19224 rpcz_store.cc:276] 0709 13:11:42.851522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.851645 (+   123us) service_pool.cc:224] Handling call
0709 13:11:42.851959 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.129396 (+277437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.175766 (+ 46370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.221049 (+ 45283us) spinlock_profiling.cc:243] Waited 989 us on lock 0x7b2c00000f48. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:43.221432 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.579365 (+357933us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:43.579417 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.579508 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.947759 (+368251us) raft_consensus.cc:1685] finished
0709 13:11:43.947779 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.947991 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208953,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4379,"spinlock_wait_cycles":2274688,"thread_start_us":617406,"threads_started":2,"wal-append.queue_time_us":494449}
I20260709 13:11:43.950292 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:43.952062 26507 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:11:43.906000 26417 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:43.925429 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1294) took 1697 ms. Trace:
I20260709 13:11:43.883366 26435 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:43.928133 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.934180 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.954274 19370 raft_consensus.cc:2468] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
W20260709 13:11:43.959036 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.957901 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.959806 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.960420 19292 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:43.955282 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.954589 19365 rpcz_store.cc:276] 0709 13:11:42.227604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.834786 (+607182us) service_pool.cc:224] Handling call
0709 13:11:42.867174 (+ 32388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:42.893993 (+ 26819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.894021 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.898974 (+  4953us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.130475 (+231501us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:43.130609 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.130859 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:43.766702 (+635843us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:43.906767 (+140065us) raft_consensus.cc:1685] finished
0709 13:11:43.906809 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.925366 (+ 18557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26323,"raft.queue_time_us":26439,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6591,"spinlock_wait_cycles":11767168,"thread_start_us":192305,"threads_started":1,"wal-append.queue_time_us":385986}
I20260709 13:11:43.963999 19224 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:43.968327 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:43.969170 19224 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:43.967257 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:43.970466 19191 leader_election.cc:400] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21.
I20260709 13:11:43.971381 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.972112 19292 raft_consensus.cc:2410] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260709 13:11:43.971926 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 43922.5us
I20260709 13:11:43.973066 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:43.933386 26348 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:43.953068 26417 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:43.982287 19266 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:43.931252 26207 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:43.983306 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:43.984359 19224 raft_consensus.cc:1240] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:43.974836 26339 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:43.748596 26386 consensus_queue.cc:260] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:43.923511 26511 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:11:43.998106 19224 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:43.998544 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:43.990865 19292 raft_consensus.cc:2468] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:43.962518 26340 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:43.986125 26489 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 13:11:43.974895 26294 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:43.966822 26500 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:11:43.997640 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.007824 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.001005 19365 raft_consensus.cc:2393] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 23: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
W20260709 13:11:43.986861 26504 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:11:43.964887 26400 raft_consensus.cc:2804] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:43.974824 26486 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:43.974660 26264 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:43.928032 25654 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.015640 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:43.985772 26417 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:43.980391 26521 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:43.994395 26414 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:43.983336 26442 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.021013 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:43.966478 26357 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:11:44.044642 19222 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:43.991750 26526 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:44.030277 26207 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.037927 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.055584 19296 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:44.056502 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.058019 19296 raft_consensus.cc:1275] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:11:44.058342 19296 pending_rounds.cc:85] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 9
I20260709 13:11:44.058560 19296 pending_rounds.cc:107] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:11:44.058789 19296 raft_consensus.cc:2889] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.060055 26414 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:44.061132 26414 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.063941 19369 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:44.038537 19292 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:44.065500 19292 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:11:44.065980 26380 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.832s	user 0.019s	sys 0.000s
I20260709 13:11:44.066867 26476 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.038605 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.068883 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.070078 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.073562 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.026746 26417 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.045809 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.050347 25654 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:44.018767 26358 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.052026 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3139) took 1738 ms. Trace:
I20260709 13:11:44.081802 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:44.082933 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 103348us
I20260709 13:11:44.053521 26526 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.037755 26521 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:44.046852 26400 raft_consensus.cc:697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:44.041203 26333 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:44.039695 26264 raft_consensus.cc:2804] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:44.049350 26527 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.072268 26244 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.039104 26386 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:44.080070 26437 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:44.080655 26517 log.cc:927] Time spent T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:44.012403 26489 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.081283 19367 rpcz_store.cc:276] 0709 13:11:42.313871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.077356 (+763485us) service_pool.cc:224] Handling call
0709 13:11:43.100685 (+ 23329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.114385 (+ 13700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.114417 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:43.114928 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:11:43.551799 (+436871us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:43.570140 (+ 18341us) log.cc:844] Serialized 14 byte log entry
0709 13:11:43.570409 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.570475 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.051824 (+481349us) raft_consensus.cc:1685] finished
0709 13:11:44.051845 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.051970 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1363,"prepare.queue_time_us":16368,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":4960,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":14016,"thread_start_us":388000,"threads_started":1,"wal-append.queue_time_us":514226}
W20260709 13:11:44.081593 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.076707 19365 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:44.087172 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:44.054677 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:44.076612 26230 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 1.349s	user 0.014s	sys 0.008s
W20260709 13:11:44.090806 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 83527.3us
I20260709 13:11:44.077325 26374 consensus_queue.cc:1059] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:11:44.093767 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:44.094223 19340 leader_election.cc:400] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21.
I20260709 13:11:44.095333 19298 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 13:11:44.120757 26514 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:11:44.075922 26505 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:44.096971 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:44.097635 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:44.137962 19903 raft_consensus.cc:1240] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:44.077204 26432 consensus_queue.cc:1048] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:11:44.023468 26486 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.083325 26348 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:44.101939 26373 consensus_meta.cc:287] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 13:11:44.074427 26364 consensus_queue.cc:1048] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.027s
W20260709 13:11:44.080205 26519 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:11:44.132634 19374 raft_consensus.cc:2393] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:44.095227 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 113045us
I20260709 13:11:44.133910 19340 leader_election.cc:403] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.146585 19217 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:11:44.146852 19217 pending_rounds.cc:85] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:44.146977 19217 pending_rounds.cc:107] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:11:44.147105 19217 raft_consensus.cc:2889] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.096045 26521 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.087239 26380 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:11:44.139801 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:44.152746 19266 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.153656 19367 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:44.141075 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:44.151630 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64677us
W20260709 13:11:44.133821 26433 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.001s
W20260709 13:11:44.136209 26513 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:11:44.136289 26429 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.154629 19340 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.159171 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.159869 19291 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:44.158488 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.093861 26528 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:11:44.162955 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.164076 19340 leader_election.cc:400] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16.
I20260709 13:11:44.140558 26264 raft_consensus.cc:697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:44.139380 26374 consensus_queue.cc:1243] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:44.165731 19340 leader_election.cc:403] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.166241 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.166409 19374 raft_consensus.cc:1275] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:44.166706 26429 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:44.170392 26536 log.cc:927] Time spent T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:11:44.164875 26207 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.167083 26446 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.184041 26489 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.165006 26531 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:44.185263 26294 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.186285 26530 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:44.187350 26306 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
I20260709 13:11:44.167142 25654 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:44.189867 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:44.190255 26488 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.000s
I20260709 13:11:44.190616 26488 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.155650 26400 consensus_queue.cc:237] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.192986 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.194486 19291 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:11:44.194871 19291 pending_rounds.cc:85] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 12
I20260709 13:11:44.195096 19291 pending_rounds.cc:107] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:11:44.155995 26373 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:44.202634 19224 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:44.183290 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3419) took 1012 ms. Trace:
I20260709 13:11:44.159361 26244 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21.
I20260709 13:11:44.159119 26414 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:44.164580 26476 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.195307 19291 raft_consensus.cc:2889] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.181977 26264 consensus_queue.cc:237] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.196259 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.182478 19372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2569) took 1973 ms. Trace:
I20260709 13:11:44.198688 19374 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:44.182705 26477 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 13:11:44.199270 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:44.199921 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.203500 19225 rpcz_store.cc:276] 0709 13:11:43.170995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.202233 (+ 31238us) service_pool.cc:224] Handling call
0709 13:11:44.183085 (+980852us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b540039a8d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:44.183215 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72547712}
I20260709 13:11:44.172111 26526 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.208951 19372 rpcz_store.cc:276] 0709 13:11:42.208996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.751647 (+542651us) service_pool.cc:224] Handling call
0709 13:11:42.781512 (+ 29865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.417622 (+636110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.182245 (+764623us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400357854. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.182420 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461415680}
I20260709 13:11:44.212460 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.165434 26348 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:44.215870 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.216616 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.217180 19292 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.187858 26306 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.220001 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.217252 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.224898 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.226562 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.226905 26207 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.227833 26522 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.229375 26530 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:44.240813 26522 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:44.241585 26522 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.223322 26414 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:44.247567 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.161563 26433 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:11:44.252943 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 88967us
I20260709 13:11:44.219952 26531 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:44.220253 25654 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16.
I20260709 13:11:44.257917 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.259228 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:44.243634 26402 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:11:44.218880 26493 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.224115 26294 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:44.271976 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.277500 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.252593 26488 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.273288 26527 consensus_queue.cc:1059] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:11:44.281419 26527 raft_consensus.cc:3055] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:44.281816 26527 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.282687 26527 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.219353 26477 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.285501 26306 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.285876 26477 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.254523 19292 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 13.
I20260709 13:11:44.256600 19223 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:44.249648 26476 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:44.224728 26526 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.261364 26373 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:44.261834 26347 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:44.290689 26488 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:44.299139 26347 consensus_queue.cc:1243] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:44.299351 26488 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.299677 26347 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:44.256218 26358 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:44.270002 26522 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.300139 26347 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.288456 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.300686 26358 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.300984 26347 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.302140 26347 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.301970 26358 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.303987 26357 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:44.304149 26306 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:44.304417 26510 consensus_queue.cc:1059] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:44.305361 26533 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:44.305750 26533 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.305830 26510 raft_consensus.cc:3055] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:44.306380 26510 raft_consensus.cc:740] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.251278 26417 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.306584 26533 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.307567 19373 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:44.307324 26510 consensus_queue.cc:260] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:44.292039 26529 log.cc:927] Time spent T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:44.256623 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.269394 26520 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:11:44.289237 26402 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:44.245189 26432 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:11:44.296255 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.264798 19291 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:44.267267 26433 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:44.271730 26348 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.299758 26488 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.310132 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:44.348546 19898 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13.
I20260709 13:11:44.318843 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:44.349624 19367 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:44.339676 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 43526.8us
I20260709 13:11:44.312315 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:44.351432 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46294.7us
I20260709 13:11:44.353081 19337 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13.
I20260709 13:11:44.353434 19337 leader_election.cc:403] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.353369 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.288143 26527 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.338668 19372 raft_consensus.cc:2393] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:44.312888 26490 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.016s	sys 0.009s
I20260709 13:11:44.312863 26510 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.362444 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.362706 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:44.308055 26533 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:44.308776 26417 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.298105 26294 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.366959 26433 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.369490 19292 raft_consensus.cc:2368] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24.
I20260709 13:11:44.346086 25654 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:44.374518 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.385579 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.387247 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.389034 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:44.368342 26490 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.016s	sys 0.012s
I20260709 13:11:44.390576 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.367369 26386 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:44.375110 19191 leader_election.cc:400] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:11:44.391889 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.356868 26493 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:44.362038 26526 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:44.396255 19191 leader_election.cc:403] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.398733 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.400614 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.401688 19292 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:44.386283 26437 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:44.404497 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:44.405208 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.406103 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.362234 26373 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:11:44.399775 19367 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:44.394538 26402 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:44.408905 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:44.409530 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.407500 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.406522 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:44.410096 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:44.402556 26526 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:44.415956 19340 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.407250 26417 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:44.411522 26543 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:11:44.412765 26306 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:44.394440 26489 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:11:44.446230 26429 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.415364 26437 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:44.430514 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3416) took 1292 ms. Trace:
I20260709 13:11:44.431357 19340 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.408628 26482 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 13. Current term is 14.
I20260709 13:11:44.407092 26511 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:44.440315 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:44.406960 26531 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:44.452927 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.460666 19340 leader_election.cc:304] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.453166 19222 rpcz_store.cc:276] 0709 13:11:43.138215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.138575 (+   360us) service_pool.cc:224] Handling call
0709 13:11:43.138875 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.046529 (+907654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.430264 (+383735us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54000e3b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.430448 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082653056}
I20260709 13:11:44.419678 26526 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:44.462110 19340 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.402448 26493 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.431702 26521 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.468530 26294 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.433141 26417 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:44.470520 26528 consensus_queue.cc:1059] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:44.482144 26528 raft_consensus.cc:3055] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:44.482564 26528 raft_consensus.cc:740] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:44.483912 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2577) took 1337 ms. Trace:
I20260709 13:11:44.484556 19293 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:44.483467 26528 consensus_queue.cc:260] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.484360 19300 rpcz_store.cc:276] 0709 13:11:43.146075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.146449 (+   374us) service_pool.cc:224] Handling call
0709 13:11:43.146852 (+   403us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:43.377573 (+230721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.377619 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:43.385657 (+  8038us) log.cc:844] Serialized 78 byte log entry
0709 13:11:43.663339 (+277682us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:44.077502 (+414163us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b18001ce4c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d7a5d4bc 00007fe8d4dab48b 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf
0709 13:11:44.077654 (+   152us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.078070 (+   416us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.078379 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:11:44.078520 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.087322 (+  8802us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.480903 (+393581us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b18001ce4c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:44.483625 (+  2722us) raft_consensus.cc:1685] finished
0709 13:11:44.483647 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.483827 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101109,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":28263,"raft.queue_time_us":17117,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":38452,"spinlock_wait_cycles":41081984,"thread_start_us":355935,"threads_started":2,"wal-append.queue_time_us":434286}
I20260709 13:11:44.486256 26528 raft_consensus.cc:3060] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:44.484560 19292 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:44.435263 26306 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:44.492632 26306 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:44.494823 26493 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:44.496136 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.497287 26437 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.488008 19297 raft_consensus.cc:1275] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:44.475412 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:44.473011 26435 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:44.480154 26439 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:44.511498 26439 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:44.512020 26439 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:44.513105 26230 raft_consensus.cc:3055] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:44.513836 26230 raft_consensus.cc:740] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:44.514757 26230 consensus_queue.cc:260] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.508543 26489 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.509296 26268 raft_consensus.cc:993] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:44.527904 19339 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.509497 26429 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:44.509898 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:44.510865 19222 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:44.517417 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:44.520450 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 45138us
I20260709 13:11:44.546253 19296 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:44.546540 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.547217 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:44.547966 19216 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 19.
I20260709 13:11:44.548978 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:44.552328 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:44.516147 26230 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:44.447726 25654 consensus_queue.cc:1048] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:11:44.559844 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:44.566767 19868 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.569389 19191 leader_election.cc:400] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24.
I20260709 13:11:44.569806 19191 leader_election.cc:403] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:44.570847 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.561781 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:44.545993 26259 raft_consensus.cc:1081] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:44.584872 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3144) took 1089 ms. Trace:
I20260709 13:11:44.538337 26162 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:44.580220 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3436) took 1147 ms. Trace:
I20260709 13:11:44.517128 26530 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:11:44.582473 19297 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:44.546160 26333 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.585414 19371 rpcz_store.cc:276] 0709 13:11:43.495591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.495755 (+   164us) service_pool.cc:224] Handling call
0709 13:11:43.534316 (+ 38561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.557643 (+ 23327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.584622 (+1026979us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5400314554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.584818 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32445184}
I20260709 13:11:44.602347 19371 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:44.603008 26306 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.563877 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:44.588063 19366 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:11:44.605028 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.605309 19366 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [17.9-20.10]
I20260709 13:11:44.594347 19365 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:44.518735 26489 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.584044 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.595736 19223 rpcz_store.cc:276] 0709 13:11:43.432766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.468214 (+ 35448us) service_pool.cc:224] Handling call
0709 13:11:43.468608 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.291102 (+822494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.579944 (+288842us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54000190d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.580129 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809008512}
I20260709 13:11:44.555646 26373 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.609210 26489 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:44.609781 26373 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.575548 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1299) took 2078 ms. Trace:
I20260709 13:11:44.611253 19368 rpcz_store.cc:276] 0709 13:11:42.496944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.226628 (+729684us) service_pool.cc:224] Handling call
0709 13:11:43.226895 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:43.695133 (+468238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.575296 (+880163us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400197154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.575487 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024509184}
I20260709 13:11:44.603549 19371 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:44.516995 26400 consensus_queue.cc:1048] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:44.545928 26408 consensus_queue.cc:1048] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:11:44.580557 26511 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:11:44.628750 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 62071.9us
I20260709 13:11:44.633078 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:44.636628 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52695.8us
I20260709 13:11:44.640431 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.596448 26294 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:44.596401 26487 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:44.671610 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.661109 26521 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.674875 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.678450 19296 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:44.689368 26433 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13.
I20260709 13:11:44.689786 26488 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.691125 19218 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:44.691264 26435 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:44.641954 26520 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.641659 26358 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:44.679292 26357 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:11:44.754549 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 215135us
I20260709 13:11:44.755983 19291 raft_consensus.cc:1240] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:11:44.677986 26527 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:11:44.619515 26531 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:44.758523 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 216344us
I20260709 13:11:44.768215 19898 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:44.776906 19299 raft_consensus.cc:606] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.777473 19299 raft_consensus.cc:614] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:44.777691 19901 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:44.777588 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:44.787973 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 155018us
I20260709 13:11:44.731415 26482 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:11:44.794370 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:44.796461 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:44.801062 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:44.802090 19224 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:44.749320 26358 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:44.809332 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.817437 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:44.817910 19370 raft_consensus.cc:1275] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:44.818190 19291 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
W20260709 13:11:44.818995 26347 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.008s
I20260709 13:11:44.797330 26374 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:44.827131 19224 raft_consensus.cc:1240] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:44.786710 26520 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:11:44.786227 26294 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:11:44.793561 26494 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:11:44.794200 26357 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:11:44.847544 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:44.856364 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:44.852934 19224 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:44.803069 26162 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:11:44.861784 26549 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.862411 26549 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.863420 26433 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:44.863884 26433 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:44.876109 26510 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 13:11:44.876732 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:44.877483 19894 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:44.878357 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:44.867157 26553 log.cc:927] Time spent T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:11:44.868503 26570 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.820351 26436 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:11:44.825636 26374 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.871059 19373 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:11:44.872030 26555 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:11:44.872716 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:44.873246 26358 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:44.874469 26402 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:44.875036 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1099) took 1430 ms. Trace:
I20260709 13:11:44.871830 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:44.890852 19902 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:44.876353 26433 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.864856 26488 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:44.884723 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 120819us
I20260709 13:11:44.890223 19295 rpcz_store.cc:276] 0709 13:11:43.444760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.444911 (+   151us) service_pool.cc:224] Handling call
0709 13:11:43.445289 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:43.445718 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:43.445768 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:44.051913 (+606145us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b1800396460. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d962a6 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a
0709 13:11:44.066196 (+ 14283us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b1800396460. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc8557 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:44.594284 (+528088us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b2c0000e678. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:44.594728 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:11:44.776645 (+181917us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:44.776717 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.776853 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:44.874841 (+ 97988us) raft_consensus.cc:1685] finished
0709 13:11:44.874859 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:44.874982 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9610,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10319,"spinlock_wait_cycles":91886592,"thread_start_us":181437,"threads_started":1,"wal-append.queue_time_us":278410}
I20260709 13:11:44.881121 26442 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:44.876750 26347 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:44.898190 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:44.902654 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2582) took 2579 ms. Trace:
I20260709 13:11:44.903038 19369 rpcz_store.cc:276] 0709 13:11:42.323095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.155702 (+832607us) service_pool.cc:224] Handling call
0709 13:11:43.156121 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.064383 (+908262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.902432 (+838049us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b5400198054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.902601 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087350528}
I20260709 13:11:44.886432 26521 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:44.908561 26511 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24.
I20260709 13:11:44.891876 26374 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:44.880965 26489 consensus_queue.cc:1048] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:11:44.882553 26162 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:44.930859 19902 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:44.892416 26339 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:11:44.904654 26442 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.888502 26268 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:11:44.901304 26347 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.919450 26433 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:44.973891 26439 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.964099 26482 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:11:44.976372 26482 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:44.976871 26482 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:44.977900 26482 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.983415 26510 consensus_queue.cc:1059] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:44.979471 26482 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:44.985858 26347 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:44.987380 26347 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:44.989579 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1271) took 1348 ms. Trace:
I20260709 13:11:44.990012 19903 rpcz_store.cc:276] 0709 13:11:43.641158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.641804 (+   646us) service_pool.cc:224] Handling call
0709 13:11:43.653403 (+ 11599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.141681 (+488278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:44.989333 (+847652us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540049f054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:44.989519 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113914112}
I20260709 13:11:44.998067 26251 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:44.998728 26251 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.003373 19222 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:45.004884 26251 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:44.964241 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 130329us
I20260709 13:11:44.974014 19299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37812 (request call id 71) took 1231 ms. Trace:
I20260709 13:11:45.014904 19299 rpcz_store.cc:276] 0709 13:11:43.742152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.742329 (+   177us) service_pool.cc:224] Handling call
0709 13:11:44.973806 (+1231477us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54001d3154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaf853 00007fe8dce7d60a 00007fe8d64037d4 00007fe8d6403762 00007fe8d6403691 00007fe8d640360c 00007fe8d64028c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:44.973926 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194327296}
I20260709 13:11:45.021824 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:45.024632 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:44.952978 26549 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.040066 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:44.961962 26442 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:45.040839 19294 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:44.921715 26526 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:44.947549 26521 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:11:45.043063 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 162401us
I20260709 13:11:45.083094 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:45.084002 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:45.038612 26533 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.002s
I20260709 13:11:45.085219 19295 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:45.039688 26482 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.089807 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:45.039003 26207 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.083451 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:45.096561 19220 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:45.097851 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:45.098713 19373 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:45.092957 19296 raft_consensus.cc:2368] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13.
I20260709 13:11:45.040030 26488 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.100524 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:45.106030 19291 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:45.107288 19299 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:45.096449 26439 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.102949 26207 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.110669 26207 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.123481 26373 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:45.090536 26230 consensus_meta.cc:287] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
I20260709 13:11:45.128149 19294 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:45.101166 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:45.125890 19295 raft_consensus.cc:1275] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:45.127310 19340 leader_election.cc:400] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 12 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 12. Current term is 13.
I20260709 13:11:45.135274 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:45.122031 26442 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.042709 26244 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:11:45.129454 26404 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.146610 19898 raft_consensus.cc:2368] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22.
I20260709 13:11:45.096930 26482 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.148386 26584 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.161209 26526 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.161258 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:45.162221 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2591) took 1760 ms. Trace:
I20260709 13:11:45.162714 19293 rpcz_store.cc:276] 0709 13:11:43.401621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.401753 (+   132us) service_pool.cc:224] Handling call
0709 13:11:44.484256 (+1082503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.485137 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.161964 (+676827us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003f25d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:45.162154 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2477232896}
I20260709 13:11:45.163306 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:45.165290 26581 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:45.165812 26268 consensus_queue.cc:1059] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:45.166587 19224 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:45.162298 26477 raft_consensus.cc:3055] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:45.170185 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.175004 26386 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:45.175488 26386 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.148715 26374 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.148445 26433 consensus_queue.cc:1048] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:11:45.169194 26251 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:11:45.175523 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1302) took 1668 ms. Trace:
I20260709 13:11:45.183704 19365 rpcz_store.cc:276] 0709 13:11:43.507371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.125601 (+618230us) service_pool.cc:224] Handling call
0709 13:11:44.139626 (+ 14025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.607168 (+467542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.175300 (+568132us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54001626d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:45.175469 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045249920}
I20260709 13:11:45.185351 19902 raft_consensus.cc:2393] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 20: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:45.188781 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:45.189073 26404 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:11:45.191320 26521 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.191862 26521 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.192360 26521 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:45.195489 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.168675 26477 raft_consensus.cc:740] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:45.200543 26583 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.201362 26435 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.201139 26477 consensus_queue.cc:260] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.201856 26435 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.202373 26477 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:45.202776 19295 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:45.203881 26374 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.205097 26549 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:45.205478 26549 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:45.201051 26583 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.213953 19897 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: [20.16-22.17]
I20260709 13:11:45.225793 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:45.217664 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.228336 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.228464 19337 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.229831 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:45.232734 26570 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:11:45.203919 26435 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:45.235006 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 69722.1us
I20260709 13:11:45.238910 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.223753 26439 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:45.255184 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.255882 19365 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 25.
I20260709 13:11:45.244251 26598 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:11:45.246235 26583 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.259243 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.259888 19371 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:45.260677 19291 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:45.241828 26494 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.254082 26435 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.252879 26442 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:45.232287 26521 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.235244 26499 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:45.269872 19372 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:45.271124 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:45.268553 26439 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.287361 26439 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.256124 26339 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.288336 26586 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.288867 26586 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.206374 26549 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.274616 19373 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:45.295015 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:45.276825 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.295701 19899 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:45.295892 19366 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:45.271929 19371 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:11:45.297608 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:45.293845 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:45.300758 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 72566.7us
I20260709 13:11:45.302011 19365 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:45.301869 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.302923 26549 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:45.303489 26321 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:45.303897 26321 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:45.304790 26321 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.305977 26321 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:45.307030 26259 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:45.307433 26259 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:45.308456 26581 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:45.309779 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46281.1us
I20260709 13:11:45.320930 26482 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.322949 19337 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:45.323896 26486 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.327150 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1308) took 1133 ms. Trace:
I20260709 13:11:45.326639 26518 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:45.331017 26518 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.331365 26518 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:45.332438 19896 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:45.327570 19367 rpcz_store.cc:276] 0709 13:11:44.194258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.415127 (+220869us) service_pool.cc:224] Handling call
0709 13:11:44.415793 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.455815 (+ 40022us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:44.529080 (+ 73265us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.170207 (+641127us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b180039e500. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:11:45.226019 (+ 55812us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:45.233727 (+  7708us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.233862 (+   135us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:45.233895 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.234067 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.310154 (+ 76087us) raft_consensus.cc:1685] finished
0709 13:11:45.326948 (+ 16794us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.327094 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18386,"prepare.queue_time_us":72903,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":36397,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":6982,"spinlock_wait_cycles":21658368,"thread_start_us":49000,"threads_started":1,"wal-append.queue_time_us":684265}
I20260709 13:11:45.344449 19266 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:45.348616 26595 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.310310 26586 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.358196 26400 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:45.362779 26264 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.363353 26264 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.369510 26437 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:45.370117 26437 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:45.371263 26437 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.377434 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.388598 26597 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:45.389364 26597 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:45.389647 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:45.389915 26597 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:45.393319 26321 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.395210 26321 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.396064 26521 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:45.398278 26521 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:45.378253 26400 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:45.401770 26400 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.398295 26321 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:45.420758 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 315727us
I20260709 13:11:45.426100 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:45.426208 26488 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:45.426910 26488 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.388998 26264 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.432060 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.433137 19221 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:45.435447 19219 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:45.434259 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:45.438299 19224 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:45.440985 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.395649 26251 raft_consensus.cc:3055] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:45.455137 19221 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:11:45.455039 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:45.420456 26577 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.426280 26437 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:45.437510 26264 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.473142 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 80269.6us
I20260709 13:11:45.475674 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:45.428879 26373 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:11:45.457631 26251 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:45.491226 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:45.452030 26436 consensus_queue.cc:1059] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:11:45.497999 26433 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.501293 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.502543 26583 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:45.477059 26520 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:45.508545 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:45.509526 19217 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:45.475080 26577 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.473773 26386 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.479466 26264 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.497372 26435 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:11:45.568663 19900 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:45.507589 26348 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
W20260709 13:11:45.556964 26599 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.234s	user 0.002s	sys 0.001s
I20260709 13:11:45.565119 26306 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.566990 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1002) took 1090 ms. Trace:
I20260709 13:11:45.553143 19217 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:45.571285 19225 rpcz_store.cc:276] 0709 13:11:44.476614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.476794 (+   180us) service_pool.cc:224] Handling call
0709 13:11:44.480898 (+  4104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:44.499310 (+ 18412us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:11:44.543903 (+ 44593us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.158052 (+614149us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b18003ec8c0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a5523a 00007fe8d7ebfa2a
0709 13:11:45.437465 (+279413us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:45.437956 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.450840 (+ 12884us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:11:45.451186 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:11:45.472607 (+ 21421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.472701 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:45.564919 (+ 92218us) raft_consensus.cc:1685] finished
0709 13:11:45.564944 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.566920 (+  1976us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253115,"prepare.queue_time_us":45020,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":5660,"raft.queue_time_us":269563,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":13066,"spinlock_wait_cycles":57917056,"thread_start_us":71812,"threads_started":1,"wal-append.queue_time_us":728828}
I20260709 13:11:45.587291 19366 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:45.587486 19300 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:45.589334 19365 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:45.590723 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:45.591271 19294 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:45.592509 19373 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:45.519910 26251 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.593915 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:45.594663 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.596060 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:45.597162 19217 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:45.598016 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:45.598563 19225 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:45.515924 26520 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.567034 26488 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.604408 19295 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:45.612776 19294 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:45.615944 19373 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:45.621251 26251 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:45.603910 26259 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.627056 26259 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.631458 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.633697 26577 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.637270 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2809) took 1143 ms. Trace:
I20260709 13:11:45.637478 26520 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.637732 19216 rpcz_store.cc:276] 0709 13:11:44.494213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.602361 (+108148us) service_pool.cc:224] Handling call
0709 13:11:44.602718 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:44.680768 (+ 78050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:44.680814 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:44.680964 (+   150us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:44.681010 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.637049 (+956039us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54000776d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:45.637096 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.637218 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178931584}
I20260709 13:11:45.638866 19225 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:45.640255 26560 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:11:45.644244 26493 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.664098 26364 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:11:45.663407 26493 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.670928 26493 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:45.672076 26597 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.673200 19298 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:45.673370 26386 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.674420 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:45.674975 26597 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.681396 26489 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:45.681998 26489 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.663727 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:45.686721 26518 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.687652 26584 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:45.688062 26584 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:45.688916 26584 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.692512 19367 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:45.697332 26162 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:45.698226 26162 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:45.698540 26162 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:45.700752 26162 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.711205 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2811) took 1216 ms. Trace:
I20260709 13:11:45.711674 19220 rpcz_store.cc:276] 0709 13:11:44.494772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.629935 (+135163us) service_pool.cc:224] Handling call
0709 13:11:44.676706 (+ 46771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.097121 (+420415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.710954 (+613833us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400077bd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:45.711130 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964988672}
I20260709 13:11:45.713660 26489 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.714471 26162 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:45.724202 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 60528.4us
W20260709 13:11:45.729336 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 244407us
I20260709 13:11:45.729842 26518 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:45.730126 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:45.731115 26264 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.732422 26581 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:45.732844 26581 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.733174 26581 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.737926 26521 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.738505 26521 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:45.739744 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 265487us
I20260709 13:11:45.746369 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:45.747012 19900 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:45.731698 26264 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:45.752609 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.755458 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.756340 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:45.756063 19366 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:45.764539 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.766083 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.766726 19374 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:45.768071 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:45.770926 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.772090 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.768740 19372 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:45.781121 19896 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:11:45.748674 26572 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:45.735805 26251 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:11:45.786008 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.789621 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:45.748536 26526 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:11:45.800940 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:45.815066 26607 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.813458 19368 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
W20260709 13:11:45.823123 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.817723 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 73201.1us
I20260709 13:11:45.824363 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:45.826177 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 181235us
I20260709 13:11:45.749107 25654 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:11:45.752142 26489 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:11:45.820920 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48922us
I20260709 13:11:45.800015 26306 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.834831 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.831777 26595 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.835546 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.836505 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:45.842131 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:45.833155 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 159969us
I20260709 13:11:45.840070 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.770371 26560 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
W20260709 13:11:45.843945 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.844388 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:45.847548 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:45.847791 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.851555 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:45.853871 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:45.855250 19900 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:45.856073 19188 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.778270 26386 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:11:45.841423 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:45.859337 19292 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:45.800191 26572 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:45.819196 26521 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:45.822068 26432 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:45.867736 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.834097 26373 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.785988 26435 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.068s
I20260709 13:11:45.879901 19188 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:45.886421 26533 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.887058 26527 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.887552 26488 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.887630 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:45.940214 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52622.7us
I20260709 13:11:45.941280 19367 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:45.893805 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:45.894930 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:45.853039 26436 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:45.951815 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.957685 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:45.958611 19367 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:45.899501 19188 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:45.896799 26604 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:45.881055 25654 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:45.857622 26306 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.839519 26429 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:11:45.865320 26477 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:45.875770 26603 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:45.877625 26432 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:45.898200 26294 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.916584 26572 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:45.919950 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:45.921540 26207 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.922230 26400 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.924279 26439 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:45.924489 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:46.016794 19216 raft_consensus.cc:3060] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:45.945322 19218 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:45.930704 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.858608 26595 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:45.970904 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 71509.2us
I20260709 13:11:45.968935 26251 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:11:45.989758 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.969889 26408 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:45.939287 26358 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:46.032042 19367 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:11:45.969415 19373 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:45.969822 26598 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.041656 26598 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:46.043033 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 157368us
I20260709 13:11:46.046248 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.002278 26603 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.984469 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:45.974617 26373 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:45.822368 26607 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:45.967763 26321 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:46.018154 19188 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:46.010864 26432 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:46.031750 26408 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.048110 19371 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:45.949749 26533 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.043874 26598 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.002868 26347 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:46.052225 19299 raft_consensus.cc:1275] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:45.968073 26442 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 13:11:46.009513 25654 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:11:46.054179 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 172043us
I20260709 13:11:46.015708 26436 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:46.055100 19220 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:46.033190 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 102559us
I20260709 13:11:45.969267 26488 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.059062 19188 leader_election.cc:400] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22.
I20260709 13:11:46.101334 19188 leader_election.cc:403] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:46.038384 26477 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:45.949267 26527 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.030324 26400 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.037523 26358 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:46.051138 26603 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:46.030675 26207 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:46.076228 26613 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:11:46.062055 26373 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.061421 26408 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:46.103569 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:46.158638 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55155.4us
I20260709 13:11:46.159833 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:46.120724 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 61778.5us
I20260709 13:11:46.162390 19221 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:11:46.162595 19222 raft_consensus.cc:1275] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:46.163856 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.070463 19216 raft_consensus.cc:2468] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:46.164606 19222 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 12: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:46.060412 26321 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:46.148010 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 104482us
I20260709 13:11:46.170168 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:46.162775 19221 pending_rounds.cc:85] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 10
I20260709 13:11:46.171319 19221 pending_rounds.cc:107] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:11:46.171701 19221 raft_consensus.cc:2889] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.172685 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.173388 19216 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:46.173990 19222 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:46.164654 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.172812 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:46.175207 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 122145us
I20260709 13:11:46.175904 19221 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:11:46.176396 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:46.176862 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.178203 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.178381 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:45.982475 26604 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.180765 19339 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:46.129992 26294 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22.
I20260709 13:11:46.185913 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.156421 26598 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.130892 26597 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:46.099171 26347 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.191367 19217 raft_consensus.cc:1275] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:11:46.189059 26511 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:46.192819 26437 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:46.196508 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.172039 26477 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:46.172422 19224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:46.206387 19224 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.206759 19224 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:46.172129 26435 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:46.181596 26505 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:46.208930 26306 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:46.250186 26621 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:11:46.252027 26623 log.cc:927] Time spent T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:46.253624 26400 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.255245 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:46.256239 26604 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:46.257100 26624 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:11:46.257582 26347 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:46.261734 26581 consensus_meta.cc:287] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:11:46.262183 26581 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.263284 19291 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:46.203626 26437 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:46.265079 26581 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.265208 26437 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.210700 26595 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.214568 26607 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.184684 26357 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:46.190529 26482 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:11:46.226132 26207 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.229120 25654 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:46.230999 26488 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.233776 26432 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.191982 26520 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:11:46.305490 26437 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:46.203109 26597 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.307777 26597 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.248792 26321 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.308221 26408 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.197088 26612 raft_consensus.cc:2804] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:46.309449 26612 raft_consensus.cc:697] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:46.310490 26408 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.310410 26612 consensus_queue.cc:237] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.298877 26577 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.312338 26630 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.312887 26630 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.315506 26630 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:46.201128 26598 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.319278 26598 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.295361 26358 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.241000 26477 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:46.324313 26477 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:46.327678 26207 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:46.267532 26505 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:46.328437 26207 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.328867 26505 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.329945 26598 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:46.330149 26505 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:46.330519 26598 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:46.332486 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.334523 19224 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:46.335981 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 157659us
I20260709 13:11:46.336796 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
W20260709 13:11:46.340494 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 387686us
W20260709 13:11:46.341269 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 242478us
I20260709 13:11:46.349050 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:46.350551 19224 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.334420 26533 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.282989 26435 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.360488 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.241587 26436 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.292158 26603 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.374783 26631 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:46.375558 26631 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.376183 26374 raft_consensus.cc:3055] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:46.376639 26374 raft_consensus.cc:740] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:46.378366 26631 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:46.380254 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:46.358266 26586 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:46.358476 26527 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.385247 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.390879 19900 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:46.391952 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:46.393090 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.393756 19297 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:46.397780 19901 raft_consensus.cc:2393] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:46.359627 26597 consensus_queue.cc:1048] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:11:46.402395 26435 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:46.405349 26518 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:46.409399 26518 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:46.358280 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:46.416589 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.397981 26604 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:46.420492 26597 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:46.430498 26486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.020s	sys 0.011s
I20260709 13:11:46.426148 26604 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.540462 26604 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:46.546380 26207 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.533594 25654 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.420969 26518 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.548144 25654 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.549942 26477 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.550734 25654 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:46.558651 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 200436us
I20260709 13:11:46.445816 26417 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.564052 19265 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:46.532964 26400 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.566856 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:46.554580 26584 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:46.554989 26486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.021s	sys 0.012s
I20260709 13:11:46.568836 26321 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:46.567574 26477 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.563068 26207 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:11:46.566298 26597 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:11:46.574884 26598 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.605109 26493 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:46.605553 26493 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:46.606408 26493 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.607625 26493 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:46.611924 26629 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.612509 26629 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.614709 26629 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:46.620085 26435 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.620675 26435 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.567905 26417 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.623049 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:46.634407 19901 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:11:46.572817 26400 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.640569 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.642315 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.643657 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.644531 19371 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:46.645749 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.647712 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:46.648391 19371 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:46.648967 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:46.649895 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 83206.8us
I20260709 13:11:46.650651 19370 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:46.651283 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.652045 19366 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:46.650764 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:46.654330 26321 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:46.657330 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:46.657752 26417 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.658232 26321 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:46.662549 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.638752 26598 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.667074 19371 raft_consensus.cc:2468] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:46.640017 26603 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.679939 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:46.681470 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:46.682121 19291 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:46.683001 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:46.683554 19291 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
W20260709 13:11:46.684765 26642 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:11:46.686262 26400 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.688776 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.689426 19901 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:46.692498 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.692498 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.694653 19371 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
W20260709 13:11:46.677747 26568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.010s	sys 0.008s
I20260709 13:11:46.701357 26505 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:46.672987 26321 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:46.713799 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.728379 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:46.716514 26617 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.830s	user 0.006s	sys 0.004s
I20260709 13:11:46.722600 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:46.722602 19366 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:11:46.723721 26568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.011s	sys 0.008s
I20260709 13:11:46.723660 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.724232 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.734623 19374 raft_consensus.cc:2393] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:46.709470 26432 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.725863 19297 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:46.730556 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:46.739108 19291 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:46.733871 19372 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:46.742857 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:46.720399 26400 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:46.755089 19291 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:46.731400 26598 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.757463 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:46.759284 19371 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:46.736397 26339 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:46.743645 26437 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.782876 26437 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.735275 26321 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.794498 26437 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:46.795403 26321 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.796972 19901 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:46.804281 26604 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.805696 19292 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:46.774672 26598 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.813705 26598 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:46.774904 26339 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.814604 26339 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:46.816322 26617 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:46.816911 26574 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:46.817330 26574 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:46.818449 26435 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.820135 19367 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:46.823151 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.824410 19900 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:46.827389 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:46.825964 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:46.771545 26499 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.762161 26400 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.858623 26230 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:46.820775 26429 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:11:46.861331 26499 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.898985 26499 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:46.899719 26625 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.732s	user 0.002s	sys 0.000s
I20260709 13:11:46.860261 26433 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
W20260709 13:11:46.905256 26639 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
I20260709 13:11:46.909809 26604 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:46.860596 26629 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:46.911919 26629 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.914299 26629 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:46.916446 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.925953 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:46.926622 19898 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:46.872537 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 135521us
I20260709 13:11:46.941131 19266 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:46.872515 26612 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:46.917006 26616 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:46.948628 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:46.951505 26651 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:46.952657 19266 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:46.953704 26604 raft_consensus.cc:2804] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:46.954439 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:46.956351 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 619577us
I20260709 13:11:46.917352 26373 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.942521 26511 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.946619 26348 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.942916 26306 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.967840 19898 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:46.946476 26347 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:46.945921 26612 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.968885 19266 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:46.954934 26597 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:11:46.962038 26533 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:46.997479 19300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2759) took 1126 ms. Trace:
I20260709 13:11:46.955765 26230 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:47.001672 26230 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.914692 26374 consensus_queue.cc:260] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:46.971069 26373 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.004734 26374 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.006094 26373 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.006608 26651 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.007046 26651 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.007372 26651 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.008566 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:46.993036 26306 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.009348 19369 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:47.011483 26306 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.013720 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 1015) took 1120 ms. Trace:
I20260709 13:11:47.014150 19220 rpcz_store.cc:276] 0709 13:11:45.893720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.894717 (+   997us) service_pool.cc:224] Handling call
0709 13:11:47.013467 (+1118750us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000780d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:47.013628 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255569664}
I20260709 13:11:46.994513 26612 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:46.974323 26482 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.976608 26511 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:46.974944 26604 raft_consensus.cc:697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:47.020826 19898 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:46.975606 26268 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:47.022768 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 65490.8us
I20260709 13:11:46.998894 19300 rpcz_store.cc:276] 0709 13:11:45.871385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.711787 (+840402us) service_pool.cc:224] Handling call
0709 13:11:46.712093 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.712344 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:46.869059 (+156715us) log.cc:844] Serialized 14 byte log entry
0709 13:11:46.989535 (+120476us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:46.997171 (+  7636us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:46.997220 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.997286 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:46.997422 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":255170,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5273,"thread_start_us":276505,"threads_started":2}
I20260709 13:11:47.024080 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.032738 19374 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:47.044649 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.045519 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.046365 19221 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:47.046867 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.049353 19220 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:47.047456 19223 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:47.022408 26294 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.057708 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.031303 26482 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.052290 26533 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:47.068497 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:47.104097 19220 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:47.070122 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.074180 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:47.105702 19224 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:47.078500 19218 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:47.099790 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:46.993264 26347 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.107676 19225 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:47.030676 26486 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.051810 19898 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:11:47.111908 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:47.117705 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75746.9us
I20260709 13:11:47.120225 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.120915 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.121649 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.114078 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.122202 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.109153 19224 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:11:47.033886 26268 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.992640 26348 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.160993 26348 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:47.161854 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.162472 25654 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:47.163167 25654 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.163967 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.164716 26499 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.164928 19340 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:47.165199 26499 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.165717 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:47.166196 19365 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:11:47.166291 19903 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:47.166582 19365 pending_rounds.cc:85] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 14
I20260709 13:11:47.166885 19365 pending_rounds.cc:107] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:11:47.167115 19365 raft_consensus.cc:2889] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:47.167354 26499 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:47.167063 26574 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.168483 26574 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:47.165169 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:47.175048 19901 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:47.176481 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.176631 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.176043 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.178349 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:47.123040 19372 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:47.034427 26373 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.100649 26521 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:47.124621 26402 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.124361 26259 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:47.125826 26533 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.128389 26604 consensus_queue.cc:237] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.048728 26530 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:47.224370 26530 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.224784 26530 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:47.110070 26294 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.229517 26294 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.132267 26347 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:47.133672 26620 log.cc:927] Time spent T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.066s	user 0.005s	sys 0.005s
I20260709 13:11:47.033792 26477 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:11:47.137724 26518 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:47.231062 26358 consensus_queue.cc:1059] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:47.231256 19296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1119) took 1648 ms. Trace:
I20260709 13:11:47.234090 19296 rpcz_store.cc:276] 0709 13:11:45.582376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.582525 (+   149us) service_pool.cc:224] Handling call
0709 13:11:45.582812 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:45.797196 (+214384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.797229 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:45.820986 (+ 23757us) log.cc:844] Serialized 26 byte log entry
0709 13:11:45.895681 (+ 74695us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:45.895719 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.895782 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:46.895649 (+999867us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:47.230901 (+335252us) raft_consensus.cc:1685] finished
0709 13:11:47.230929 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.231181 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220214,"raft.queue_time_us":206358,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5639,"spinlock_wait_cycles":114178432,"thread_start_us":60655,"threads_started":1,"wal-append.queue_time_us":61172}
I20260709 13:11:47.139233 26482 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.140832 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:47.236521 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:47.237360 19296 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:11:47.237483 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 96725.4us
I20260709 13:11:47.238021 19296 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:47.141299 26607 consensus_queue.cc:1059] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:47.238956 19296 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.240099 26630 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:47.142241 19221 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:47.143251 19896 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:11:47.144997 26400 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.145592 26511 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.055400 26636 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:47.244040 26386 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:47.244275 26636 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.146101 26486 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.149636 26339 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.249781 26339 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.151218 26162 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:47.250447 26162 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:47.251315 26162 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.252415 26162 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.256421 19291 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:47.158125 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.159098 26268 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.122269 19367 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:47.181208 19217 raft_consensus.cc:1275] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:47.182471 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2622) took 1080 ms. Trace:
I20260709 13:11:47.189145 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.259207 19298 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:47.260048 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:47.190008 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.190367 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:47.174028 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:47.260931 19299 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
W20260709 13:11:47.261554 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 87596us
I20260709 13:11:47.261814 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.262467 19299 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:47.193928 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.116048 19898 pending_rounds.cc:85] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 13
I20260709 13:11:47.263701 19898 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.14
I20260709 13:11:47.198786 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.199373 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:47.203588 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:47.204501 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.203636 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.203651 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.265494 19372 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:47.265800 19222 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:47.205778 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.266644 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:47.179934 26499 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.207890 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:47.214557 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.270581 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.273039 19898 raft_consensus.cc:2917] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Aborting config change with OpId 18.14: Aborted: Op aborted by new leader
I20260709 13:11:47.273383 19365 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:47.273494 19898 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:47.274216 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.195052 26375 consensus_queue.cc:1048] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:11:47.220746 26259 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.190562 26595 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.246047 19223 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
W20260709 13:11:47.247467 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 69194.5us
I20260709 13:11:47.263222 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.270668 19218 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:47.270524 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:47.271812 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 68303.5us
I20260709 13:11:47.269934 19903 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:47.297812 19298 raft_consensus.cc:2410] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 13:11:47.301030 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 101772us
I20260709 13:11:47.277621 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.257926 19292 rpcz_store.cc:276] 0709 13:11:46.102323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.824211 (+721888us) service_pool.cc:224] Handling call
0709 13:11:46.829003 (+  4792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.829256 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:46.966654 (+137398us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.182154 (+215500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.182204 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:47.182246 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.182306 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.182421 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183230,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":882,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2112,"thread_start_us":351223,"threads_started":2}
I20260709 13:11:47.278083 19300 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:47.278911 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.305883 19372 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:47.306389 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:47.306815 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:47.307188 26477 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:47.307680 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:47.283473 19339 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:47.289666 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.307706 26477 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.308733 26477 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.236574 26482 raft_consensus.cc:3055] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:47.293937 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:47.274845 19365 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:47.307137 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.328007 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.249786 26486 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.271433 26583 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.257108 26402 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.217170 26373 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.336205 19298 raft_consensus.cc:1240] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:47.332346 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52846.1us
I20260709 13:11:47.278355 26489 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:47.349802 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 66437.9us
W20260709 13:11:47.381592 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 74542.6us
I20260709 13:11:47.331100 26482 raft_consensus.cc:740] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:47.276933 26493 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:47.381503 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 87626.4us
I20260709 13:11:47.356712 25654 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.280800 26259 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:47.404712 26373 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.325039 26244 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:11:47.397109 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.404399 26636 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.381388 26568 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:47.431677 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.298744 26347 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:47.330875 26511 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:47.447214 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.462904 26433 consensus_queue.cc:1048] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:47.466811 26499 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:47.387005 26321 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:47.333997 26603 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:47.395007 26583 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.468331 26402 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:47.469878 19367 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:47.387759 26645 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:47.472338 19903 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:47.542232 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.473449 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 76401.2us
I20260709 13:11:47.547902 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:47.438918 19263 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:47.395169 26489 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:47.477279 19298 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:47.432260 26358 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:47.346318 26333 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.469182 26259 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:47.539463 26374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.008s
I20260709 13:11:47.508895 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.509966 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41704 (request call id 2621) took 1568 ms. Trace:
I20260709 13:11:47.503742 26321 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.474536 26348 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:47.522980 19372 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:47.482136 25654 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:47.550323 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.590922 19224 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:47.588871 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:47.550913 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 112103us
W20260709 13:11:47.551657 19188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.006s
I20260709 13:11:47.592947 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:47.540452 19297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.010s	sys 0.005s
I20260709 13:11:47.482448 26511 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.327289 26595 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.388926 26651 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.521694 26603 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.389086 26634 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:11:47.577318 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.634289 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.577390 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.635639 19300 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:47.636912 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.638437 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.639163 19300 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:47.575929 19291 rpcz_store.cc:276] 0709 13:11:45.941239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.755923 (+814684us) service_pool.cc:224] Handling call
0709 13:11:46.782654 (+ 26731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.256841 (+474187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.490573 (+233732us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540004d8d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:47.509880 (+ 19307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088966400}
W20260709 13:11:47.544029 26648 log.cc:927] Time spent T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:47.584599 26400 raft_consensus.cc:2804] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:47.535840 26612 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:47.593061 19188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.011s	sys 0.006s
I20260709 13:11:47.551671 19221 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
W20260709 13:11:47.593560 19297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.010s	sys 0.005s
I20260709 13:11:47.647737 19221 pending_rounds.cc:85] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 13
I20260709 13:11:47.648028 19221 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 18.14
I20260709 13:11:47.648304 19221 raft_consensus.cc:2917] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Aborting config change with OpId 18.14: Aborted: Op aborted by new leader
I20260709 13:11:47.648351 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1125) took 1761 ms. Trace:
I20260709 13:11:47.594084 19365 raft_consensus.cc:1240] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:11:47.650924 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.597266 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:47.574944 26374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.008s	sys 0.009s
I20260709 13:11:47.572943 26636 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.656190 19188 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:47.656564 19292 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:47.573699 26333 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.602581 26597 consensus_queue.cc:1048] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:47.603739 26661 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:11:47.615068 26662 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:47.542181 26645 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:47.570638 26489 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:47.504078 26268 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.616268 26499 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:47.559311 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.585561 26321 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:47.594033 26581 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.650835 19291 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:47.590487 25654 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:47.682065 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 122854us
I20260709 13:11:47.683279 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:47.648751 19297 rpcz_store.cc:276] 0709 13:11:45.886659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.745019 (+858360us) service_pool.cc:224] Handling call
0709 13:11:46.745301 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.745485 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:46.868809 (+123324us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.647989 (+779180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:47.648039 (+    50us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:47.648087 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.648150 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.648300 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":240057,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":901373,"threads_started":2}
I20260709 13:11:47.672140 26645 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:47.654434 26339 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:47.654671 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57472.2us
I20260709 13:11:47.535358 26530 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.600617 26511 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:47.658829 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.660112 19294 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:47.661098 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:47.619917 26629 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:47.575251 26358 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.684777 25654 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.535143 26482 consensus_queue.cc:260] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:47.669242 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 464747us
I20260709 13:11:47.671598 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.659047 26636 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.595783 26348 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.662030 26333 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.662640 26400 raft_consensus.cc:697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:47.746095 26400 consensus_queue.cc:237] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.756191 26630 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:47.763756 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:47.764585 19367 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:47.764678 26321 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.765872 19291 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:47.767778 19291 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:47.769513 26489 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.771831 26645 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.776793 26321 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.777395 26493 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.778005 26493 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.778622 26489 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:47.782922 26518 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:47.783471 26518 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:47.785529 26645 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:47.786170 26667 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:11:47.704341 26347 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.788606 26347 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.789479 26526 raft_consensus.cc:3055] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:47.789877 26526 raft_consensus.cc:740] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:47.688921 26670 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:47.790652 26526 consensus_queue.cc:260] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.701529 26629 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.791581 26526 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.791908 26629 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:47.653496 19221 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:47.686450 19299 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:47.686269 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:47.676298 26499 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.677954 26417 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:11:47.704660 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43660.2us
I20260709 13:11:47.641842 26603 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:47.687227 26527 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.687466 26373 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.709296 19372 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:47.711501 26612 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.730793 26595 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.728157 26636 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.737459 26530 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.738196 26259 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.738715 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:47.740626 26583 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:47.741423 26668 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:11:47.848829 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 110198us
W20260709 13:11:47.849490 26672 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:11:47.849788 26259 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.684577 26581 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.850519 19298 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:47.851883 26581 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.796198 19368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3186) took 1166 ms. Trace:
I20260709 13:11:47.852506 19368 rpcz_store.cc:276] 0709 13:11:46.629384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.629588 (+   204us) service_pool.cc:224] Handling call
0709 13:11:46.643023 (+ 13435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:46.643485 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:46.643523 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.991699 (+348176us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b2c001323f8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:46.996979 (+  5280us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.470702 (+473723us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:47.485217 (+ 14515us) log.cc:844] Serialized 14 byte log entry
0709 13:11:47.485540 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.485644 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.795893 (+310249us) raft_consensus.cc:1685] finished
0709 13:11:47.795984 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.796116 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3793,"prepare.queue_time_us":51318,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":3798,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":40424,"spinlock_wait_cycles":2322176,"thread_start_us":461371,"threads_started":1,"wal-append.queue_time_us":635697}
I20260709 13:11:47.799448 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:47.828483 26499 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.833274 26373 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.664412 26433 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.860546 26373 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.860812 26433 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.862920 26433 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:47.862617 26321 consensus_queue.cc:1175] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d50eb2dab6754df8bcbed1445f2e8430" responder_term: 16 status { last_received { term: 15 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:47.831415 26417 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.866393 26417 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:47.828388 26402 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:11:47.828089 26488 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:47.868693 26488 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.869423 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1342) took 1091 ms. Trace:
I20260709 13:11:47.869197 26488 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:47.869800 19373 rpcz_store.cc:276] 0709 13:11:46.778543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.813121 (+ 34578us) service_pool.cc:224] Handling call
0709 13:11:47.134909 (+321788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.135321 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.135347 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.135918 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.570794 (+434876us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:47.570844 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.570921 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.745120 (+174199us) raft_consensus.cc:1685] finished
0709 13:11:47.745146 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.869163 (+124017us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400137ed0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:47.869365 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":739144064,"thread_start_us":434409,"threads_started":1,"wal-append.queue_time_us":532519}
I20260709 13:11:47.871308 26488 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.842700 26244 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.873021 26244 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.875093 26244 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:47.845721 26670 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:47.843022 26527 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.876948 26670 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.878626 26527 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.743227 26358 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.818811 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:47.892704 19900 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:47.817050 19293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1123) took 1958 ms. Trace:
W20260709 13:11:47.825258 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 139212us
I20260709 13:11:47.584892 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:47.826740 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:47.708508 26598 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.706709 26477 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.830981 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.912768 19372 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:47.914753 19369 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:47.840044 19367 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:47.742048 26348 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:47.849674 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:47.800006 26521 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:47.882009 19365 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
W20260709 13:11:47.810497 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 570897us
W20260709 13:11:47.895408 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 68745.6us
I20260709 13:11:47.936532 19188 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:47.938452 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.938441 19217 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:11:47.939935 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.901433 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.940783 19218 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:47.941021 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.941617 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:47.942198 19218 raft_consensus.cc:2376] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24. Re-sending same reply.
I20260709 13:11:47.943091 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.943832 19218 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:47.902793 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.905359 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.944667 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.944733 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:47.878932 26670 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.894222 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.946853 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.907586 19371 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:47.918442 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:47.949282 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:47.949649 19372 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 25.
I20260709 13:11:47.848891 26680 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:47.919938 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:47.921535 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:47.956125 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:47.956420 19898 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 26.
I20260709 13:11:47.893546 19293 rpcz_store.cc:276] 0709 13:11:45.858521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.860478 (+  1957us) service_pool.cc:224] Handling call
0709 13:11:45.860750 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:45.875533 (+ 14783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.875564 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:46.823661 (+948097us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2c0000e678. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:46.824091 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:11:47.058542 (+234451us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:47.058576 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.058645 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:47.728616 (+669971us) raft_consensus.cc:1685] finished
0709 13:11:47.728642 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:47.816968 (+ 88326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7287,"raft.queue_time_us":4457,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9728,"spinlock_wait_cycles":3255552,"thread_start_us":185664,"threads_started":1,"wal-append.queue_time_us":501908}
I20260709 13:11:47.927866 26268 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:47.894790 26386 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.845676 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:47.966388 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 116785us
I20260709 13:11:47.933954 19900 raft_consensus.cc:2468] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:47.944870 19222 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:47.968752 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.945566 19225 raft_consensus.cc:2410] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:47.942050 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.973624 19222 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:47.973989 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.974669 19216 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:47.974720 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.976613 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:47.977111 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:47.977573 19900 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:47.977859 19225 raft_consensus.cc:3060] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:47.839735 26533 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:47.953217 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:47.912806 26527 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:47.959100 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:47.961102 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66960us
I20260709 13:11:47.988829 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:47.962591 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:47.990327 19898 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:47.963254 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:47.994336 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:47.945377 26521 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:47.997285 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.997665 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:47.998811 19900 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:47.963346 26348 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:47.917245 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:47.951961 19339 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:47.953733 26358 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:47.917003 26598 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.000984 19903 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:48.051437 19294 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:11:47.907341 26518 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:47.961841 26347 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.044373 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.062256 19299 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:48.064014 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.065893 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.054869 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.006727 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.015777 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.004763 19293 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:48.057914 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:47.973456 26488 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.974682 26651 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.006353 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.003180 26530 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:48.068539 19368 raft_consensus.cc:2368] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:48.072688 19225 raft_consensus.cc:2468] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:48.084858 19292 raft_consensus.cc:2393] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 26: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:48.076655 26488 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.076026 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.092549 19300 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:47.988598 26585 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:47.983565 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:48.094039 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 110580us
I20260709 13:11:48.094129 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.094822 19896 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:48.077152 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.000824 26268 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:48.076615 26674 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:47.980721 26417 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:11:48.088505 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:48.070644 26433 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.106221 19900 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:48.092512 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.102352 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.108685 19294 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:48.081501 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.110034 19903 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 26.
I20260709 13:11:47.970115 26489 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:11:48.072829 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:47.981621 26386 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.077138 26347 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.132644 19263 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:48.105046 26268 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.141593 19900 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:48.117100 26259 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:48.100260 26488 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:48.098126 26530 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.100730 26678 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:48.171337 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.117853 26670 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:48.181214 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.144961 26268 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:48.172911 26251 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:48.176915 26678 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:48.200286 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 211500us
I20260709 13:11:48.176229 26259 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:48.206740 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.138167 26433 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.176609 26530 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:48.182934 26670 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.140599 26333 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.195405 26533 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:48.141481 26347 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.253129 19369 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:48.235451 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.254101 19299 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:48.253214 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.255461 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:48.258484 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 88563.4us
I20260709 13:11:48.207952 26339 raft_consensus.cc:2804] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:11:48.250149 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 298300us
I20260709 13:11:48.260646 19300 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:48.262118 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:48.238933 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:48.208021 26678 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:48.265355 19299 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:48.265646 19294 raft_consensus.cc:1240] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:11:48.216421 26477 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.227183 26670 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:48.249526 26527 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.273638 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:48.272295 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.271973 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:48.277647 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.278353 19368 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:48.200836 26595 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:11:48.280598 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.282696 19368 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
W20260709 13:11:48.286113 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.289768 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.292534 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.295089 19903 raft_consensus.cc:1240] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:48.294052 19299 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:48.258711 26533 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.300729 19188 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:48.277747 26402 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:48.275884 26693 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:48.305516 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.305275 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:48.303336 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 170761us
I20260709 13:11:48.313828 19263 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:48.313448 26402 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.282001 26527 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.302009 26607 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:48.308565 26693 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:48.321715 26681 log.cc:927] Time spent T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:11:48.304543 26689 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:48.331306 26526 consensus_meta.cc:287] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
W20260709 13:11:48.329102 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 254720us
I20260709 13:11:48.315135 26680 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:48.328078 26694 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.324404 26598 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.352399 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:48.353279 26612 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:48.342849 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 70970.7us
W20260709 13:11:48.349480 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 48848.2us
I20260709 13:11:48.348847 19218 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:11:48.354753 19188 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:48.297916 26259 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.346032 26680 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.346074 26692 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:48.339944 26693 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:48.371124 26685 log.cc:927] Time spent T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:11:48.372901 26695 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:48.373698 26684 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
I20260709 13:11:48.373939 26695 consensus_queue.cc:1059] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:48.374867 26695 consensus_queue.cc:1059] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:48.375591 26695 consensus_queue.cc:1243] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 22.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:11:48.373566 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.355471 26526 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:48.385938 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.355068 26386 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.391189 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:48.376812 26701 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:11:48.369989 26680 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:48.386965 26499 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.005s
I20260709 13:11:48.347651 26689 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.376051 26695 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:48.413304 26527 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:48.402773 26636 consensus_meta.cc:287] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260709 13:11:48.416415 26710 raft_consensus.cc:3055] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:11:48.417004 26373 consensus_meta.cc:287] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:11:48.388891 26692 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:48.418308 26629 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.003s
I20260709 13:11:48.419454 19370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3208) took 1117 ms. Trace:
I20260709 13:11:48.453523 19370 rpcz_store.cc:276] 0709 13:11:47.302577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.308741 (+  6164us) service_pool.cc:224] Handling call
0709 13:11:47.309094 (+   353us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:47.394030 (+ 84936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.394062 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:47.401861 (+  7799us) log.cc:844] Serialized 78 byte log entry
0709 13:11:47.681093 (+279232us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:47.681135 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.681196 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.419180 (+737984us) raft_consensus.cc:1685] finished
0709 13:11:48.419206 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.419373 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103906,"raft.queue_time_us":85192,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":278711,"threads_started":1,"wal-append.queue_time_us":543148}
I20260709 13:11:48.420506 26533 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.420269 26499 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:48.421187 26690 log.cc:927] Time spent T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:11:48.369339 26707 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:48.409025 25654 consensus_meta.cc:287] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:11:48.437556 26695 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.354724 26694 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.396049 26347 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:48.423144 26691 log.cc:927] Time spent T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:11:48.443826 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 296830us
W20260709 13:11:48.408592 26511 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.002s
I20260709 13:11:48.466908 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.455443 26527 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:48.503710 26527 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.504249 26527 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:48.504657 19117 catalog_manager.cc:5697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 16, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 16 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.507856 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:48.508335 26699 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:11:48.507313 19117 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 13 to 19, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 19 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:48.512936 26708 log.cc:927] Time spent T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:48.514793 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.515559 26694 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.516331 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.518141 26530 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.518738 26402 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.452548 26373 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.522179 26373 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.523360 26521 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.526525 26268 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.471496 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2769) took 1035 ms. Trace:
I20260709 13:11:48.564977 19298 rpcz_store.cc:276] 0709 13:11:47.435991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.633936 (+197945us) service_pool.cc:224] Handling call
0709 13:11:48.471341 (+837405us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001bf654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:48.471443 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495269120}
I20260709 13:11:48.474400 26511 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.475487 19366 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:48.475610 26499 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.475487 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.473222 26437 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.478241 26680 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:48.479537 26702 log.cc:927] Time spent T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:11:48.576527 26437 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:48.480108 26688 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 13:11:48.577901 26268 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.578814 26437 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.579762 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2628) took 1400 ms. Trace:
I20260709 13:11:48.581322 26511 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:48.488878 26700 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:11:48.464031 26707 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.464180 26533 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:48.473484 26634 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:48.491001 26493 consensus_meta.cc:287] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.005s
I20260709 13:11:48.460649 26629 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:48.494163 26603 consensus_meta.cc:287] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.665s	user 0.005s	sys 0.005s
I20260709 13:11:48.465937 25654 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.528379 26402 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:48.530221 19223 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 19: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:48.530382 19216 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:48.533838 26488 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.536311 26689 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.442428 26710 raft_consensus.cc:740] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:48.471971 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:48.538759 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.545114 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 144719us
I20260709 13:11:48.547339 26694 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.444645 26636 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:48.633679 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 161776us
I20260709 13:11:48.634332 19225 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:48.634476 19265 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:48.470150 26695 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:48.546507 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:48.568107 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 213792us
W20260709 13:11:48.644476 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 98057.5us
I20260709 13:11:48.559150 26670 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.573767 26521 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.582415 19217 raft_consensus.cc:2368] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:48.583470 19224 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:48.649263 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.580250 19374 rpcz_store.cc:276] 0709 13:11:47.178943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.294017 (+115074us) service_pool.cc:224] Handling call
0709 13:11:47.298233 (+  4216us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:47.693399 (+395166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.693426 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:47.701296 (+  7870us) log.cc:844] Serialized 52 byte log entry
0709 13:11:47.936358 (+235062us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:48.001443 (+ 65085us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.043942 (+ 42499us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.049960 (+  6018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.050040 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.579487 (+529447us) raft_consensus.cc:1685] finished
0709 13:11:48.579512 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.579695 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80098,"prepare.queue_time_us":65929,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":114,"raft.queue_time_us":122550,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":22091,"spinlock_wait_cycles":44460544,"thread_start_us":582331,"threads_started":2,"wal-append.queue_time_us":488462}
I20260709 13:11:48.487900 26678 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.564296 26358 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:48.586974 26707 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:48.590740 26634 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.662801 26634 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.594269 26603 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.596062 26680 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.596623 25654 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.597155 26402 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.665095 26603 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.665728 26607 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:48.665895 26402 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.666085 19295 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:48.598635 19373 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:11:48.666294 26607 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.640894 26268 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:48.667300 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.650425 26436 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:48.668036 19369 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:48.599728 26251 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:48.650115 26574 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:11:48.669817 26251 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.604481 26339 raft_consensus.cc:697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:48.605422 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 291774us
I20260709 13:11:48.605737 26477 raft_consensus.cc:3055] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:48.606068 26604 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:48.605310 26527 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.609884 26518 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:48.610138 26715 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.611824 19266 leader_election.cc:400] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:48.677150 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:48.677820 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66402.3us
I20260709 13:11:48.612653 26629 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.616230 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.586807 26533 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.606086 26530 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 27 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.637303 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:48.637493 19222 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:48.644738 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:48.626056 26437 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.688231 19900 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:48.637512 26207 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:48.592046 26493 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.655195 19224 raft_consensus.cc:2393] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:48.656812 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:48.695884 19371 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:48.657130 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:48.657717 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.697077 19365 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:48.658646 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.665207 26678 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.597712 19291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1135) took 1002 ms. Trace:
W20260709 13:11:48.598819 26348 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.005s
I20260709 13:11:48.679244 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.674561 26689 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:48.729175 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.680207 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.679598 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.730960 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.731220 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.686504 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:48.687214 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:48.731622 19216 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:48.731964 19898 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:48.732229 19294 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:48.687363 26533 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:48.688668 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:48.636076 26694 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:48.692602 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 47961.6us
W20260709 13:11:48.740479 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.740887 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.741490 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.642791 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:48.692456 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:48.697775 26526 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:48.686694 26720 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.694748 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.673481 26477 raft_consensus.cc:740] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:48.746780 19371 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:48.700350 26607 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.709107 26603 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.749399 26694 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.749765 26717 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.749929 26694 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:48.748941 26603 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.750321 26717 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.679821 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.689332 26710 consensus_queue.cc:260] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.743505 26636 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.752828 26710 raft_consensus.cc:3060] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:48.739846 26723 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:11:48.753078 26714 consensus_queue.cc:1175] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d50eb2dab6754df8bcbed1445f2e8430" responder_term: 24 status { last_received { term: 18 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:11:48.715384 26677 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.865s	user 0.002s	sys 0.003s
I20260709 13:11:48.716640 26433 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.708446 26676 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:48.721913 26488 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.721629 26358 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.695188 26604 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:48.722751 26339 consensus_queue.cc:237] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.723428 26482 raft_consensus.cc:3060] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:48.723620 26348 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:48.690191 26715 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.724659 26333 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.725701 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49022 (request call id 1354) took 1031 ms. Trace:
W20260709 13:11:48.790226 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.790086 19373 rpcz_store.cc:276] 0709 13:11:47.694270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.871352 (+177082us) service_pool.cc:224] Handling call
0709 13:11:47.949531 (+ 78179us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5800242d98. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:47.949713 (+   182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.666899 (+717186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.725457 (+ 58558us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54002d0354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:48.725642 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530651776}
I20260709 13:11:48.734586 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:48.791517 19300 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:48.721693 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.792088 26574 consensus_queue.cc:1059] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:48.792482 19219 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:48.793195 26574 raft_consensus.cc:3055] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:48.793465 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.794116 19219 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:48.729863 19365 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:48.693507 26436 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:48.737084 19367 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:48.739378 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.742893 19896 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:48.705479 19291 rpcz_store.cc:276] 0709 13:11:47.595348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.768808 (+173460us) service_pool.cc:224] Handling call
0709 13:11:47.810827 (+ 42019us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:47.819036 (+  8209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.819063 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:47.833253 (+ 14190us) log.cc:844] Serialized 52 byte log entry
0709 13:11:48.172943 (+339690us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:48.203539 (+ 30596us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.203950 (+   411us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.597033 (+393083us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b18003ba0a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4d42c0a 00007fe8de482219 00007fe8d4dcaa40 00007fe8d4dc54e4 00007fe8d4dc5455 00007fe8d7ead060 00007fe8d7ebf716 00007fe8d7ed0287 00007fe8d7ed0208
0709 13:11:48.597254 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.597341 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.597484 (+   143us) raft_consensus.cc:1685] finished
0709 13:11:48.597501 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.597650 (+   149us) inbound_call.cc:177] Queueing success response
0709 13:11:48.610728 (+ 13078us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b18003ba0a0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:48.661622 (+ 50894us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800150258. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
Metrics: {"mutex_wait_us":17661,"prepare.queue_time_us":96000,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":3677,"raft.queue_time_us":408463,"raft.run_cpu_time_us":5056,"raft.run_wall_time_us":837266,"spinlock_wait_cycles":28452352,"thread_start_us":245287,"threads_started":1,"wal-append.queue_time_us":354723}
I20260709 13:11:48.709959 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.798382 19224 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:48.798652 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.799504 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.750394 26694 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.707960 26698 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:11:48.745908 26526 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.801600 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:48.796983 19222 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 12.
I20260709 13:11:48.757115 26477 consensus_queue.cc:260] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:48.713640 26527 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.759909 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:48.761555 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 124502us
I20260709 13:11:48.809867 19265 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:48.812384 26436 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.814354 26477 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:48.824362 26717 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.824503 26604 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.800947 26433 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.828648 19298 raft_consensus.cc:2410] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:11:48.762421 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 119719us
I20260709 13:11:48.836269 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:48.836695 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.730237 26692 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:48.854795 19219 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:48.900671 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:48.932878 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 96728.1us
I20260709 13:11:48.933887 19337 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:48.935598 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.939869 19219 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:48.945060 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.949069 19219 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:11:48.698716 26437 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.785758 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.787882 26207 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:48.789247 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:48.793546 26574 raft_consensus.cc:740] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:48.765369 26521 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:48.797405 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:48.806332 26526 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:48.989984 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 192650us
I20260709 13:11:48.743745 26645 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:48.780861 26583 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:48.736968 26689 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.003804 26689 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.802188 19291 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:48.807571 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:48.829366 26715 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.846165 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:48.762147 19898 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 27.
W20260709 13:11:49.008729 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 162690us
I20260709 13:11:49.009112 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.010353 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.011411 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:48.782033 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.013098 26259 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:48.952775 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.934856 26433 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.017279 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:48.932919 19900 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:49.017830 26437 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:48.933223 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:49.018814 26433 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:48.768666 26676 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.765120 26720 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:48.960697 19337 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:49.019429 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 86287.4us
I20260709 13:11:49.023584 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.987315 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
W20260709 13:11:49.024009 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 63437.1us
I20260709 13:11:49.024605 19293 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:48.779479 19216 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
W20260709 13:11:49.027885 19265 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.552s (SENT) [suppressed 4 similar messages]
I20260709 13:11:48.988104 19224 raft_consensus.cc:2468] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:48.823132 26707 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.033761 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:48.993108 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1138) took 1175 ms. Trace:
I20260709 13:11:48.824146 26530 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:48.830459 26333 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:11:49.000671 26725 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:11:49.000694 26686 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.731s	user 0.013s	sys 0.023s
I20260709 13:11:48.964406 19300 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:48.998610 26489 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:49.022447 26499 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:49.029230 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:48.998229 26583 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.066059 19292 raft_consensus.cc:1240] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:49.034335 19297 rpcz_store.cc:276] 0709 13:11:47.817948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.818387 (+   439us) service_pool.cc:224] Handling call
0709 13:11:47.818712 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.085763 (+267051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.085801 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.086234 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.200942 (+114708us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:48.200992 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.984308 (+783316us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540034f154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:48.984353 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.984400 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:48.984417 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.993032 (+  8615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21913,"raft.queue_time_us":4709,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10631,"spinlock_wait_cycles":604733824,"thread_start_us":113957,"threads_started":1,"wal-append.queue_time_us":197817}
W20260709 13:11:48.996605 26693 consensus_meta.cc:287] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 13:11:49.033545 19339 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:48.986011 26348 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:48.966149 26244 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:48.969286 26698 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:49.039775 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:49.040835 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3490) took 1092 ms. Trace:
I20260709 13:11:49.077965 19225 rpcz_store.cc:276] 0709 13:11:47.948083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.125050 (+176967us) service_pool.cc:224] Handling call
0709 13:11:48.130997 (+  5947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.634885 (+503888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.040589 (+405704us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54003c8cd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:49.040776 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157117312}
I20260709 13:11:49.036892 26402 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:49.042714 26433 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:49.042909 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 370040us
I20260709 13:11:49.081140 26493 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.045414 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:49.045819 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.019831 26645 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.047950 26707 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.036520 26670 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.048643 19219 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:49.052202 19293 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:49.052811 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:49.081169 26433 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:49.059749 26533 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.058866 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1131) took 1881 ms. Trace:
I20260709 13:11:49.062942 19224 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:49.099583 19220 raft_consensus.cc:2410] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:11:49.031625 19291 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:11:49.067977 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:49.099284 19295 rpcz_store.cc:276] 0709 13:11:47.177434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.292575 (+115141us) service_pool.cc:224] Handling call
0709 13:11:47.381084 (+ 88509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.666531 (+1285447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.055949 (+389418us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001d3654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:49.058805 (+  2856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2954600192}
I20260709 13:11:49.063472 26489 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.054129 26333 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.080410 19297 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:49.058593 26417 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:49.081939 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 48534.7us
I20260709 13:11:49.077277 19222 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:49.044104 26676 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.036401 26629 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:49.127779 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.087117 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:49.069823 26583 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:49.129505 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:49.129729 26417 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.130146 19902 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:49.091785 19368 raft_consensus.cc:3060] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:49.132318 26333 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:49.132661 19369 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:49.135372 26720 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.090479 26612 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:49.084872 26698 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.137270 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:49.137920 26698 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.139156 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3223) took 1140 ms. Trace:
I20260709 13:11:49.126820 19339 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:49.139539 19367 rpcz_store.cc:276] 0709 13:11:48.004718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.507577 (+502859us) service_pool.cc:224] Handling call
0709 13:11:49.138966 (+631389us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400424fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:49.139095 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525385472}
I20260709 13:11:49.088721 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:49.142134 19225 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:49.092096 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:49.142863 19293 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:49.056150 19294 raft_consensus.cc:3060] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:49.096475 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:49.058425 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:49.144246 19300 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:49.096719 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3484) took 1150 ms. Trace:
I20260709 13:11:49.144832 19218 rpcz_store.cc:276] 0709 13:11:47.946631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.949063 (+  2432us) service_pool.cc:224] Handling call
0709 13:11:49.089781 (+1140718us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540039b7d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:49.096645 (+  6864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915156736}
I20260709 13:11:49.103339 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:49.100744 26433 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:49.109575 19372 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:49.081851 26499 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:49.111632 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:49.114720 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:49.115427 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:49.116667 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:49.164315 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47761.6us
I20260709 13:11:49.121181 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:49.121644 26533 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.076078 26244 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:49.145967 19216 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 12.
I20260709 13:11:49.138041 19223 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:49.086247 26348 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:49.141623 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:49.150875 19298 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:49.173336 19217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3479) took 1234 ms (client timeout 1552 ms). Trace:
I20260709 13:11:49.155733 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:49.175771 19222 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:49.075600 26693 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:49.173806 19217 rpcz_store.cc:269] 0709 13:11:47.939147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.939628 (+   481us) service_pool.cc:224] Handling call
0709 13:11:49.173075 (+1233447us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400019ad4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:49.173241 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475549440}
I20260709 13:11:49.177634 19223 raft_consensus.cc:1240] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:49.161476 19294 raft_consensus.cc:2468] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:49.163221 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3494) took 1208 ms. Trace:
I20260709 13:11:49.178270 19218 rpcz_store.cc:276] 0709 13:11:47.955051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.162422 (+1207371us) service_pool.cc:224] Handling call
0709 13:11:49.162726 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.162902 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.162923 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.162961 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:49.162989 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.163043 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.163160 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.141604 26489 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:49.065424 26574 consensus_queue.cc:260] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.166352 19266 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:49.148047 19368 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
W20260709 13:11:49.185437 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 43877.8us
I20260709 13:11:49.087853 26402 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.195513 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:49.168953 25654 raft_consensus.cc:2804] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:49.132122 26417 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.140668 26692 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.172257 26244 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:49.163880 26612 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:49.139473 26695 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:49.205404 19221 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:49.209082 19266 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:49.206060 26499 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.209826 26595 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:49.210361 26715 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:49.186781 26653 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:49.196028 26629 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:49.194965 26259 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:49.197274 26720 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:49.211534 26687 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:11:49.188933 26585 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:49.214118 26533 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.216218 26694 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.217315 25654 raft_consensus.cc:697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:49.223162 26629 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.241664 26526 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:49.235018 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 207144us
I20260709 13:11:49.220974 26604 raft_consensus.cc:2804] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:49.214587 26692 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.256458 26533 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.270849 26533 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.264370 26437 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:11:49.216212 26583 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.276238 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:49.286373 26728 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:49.231786 26720 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.261610 26629 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:49.290122 26604 raft_consensus.cc:697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:49.316623 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:49.292059 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 208789us
W20260709 13:11:49.303370 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 126616us
I20260709 13:11:49.304378 19374 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24.
W20260709 13:11:49.311589 26518 consensus_meta.cc:287] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.002s
I20260709 13:11:49.238397 26348 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:49.332459 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 127634us
I20260709 13:11:49.334443 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:49.330295 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:49.335971 26518 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:49.319968 26707 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:49.284566 26612 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.345882 19340 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:49.348980 26526 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.349368 26676 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:49.350965 26583 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.356678 26695 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.323539 26645 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.331570 26530 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:49.344292 26597 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:49.324496 26402 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.369863 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:49.380468 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:49.330593 26693 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.373953 26518 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:49.383749 26679 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:49.323128 26521 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:49.326735 25654 consensus_queue.cc:237] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:49.375190 26710 consensus_meta.cc:287] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.006s
I20260709 13:11:49.376420 26597 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:49.374989 26676 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:49.388935 26634 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:49.382061 26583 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:49.367010 26707 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:49.401569 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.391433 26521 consensus_queue.cc:1243] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:49.392969 26597 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:49.389535 26679 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:49.395646 26676 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:49.382504 26530 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.384371 26489 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.401203 26634 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:49.445577 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 107530us
I20260709 13:11:49.385601 26604 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.455039 19896 raft_consensus.cc:2368] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24.
I20260709 13:11:49.463898 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:49.464763 19901 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:49.464933 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.447436 26499 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:49.512082 26735 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:11:49.513218 26707 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.514281 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1029) took 1278 ms. Trace:
I20260709 13:11:49.514737 19225 rpcz_store.cc:276] 0709 13:11:48.235615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.177187 (+941572us) service_pool.cc:224] Handling call
0709 13:11:49.179658 (+  2471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.180084 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.180123 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.181488 (+  1365us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.301011 (+119523us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:49.301055 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.301119 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.514061 (+212942us) raft_consensus.cc:1685] finished
0709 13:11:49.514084 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.514219 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5372,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7889,"thread_start_us":119200,"threads_started":1,"wal-append.queue_time_us":180613}
I20260709 13:11:49.521633 26530 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.523121 26518 raft_consensus.cc:1064] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:11:49.501873 26333 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.423266 26679 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:49.507370 26732 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:49.519658 26244 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.528133 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3503) took 1227 ms. Trace:
I20260709 13:11:49.563192 19217 rpcz_store.cc:276] 0709 13:11:48.300370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.527185 (+1226815us) service_pool.cc:224] Handling call
0709 13:11:49.527534 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.527737 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.527782 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.527833 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:49.527874 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.527937 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.528066 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.543891 19365 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:49.536427 26333 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.536705 26518 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.583949 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2880) took 1061 ms. Trace:
I20260709 13:11:49.584540 19225 rpcz_store.cc:276] 0709 13:11:48.522894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.582816 (+1059922us) service_pool.cc:224] Handling call
0709 13:11:49.583280 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.583510 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.583549 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.583607 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:49.583652 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.583725 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.583875 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.586751 19225 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:49.587370 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2882) took 1064 ms. Trace:
I20260709 13:11:49.587669 19225 rpcz_store.cc:276] 0709 13:11:48.523408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.586158 (+1062750us) service_pool.cc:224] Handling call
0709 13:11:49.586539 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.587155 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.587321 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.588104 26489 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.523074 26720 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.528213 26499 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.594724 19901 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:49.595134 26629 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.597349 26679 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.597443 19365 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 27.
I20260709 13:11:49.622483 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:49.725622 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2883) took 1164 ms. Trace:
I20260709 13:11:49.726207 19225 rpcz_store.cc:276] 0709 13:11:48.560981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.724199 (+1163218us) service_pool.cc:224] Handling call
0709 13:11:49.724861 (+   662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.725197 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.725234 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.725290 (+    56us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:49.725337 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.725408 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.725549 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.724720 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:49.732995 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2884) took 1148 ms. Trace:
W20260709 13:11:49.692615 26433 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 13:11:49.737579 19225 rpcz_store.cc:276] 0709 13:11:48.584963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.731875 (+1146912us) service_pool.cc:224] Handling call
0709 13:11:49.732314 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.732544 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.732581 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.732647 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:49.732692 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.732770 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.732919 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.743047 19225 raft_consensus.cc:1240] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:11:49.746868 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1035) took 1113 ms. Trace:
I20260709 13:11:49.749234 19225 rpcz_store.cc:276] 0709 13:11:48.633555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.742354 (+1108799us) service_pool.cc:224] Handling call
0709 13:11:49.742757 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.746509 (+  3752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.746800 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.745297 26433 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.755537 19366 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:49.509428 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:49.769730 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1038) took 1129 ms. Trace:
I20260709 13:11:49.778383 19225 rpcz_store.cc:276] 0709 13:11:48.640629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.751862 (+1111233us) service_pool.cc:224] Handling call
0709 13:11:49.769218 (+ 17356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.769385 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.769409 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.769451 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:49.769481 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.769533 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.769671 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:49.757575 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2879) took 1234 ms. Trace:
I20260709 13:11:49.801640 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:49.802366 19898 raft_consensus.cc:2368] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 26. Current term is 27.
I20260709 13:11:49.801869 19217 rpcz_store.cc:276] 0709 13:11:48.522644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.621141 (+1098497us) service_pool.cc:224] Handling call
0709 13:11:49.621542 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.621808 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:49.622186 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.757134 (+134948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.757203 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:49.757263 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.757348 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.757501 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":134,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":64,"raft.queue_time_us":158,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"thread_start_us":134400,"threads_started":1}
I20260709 13:11:49.803557 19337 leader_election.cc:400] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 26. Current term is 27.
I20260709 13:11:49.803925 19337 leader_election.cc:403] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:11:49.804991 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47354 (request call id 2888) took 1108 ms. Trace:
I20260709 13:11:49.757551 26679 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:49.805558 19219 rpcz_store.cc:276] 0709 13:11:48.696359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.016983 (+320624us) service_pool.cc:224] Handling call
0709 13:11:49.804751 (+787768us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54003d1b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:49.804919 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69960576}
I20260709 13:11:49.806871 26244 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.756466 26433 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.819459 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:49.830339 19898 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:49.833570 26603 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.835897 26207 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:49.836385 26207 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:49.837291 26207 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.839378 26597 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.840262 26651 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:49.840812 26651 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.841322 26499 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:49.843003 26651 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.844378 26244 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 26. Current term is 27.
I20260709 13:11:49.845170 26715 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:49.845780 26715 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.843729 26597 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:49.848930 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.850741 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.852293 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.857703 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:49.863544 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:49.864363 19216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.018s
I20260709 13:11:49.817263 26629 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:49.866438 19216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.015s	sys 0.019s
I20260709 13:11:49.866230 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:49.869877 19295 raft_consensus.cc:2368] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 26. Current term is 27.
I20260709 13:11:49.870479 19216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3497) took 1582 ms. Trace:
I20260709 13:11:49.870623 19898 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:49.871532 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:49.861740 26679 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:49.875466 19337 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:49.862860 26715 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:49.891708 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:49.892556 19295 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:11:49.903036 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.911414 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:49.912645 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:49.913408 19372 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:49.914165 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:49.920490 19896 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 1073) took 1113 ms. Trace:
W20260709 13:11:49.921062 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.931303 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:49.932080 19901 raft_consensus.cc:2368] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24.
I20260709 13:11:49.925033 19296 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:49.926522 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 1.2701e+06us
I20260709 13:11:49.934064 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:49.934813 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.935912 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.939980 19224 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:49.941444 19868 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Timed out: RequestConsensusVote RPC to 127.17.171.193:44875 timed out after 1.579s (SENT)
I20260709 13:11:49.942101 19868 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:49.942409 19224 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:49.942946 19224 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:49.930217 19265 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:49.929467 19896 rpcz_store.cc:276] 0709 13:11:48.807201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.807326 (+   125us) service_pool.cc:224] Handling call
0709 13:11:49.920155 (+1112829us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400780fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:49.920398 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027322112}
I20260709 13:11:49.927839 19369 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:49.944240 19224 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.947144 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:49.953780 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:49.956015 19901 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:49.957903 19901 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:49.957934 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:49.950181 19224 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:49.963444 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:49.968923 19896 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:49.965726 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:49.945300 26244 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:49.975045 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:49.972900 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:49.951225 26720 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:49.945459 25654 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:49.988663 25654 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:49.966580 26710 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:49.974959 26651 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:49.992129 26651 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.992596 26651 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:49.966605 26707 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:49.997291 26707 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:49.998132 26707 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:49.995932 19263 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:50.002081 26715 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:50.002650 26715 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:49.977605 26603 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.004117 26715 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.008363 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:49.966910 26402 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:11:49.986666 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:50.011792 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.016259 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:50.017038 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.020812 19221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3496) took 1733 ms (client timeout 1979 ms). Trace:
W20260709 13:11:50.021462 19221 rpcz_store.cc:269] 0709 13:11:48.287473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.615897 (+328424us) service_pool.cc:224] Handling call
0709 13:11:50.020484 (+1404587us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54001c4154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:50.020716 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195697536}
I20260709 13:11:50.023007 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.026221 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:50.019485 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 283753us
I20260709 13:11:50.030476 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:49.982669 26676 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:11:50.042786 26676 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.043790 26651 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.033888 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.046581 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3510) took 1017 ms. Trace:
I20260709 13:11:50.160269 19188 leader_election.cc:400] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24.
I20260709 13:11:50.164732 19188 leader_election.cc:403] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.165727 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3506) took 1138 ms. Trace:
I20260709 13:11:50.163928 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3511) took 1135 ms. Trace:
I20260709 13:11:50.163625 19217 rpcz_store.cc:276] 0709 13:11:49.028126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.815041 (+786915us) service_pool.cc:224] Handling call
0709 13:11:49.815335 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.815574 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:49.864479 (+ 48905us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.040466 (+175987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:50.041047 (+   581us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:50.041732 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.043486 (+  1754us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.045640 (+  2154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50476,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":1497,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":162865,"threads_started":1,"wal-append.queue_time_us":213438}
I20260709 13:11:50.168588 19219 rpcz_store.cc:276] 0709 13:11:49.028437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.815423 (+786986us) service_pool.cc:224] Handling call
0709 13:11:49.815764 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.815978 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:49.865868 (+ 49890us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.162923 (+297055us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:50.163070 (+   147us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:50.163225 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.163413 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.163673 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51874,"prepare.queue_time_us":79605,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":292297,"threads_started":1,"wal-append.queue_time_us":249483}
I20260709 13:11:50.170565 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.171300 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.166316 19225 rpcz_store.cc:276] 0709 13:11:49.027061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.807214 (+780153us) service_pool.cc:224] Handling call
0709 13:11:49.807699 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.808265 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.808312 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.817055 (+  8743us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.059573 (+242518us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:50.064058 (+  4485us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.164898 (+100840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.165090 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.165220 (+   130us) raft_consensus.cc:1685] finished
0709 13:11:50.165249 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.165528 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100038,"prepare.queue_time_us":4135,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":92,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":14210,"thread_start_us":242086,"threads_started":1,"wal-append.queue_time_us":288516}
I20260709 13:11:50.035269 19265 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:50.036821 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.019618 26244 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:50.014123 26679 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:49.999431 26707 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.196112 26244 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:50.178886 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 143603us
I20260709 13:11:50.234459 26653 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:50.235597 26653 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.236508 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:50.237505 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 271731us
I20260709 13:11:50.239174 26653 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.056811 19263 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24.
I20260709 13:11:50.082468 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3225) took 1057 ms. Trace:
I20260709 13:11:50.240820 19373 rpcz_store.cc:276] 0709 13:11:49.025171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.025313 (+   142us) service_pool.cc:224] Handling call
0709 13:11:49.025586 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.141239 (+115653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.141280 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.141319 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:49.141349 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.082144 (+940795us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400357354. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:50.082217 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.082396 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265488128}
W20260709 13:11:50.184829 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.162249 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.244808 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.245438 19365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3230) took 1179 ms. Trace:
I20260709 13:11:50.216030 26751 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:50.245950 19365 rpcz_store.cc:276] 0709 13:11:49.066222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.067781 (+  1559us) service_pool.cc:224] Handling call
0709 13:11:50.244880 (+1177099us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400355f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:50.245154 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019871104}
I20260709 13:11:50.245970 19221 raft_consensus.cc:2410] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:11:50.088402 26760 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.248046 26738 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.217924 26651 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.068809 26629 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.249189 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.250026 26629 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.251075 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.112771 26710 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:50.252699 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3236) took 1139 ms. Trace:
I20260709 13:11:50.253328 19374 rpcz_store.cc:276] 0709 13:11:49.112981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.115192 (+  2211us) service_pool.cc:224] Handling call
0709 13:11:50.252194 (+1137002us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54004245d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:50.252451 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323104640}
I20260709 13:11:50.253970 26710 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.087760 26634 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.177414 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.239104 26493 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.240201 19263 leader_election.cc:403] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:50.176640 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.248736 26759 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.225534 26715 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.172127 19217 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:11:50.249053 26760 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.069063 26499 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.054875 19296 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 16.
I20260709 13:11:50.057871 19896 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:50.064447 19295 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:50.252097 19221 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:50.199123 26386 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:11:50.275434 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 218938us
I20260709 13:11:50.276846 26760 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.277684 19219 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:50.278070 26499 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.279242 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.280530 26598 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.280969 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.281881 26598 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.283516 25654 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:50.280627 19296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41704 (request call id 2628) took 3103 ms (client timeout 1821 ms). Trace:
I20260709 13:11:50.282578 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.284900 26759 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.273341 26386 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:50.286537 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.287211 26386 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:50.284394 19296 rpcz_store.cc:269] 0709 13:11:47.177137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.236215 (+ 59078us) service_pool.cc:224] Handling call
0709 13:11:47.862047 (+625832us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b18002fe080. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7ef0646 00007fe8d7e2a58e 00007fe8d7eabf9e 00007fe8d7ead7de 00007fe8d7eb927c 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c
0709 13:11:49.924828 (+2062781us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b58005033d0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e110aa 00007fe8d7e93447 00007fe8d7eabfe7 00007fe8d7ead7de 00007fe8d7eb927c 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c
0709 13:11:50.280387 (+355559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3837321216}
I20260709 13:11:50.292227 26493 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.292805 26251 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24.
I20260709 13:11:50.295222 26493 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.296178 26386 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:50.296806 26634 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:50.300558 26499 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:50.302006 26207 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:50.308773 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:50.303474 26651 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.249063 26738 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.305464 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:50.313805 19896 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:50.312420 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 257046us
I20260709 13:11:50.314745 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.315928 19219 raft_consensus.cc:2393] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:50.332587 26738 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:50.319351 26759 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.320870 26629 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.334419 19219 raft_consensus.cc:1275] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:50.335816 19339 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:50.337134 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:50.321714 26744 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.777s	user 0.008s	sys 0.003s
I20260709 13:11:50.321782 26676 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.322623 26417 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:50.324445 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36770 (request call id 1141) took 1584 ms. Trace:
I20260709 13:11:50.326563 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.327802 26687 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:50.329269 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:50.310076 26651 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.306931 26400 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:11:50.345539 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 186066us
I20260709 13:11:50.346206 19219 raft_consensus.cc:1275] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:50.346760 19292 rpcz_store.cc:276] 0709 13:11:48.740060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.067007 (+326947us) service_pool.cc:224] Handling call
0709 13:11:49.067256 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.142130 (+ 74874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.142160 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.142215 (+    55us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:11:49.142246 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.323839 (+1181593us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b54002b8ed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:50.323929 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.324199 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171813120}
I20260709 13:11:50.343469 19117 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 16 to 18, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 18 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:50.346567 26417 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:50.344027 26629 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.383390 19221 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:49.871173 19216 rpcz_store.cc:276] 0709 13:11:48.287770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.207656 (+919886us) service_pool.cc:224] Handling call
0709 13:11:49.223747 (+ 16091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.224029 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:49.332014 (+107985us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.870099 (+538085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.870158 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:49.870205 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.870282 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.870415 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194544,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1322,"raft.queue_time_us":1864,"thread_start_us":633817,"threads_started":2}
I20260709 13:11:50.418426 19896 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:50.382665 26417 raft_consensus.cc:3060] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:50.420001 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:50.424521 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75154us
I20260709 13:11:50.426982 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:50.442667 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.440974 26402 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:50.438434 26530 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:50.456420 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 181195us
I20260709 13:11:50.457165 19219 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:50.461308 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 132255us
I20260709 13:11:50.461831 26651 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.462708 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:50.464547 26400 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.509845 26714 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.510332 19225 raft_consensus.cc:2393] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 23: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:50.510905 19219 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:50.516659 19294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2792) took 1731 ms. Trace:
I20260709 13:11:50.517105 19294 rpcz_store.cc:276] 0709 13:11:48.784915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.011189 (+226274us) service_pool.cc:224] Handling call
0709 13:11:50.516313 (+1505124us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54002e7554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:50.516484 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101576064}
I20260709 13:11:50.518298 26598 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.524196 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3231) took 1453 ms. Trace:
I20260709 13:11:50.524722 19366 rpcz_store.cc:276] 0709 13:11:49.070786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.070941 (+   155us) service_pool.cc:224] Handling call
0709 13:11:49.071212 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:49.756009 (+684797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.523742 (+767733us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400313b54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:50.523991 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573198592}
I20260709 13:11:50.528326 19225 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:50.537024 19217 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:50.538334 26771 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805) with higher term. Message: Invalid argument: T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24.
I20260709 13:11:50.536500 26710 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 13:11:50.538870 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.539348 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.544116 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 81664.2us
I20260709 13:11:50.542654 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.537024 26775 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.557255 19219 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:50.555912 19216 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:50.565485 19265 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:50.566568 26651 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.568996 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:50.570405 26598 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.572510 26692 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:50.574018 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 131619us
I20260709 13:11:50.575316 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:50.570945 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:50.580902 26687 consensus_queue.cc:1048] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:50.581722 26687 consensus_queue.cc:1243] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:50.582469 26244 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:50.582646 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3495) took 2295 ms. Trace:
I20260709 13:11:50.583155 26244 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.583071 19223 rpcz_store.cc:276] 0709 13:11:48.287140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.236671 (+949531us) service_pool.cc:224] Handling call
0709 13:11:49.237069 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.237482 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:49.905747 (+668265us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b180047e360. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc5455 00007fe8db8ad3c7 00007fe8d7ebf9a7 00007fe8d7ecf0bf 00007fe8d7ecf038
0709 13:11:50.268074 (+362327us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.452113 (+184039us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.455881 (+  3768us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.456836 (+   955us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:50.471938 (+ 15102us) log.cc:844] Serialized 14 byte log entry
0709 13:11:50.472200 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.502728 (+ 30528us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.582314 (+ 79586us) raft_consensus.cc:1685] finished
0709 13:11:50.582332 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.582475 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7029,"prepare.queue_time_us":284793,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":39172,"raft.run_cpu_time_us":523,"raft.run_wall_time_us":40306,"spinlock_wait_cycles":22020352,"thread_start_us":410530,"threads_started":2,"wal-append.queue_time_us":243277}
I20260709 13:11:50.585392 26244 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:50.586071 26780 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:11:50.587056 26259 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:50.587461 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.587551 26259 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:50.588025 26259 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:50.588918 19291 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:50.588011 19298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2786) took 1845 ms. Trace:
I20260709 13:11:50.589659 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:50.590965 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 167702us
I20260709 13:11:50.591648 26348 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:50.589838 19298 rpcz_store.cc:276] 0709 13:11:48.742015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.180366 (+438351us) service_pool.cc:224] Handling call
0709 13:11:49.180587 (+   221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.180890 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.180919 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.181241 (+   322us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.231805 (+1050564us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b18003bfb60. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:50.457897 (+226092us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:50.460001 (+  2104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.470867 (+ 10866us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.587555 (+116688us) raft_consensus.cc:1685] finished
0709 13:11:50.587572 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.587853 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454,"raft.queue_time_us":119,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9260,"spinlock_wait_cycles":10495360,"thread_start_us":149330,"threads_started":1,"wal-append.queue_time_us":1259794}
W20260709 13:11:50.588001 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.592989 19220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47368 (request call id 3478) took 2653 ms (client timeout 1885 ms). Trace:
I20260709 13:11:50.593685 19218 raft_consensus.cc:1275] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:11:50.594053 19218 pending_rounds.cc:85] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 13
I20260709 13:11:50.594276 19218 pending_rounds.cc:107] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:11:50.594568 19218 raft_consensus.cc:2889] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:50.593434 19220 rpcz_store.cc:269] 0709 13:11:47.938930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.944512 (+  5582us) service_pool.cc:224] Handling call
0709 13:11:50.592531 (+2648019us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001b2454. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:50.592784 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2648231168}
I20260709 13:11:50.597313 26251 consensus_queue.cc:1048] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:50.598099 26251 consensus_queue.cc:1243] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 23.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:11:50.600648 26612 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:50.601056 26402 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:50.601722 26612 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:50.602188 26612 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:50.591872 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:50.607394 19263 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:50.606410 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:50.614666 26518 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.008s	sys 0.030s
W20260709 13:11:50.629571 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54382.1us
I20260709 13:11:50.630736 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:50.630939 19903 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:50.636407 26710 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:50.636606 26771 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:50.636929 26710 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:50.637066 26771 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.637368 26710 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:50.637436 26771 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:50.638551 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.616318 26775 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.641522 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.642706 26775 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.642911 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.643636 19903 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:50.644097 19339 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:50.645753 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:50.646322 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.646924 26759 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:50.647703 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 55937.2us
I20260709 13:11:50.648567 26244 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:50.649199 26244 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:50.650295 26244 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.652309 26583 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:50.652508 26400 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.652827 26583 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.652724 26738 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:50.653414 26583 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:50.653362 26400 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.640558 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:50.615113 26518 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.008s	sys 0.030s
W20260709 13:11:50.636037 26782 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:50.672214 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:50.673525 26604 consensus_queue.cc:1059] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:11:50.673959 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:50.662762 26386 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.678611 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.684293 26692 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:11:50.684156 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 107705us
I20260709 13:11:50.607641 26612 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.683281 26651 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:50.689253 26679 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.675684 26207 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.684935 26775 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:50.689417 26604 consensus_queue.cc:1243] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer c6a09cefdddd4ca8a10b66682ed27dad log is divergent from this leader: its last log entry 23.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 13:11:50.726893 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53073.1us
I20260709 13:11:50.691236 26348 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.682219 26386 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.738323 26598 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:50.744972 26598 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.746901 26612 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:50.748355 26348 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.751111 26348 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:50.751796 26436 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.753027 26436 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.755793 26436 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:50.756808 19263 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:50.762259 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.763082 19218 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:50.731158 26759 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:50.768911 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:50.770205 26653 raft_consensus.cc:2804] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:50.771003 26386 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:50.772356 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 79606.6us
I20260709 13:11:50.773288 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:50.775035 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:50.777426 26583 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.772545 26400 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.794636 26400 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:50.795324 26400 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.783118 26207 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.736667 26530 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:50.785257 19266 leader_election.cc:400] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24.
I20260709 13:11:50.785683 26775 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:50.745329 26259 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.789608 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.791749 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.792716 26574 raft_consensus.cc:3060] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:50.792809 19901 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:11:50.793145 26339 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:50.828713 26339 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:50.831174 26339 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.779633 26759 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.831218 26771 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.832404 26530 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.833437 26207 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.814162 26679 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:50.814400 26651 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.814910 19292 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:50.816002 26777 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 13:11:50.816707 19340 leader_election.cc:400] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 26. Current term is 27.
I20260709 13:11:50.817257 26773 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:50.825290 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.825567 19898 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
W20260709 13:11:50.807135 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 63446.6us
I20260709 13:11:50.833442 26759 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:50.861948 19294 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:50.868999 26679 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:50.870100 26400 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.871253 26679 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:50.874147 26781 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.219s	user 0.001s	sys 0.001s
I20260709 13:11:50.878207 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.879180 19225 raft_consensus.cc:3060] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:50.885986 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 69487.6us
I20260709 13:11:50.886965 19340 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:50.888808 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.889393 26759 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:50.890024 19221 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 16: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:50.893783 26259 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.894528 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.895215 19216 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:50.896123 19897 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:11:50.898676 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.899595 19220 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 17: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:50.848596 26715 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:50.900734 26530 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.901081 26715 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:50.902086 26715 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.903483 19216 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:50.913319 26715 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:50.856060 26653 raft_consensus.cc:697] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:50.916612 26771 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.917237 26653 consensus_queue.cc:237] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.917965 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.845376 26651 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.917261 19221 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:11:50.922273 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 137192us
I20260709 13:11:50.927479 26634 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.928012 19220 pending_rounds.cc:85] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 16
I20260709 13:11:50.928785 19220 pending_rounds.cc:107] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:11:50.929184 19220 raft_consensus.cc:2889] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:50.928092 26634 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.932269 26386 consensus_queue.cc:1059] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:50.933282 19224 pending_rounds.cc:85] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 14
I20260709 13:11:50.933736 19224 pending_rounds.cc:107] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:11:50.934044 19224 raft_consensus.cc:2889] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:50.934994 26436 raft_consensus.cc:3055] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:50.935396 26436 raft_consensus.cc:740] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:50.936436 26436 consensus_queue.cc:260] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.937937 26436 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:50.938112 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.941362 26634 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.941882 19900 raft_consensus.cc:2410] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:11:50.944654 26417 consensus_meta.cc:287] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.507s	user 0.016s	sys 0.003s
I20260709 13:11:50.945098 26417 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:50.947041 26785 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.275s	user 0.001s	sys 0.001s
I20260709 13:11:50.947252 26417 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:50.952512 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:50.953377 19372 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 16.
I20260709 13:11:50.956624 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:50.957229 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.932111 19218 pending_rounds.cc:85] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 8
I20260709 13:11:50.958528 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.958745 19218 pending_rounds.cc:107] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:11:50.959354 19372 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:11:50.959633 19218 raft_consensus.cc:2889] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:50.959793 19370 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:50.952383 26598 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:50.960939 26771 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.961604 26771 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.963860 26771 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:50.964515 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.982568 19216 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:50.966136 19223 raft_consensus.cc:1240] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:50.966463 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:50.966842 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.947927 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:50.966964 19117 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:50.967847 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.984721 19221 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
W20260709 13:11:50.968940 19867 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.957118 19900 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37370 (request call id 1315) took 1842 ms (client timeout 1775 ms). Trace:
I20260709 13:11:50.972823 26629 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:50.986639 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:50.985421 19900 rpcz_store.cc:269] 0709 13:11:49.114296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.114455 (+   159us) service_pool.cc:224] Handling call
0709 13:11:50.956864 (+1842409us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54004f0954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:50.957017 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4089853696}
I20260709 13:11:50.974084 26583 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:50.958407 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.976150 19225 raft_consensus.cc:2468] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 13.
I20260709 13:11:50.988291 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.987834 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:50.990638 26629 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:50.993249 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
W20260709 13:11:50.978324 19191 connection.cc:256] RPC call timeout handler was delayed by -2.082398952999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 13:11:50.988281 19117 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 13 to 17, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 17 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.991788 26402 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:51.011036 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:50.991955 26651 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.012620 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.014168 19117 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 20 to 22, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.010468 26402 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.001318 25654 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:51.027066 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 118676us
I20260709 13:11:51.042189 19216 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:51.045485 19221 raft_consensus.cc:2468] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
I20260709 13:11:51.025810 26402 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.051781 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:51.054894 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 163301us
I20260709 13:11:51.057979 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.058843 19373 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 27.
I20260709 13:11:51.058995 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.059893 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.048480 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.068626 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:51.036350 26775 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:51.065758 19117 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 16 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.072813 19117 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 14 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.073386 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.074331 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.074932 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.075253 19296 raft_consensus.cc:2368] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:51.075706 19293 raft_consensus.cc:2393] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.076393 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.076586 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.077021 19291 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:51.077181 19293 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:51.078613 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.078871 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.079469 19295 raft_consensus.cc:2393] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:51.080092 19296 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:51.080482 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.080696 26750 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.081283 19292 raft_consensus.cc:2368] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:51.081244 26750 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.083377 26750 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:51.084558 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 264) took 46691 ms (client timeout 15000 ms). Trace:
I20260709 13:11:51.086134 19340 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:51.087384 26629 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.087992 26629 raft_consensus.cc:2804] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:51.088066 26400 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:51.088609 26400 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.088967 26400 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.089870 26710 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.092517 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.068881 26714 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:51.093873 19371 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:11:51.094295 26714 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.094728 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.094906 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.095917 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.066723 26251 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:51.096877 26251 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.097261 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.097450 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.098222 19365 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:51.085032 26791 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.098887 26251 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:51.099093 26791 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.099519 26775 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.101619 26775 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.074414 19117 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 15 to 18, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.080024 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.093725 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.083292 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.092371 19219 raft_consensus.cc:1240] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:51.107544 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.108677 19294 raft_consensus.cc:2410] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:11:51.109946 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.076622 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.115039 19300 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 23: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.114975 19297 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:51.115577 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.116830 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:51.117586 19225 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:51.092013 26710 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:51.119352 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.088610 26629 raft_consensus.cc:697] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:51.120952 26629 consensus_queue.cc:237] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.119402 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.109860 26791 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:51.125916 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.127796 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:51.117614 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.108136 26769 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.129506 19117 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.144979 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.131528 26634 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.088604 26530 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 13:11:51.163475 19368 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:51.135581 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.165700 19293 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:51.166636 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.167624 19221 raft_consensus.cc:2393] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 13: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.168828 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.169165 19298 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.169509 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:51.137768 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.129705 19296 raft_consensus.cc:2410] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:11:51.128784 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:51.135877 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.149639 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.129804 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.162817 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:51.084991 19118 rpcz_store.cc:269] 0709 13:11:04.360122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.360397 (+   275us) service_pool.cc:224] Handling call
0709 13:11:04.551019 (+190622us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5400002490. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d910b2 00007fe8ddd0aa89 00007fe8ddca2da6 00007fe8ddc74088 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc
0709 13:11:04.755673 (+204654us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:51.046684 (+46291011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:41.102986 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:41.187120 (+ 84134us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:41.204865 (+ 17745us) write_op.cc:435] Acquired schema lock
0709 13:11:41.211338 (+  6473us) tablet.cc:662] Decoding operations
0709 13:11:41.286196 (+ 74858us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:41.307198 (+ 21002us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:41.308429 (+  1231us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:11:41.552637 (+244208us) tablet.cc:701] Row locks acquired
0709 13:11:41.579220 (+ 26583us) write_op.cc:260] PREPARE: finished
0709 13:11:41.654168 (+ 74948us) write_op.cc:270] Start()
0709 13:11:41.719956 (+ 65788us) write_op.cc:276] Timestamp: P: 1783602701624065 usec, L: 0
0709 13:11:41.727700 (+  7744us) op_driver.cc:348] REPLICATION: starting
0709 13:11:41.822149 (+ 94449us) log.cc:844] Serialized 4044 byte log entry
0709 13:11:41.990391 (+168242us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d4dab0ac 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b
0709 13:11:42.561074 (+570683us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:43.166534 (+605460us) op_driver.cc:464] REPLICATION: finished
0709 13:11:44.181358 (+1014824us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d4dab0ac 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8db8ebef0
0709 13:11:44.398366 (+217008us) write_op.cc:301] APPLY: starting
0709 13:11:44.404455 (+  6089us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:44.616131 (+211676us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:44.629952 (+ 13821us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:44.870606 (+240654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:44.870968 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:11:44.871041 (+    73us) write_op.cc:312] APPLY: finished
0709 13:11:44.871515 (+   474us) log.cc:844] Serialized 97 byte log entry
0709 13:11:44.955124 (+ 83609us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.962323 (+  7199us) write_op.cc:454] Released schema lock
0709 13:11:44.962416 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:45.103532 (+141116us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:45.127050 (+ 23518us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64586,"reported_tablets":50,"spinlock_wait_cycles":64584448,"child_traces":[["op",{"apply.queue_time_us":1190421,"apply.run_cpu_time_us":49463,"apply.run_wall_time_us":703361,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":400343,"prepare.run_cpu_time_us":73833,"prepare.run_wall_time_us":1204400,"raft.queue_time_us":272766,"raft.run_cpu_time_us":29219,"raft.run_wall_time_us":1232465,"replication_time_us":1438671,"spinlock_wait_cycles":290894848,"thread_start_us":2134476,"threads_started":5,"wal-append.queue_time_us":695072,"wal-append.run_cpu_time_us":21832,"wal-append.run_wall_time_us":2939635}]]}
I20260709 13:11:51.162668 19299 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:51.174793 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.175204 19365 raft_consensus.cc:2393] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 23: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:51.184429 19370 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:11:51.185865 19369 raft_consensus.cc:2393] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.186786 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.187356 19292 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.188593 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.189574 19221 raft_consensus.cc:2393] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:51.197285 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.193097 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.198969 19294 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:51.194619 19265 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:51.199963 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 139865us
I20260709 13:11:51.201596 19900 raft_consensus.cc:1275] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:11:51.201956 19900 pending_rounds.cc:85] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 14
I20260709 13:11:51.202188 19900 pending_rounds.cc:107] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:11:51.202414 19900 raft_consensus.cc:2889] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.211763 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:51.202286 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.212491 19903 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:51.213534 19117 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 15 to 19, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 19 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.214696 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.187880 26714 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.170109 26339 consensus_queue.cc:1048] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:11:51.169831 26634 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.226747 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:51.227506 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.228500 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:51.228876 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.233022 19374 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:11:51.237433 26598 consensus_queue.cc:1059] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:11:51.245724 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.248867 26400 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.253072 19296 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 13:11:51.253468 19296 pending_rounds.cc:85] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 16
I20260709 13:11:51.253734 19296 pending_rounds.cc:107] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 13:11:51.253959 19296 raft_consensus.cc:2889] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.256261 19217 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:11:51.257418 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:51.258037 19223 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:51.260984 19370 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:51.237809 26676 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:51.263069 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.263830 19297 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.229017 26207 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:11:51.247069 19117 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 10 to 12, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 12 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.246577 19265 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:51.221279 26769 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:51.276494 19898 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:51.212405 26417 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
W20260709 13:11:51.288964 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44965us
I20260709 13:11:51.289947 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.292806 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:51.294500 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.294963 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.295620 19337 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:51.296633 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 89740.6us
I20260709 13:11:51.297410 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:51.298111 26651 raft_consensus.cc:3055] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:51.298583 26651 raft_consensus.cc:740] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:51.284734 26676 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:51.300426 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.300588 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.300822 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.301280 19294 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:51.301153 26676 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.301867 26629 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:51.303597 19293 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:51.304450 25654 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:51.299548 26651 consensus_queue.cc:260] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.304863 25654 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:51.305281 25654 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:51.305567 26651 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:51.305665 26400 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.304258 26207 consensus_queue.cc:1059] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:11:51.307799 26207 raft_consensus.cc:3055] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:51.308205 26207 raft_consensus.cc:740] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:51.309228 26207 consensus_queue.cc:260] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:51.310025 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.299888 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.311600 19298 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:51.308233 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:51.310535 26207 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:51.315420 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:51.313833 19339 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:51.319548 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.320842 19300 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:51.328526 19217 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:51.313190 26804 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:51.331374 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:51.293329 26251 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:51.341356 26251 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.334178 26244 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.008s
I20260709 13:11:51.341900 26251 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:51.342473 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:51.343031 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.343273 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.343628 19224 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:51.344134 19225 raft_consensus.cc:2410] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:51.345055 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:51.346174 26773 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:51.346710 26773 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:51.347078 26773 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.349217 26518 consensus_queue.cc:1048] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:11:51.339666 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52024.2us
I20260709 13:11:51.334393 26804 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.340524 26679 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.340369 26386 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:51.346144 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.330529 26612 raft_consensus.cc:2804] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:51.351773 26804 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:51.352552 26612 raft_consensus.cc:697] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:51.353524 26612 consensus_queue.cc:237] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.354022 26634 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:51.354800 26769 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:51.350622 26518 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:51.360538 19191 leader_election.cc:400] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:51.360862 19191 leader_election.cc:403] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:51.361613 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:51.376519 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.360997 19117 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 16 to 18, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 18 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.377373 19300 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:11:51.382665 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.393121 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.393929 19293 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:51.395819 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:51.399133 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.398873 19117 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.399981 19293 raft_consensus.cc:2393] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 16: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:51.401834 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 56069.9us
I20260709 13:11:51.404415 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.374081 26259 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.381523 26634 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:51.411024 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.413398 19293 raft_consensus.cc:3060] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:51.401160 26775 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:51.400816 26400 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:51.380039 26679 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:11:51.441552 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.443495 19296 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:51.442250 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 54619.8us
I20260709 13:11:51.446352 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.439512 26400 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:51.520834 26402 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.521442 26400 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:51.523003 26402 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:51.443288 26583 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.524248 26583 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.527499 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.534890 19223 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:51.535539 26400 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.540457 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.541635 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:51.546451 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 104952us
I20260709 13:11:51.430286 26786 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.542076 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.566578 19292 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 17.
I20260709 13:11:51.584229 19296 raft_consensus.cc:1240] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:51.584667 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:51.585598 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 176536us
I20260709 13:11:51.575333 25654 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.592320 19293 raft_consensus.cc:2468] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:11:51.415028 26259 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.595336 25654 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.526938 26583 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:51.628296 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.628453 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:51.629113 19223 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.628451 19191 leader_election.cc:400] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:51.630062 19191 leader_election.cc:403] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:11:51.630805 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46254.8us
I20260709 13:11:51.631278 19298 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:51.586930 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:51.632633 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:51.632926 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46096.6us
I20260709 13:11:51.601117 19117 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 15 to 21, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:51.582105 26604 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:51.638660 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 207234us
W20260709 13:11:51.583125 26795 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:11:51.633909 25654 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:11:51.683523 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:51.685236 25654 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:51.685830 25654 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:51.686270 25654 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:51.595323 26402 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:51.692325 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 109974us
I20260709 13:11:51.592561 26759 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:51.593894 26769 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:11:51.639370 26750 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:51.699136 19117 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 18 to 19, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 19 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
W20260709 13:11:51.691275 26774 log.cc:927] Time spent T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:51.636317 26810 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:51.707176 19295 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:51.709084 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:51.714448 19296 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:51.716729 19299 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:51.600327 26786 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.680756 26583 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:11:51.698952 26771 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18.
I20260709 13:11:51.724596 19117 catalog_manager.cc:5697] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 13 to 18, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 18 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:51.726567 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 130779us
I20260709 13:11:51.695555 26339 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:11:51.708031 26750 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.743181 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:51.743623 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:51.745224 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:51.758217 26799 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:11:51.741819 26750 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:51.759596 25654 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.764151 19223 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:51.753899 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 58689.5us
W20260709 13:11:51.771538 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 138986us
I20260709 13:11:51.691809 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:51.761193 19339 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:51.789216 19293 raft_consensus.cc:606] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:51.790148 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:51.800944 19300 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 24 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:51.796530 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:51.731812 26759 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:51.803224 25654 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:51.745393 26634 consensus_queue.cc:1059] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260709 13:11:51.796026 26402 raft_consensus.cc:2804] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:51.804826 19117 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 13 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 20 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.815414 19117 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:51.817026 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:51.806159 26805 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:11:51.820818 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.819339 19896 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 14.
I20260709 13:11:51.861384 19899 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 13:11:51.860869 26806 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:11:51.878180 19337 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:51.850627 26819 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:51.808151 26814 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.862973 19117 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:51.913853 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:51.918349 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:51.862548 26436 raft_consensus.cc:3055] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:51.919085 19223 raft_consensus.cc:2368] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17.
W20260709 13:11:51.918687 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 175560us
I20260709 13:11:51.817226 26687 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.877679 26400 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:51.917846 26820 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:51.921583 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:51.876029 26402 raft_consensus.cc:697] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:51.914454 26259 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:51.930547 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 140467us
I20260709 13:11:51.973940 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.974140 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:51.862911 26612 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:51.956310 19117 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 15 to 19, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 19 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:51.959936 19896 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:51.974699 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:51.957510 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37398 (request call id 1080) took 1015 ms. Trace:
I20260709 13:11:51.958446 19216 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:51.975419 19374 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:51.973742 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.967993 19293 raft_consensus.cc:606] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:51.978114 19293 raft_consensus.cc:614] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:51.976128 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 277230us
I20260709 13:11:51.980733 19370 raft_consensus.cc:2393] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 21: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:51.981256 19373 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:51.959841 26824 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:51.919306 26816 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.257s
I20260709 13:11:51.984543 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:51.985827 19371 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:11:51.986582 26759 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:51.987643 26796 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:11:51.988770 26402 consensus_queue.cc:237] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:51.989603 26821 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:11:51.991372 26811 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:11:51.964836 26820 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.993171 26820 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:51.997646 26817 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:51.975593 19897 rpcz_store.cc:276] 0709 13:11:50.937007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.940281 (+  3274us) service_pool.cc:224] Handling call
0709 13:11:50.940603 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:50.941059 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.941090 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.991780 (+ 50690us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b2c000474b8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:51.009732 (+ 17952us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.195929 (+186197us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:51.196945 (+  1016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.197066 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:51.919674 (+722608us) raft_consensus.cc:1685] finished
0709 13:11:51.919693 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:51.952121 (+ 32428us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":560,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":103003392,"thread_start_us":174179,"threads_started":1,"wal-append.queue_time_us":352223}
I20260709 13:11:51.998262 26817 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:51.999287 26817 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.917181 26814 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.004787 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.005697 19223 raft_consensus.cc:2393] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:52.006794 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.007565 26814 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.013175 25654 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:52.014423 26820 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:51.958907 26417 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.964938 26687 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.020542 25654 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:52.092664 25654 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:52.034138 19868 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:52.034824 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 126896us
I20260709 13:11:51.951838 26436 raft_consensus.cc:740] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:52.076227 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:52.095499 19296 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
I20260709 13:11:52.062956 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:52.087909 19374 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:11:52.111768 19293 raft_consensus.cc:606] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.088721 19263 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.112579 19293 raft_consensus.cc:614] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:52.063334 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.025210 19902 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 1218) took 1235 ms. Trace:
I20260709 13:11:52.123195 19901 raft_consensus.cc:2410] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:52.124292 19265 leader_election.cc:400] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17.
I20260709 13:11:52.039467 19894 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:11:52.061386 19117 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 21 to 22, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 22 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:52.138310 19265 leader_election.cc:403] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:11:52.140283 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 45688.7us
I20260709 13:11:52.074060 19339 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:52.023270 19340 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:52.066836 26818 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:11:52.095425 26629 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.003s
W20260709 13:11:52.076973 26802 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
I20260709 13:11:52.020442 26786 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:52.097975 26251 consensus_meta.cc:287] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
W20260709 13:11:52.147086 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 73125.1us
I20260709 13:11:52.041051 26820 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:52.053117 26207 consensus_meta.cc:287] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.001s
I20260709 13:11:52.148334 26833 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:52.148437 19117 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 14 to 16, leader changed from <none> to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), no longer has a pending config: VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194), VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 16 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:11:52.152280 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.136878 19902 rpcz_store.cc:276] 0709 13:11:50.789353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.790139 (+   786us) service_pool.cc:224] Handling call
0709 13:11:50.790552 (+   413us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:50.835646 (+ 45094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:50.835677 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:50.894514 (+ 58837us) log.cc:844] Serialized 78 byte log entry
0709 13:11:51.028481 (+133967us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:51.028526 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.028595 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.024945 (+996350us) raft_consensus.cc:1685] finished
0709 13:11:52.024966 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.025122 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30769,"raft.queue_time_us":47386,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2407,"thread_start_us":133526,"threads_started":1,"wal-append.queue_time_us":547231}
W20260709 13:11:52.156589 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 133466us
I20260709 13:11:52.194473 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.195178 19223 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:52.157143 26244 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:52.058136 26687 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.157557 26442 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:52.062758 26828 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 13:11:52.158492 26436 consensus_queue.cc:260] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.040494 26417 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.051265 26583 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.115s
W20260709 13:11:52.167613 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 79026.6us
I20260709 13:11:52.168180 26718 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 16. Current term is 17.
I20260709 13:11:52.168460 26604 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.169255 26816 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:52.170975 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 107725us
I20260709 13:11:52.230284 19373 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:52.231388 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.171502 26715 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:52.095404 26773 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.006s
W20260709 13:11:52.172639 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 138612us
W20260709 13:11:52.020103 26804 consensus_meta.cc:287] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.667s	user 0.000s	sys 0.007s
I20260709 13:11:52.178400 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:52.180308 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 144252us
W20260709 13:11:52.180830 26809 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.650s	user 0.003s	sys 0.000s
W20260709 13:11:52.066092 26807 log.cc:927] Time spent T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.545s	user 0.004s	sys 0.000s
W20260709 13:11:52.184118 19221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.034s
I20260709 13:11:52.186784 25654 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:52.246057 19221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.034s
I20260709 13:11:52.193585 19117 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 13 to 19, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 19 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:52.207336 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:52.246771 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1049) took 1002 ms. Trace:
W20260709 13:11:52.200693 26791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.010s	sys 0.035s
I20260709 13:11:52.247100 19221 rpcz_store.cc:276] 0709 13:11:51.244448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.244792 (+   344us) service_pool.cc:224] Handling call
0709 13:11:51.245297 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.286986 (+ 41689us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:11:51.573688 (+286702us) log.cc:844] Serialized 14 byte log entry
0709 13:11:52.246454 (+672766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.246504 (+    50us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:52.246549 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.246610 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.246712 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233430,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":858649,"threads_started":2,"wal-append.queue_time_us":587193}
I20260709 13:11:52.183763 26676 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.203474 26833 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:52.222872 26820 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:52.233351 26750 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.235347 26832 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.236001 26840 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:52.236413 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 95024.1us
I20260709 13:11:52.239109 19293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc8043164d78443493704a95fae3b832"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:52.196121 26629 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:52.212852 26775 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:52.249698 26769 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:52.193043 26251 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.255179 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.256492 25654 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.257102 19223 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:52.230418 26687 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.258308 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:52.280746 19221 raft_consensus.cc:2393] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:52.261988 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:52.259354 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 2917) took 1285 ms. Trace:
I20260709 13:11:52.282166 26750 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.283250 26244 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:52.263193 19117 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 18 to 19, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 19 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:52.285055 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.251863 26791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.010s	sys 0.042s
I20260709 13:11:52.261293 26436 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:52.288470 19298 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:11:52.266376 19293 raft_consensus.cc:606] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.289165 19293 raft_consensus.cc:614] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:52.289397 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.267349 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.251572 26773 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.270556 26830 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:52.288043 19117 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:52.290449 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.290879 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.248858 19217 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:52.294627 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.326403 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.327534 19293 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:52.328585 19297 raft_consensus.cc:1240] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:52.329056 19295 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:52.329857 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 78283.1us
I20260709 13:11:52.330116 19117 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 8 to 11, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 11 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:52.330787 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.267433 26810 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:52.284116 26244 consensus_queue.cc:1243] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:11:52.252154 26804 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.332993 19293 raft_consensus.cc:1275] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:52.281481 19218 rpcz_store.cc:276] 0709 13:11:50.973662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.001100 (+ 27438us) service_pool.cc:224] Handling call
0709 13:11:51.009827 (+  8727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.025556 (+ 15729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.025787 (+   231us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.035843 (+ 10056us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.210043 (+174200us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:51.210095 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.210182 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:52.076214 (+866032us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:52.253046 (+176832us) raft_consensus.cc:1685] finished
0709 13:11:52.253067 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:52.259277 (+  6210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12311,"raft.queue_time_us":21352,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":6925568,"thread_start_us":173800,"threads_started":1,"wal-append.queue_time_us":510600}
I20260709 13:11:52.339403 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:52.344679 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 77419.1us
I20260709 13:11:52.346091 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.338442 19300 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 14: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:52.260799 26676 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.327431 26442 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:52.267321 26820 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.280041 26738 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
W20260709 13:11:52.351528 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 57036us
W20260709 13:11:52.358440 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 81038.6us
I20260709 13:11:52.271313 26832 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.361620 19898 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:11:52.350281 19294 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:52.296154 26437 consensus_queue.cc:1059] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.058s
I20260709 13:11:52.358852 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.331755 26207 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:52.370059 26207 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.370175 26817 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:52.337076 26810 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:52.371325 19222 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:52.372102 26437 raft_consensus.cc:3055] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:52.367009 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2818) took 1037 ms. Trace:
I20260709 13:11:52.372563 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.372704 19297 rpcz_store.cc:276] 0709 13:11:51.329246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.335333 (+  6087us) service_pool.cc:224] Handling call
0709 13:11:51.368328 (+ 32995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.331681 (+963353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.366793 (+ 35112us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540008fa54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:52.366956 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207790464}
I20260709 13:11:52.373739 26846 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.374168 26775 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:52.374980 26775 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:52.374526 26846 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.370509 26207 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:52.296375 26687 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.380405 26715 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:52.382386 26687 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.369450 26773 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:52.384505 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53789us
I20260709 13:11:52.384995 26833 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.386117 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.387475 19868 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.368024 26834 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.150s
I20260709 13:11:52.358012 26824 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:52.396839 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.397645 19298 raft_consensus.cc:2368] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23.
I20260709 13:11:52.397940 26251 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.271191 26840 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.373842 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.346292 26574 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:52.403151 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.367650 26676 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:52.356274 26651 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:52.363926 19266 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.371731 26810 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.419121 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:52.404657 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.423759 19217 raft_consensus.cc:1275] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:11:52.424757 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 60916.2us
I20260709 13:11:52.429278 19293 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:11:52.363847 26838 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:11:52.438762 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.436200 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.439654 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:52.440266 19297 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:52.440618 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.441378 25654 raft_consensus.cc:2764] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:11:52.441411 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.438094 19298 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:52.443671 19298 raft_consensus.cc:606] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.444068 19298 raft_consensus.cc:614] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:52.445645 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:52.448156 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:52.450805 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:52.417388 26251 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.372574 26437 raft_consensus.cc:740] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:52.495316 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56643.3us
I20260709 13:11:52.423507 26634 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:52.493283 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 51375.2us
W20260709 13:11:52.498325 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 57773.9us
I20260709 13:11:52.422618 26824 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:52.435860 26676 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:52.505278 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.510317 19295 raft_consensus.cc:2468] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 25.
I20260709 13:11:52.516480 26822 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.104s
I20260709 13:11:52.533711 19300 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:11:52.452314 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 78566.5us
I20260709 13:11:52.537078 26848 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:52.538017 26794 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:52.522138 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 61126.6us
I20260709 13:11:52.500409 26834 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:52.451485 26817 consensus_queue.cc:1059] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:11:52.528340 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.549265 19221 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:52.549510 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.550731 19219 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:52.551071 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.549304 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.555081 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.559089 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:52.556751 26651 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:52.565002 26845 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:11:52.568492 26530 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.544996 26437 consensus_queue.cc:260] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.570222 26437 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:52.553452 26750 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:52.577921 26820 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.545274 26738 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
W20260709 13:11:52.589622 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 58746.5us
I20260709 13:11:52.598945 19903 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 17.
W20260709 13:11:52.604393 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.613057 19221 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:52.614835 26840 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:52.615455 26831 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:52.559106 26828 consensus_queue.cc:1048] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:11:52.617357 26417 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.585196 26824 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:52.621915 26825 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.622465 26825 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.624791 26825 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:52.627796 19295 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:52.629070 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.629339 19897 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:52.629560 19297 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:52.631565 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.632664 19291 raft_consensus.cc:2410] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:11:52.633288 19219 raft_consensus.cc:1275] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:52.633488 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:52.634104 19903 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:11:52.528034 26251 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.640560 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.619932 26769 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:52.657675 19295 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:11:52.642560 19298 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:52.663489 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37382 (request call id 1225) took 1349 ms. Trace:
I20260709 13:11:52.666225 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.588554 26846 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.663897 19898 rpcz_store.cc:276] 0709 13:11:51.313719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.313840 (+   121us) service_pool.cc:224] Handling call
0709 13:11:51.327525 (+ 13685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:52.362089 (+1034564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:52.663271 (+301182us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006a5c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:52.663436 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377604480}
I20260709 13:11:52.600979 26714 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.664394 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.670302 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:52.672369 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.673167 19297 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
W20260709 13:11:52.657835 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 236188us
W20260709 13:11:52.668447 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 113420us
I20260709 13:11:52.671392 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:52.670168 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.635097 26804 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 28 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.587951 26207 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.678216 19371 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:52.685088 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:52.687074 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 146174us
I20260709 13:11:52.689839 19340 leader_election.cc:400] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23.
I20260709 13:11:52.690162 19340 leader_election.cc:403] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:11:52.693378 19869 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.691568 26530 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 13:11:52.680375 26714 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.696779 26828 consensus_queue.cc:1059] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:52.697750 26828 raft_consensus.cc:3055] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:52.698061 26828 raft_consensus.cc:740] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:52.698604 26714 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:52.698884 26828 consensus_queue.cc:260] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:52.700961 26851 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:11:52.635262 26831 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.706403 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.707106 19297 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:52.707476 26831 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.709199 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.709826 19293 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:52.710359 26810 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:52.710732 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.711288 19300 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:52.710511 26737 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:52.674190 26518 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:52.718200 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.717883 19368 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:52.727262 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.727628 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:52.728754 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:52.729164 26530 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:11:52.729563 26530 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:52.730405 26530 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.731607 26530 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:52.733667 26829 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:11:52.740973 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50863.5us
I20260709 13:11:52.688421 26834 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:52.743412 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:52.744010 19220 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:52.745800 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 52617.2us
I20260709 13:11:52.700040 26828 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:52.680140 26825 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 13:11:52.769243 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 50315.9us
I20260709 13:11:52.727200 26817 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:52.786782 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:52.795411 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 68268.1us
I20260709 13:11:52.724378 26574 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:52.751695 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.751996 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.747596 26714 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:52.791865 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:52.793632 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.740628 26822 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:11:52.745880 26834 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.797282 19373 raft_consensus.cc:1240] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:52.801366 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:52.808571 19372 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:52.801964 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:52.809686 19295 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:52.752128 26737 raft_consensus.cc:2804] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:52.840812 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.841687 19368 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:52.796797 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:52.803182 19371 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:52.810926 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:52.814029 26839 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:52.814869 26827 log.cc:927] Time spent T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:52.815208 26823 consensus_queue.cc:1048] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:11:52.816360 26820 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.817723 26775 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:52.800693 26832 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.800366 26738 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:52.818104 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:52.866061 19367 raft_consensus.cc:2410] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:11:52.818693 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:52.746181 26846 consensus_queue.cc:1059] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:11:52.742971 26518 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.858278 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:52.858541 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 47709.3us
I20260709 13:11:52.798854 26574 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:52.863489 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66767.1us
I20260709 13:11:52.836728 26833 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:52.871184 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.895998 19365 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
W20260709 13:11:52.895478 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.827497 26834 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:52.837064 26822 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.873358 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:52.873181 26244 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:52.877995 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.871213 26738 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.906601 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:52.866755 26715 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:52.876387 26737 raft_consensus.cc:697] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:52.909078 26791 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:52.909881 26737 consensus_queue.cc:237] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.866657 19898 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:52.912245 26738 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:52.860778 26714 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:11:52.897545 19367 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:52.908838 26824 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:52.900004 19298 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:52.916339 26718 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:52.924944 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:52.925809 26679 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:52.926339 26679 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:52.927217 26679 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.928284 26518 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.928452 26207 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.929921 26251 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:52.904716 26244 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.932673 26244 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:52.935447 19223 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:52.936329 26417 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:52.936877 26417 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.938687 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:52.939186 26417 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:52.943079 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:52.943154 26574 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.944949 26574 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:52.947126 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.897396 26822 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:52.965888 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:52.862579 26820 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:52.966759 19223 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:52.967126 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 108930us
I20260709 13:11:52.967373 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:52.968413 19220 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:52.968915 26786 consensus_queue.cc:1048] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:11:52.972092 26857 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:52.972587 26857 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.973052 26857 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:52.973646 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.975911 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:52.979140 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:52.979828 26825 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:52.980999 26251 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:52.981383 26251 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.981750 26251 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:52.983003 26820 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:52.904647 26775 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:52.999765 26817 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for earlier term 22. Current term is 23.
I20260709 13:11:53.004007 19300 raft_consensus.cc:2410] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
W20260709 13:11:52.981022 26864 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:52.946798 26715 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:53.008594 26715 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:53.008956 26822 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:53.011013 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 66250.3us
I20260709 13:11:53.016255 19221 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:53.018527 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:53.021746 19372 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 28.
I20260709 13:11:53.023073 19371 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:11:53.021937 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:53.025552 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.032423 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:53.033284 19298 raft_consensus.cc:2393] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:11:53.049546 19868 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.042121 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:52.995713 26207 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:53.050839 19365 raft_consensus.cc:3060] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:53.051833 19296 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:53.049896 26442 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:53.013854 26825 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:53.059973 19265 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:53.060586 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:53.061527 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:53.027171 26436 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.004s
I20260709 13:11:53.069037 19219 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:53.062824 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:53.063462 19298 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:52.904903 26833 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.127166 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.067870 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:53.132627 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 64872.4us
I20260709 13:11:53.127725 19903 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:53.050192 26710 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:53.050066 26830 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:53.131551 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 65097us
W20260709 13:11:53.151371 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 133091us
I20260709 13:11:53.059353 26259 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:53.017539 26775 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.176384 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.178972 19224 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:53.061883 26839 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:53.180279 19223 raft_consensus.cc:2393] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:53.178038 19339 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:53.134050 26791 raft_consensus.cc:2804] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:53.184322 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.176774 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.160450 26820 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:53.193614 19224 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:11:53.196605 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.201094 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.158375 26830 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.059303 26442 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:53.301400 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 123486us
I20260709 13:11:53.126708 26207 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:53.313742 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 130814us
I20260709 13:11:53.135342 26773 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:11:53.179658 26679 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:53.316351 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.321007 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:53.130723 26869 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.236s
I20260709 13:11:53.323446 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.332868 19223 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:53.179231 26828 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 13:11:53.202102 26791 raft_consensus.cc:697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:53.313712 26830 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:53.321697 26824 raft_consensus.cc:2764] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:11:53.328142 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.319173 26849 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:53.340780 19897 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:53.315927 26820 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
W20260709 13:11:53.391922 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 70978.6us
I20260709 13:11:53.337422 26710 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:53.200083 26839 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.357880 26822 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:53.410181 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 82097.4us
I20260709 13:11:53.411430 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.387842 26849 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:53.396222 26810 consensus_meta.cc:287] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.685s	user 0.018s	sys 0.002s
I20260709 13:11:53.338045 26679 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.406395 26714 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:53.421792 26849 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:53.440861 19366 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:53.342658 26825 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.422032 26710 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:53.461606 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 50335.1us
I20260709 13:11:53.463011 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:53.467175 26869 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:53.442098 26769 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:53.422277 26870 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:11:53.443226 26687 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.467768 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.476089 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:53.470288 26769 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:53.484699 26442 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:53.485216 26873 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:53.485948 26207 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:53.459369 26820 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.495306 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
W20260709 13:11:53.496362 26244 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.006s
I20260709 13:11:53.504117 26244 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.504472 26775 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:53.506524 26244 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:53.479147 26769 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:53.513895 26847 log.cc:927] Time spent T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.950s	user 0.000s	sys 0.012s
I20260709 13:11:53.474927 26687 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:53.503382 26251 consensus_meta.cc:287] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.002s
I20260709 13:11:53.524076 19365 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:11:53.532279 26687 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:53.534802 26769 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.537279 26769 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:53.542155 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 66111.3us
I20260709 13:11:53.542263 26710 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:53.474931 26791 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.478067 26869 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:53.552568 26714 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:53.553431 26714 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:53.554695 26714 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:53.565142 26879 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:53.568967 26251 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.571262 26251 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:53.518731 26833 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:53.559907 26834 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.002s
W20260709 13:11:53.612157 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 68771.4us
W20260709 13:11:53.612403 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.614321 26869 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:53.621136 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:53.625296 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:11:53.608752 26574 consensus_meta.cc:287] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.005s
W20260709 13:11:53.609057 26738 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.000s
W20260709 13:11:53.620213 26857 consensus_meta.cc:287] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.005s
I20260709 13:11:53.652480 19897 raft_consensus.cc:2410] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:11:53.656237 19901 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:11:53.653614 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 234377us
I20260709 13:11:53.659327 19339 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:53.619946 26869 consensus_queue.cc:1059] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:11:53.665222 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 51644.5us
I20260709 13:11:53.669212 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:53.671132 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3580) took 1034 ms. Trace:
I20260709 13:11:53.671720 19225 rpcz_store.cc:276] 0709 13:11:52.636558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.636995 (+   437us) service_pool.cc:224] Handling call
0709 13:11:52.980448 (+343453us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5800000098. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d90a22 00007fe8ddca9c09 00007fe8dce03ee0 00007fe8dcecd0ab 00007fe8dcecd131 00007fe8dce8efc0 00007fe8dce79929 00007fe8dce793d2 00007fe8d63f0bd4
0709 13:11:52.980668 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.192739 (+212071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.192770 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:53.192834 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:53.192878 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.670795 (+477917us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54000e4054. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:53.670872 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.671050 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528342656}
I20260709 13:11:53.665026 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:53.682890 26840 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:53.683331 26840 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.683688 26840 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:53.683913 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.685778 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.650319 26738 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.691414 26738 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:53.691777 19219 raft_consensus.cc:1275] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:53.692889 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:53.693887 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:53.694458 19225 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:53.695253 26840 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.695926 26869 raft_consensus.cc:3055] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:53.696578 26869 raft_consensus.cc:740] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:53.697525 26840 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:53.697734 26869 consensus_queue.cc:260] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.699538 26869 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:53.700526 19225 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
W20260709 13:11:53.669167 26715 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.017s
W20260709 13:11:53.761693 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 92539.9us
I20260709 13:11:53.620369 26834 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.767982 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:53.668864 26833 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:53.791139 19365 raft_consensus.cc:1240] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:11:53.803247 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:53.803812 26840 consensus_queue.cc:1048] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:53.804550 26834 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:53.804751 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:53.805343 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:53.806095 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:53.650803 26857 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.873929 19223 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:53.874186 19902 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:53.884478 25654 raft_consensus.cc:3055] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:53.925719 25654 raft_consensus.cc:740] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:53.813036 26824 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:53.826144 26791 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:53.942461 25654 consensus_queue.cc:260] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.946935 25654 raft_consensus.cc:3060] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:53.937609 26339 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:53.873311 26839 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:53.839983 26715 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:53.950124 26825 raft_consensus.cc:493] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:53.986066 19223 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:53.994099 26714 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:53.961018 26339 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:53.963121 26791 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.018136 26824 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:53.991629 26825 raft_consensus.cc:515] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.020514 26897 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.034699 26887 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.045528 26887 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.053671 19367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3295) took 1066 ms. Trace:
I20260709 13:11:54.054160 19367 rpcz_store.cc:276] 0709 13:11:52.987693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.988235 (+   542us) service_pool.cc:224] Handling call
0709 13:11:52.988741 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.179970 (+191229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:53.180002 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:53.180039 (+    37us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:53.180068 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.053360 (+873292us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000942d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:54.053425 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.053592 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439342336}
I20260709 13:11:54.057492 19369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53992 (request call id 3287) took 1343 ms. Trace:
I20260709 13:11:54.057910 19369 rpcz_store.cc:276] 0709 13:11:52.714476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.714632 (+   156us) service_pool.cc:224] Handling call
0709 13:11:54.057319 (+1342687us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400357d54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:54.057432 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646549248}
I20260709 13:11:54.059006 26339 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.059829 26339 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.060741 26339 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.064801 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 1235) took 1122 ms. Trace:
I20260709 13:11:54.065210 19903 rpcz_store.cc:276] 0709 13:11:52.942665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.942793 (+   128us) service_pool.cc:224] Handling call
0709 13:11:54.064566 (+1121773us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54006a68d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:54.064706 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422677888}
I20260709 13:11:54.076445 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:54.068861 26820 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.068640 26604 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.079416 26884 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:11:54.076900 26831 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:54.041785 26824 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:54.108618 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.082476 26820 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.078011 26897 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.105420 26857 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.106352 26715 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.092999 26604 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:54.120703 26890 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:11:54.116199 26898 log.cc:927] Time spent T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:11:54.101469 26831 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:54.120891 26899 log.cc:927] Time spent T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:11:54.141264 26715 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.141952 26878 raft_consensus.cc:993] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:54.141885 26715 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.142529 26878 raft_consensus.cc:1081] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:11:54.148607 26604 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.149370 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:54.152125 26897 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.154160 19902 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:54.157207 26820 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.158505 26824 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.161630 19339 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:54.165251 26893 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
W20260709 13:11:54.167215 26902 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
W20260709 13:11:54.168031 26849 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 13:11:54.168474 26849 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.168996 19901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1360) took 1234 ms. Trace:
I20260709 13:11:54.169425 19901 rpcz_store.cc:276] 0709 13:11:52.934977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.935096 (+   119us) service_pool.cc:224] Handling call
0709 13:11:52.935437 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.658608 (+723171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.168694 (+510086us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54006beed4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:54.168936 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656696704}
I20260709 13:11:54.171079 26849 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.171499 25654 raft_consensus.cc:2804] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:54.171984 25654 raft_consensus.cc:697] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:54.172866 25654 consensus_queue.cc:237] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.175263 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.176561 26825 leader_election.cc:290] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.178927 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.179598 19369 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:54.181241 26828 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.181913 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:54.181831 26828 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.185938 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:54.187326 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:54.188042 19291 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 17. (term mismatch)
I20260709 13:11:54.189054 19291 pending_rounds.cc:85] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Aborting all ops after (but not including) 16
I20260709 13:11:54.189359 19291 pending_rounds.cc:107] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Aborting uncommitted NO_OP operation due to leader change: 27.17
I20260709 13:11:54.189642 19291 raft_consensus.cc:2889] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.192553 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:54.191840 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:54.193251 19901 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:11:54.191373 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:54.153820 26715 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.200764 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.201977 19365 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:54.199826 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.202842 19368 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 25: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:54.219607 26836 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:54.204509 26604 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:54.217971 26880 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:54.245669 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 477763us
I20260709 13:11:54.252748 26878 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.255060 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:54.221894 26836 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:54.267874 26836 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:54.267614 26878 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.269802 26679 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.270206 26878 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.273665 26828 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:54.275717 26830 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.001s
I20260709 13:11:54.276321 26822 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:54.275872 26679 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.277704 19222 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:54.278595 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.299762 19901 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:54.300220 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.301596 19224 raft_consensus.cc:2410] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:11:54.279223 26869 consensus_meta.cc:287] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.004s
I20260709 13:11:54.280339 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:54.280419 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:54.284427 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.303193 26679 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.305236 19365 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:11:54.305410 26679 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:54.303256 19369 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:54.263962 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:54.302354 26822 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.259101 26604 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:54.319897 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 56047.2us
I20260709 13:11:54.303174 26833 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.323019 26913 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.050s	user 0.002s	sys 0.004s
I20260709 13:11:54.343222 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:54.323699 26911 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.192s	user 0.005s	sys 0.000s
W20260709 13:11:54.343222 19337 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.17.171.196:38805 timed out after 1.524s (SENT) [suppressed 7 similar messages]
W20260709 13:11:54.336140 26912 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.067s	user 0.000s	sys 0.006s
I20260709 13:11:54.347556 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:54.266747 26880 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:54.348034 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 131903us
W20260709 13:11:54.351145 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 127137us
I20260709 13:11:54.352775 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.354277 19369 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:54.319473 26897 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:54.357467 19373 raft_consensus.cc:1240] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:54.360096 19292 raft_consensus.cc:1240] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:11:54.361995 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.363785 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.365217 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:54.366875 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.367837 19296 raft_consensus.cc:2393] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 19: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:54.341894 26824 raft_consensus.cc:2764] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:11:54.379248 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:54.380085 19222 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:54.306530 26830 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.373310 19299 raft_consensus.cc:1240] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:11:54.374783 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:54.380887 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.388536 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.382491 19292 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:54.391778 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.392645 19369 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:54.392850 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:54.391958 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:11:54.412645 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.372915 26878 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.374320 26769 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:54.425163 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.425954 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.430305 19292 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 23: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:54.430713 19368 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:54.432906 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.434370 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.436761 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:54.438807 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:54.387308 26831 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:54.449826 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:54.438551 26518 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:54.450642 19291 raft_consensus.cc:3060] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:54.450991 26518 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.453045 26518 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:54.446897 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.420670 26904 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:54.425429 26911 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:54.454918 19371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3290) took 1662 ms. Trace:
W20260709 13:11:54.455312 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 90899.7us
I20260709 13:11:54.455564 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:54.455612 19374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3286) took 1769 ms. Trace:
I20260709 13:11:54.468770 19868 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:54.468855 19374 rpcz_store.cc:276] 0709 13:11:52.686716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.686960 (+   244us) service_pool.cc:224] Handling call
0709 13:11:52.696576 (+  9616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:52.714955 (+ 18379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.714983 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:52.715020 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:52.715051 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.455415 (+1740364us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400093dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:54.455457 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.455562 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41846016}
I20260709 13:11:54.460031 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.388113 26771 consensus_queue.cc:1059] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:11:54.372782 26259 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:11:54.465318 19216 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:54.465570 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:54.460193 19219 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:11:54.467371 19371 rpcz_store.cc:276] 0709 13:11:52.792407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.843263 (+ 50856us) service_pool.cc:224] Handling call
0709 13:11:53.022485 (+179222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:53.023488 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.454731 (+1431243us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400355f50. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb48ad 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:54.454864 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411160320}
I20260709 13:11:54.415884 26775 consensus_queue.cc:1059] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:11:54.377159 26917 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 13:11:54.473452 26750 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.513806 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:54.477941 19898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1357) took 1544 ms. Trace:
I20260709 13:11:54.514427 19299 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:54.478893 26830 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.434012 26878 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.479298 26604 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.480082 19366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53992 (request call id 3282) took 1815 ms. Trace:
I20260709 13:11:54.481104 26880 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:54.476518 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 133312us
I20260709 13:11:54.440361 26251 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.419309 26897 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.466465 26679 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:54.514484 19898 rpcz_store.cc:276] 0709 13:11:52.933528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.935950 (+  2422us) service_pool.cc:224] Handling call
0709 13:11:52.941297 (+  5347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:52.996877 (+ 55580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.996906 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:53.662168 (+665262us) spinlock_profiling.cc:243] Waited 966 us on lock 0x7b2c000474b8. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d67aea11 00007fe8d67be372 00007fe8d7ef0a01 00007fe8d7eb543a 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:53.662713 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 13:11:53.756210 (+ 93497us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:53.756261 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.477629 (+721368us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54006b0154. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:54.477691 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.477735 (+    44us) raft_consensus.cc:1685] finished
0709 13:11:54.477748 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.477888 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3499,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":22961,"spinlock_wait_cycles":102999552,"thread_start_us":93010,"threads_started":1,"wal-append.queue_time_us":138509}
I20260709 13:11:54.509093 26804 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:54.519189 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50512.2us
I20260709 13:11:54.522117 19366 rpcz_store.cc:276] 0709 13:11:52.665038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.666007 (+   969us) service_pool.cc:224] Handling call
0709 13:11:52.679876 (+ 13869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:53.444158 (+764282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.171565 (+727407us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b54000fcba0. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7e2cdc0 00007fe8d7eb8a02 00007fe8d7eb4dd6 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2
0709 13:11:54.479792 (+308227us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400314554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:54.480011 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733025024}
I20260709 13:11:54.490772 26920 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.517772 26823 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.518949 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.513430 19222 raft_consensus.cc:2468] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:11:54.527900 26905 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.545653 26920 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.549448 26823 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.530517 19219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:54.560907 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:54.530304 26833 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.602351 26833 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.605216 26833 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:54.520653 26750 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:54.608619 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.598217 26857 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.615211 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 54400.9us
I20260709 13:11:54.535064 26251 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:54.620085 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:54.619482 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 163379us
I20260709 13:11:54.541498 26804 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.606890 26714 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.606263 26771 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:54.627144 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 93348us
I20260709 13:11:54.627873 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:54.641999 26824 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.642752 26824 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.643702 19294 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:54.644588 26804 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.618127 26679 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.645196 26824 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:54.646956 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:54.653396 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.622637 26629 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:54.661414 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:54.662202 19216 raft_consensus.cc:2410] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 23 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:11:54.662657 19291 raft_consensus.cc:2468] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:54.606799 26905 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.668908 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.670070 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.670569 19291 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:54.675294 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.677035 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.677651 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:54.677881 19291 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:54.650918 26848 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:11:54.666611 26921 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:54.694798 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:54.683291 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:54.686218 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:54.663998 26857 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:54.700055 19297 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:54.660607 26771 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.667798 26417 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:54.664350 26824 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:54.645952 26714 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.684013 26629 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:54.684365 26715 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:54.772505 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 144707us
I20260709 13:11:54.823513 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:54.824149 19903 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:54.824928 26715 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.655786 26679 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:54.701742 26750 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:54.804940 26897 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:54.806213 26871 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 1.376s	user 0.007s	sys 0.000s
I20260709 13:11:54.808473 26920 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:54.816484 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 95479.8us
I20260709 13:11:54.820410 26905 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:54.866042 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 67371us
I20260709 13:11:54.773254 26738 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:54.790611 26629 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.000452 26629 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:54.716519 26857 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.026531 19265 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:55.031916 19299 consensus_meta.cc:287] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.000s
I20260709 13:11:55.034848 19299 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:54.998230 26878 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.040220 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.059563 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.047286 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.008284 26738 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.057027 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.061548 19217 raft_consensus.cc:2410] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 24 because replica has last-logged OpId of term: 23 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:11:55.077056 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.077621 19868 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:54.860802 26824 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.018281 26715 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.081220 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:55.079699 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53249.6us
I20260709 13:11:55.080384 19868 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:55.081054 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:55.085307 19223 raft_consensus.cc:3060] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:55.019033 26905 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:55.073751 26738 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:55.093127 19265 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:55.094686 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:55.083681 26937 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:55.082974 26920 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:55.100909 19902 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:11:55.103958 19902 pending_rounds.cc:85] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 13
I20260709 13:11:55.104393 19902 pending_rounds.cc:107] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:11:55.104624 19902 raft_consensus.cc:2889] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.104041 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 1239) took 1483 ms. Trace:
I20260709 13:11:55.105031 19897 rpcz_store.cc:276] 0709 13:11:53.620503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.620785 (+   282us) service_pool.cc:224] Handling call
0709 13:11:55.099965 (+1479180us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b54006c5554. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:55.103986 (+  4021us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69066112}
W20260709 13:11:55.099432 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 475123us
W20260709 13:11:55.110204 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 283729us
I20260709 13:11:55.087908 26804 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:55.112941 25654 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:55.113394 19869 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:55.086215 26848 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:11:55.096719 26878 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:55.145604 19295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2852) took 2239 ms. Trace:
I20260709 13:11:55.089389 26905 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.143002 19223 raft_consensus.cc:2468] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:55.098104 26715 raft_consensus.cc:2804] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:55.146994 19869 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:55.146207 19295 rpcz_store.cc:276] 0709 13:11:52.897876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.898058 (+   182us) service_pool.cc:224] Handling call
0709 13:11:52.908396 (+ 10338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:52.908815 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:52.908847 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:52.909458 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 13:11:53.185405 (+275947us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:53.185460 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.185548 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:54.701998 (+1516450us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
0709 13:11:55.121248 (+419250us) raft_consensus.cc:1685] finished
0709 13:11:55.121278 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.136875 (+ 15597us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2080,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":68,"spinlock_wait_cycles":12018944,"thread_start_us":275513,"threads_started":1,"wal-append.queue_time_us":477340}
I20260709 13:11:55.091202 26927 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:11:55.098503 26834 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:11:55.159710 19219 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:55.128758 26820 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:55.160487 19219 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.162237 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.165791 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:55.178761 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.163136 26927 consensus_queue.cc:1243] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:55.162092 26715 raft_consensus.cc:697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:11:55.236785 26946 log.cc:927] Time spent T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:11:55.223767 26836 consensus_meta.cc:287] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.955s	user 0.009s	sys 0.003s
I20260709 13:11:55.156144 26935 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.080s
I20260709 13:11:55.179629 26771 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.244725 26857 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.228581 26937 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.248342 26836 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.251384 26905 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.229668 26773 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.268914 26773 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.269783 26836 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.270481 26937 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.271171 26773 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:55.261775 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:55.261857 26939 log.cc:927] Time spent T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.427s	user 0.000s	sys 0.001s
I20260709 13:11:55.273167 26937 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.274048 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.274745 19218 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:55.275496 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.275949 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.276726 19298 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:55.277109 19223 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:55.263396 26679 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.265091 26715 consensus_queue.cc:237] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.280098 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.249293 26714 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.275811 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.283505 19220 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:55.283638 26679 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.284322 26679 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.286628 26679 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:55.296939 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.297695 19903 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:55.298717 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.303674 26823 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.307588 26910 raft_consensus.cc:3055] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:55.308081 26910 raft_consensus.cc:740] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:55.308979 26910 consensus_queue.cc:260] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.310297 26910 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:55.322248 26679 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.322876 26679 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.325114 26679 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.334127 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.335166 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.341236 19373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54008 (request call id 2682) took 1596 ms. Trace:
I20260709 13:11:55.343577 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.384590 19223 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
W20260709 13:11:55.384764 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 200309us
I20260709 13:11:55.384123 19373 rpcz_store.cc:276] 0709 13:11:53.744467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:53.789730 (+ 45263us) service_pool.cc:224] Handling call
0709 13:11:53.790103 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.372676 (+582573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.340977 (+968301us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54004259d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:55.341177 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304233728}
I20260709 13:11:55.291996 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:11:55.386593 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 94700.6us
I20260709 13:11:55.342491 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:55.394795 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52390.1us
I20260709 13:11:55.364010 26251 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.341187 26904 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.346760 26943 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.256057 26629 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.336633 26905 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.336187 26714 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.397696 26825 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:55.400460 26829 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.354964 26339 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.409307 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.405532 19263 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:55.415105 19340 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:55.416992 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:55.426934 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.427554 19299 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:55.412524 26829 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.430029 26829 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.430128 26339 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:55.431945 26954 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:55.432488 26954 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.433056 26954 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:55.433997 26887 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.440315 26888 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.404708 26955 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.444314 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.444830 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.449028 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.449416 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:55.453109 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.454032 19370 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 28.
I20260709 13:11:55.460680 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.462266 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.397281 26820 raft_consensus.cc:2804] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:55.472363 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.470623 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.469934 19373 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 25.
I20260709 13:11:55.409672 26629 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:55.483821 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.486074 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.486372 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.487077 19216 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:11:55.487203 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:55.335683 26738 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.497776 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.498478 19218 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:55.498816 26820 raft_consensus.cc:697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:55.499984 26820 consensus_queue.cc:237] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.491112 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:55.501252 19296 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:55.501194 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52be2d3fd44446e288f920256640822f" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.492560 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.494427 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.505204 19897 raft_consensus.cc:2376] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21. Re-sending same reply.
W20260709 13:11:55.509325 19190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.014s	sys 0.010s
W20260709 13:11:55.509933 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.510586 26965 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:55.511125 26965 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.511550 26965 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:55.488299 26773 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:11:55.513032 26773 consensus_queue.cc:1243] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 0316f581086f40549fea44a772fc2dec log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:11:55.513547 26773 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:55.514060 26773 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:55.514941 26773 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.515302 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:55.495539 19368 raft_consensus.cc:2393] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 23: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:55.440938 26888 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.446575 26518 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:55.500662 19902 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:55.460922 19219 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.513490 19296 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:55.492553 26857 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.462467 26917 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.410643 26714 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.539436 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.542920 19339 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:55.410151 26905 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.543002 19295 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:55.405206 26904 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.479658 26935 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.544797 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.547044 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:55.516470 26932 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:55.539610 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.552300 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.567588 19903 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 25.
I20260709 13:11:55.553531 26518 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:55.557505 26950 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:55.558545 26714 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.579509 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.559115 26869 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:55.480880 26959 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:11:55.527721 26773 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:55.548544 26917 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.574981 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:55.575587 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 150446us
I20260709 13:11:55.573019 19340 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:55.441368 26955 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.583053 19216 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
W20260709 13:11:55.607689 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 155722us
I20260709 13:11:55.587852 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:55.609673 19224 raft_consensus.cc:3060] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:55.612888 19340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.407359 26943 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.599077 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:55.600642 19894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.601516 26910 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.602681 19368 raft_consensus.cc:1275] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:11:55.603279 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:55.623009 19368 pending_rounds.cc:85] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 15
I20260709 13:11:55.623430 19368 pending_rounds.cc:107] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:11:55.623721 19368 raft_consensus.cc:2889] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.616636 26971 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.580487 26817 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:55.619458 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:55.589185 26824 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:55.580539 26938 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.542382 26857 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.633505 19265 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:55.664119 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.555428 26629 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:11:55.665819 19299 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:55.644708 26817 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.651924 26971 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.591909 26714 consensus_queue.cc:1059] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 13:11:55.705873 26966 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:11:55.705492 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:55.616461 26518 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.707273 26948 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:55.716488 26961 log.cc:927] Time spent T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.272s	user 0.004s	sys 0.000s
I20260709 13:11:55.717475 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:55.569159 26935 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:55.740386 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 152852us
I20260709 13:11:55.733150 26653 raft_consensus.cc:2764] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:11:55.635124 26775 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.108s
I20260709 13:11:55.703457 26964 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:55.709869 26963 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:55.748994 19339 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:55.652621 26833 raft_consensus.cc:2804] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:55.733340 26817 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:55.712634 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 79228.8us
I20260709 13:11:55.761188 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:55.760083 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.670382 26910 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.764092 26978 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:55.764775 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:55.750348 26714 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.797439 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:55.745080 26824 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:11:55.757813 26963 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.800020 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:55.756387 26964 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.767549 26251 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:55.750174 26948 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.737344 26938 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.822594 26251 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.823205 26251 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:55.767578 26833 raft_consensus.cc:697] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:55.824288 26948 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.812813 26904 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:55.813364 26969 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:55.815901 26917 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:55.816800 26888 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.837332 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.817382 26910 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.840837 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:55.840777 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:55.818104 26954 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.818687 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.821251 26935 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.822185 26963 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:55.826840 19224 raft_consensus.cc:2468] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:11:55.822549 26964 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:55.829631 26775 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.830008 26738 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:55.846957 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.848090 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.851693 19224 raft_consensus.cc:1217] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[17.9-23.12]   Dedup: 17.9->[19.10-23.12]
I20260709 13:11:55.803170 26714 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.805496 26978 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:55.908706 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 68018.4us
I20260709 13:11:55.909252 19223 raft_consensus.cc:1240] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:55.842965 26518 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:55.912760 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.914234 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.919656 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:55.920464 19296 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:55.902582 19224 pending_rounds.cc:85] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 9
I20260709 13:11:55.835796 26904 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.835160 26970 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:55.936457 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.937093 19368 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 14.
I20260709 13:11:55.938248 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.939667 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.932036 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:55.942225 19299 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:55.930673 19224 pending_rounds.cc:107] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:11:55.943737 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.901422 26910 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:55.831465 26833 consensus_queue.cc:237] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.910905 26978 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.943368 19224 raft_consensus.cc:2889] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:55.927155 26952 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:55.911840 26938 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:55.948124 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.935101 26738 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:55.970335 19296 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
W20260709 13:11:55.972352 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 115436us
I20260709 13:11:55.973469 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:55.975414 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:55.907426 26775 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.977077 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:55.986248 26990 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:55.961338 26978 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:55.986919 26990 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:55.987471 26990 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:55.959461 26910 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:55.993695 26910 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:55.994879 26942 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.583s	user 0.000s	sys 0.005s
W20260709 13:11:55.996306 26962 log.cc:927] Time spent T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:55.998746 26775 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.002460 26978 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.007017 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.007936 26980 raft_consensus.cc:3055] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:56.008569 26980 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:56.009655 26980 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 10, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.010840 26978 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.011301 26980 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:56.020354 26905 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.021221 26905 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:56.022017 26905 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:56.022419 26905 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:56.022863 26905 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:55.979388 26955 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:55.979628 26857 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:11:56.035086 26973 log.cc:927] Time spent T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:11:56.036247 26967 log.cc:927] Time spent T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:11:56.037336 26972 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:11:55.943470 26904 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.046806 26904 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:56.050851 26965 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:11:56.057502 26714 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.059836 26954 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.060849 26971 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.062633 26817 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:55.984726 26738 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.066928 26738 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.076877 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.078660 26822 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.081532 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.082547 19300 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:56.093667 26679 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.093806 26791 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.094398 26679 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.096809 26822 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.097339 26822 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.099326 26769 raft_consensus.cc:3055] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:56.099860 26769 raft_consensus.cc:740] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:56.102068 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.106491 19292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2865) took 1714 ms. Trace:
I20260709 13:11:56.106676 26991 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:56.106945 19292 rpcz_store.cc:276] 0709 13:11:54.392482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.392615 (+   133us) service_pool.cc:224] Handling call
0709 13:11:56.106276 (+1713661us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54003f16d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:56.106432 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84288384}
I20260709 13:11:56.107343 26991 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.109858 26991 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.110668 26786 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:56.111210 26786 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:56.111541 26817 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.113701 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.114459 19291 raft_consensus.cc:3060] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:11:56.119326 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.120177 19371 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:56.124606 19340 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:56.131784 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 228873us
I20260709 13:11:56.051450 26965 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:56.149556 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 174224us
I20260709 13:11:56.150616 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.103744 26822 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.151908 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.152899 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.156455 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:56.157073 19189 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.162367 26251 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.164368 26991 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.164413 26786 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.166440 26786 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.177989 26990 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.150920 26817 raft_consensus.cc:2804] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:56.182472 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.182740 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:56.183636 26679 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.239784 26679 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:56.240147 26679 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.240542 26679 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:56.242617 19219 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.243376 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47368 (request call id 3609) took 1719 ms. Trace:
I20260709 13:11:56.198791 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.201920 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:56.245733 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:56.211540 19366 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:11:56.252094 26679 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.260017 19191 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.264492 26857 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.264993 26995 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:56.265585 26995 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:56.265380 26857 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.268069 26679 leader_election.cc:290] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.268911 19894 raft_consensus.cc:3060] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:56.270792 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.268618 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.272635 26980 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:56.273957 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.274652 26925 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.275233 26935 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:56.275915 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.275565 26925 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.276743 26999 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:56.278466 26925 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.280522 26930 consensus_queue.cc:1048] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:56.283767 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.285782 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.286793 26941 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:56.288995 26935 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.289323 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:56.290625 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:56.199606 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.292217 19217 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:56.293458 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.294063 26935 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:56.226752 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.230849 26251 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.294739 26935 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.231680 19291 raft_consensus.cc:2468] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 26.
I20260709 13:11:56.297574 19369 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:56.232600 26964 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.225080 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.225253 26710 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:56.233120 26828 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.234411 26905 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.231333 19371 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:56.300369 26964 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.297240 26935 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:56.180130 26990 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.198894 26817 raft_consensus.cc:697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:56.209307 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:56.306304 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 97154.1us
I20260709 13:11:56.305764 26817 consensus_queue.cc:237] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.308450 19216 raft_consensus.cc:3060] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:56.309233 19337 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.227217 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.310673 26828 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:11:56.233672 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 80877us
I20260709 13:11:56.311977 19340 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:56.309988 26950 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:56.273958 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:56.239091 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56445.6us
I20260709 13:11:56.198361 26963 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.210180 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.317876 19365 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:56.318882 26963 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.190281 19225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3610) took 1652 ms. Trace:
I20260709 13:11:56.185532 26965 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.322350 19903 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 26: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:56.323436 26905 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.314801 26950 raft_consensus.cc:2804] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:56.324293 26950 raft_consensus.cc:697] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:56.325338 26950 consensus_queue.cc:237] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.326352 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.274758 26980 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.326604 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.327922 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:56.328246 26968 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.658s	user 0.001s	sys 0.003s
I20260709 13:11:56.295199 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:56.330171 19217 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:56.331104 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:56.332477 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.332741 19217 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:56.333613 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.334728 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.335701 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.337589 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.320765 19225 rpcz_store.cc:276] 0709 13:11:54.537506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.537971 (+   465us) service_pool.cc:224] Handling call
0709 13:11:54.600869 (+ 62898us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:55.086803 (+485934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.086845 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:55.090278 (+  3433us) log.cc:844] Serialized 52 byte log entry
0709 13:11:55.390757 (+300479us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:55.427296 (+ 36539us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.834503 (+407207us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.834766 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.189733 (+354967us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b540013ea54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:56.189802 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.189987 (+   185us) raft_consensus.cc:1685] finished
0709 13:11:56.190011 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.190203 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36813,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":599248,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":24388,"spinlock_wait_cycles":212956928,"thread_start_us":1047623,"threads_started":3,"wal-append.queue_time_us":315716}
I20260709 13:11:56.329355 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.300446 26710 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.332010 19337 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.246003 19373 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:11:56.343384 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.243817 19219 rpcz_store.cc:276] 0709 13:11:54.523703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.523896 (+   193us) service_pool.cc:224] Handling call
0709 13:11:56.241092 (+1717196us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54001568d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eaca3d 00007fe8dce7ccd0 00007fe8d6401254 00007fe8d64011e2 00007fe8d6401111 00007fe8d640108c 00007fe8d6400342 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:56.243256 (+  2164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284311808}
I20260709 13:11:56.331171 19898 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:56.355319 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.309953 19371 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:56.357847 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.358968 19292 raft_consensus.cc:2393] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 26: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:56.218995 19266 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:56.361083 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 142222us
I20260709 13:11:56.353838 19373 pending_rounds.cc:85] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting all ops after (but not including) 13
I20260709 13:11:56.362237 19373 pending_rounds.cc:107] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:11:56.362632 19373 raft_consensus.cc:2889] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:56.266057 26995 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:56.370518 26964 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:56.371675 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 59490.4us
I20260709 13:11:56.372926 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.374039 19217 raft_consensus.cc:2468] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
I20260709 13:11:56.396433 19366 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:56.387197 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.393138 19370 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:56.376515 19339 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.388826 19266 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.404915 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:56.405382 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.405550 19217 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:56.407119 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 61861.8us
I20260709 13:11:56.409564 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.411397 19373 raft_consensus.cc:2393] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 20: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:56.413184 19266 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.415153 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.415746 19894 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:56.416852 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.424786 26990 consensus_queue.cc:1059] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:56.425820 26990 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.426365 26990 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.427237 26943 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.427863 26943 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:56.431993 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55596.3us
I20260709 13:11:56.433090 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:56.373977 26831 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.403944 26848 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:56.442937 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:56.444989 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53568.5us
I20260709 13:11:56.445470 19266 leader_election.cc:304] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.446534 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.447359 19216 raft_consensus.cc:2468] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:11:56.447321 19225 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:56.438158 26833 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.405916 26980 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.449630 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.414649 26905 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.450538 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.429522 26857 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.434790 26943 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:56.437779 26999 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.440447 26991 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:56.437988 26965 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.431649 26825 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.437294 19217 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:56.412472 26880 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.475730 19365 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:11:56.476742 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:56.449220 26964 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.469950 26775 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:56.484771 19868 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.464854 26791 raft_consensus.cc:2749] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.496897 19265 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:56.464707 26982 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:56.506515 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.509127 26965 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.519105 26876 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:56.519621 26876 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Starting leader election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:56.519685 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.520365 26947 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.520591 26965 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.520995 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.520960 26947 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.521934 19217 raft_consensus.cc:2393] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:56.521412 26943 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:11:56.522718 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.522912 26943 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.523283 26947 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.481869 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.524827 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3595) took 2165 ms. Trace:
I20260709 13:11:56.524890 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:56.525612 19339 leader_election.cc:304] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:56.527629 26979 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:56.444581 26831 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.525305 19221 rpcz_store.cc:276] 0709 13:11:54.359100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.359268 (+   168us) service_pool.cc:224] Handling call
0709 13:11:54.359594 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.548554 (+188960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.548601 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:54.548673 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:54.548718 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.524596 (+1975878us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400156dd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:56.524639 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.524752 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433988480}
I20260709 13:11:56.530989 19221 raft_consensus.cc:1240] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:56.529536 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44905.6us
I20260709 13:11:56.534736 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:56.536034 19217 raft_consensus.cc:1240] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:56.536993 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.529155 19266 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.537518 19217 raft_consensus.cc:1275] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:56.493218 26849 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.493448 26604 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.482208 26990 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.545251 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.560770 19367 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:56.547492 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.547688 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.562242 19372 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
W20260709 13:11:56.548703 19218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.059s	sys 0.061s
I20260709 13:11:56.549485 19266 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.562505 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.497380 26857 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.546205 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.559185 26964 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:11:56.563241 26857 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.562268 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.566469 26857 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.562119 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.554478 19868 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.567312 26791 consensus_queue.cc:1059] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:56.568418 26964 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:56.569389 26857 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.559466 26936 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.559358 26880 consensus_queue.cc:1059] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:11:56.571844 26880 raft_consensus.cc:3055] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:56.572201 26880 raft_consensus.cc:740] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:56.573284 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:56.572991 26880 consensus_queue.cc:260] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.575585 19222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1061) took 1528 ms. Trace:
I20260709 13:11:56.575695 26880 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:56.580950 26710 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.529235 26982 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:56.582449 26982 raft_consensus.cc:3060] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:56.548413 26920 raft_consensus.cc:2804] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:56.588285 19266 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:56.549029 26804 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:56.588721 26920 raft_consensus.cc:697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:56.589236 26804 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:56.589890 26804 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:56.589818 26920 consensus_queue.cc:237] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.591017 26825 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:56.546066 26965 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:56.589078 19222 rpcz_store.cc:276] 0709 13:11:55.047253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.073476 (+ 26223us) service_pool.cc:224] Handling call
0709 13:11:55.073828 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.097374 (+ 23546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.097421 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.097481 (+    60us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:55.097527 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.575395 (+1477868us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54000762d4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:56.575436 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.575536 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53588864}
I20260709 13:11:56.592563 26965 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.592927 26959 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:56.493793 26999 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.593477 26959 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:56.594439 26959 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.538219 26955 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.595501 26955 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.588708 26880 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.597481 26955 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.594858 19222 raft_consensus.cc:1275] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:56.496783 26991 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.600529 26991 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.533622 26876 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:56.542534 26339 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.608628 19225 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 23. Current term is 24. Ops: []
W20260709 13:11:56.570256 19218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.059s	sys 0.062s
I20260709 13:11:56.545523 26979 raft_consensus.cc:2804] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:56.497500 26980 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.619593 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.622017 26980 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.595047 26999 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.593010 26965 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:56.557950 26820 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.627245 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.629586 19371 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 18.
I20260709 13:11:56.540518 26775 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.635815 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.638841 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.636700 19367 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:56.637501 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.638509 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.640061 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.641125 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.644917 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.645543 19296 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:56.649578 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.657819 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.658397 19367 raft_consensus.cc:3060] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.659005 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:56.660779 19366 raft_consensus.cc:1240] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:11:56.663095 19292 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:11:56.630745 26979 raft_consensus.cc:697] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:56.664708 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.665055 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.669870 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.670794 19292 raft_consensus.cc:2368] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:56.671974 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:56.634234 26994 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:56.672624 19374 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:56.673322 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:56.679868 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.682365 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.697556 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:56.698490 19291 raft_consensus.cc:3055] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:56.698886 19291 raft_consensus.cc:740] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:56.709050 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.711025 19894 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:56.643810 26999 consensus_queue.cc:1059] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:11:56.719955 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.716351 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.722609 19367 raft_consensus.cc:2468] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:11:56.728137 19298 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:56.729935 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.733506 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.731297 19291 consensus_queue.cc:260] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.737016 19291 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:56.739042 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.740257 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.741376 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.745714 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.748798 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.699842 26994 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.750983 26604 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:56.760864 26786 consensus_meta.cc:287] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 13:11:56.762784 19216 raft_consensus.cc:2410] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:11:56.763216 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.734555 26417 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:11:56.770901 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.775522 26980 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.759434 26769 consensus_queue.cc:260] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.776203 26980 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.776661 26769 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.778754 26980 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.788755 19291 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:56.802536 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3621) took 1202 ms. Trace:
I20260709 13:11:56.803066 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.752508 26985 raft_consensus.cc:3055] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:56.804417 19298 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:56.803069 19220 rpcz_store.cc:276] 0709 13:11:55.600308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.600420 (+   112us) service_pool.cc:224] Handling call
0709 13:11:55.600694 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.670043 (+ 69349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.670073 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.670116 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:55.670150 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.802178 (+1132028us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54001c3754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:56.802271 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.802467 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159065344}
I20260709 13:11:56.802027 26943 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.808151 26990 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:56.807596 26980 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:56.807546 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.811610 26980 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.816715 26775 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:56.821398 26831 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.733448 26935 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.815810 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.828806 19220 raft_consensus.cc:1275] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:56.835014 19293 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:56.807035 26985 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:56.838562 19291 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:56.838907 19191 leader_election.cc:400] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
I20260709 13:11:56.843283 19191 leader_election.cc:403] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:56.845861 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.847263 26417 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:56.865094 26417 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:56.865556 26417 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:56.866040 26980 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:56.866514 26417 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.848251 26935 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:56.867919 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.848713 26985 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.836102 26775 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:56.850634 26831 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:56.871598 19292 raft_consensus.cc:1240] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:56.765782 26979 consensus_queue.cc:237] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:56.851660 26876 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.858922 26943 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985) with higher term. Message: Invalid argument: T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 19. Current term is 20.
W20260709 13:11:56.879509 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 210223us
I20260709 13:11:56.870430 26417 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:56.904340 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.916345 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:56.922495 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44406.4us
I20260709 13:11:56.930768 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.873756 26985 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:56.934262 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.938021 19191 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:56.944947 19191 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:56.950620 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.922513 26980 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:56.882929 26983 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:56.924688 26920 raft_consensus.cc:493] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:56.935195 26943 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:56.969856 19223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 3003) took 1484 ms. Trace:
I20260709 13:11:56.973162 19219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3629) took 1370 ms. Trace:
I20260709 13:11:56.973122 19223 rpcz_store.cc:276] 0709 13:11:55.485054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.485966 (+   912us) service_pool.cc:224] Handling call
0709 13:11:55.500480 (+ 14514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.909628 (+409148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.969610 (+1059982us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540013db54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:56.969792 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939661568}
I20260709 13:11:56.973610 19219 rpcz_store.cc:276] 0709 13:11:55.602863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.410713 (+807850us) service_pool.cc:224] Handling call
0709 13:11:56.411061 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.623450 (+212389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.623484 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.623528 (+    44us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:56.623561 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.972954 (+349393us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001c4654. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:56.973000 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.973113 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":487975168}
I20260709 13:11:56.974553 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:56.971109 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:56.960379 26769 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:56.979982 26769 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:56.980813 26769 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:56.985507 27009 log.cc:927] Time spent T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:56.942236 26775 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.991724 26925 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:56.993278 26876 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 29 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:56.996644 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:56.960338 26710 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:56.998142 26710 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:56.998980 26710 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:57.010478 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.023512 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:57.024289 19374 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:56.922019 26804 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:56.944571 26773 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.075s
W20260709 13:11:57.017107 27004 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:11:57.009809 26990 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:57.040447 19903 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:57.030644 26775 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:56.972353 26920 raft_consensus.cc:515] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.005627 26983 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.039549 26990 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.042250 26339 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:57.096462 26831 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:57.097151 26831 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.099290 26831 leader_election.cc:290] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:57.101346 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.082161 26943 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:57.102115 26943 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.110397 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:57.111430 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.113158 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:57.115336 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:57.115559 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:57.115969 19293 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:57.118017 26833 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:57.118436 26833 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:57.120875 26339 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.093168 26775 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.125281 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.127535 26775 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:57.131235 26855 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:57.131821 26855 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.135370 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:57.136009 19223 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:57.137627 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:57.133946 26855 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:57.115336 19292 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 29 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 28. Current term is 29. Ops: []
I20260709 13:11:57.089376 26990 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:57.147709 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 29.
I20260709 13:11:57.149020 19366 raft_consensus.cc:1240] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 28. Current term is 29. Ops: []
W20260709 13:11:57.156466 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 218740us
I20260709 13:11:57.161481 19897 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1369) took 1624 ms. Trace:
I20260709 13:11:57.163105 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:57.164042 19223 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:57.161968 19897 rpcz_store.cc:276] 0709 13:11:55.536812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.536942 (+   130us) service_pool.cc:224] Handling call
0709 13:11:55.537329 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.585116 (+ 47787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.585173 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.585731 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.759739 (+174008us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:56.147717 (+387978us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.188059 (+ 40342us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b1800379e40. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4dc83f3 00007fe8d4dca7c1 00007fe8d4dca779 00007fe8d4dca709 00007fe8d4dca6d1 00007fe8d4dc99cd 000000000038f354 000000000038f199 00007fe8d4dab83a
0709 13:11:56.286474 (+ 98415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.161085 (+874611us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400560254. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:57.161159 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.161230 (+    71us) raft_consensus.cc:1685] finished
0709 13:11:57.161249 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.161415 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147624,"prepare.queue_time_us":44112,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":152354,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":12347,"spinlock_wait_cycles":49849472,"thread_start_us":458375,"threads_started":2,"wal-append.queue_time_us":231298}
I20260709 13:11:57.165298 19291 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:57.165174 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:57.119349 26833 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.168795 19216 raft_consensus.cc:1275] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:57.170933 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:57.176972 19223 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:57.177496 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:57.182060 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:57.182916 19223 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:57.173475 26855 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:57.189383 26855 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:57.189816 26855 raft_consensus.cc:3060] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:57.160181 26935 consensus_queue.cc:1048] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260709 13:11:57.170732 26775 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:57.192720 27003 log.cc:927] Time spent T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: Append to log took a long time: real 0.481s	user 0.004s	sys 0.000s
I20260709 13:11:57.193512 26925 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:57.193977 26925 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.194346 26925 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:57.197023 27013 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:57.198930 26804 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.200534 19222 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:57.201263 19218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3622) took 1600 ms. Trace:
I20260709 13:11:57.201651 19218 rpcz_store.cc:276] 0709 13:11:55.601078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.816662 (+215584us) service_pool.cc:224] Handling call
0709 13:11:55.817070 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.616956 (+799886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.617001 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.626661 (+  9660us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.882687 (+256026us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:56.882770 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.885715 (+  2945us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.201034 (+315319us) raft_consensus.cc:1685] finished
0709 13:11:57.201056 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.201206 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21569,"raft.queue_time_us":150779,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3156,"thread_start_us":1019068,"threads_started":2,"wal-append.queue_time_us":453080}
W20260709 13:11:57.204553 26982 consensus_meta.cc:287] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.002s
I20260709 13:11:57.204980 26982 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.207158 26982 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:57.207302 26920 leader_election.cc:290] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:57.210129 19339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.210363 26952 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:57.217257 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.217908 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:57.218262 26995 consensus_meta.cc:287] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.000s
I20260709 13:11:57.218804 19298 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:11:57.218683 26995 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.159818 26994 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.219691 26822 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:57.219825 19221 raft_consensus.cc:1240] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:57.219944 27019 consensus_queue.cc:1059] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:57.220708 26822 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.221170 27019 consensus_queue.cc:1048] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:57.221428 26964 raft_consensus.cc:3055] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:57.221848 26964 raft_consensus.cc:740] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:57.222826 26822 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:57.222644 26964 consensus_queue.cc:260] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.219767 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.223336 26978 raft_consensus.cc:3055] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:57.223933 26978 raft_consensus.cc:740] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:57.220314 26950 consensus_queue.cc:1048] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:11:57.225179 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:57.225937 19291 raft_consensus.cc:2393] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 24: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:57.227057 26773 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:57.228972 26833 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:57.223384 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.224900 26978 consensus_queue.cc:260] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.230671 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.168226 26943 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.223856 26964 raft_consensus.cc:3060] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:57.216046 26965 consensus_meta.cc:287] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 13:11:57.176620 19869 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:57.253557 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 77046us
I20260709 13:11:57.255510 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:57.260305 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:57.253123 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 84423.4us
I20260709 13:11:57.271872 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:57.276780 19291 raft_consensus.cc:1275] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:11:57.370523 19190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.384670 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:57.385784 19899 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37398 (request call id 1099) took 1094 ms. Trace:
I20260709 13:11:57.386763 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.394761 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:57.396736 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.400573 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.402129 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.386174 19899 rpcz_store.cc:276] 0709 13:11:56.291176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.384318 (+1093142us) service_pool.cc:224] Handling call
0709 13:11:57.385709 (+  1391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.262277 26804 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:57.262003 26930 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:11:57.244485 26965 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.270054 26963 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:57.427917 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 75830.3us
I20260709 13:11:57.269583 26978 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:57.431674 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.469120 26855 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.471618 26855 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:57.472239 26855 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:57.473188 19897 raft_consensus.cc:1240] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:57.482843 26948 raft_consensus.cc:3055] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:11:57.483491 26948 raft_consensus.cc:740] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:57.283509 26820 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:57.488288 19900 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:57.492525 19896 raft_consensus.cc:1240] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:57.518239 19902 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 19.
I20260709 13:11:57.275118 26876 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.213s
I20260709 13:11:57.532773 26995 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:57.534739 26965 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.535514 26948 consensus_queue.cc:260] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.539120 19221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1074) took 1104 ms. Trace:
I20260709 13:11:57.544185 26965 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.545123 26965 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.547972 26965 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.538576 26925 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.557173 26925 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:57.551926 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.553530 27021 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.368s	user 0.002s	sys 0.008s
I20260709 13:11:57.554698 26952 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:57.539628 19221 rpcz_store.cc:276] 0709 13:11:56.435402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.767850 (+332448us) service_pool.cc:224] Handling call
0709 13:11:56.768139 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.220578 (+452439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.538812 (+318234us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54001b1f54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:57.539049 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036419328}
I20260709 13:11:57.614153 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:57.612452 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:57.610805 26828 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:57.626150 26828 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:57.630893 19217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.029s	sys 0.035s
W20260709 13:11:57.634423 19217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.029s	sys 0.035s
I20260709 13:11:57.635269 19217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47354 (request call id 3029) took 1310 ms. Trace:
I20260709 13:11:57.640429 19898 raft_consensus.cc:1275] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:11:57.638187 26925 consensus_queue.cc:1059] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:11:57.650096 26925 raft_consensus.cc:3055] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:57.650612 26925 raft_consensus.cc:740] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:57.653215 26339 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.653975 26828 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:57.663246 19222 raft_consensus.cc:2468] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 17.
I20260709 13:11:57.636868 19217 rpcz_store.cc:276] 0709 13:11:56.324698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.665753 (+341055us) service_pool.cc:224] Handling call
0709 13:11:56.717584 (+ 51831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.717794 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:57.036638 (+318844us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.634950 (+598312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.635001 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:57.635042 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.635106 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.635219 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243316,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":2182,"thread_start_us":885121,"threads_started":2}
I20260709 13:11:57.651793 26925 consensus_queue.cc:260] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.670783 26925 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:57.637343 26999 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:57.696151 19188 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.677651 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37370 (request call id 1379) took 1097 ms. Trace:
I20260709 13:11:57.699084 19903 rpcz_store.cc:276] 0709 13:11:56.580547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.581127 (+   580us) service_pool.cc:224] Handling call
0709 13:11:56.581453 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.047911 (+466458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.677385 (+629474us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b5400780fd4. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb5e01 00007fe8d7eb483e 00007fe8dce79419 00007fe8d63f0bd4 00007fe8d63f0b62 00007fe8d63f0a91 00007fe8d63f0a0c 00007fe8d63efcc2 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:11:57.677583 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050206080}
I20260709 13:11:57.703639 19291 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:57.704313 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:57.705576 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.689859 19366 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:11:57.706709 19300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.017s	sys 0.016s
I20260709 13:11:57.707064 19188 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.690197 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:11:57.707027 19300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.017s	sys 0.016s
I20260709 13:11:57.708889 19374 raft_consensus.cc:2393] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:11:57.673420 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:57.693935 19373 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:57.712647 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:57.713443 19291 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:57.716636 19295 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:57.693161 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.718255 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:57.718498 19188 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.719247 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.720731 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:57.684083 19868 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:57.725025 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:57.725267 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:57.725550 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.726243 19370 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
W20260709 13:11:57.726928 19264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.725921 19295 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:11:57.728868 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2348394564c140f3aec293661379e650" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:11:57.729585 19339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.028s
W20260709 13:11:57.730041 19339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.011s	sys 0.028s
W20260709 13:11:57.730341 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 512915us
I20260709 13:11:57.731353 19339 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:57.726999 19296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.060s
W20260709 13:11:57.732795 19296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.010s	sys 0.060s
I20260709 13:11:57.733719 19188 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.744566 19291 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 24.
I20260709 13:11:57.746045 19188 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:11:57.747141 19297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.049s	sys 0.024s
W20260709 13:11:57.747684 19297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.049s	sys 0.025s
W20260709 13:11:57.722649 26979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.024s	sys 0.043s
I20260709 13:11:57.672107 26983 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:57.725304 26869 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:57.759565 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:57.676273 27018 consensus_queue.cc:1048] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.081s
W20260709 13:11:57.756500 26979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.024s	sys 0.044s
I20260709 13:11:57.763541 19339 leader_election.cc:304] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.732957 26963 raft_consensus.cc:2804] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:57.721606 26947 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:57.749080 26848 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:57.730461 26965 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:57.732822 26835 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:57.745143 26824 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:57.761657 26710 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:57.776957 26990 consensus_meta.cc:287] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 13:11:57.785739 19225 raft_consensus.cc:1275] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:57.758241 26995 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:57.781244 19266 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:57.762858 19224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.015s	sys 0.035s
I20260709 13:11:57.798849 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:57.808640 19224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.016s	sys 0.035s
I20260709 13:11:57.800415 19896 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 15.
I20260709 13:11:57.798812 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:57.773309 26983 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:57.800495 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:57.809734 19224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3624) took 2208 ms. Trace:
I20260709 13:11:57.811964 19374 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:57.812788 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.784616 26952 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:57.814286 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:57.816543 19373 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:11:57.815977 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.784138 26963 raft_consensus.cc:697] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:57.818392 19224 rpcz_store.cc:276] 0709 13:11:55.601610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.850700 (+249090us) service_pool.cc:224] Handling call
0709 13:11:55.851470 (+   770us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:11:56.406121 (+554651us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:56.773060 (+366939us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.175297 (+402237us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:57.187522 (+ 12225us) log.cc:844] Serialized 78 byte log entry
0709 13:11:57.187676 (+   154us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:57.187899 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.188193 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.573476 (+385283us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b4800080058. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:11:57.649608 (+ 76132us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b4800080058. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8dcddeaa1 00007fe8dcdd5b37 00007fe8dcdd59ca 00007fe8dcecd26f 00007fe8dceccf37 00007fe8dcee155c 00007fe8dcee1508 00007fe8dcee1488 00007fe8dcee1443 00007fe8dcee06ec 00007fe8dbe0aa96
0709 13:11:57.809219 (+159611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.809365 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.809435 (+    70us) raft_consensus.cc:1685] finished
0709 13:11:57.809457 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.809659 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580726,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":2128,"raft.queue_time_us":58209,"raft.run_cpu_time_us":25514,"raft.run_wall_time_us":894387,"spinlock_wait_cycles":193762816,"thread_start_us":1752603,"threads_started":4,"wal-append.queue_time_us":865558}
I20260709 13:11:57.767894 26817 consensus_queue.cc:1048] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:11:57.834750 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:57.837141 19369 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:57.837081 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:57.835613 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:57.835289 19368 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:57.838141 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:57.843590 19866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.013s	sys 0.036s
W20260709 13:11:57.844548 19866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.013s	sys 0.037s
I20260709 13:11:57.847443 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:57.860298 19223 raft_consensus.cc:2468] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:57.788403 26878 consensus_queue.cc:1048] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.049s
I20260709 13:11:57.817803 26983 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:57.774844 26994 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:11:57.815078 26998 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:57.817564 26947 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:57.862951 19188 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:57.889686 19369 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 24.
I20260709 13:11:57.844025 26710 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:57.880574 19869 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.042s
I20260709 13:11:57.795207 26828 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:11:57.896370 26828 consensus_queue.cc:1243] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:11:57.892961 19869 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.043s
W20260709 13:11:57.899240 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 621564us
I20260709 13:11:57.903961 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:57.904847 19295 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:57.910727 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:57.880115 26965 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:11:57.913357 26965 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:57.913826 26965 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.914191 26965 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:57.895829 19339 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:57.917268 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:57.917804 26952 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:57.918150 19295 raft_consensus.cc:2393] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 17: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:57.893133 26824 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:11:57.925333 26824 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:57.925953 26824 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:57.927093 26824 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:57.930176 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:57.815802 26990 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:57.880585 26995 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:57.936354 19339 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:11:57.889039 26983 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:57.980677 19219 raft_consensus.cc:2368] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:57.881155 26978 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 13:11:57.982065 26417 raft_consensus.cc:2804] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:57.996274 27017 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:58.005733 26417 raft_consensus.cc:697] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:58.009414 27041 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:58.017525 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61108.9us
I20260709 13:11:58.021308 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:57.988546 26963 consensus_queue.cc:237] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:58.030707 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 235390us
W20260709 13:11:58.020576 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 173194us
I20260709 13:11:58.033026 26750 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.033552 26791 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:58.034752 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 253576us
I20260709 13:11:58.035194 26835 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:11:58.035722 26920 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.037734 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:58.039400 26831 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:11:58.039857 27030 log.cc:927] Time spent T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:11:58.040745 19900 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:11:58.046681 26965 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.050062 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.018103 27042 consensus_queue.cc:1059] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:11:58.088346 19266 leader_election.cc:304] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:58.054054 26983 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.054525 19297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2923) took 1046 ms. Trace:
I20260709 13:11:58.055240 26990 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.055148 26417 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:58.058931 27036 log.cc:927] Time spent T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:11:58.059229 26820 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:58.065917 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:58.070281 19265 leader_election.cc:400] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:58.140710 19265 leader_election.cc:403] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.071624 26750 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.072857 26791 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.018479 27017 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.148993 19223 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:58.099103 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:58.078804 26831 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:11:58.139410 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.099880 19297 rpcz_store.cc:276] 0709 13:11:57.008114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.009000 (+   886us) service_pool.cc:224] Handling call
0709 13:11:57.009339 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.014849 (+  5510us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:57.014898 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.015497 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:11:57.749487 (+733990us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:57.749545 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.749632 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:58.054322 (+304690us) raft_consensus.cc:1685] finished
0709 13:11:58.054343 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.054472 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9084,"raft.queue_time_us":6037,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10370,"thread_start_us":709541,"threads_started":1,"wal-append.queue_time_us":956741}
I20260709 13:11:58.025626 27041 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.140718 19373 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:58.136842 27054 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:11:58.138638 27033 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:11:58.153286 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56609.4us
I20260709 13:11:58.084108 26876 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:11:58.138247 26835 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 29 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:58.138355 26829 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
W20260709 13:11:58.143057 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 78942.7us
I20260709 13:11:58.138095 26878 raft_consensus.cc:2749] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:58.139887 26964 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:11:58.136175 26999 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:11:58.084450 26920 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.172819 26604 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:11:58.179373 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 80340.1us
I20260709 13:11:58.179523 19191 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:11:58.181008 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 92747.8us
I20260709 13:11:58.181879 26930 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:58.221985 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.230913 26773 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:58.231562 26773 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.233875 26773 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:58.235766 19900 raft_consensus.cc:1240] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:58.181051 26339 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:11:58.204332 26950 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:58.237957 19373 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:58.223609 26848 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:58.180861 27054 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.193893 26829 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.217756 26824 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:11:58.250993 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65499.6us
W20260709 13:11:58.254127 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 114829us
I20260709 13:11:58.284282 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.291951 26791 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:58.294942 27045 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:58.296293 19220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47368 (request call id 3640) took 1721 ms. Trace:
I20260709 13:11:58.284961 27065 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:58.298285 27065 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.298672 27065 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:58.296718 19220 rpcz_store.cc:276] 0709 13:11:56.575117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.839171 (+264054us) service_pool.cc:224] Handling call
0709 13:11:56.840042 (+   871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.840413 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.840452 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:56.840884 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:11:57.640739 (+799855us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b1800228e20. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8d4daae07 00007fe8ddc05ab9 00007fe8d4dc769b 00007fe8d4dc593f 00007fe8d4dc7c02 00007fe8d7a4f20b 00007fe8d7a54d23 00007fe8d7a550d1 00007fe8d7e70a0f
0709 13:11:58.026755 (+386016us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:58.026795 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.026868 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:58.295980 (+269112us) raft_consensus.cc:1685] finished
0709 13:11:58.296003 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:58.296233 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8997,"spinlock_wait_cycles":6421888,"thread_start_us":385839,"threads_started":1,"wal-append.queue_time_us":1321010}
I20260709 13:11:58.262508 26824 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:58.247562 26848 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.252861 26869 consensus_queue.cc:1059] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:11:58.255036 26876 consensus_queue.cc:1048] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:11:58.325356 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 153480us
W20260709 13:11:58.330703 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45349.4us
I20260709 13:11:58.346146 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:58.296468 26750 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.356590 26824 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.359396 27054 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.289125 27042 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:11:58.360230 27046 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:11:58.360528 27017 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.360846 26983 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:58.301442 26965 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:58.361474 27058 log.cc:927] Time spent T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:11:58.330850 27060 log.cc:927] Time spent T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:11:58.361846 26990 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:58.362592 26990 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.365564 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:11:58.365744 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.367157 26965 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.367733 26965 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:11:58.368644 27052 log.cc:927] Time spent T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:11:58.369989 26965 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.370167 26990 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:58.370442 27047 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:11:58.373296 27065 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.375763 27065 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.237854 26831 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:58.405179 27062 log.cc:927] Time spent T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:11:58.408953 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 63221.3us
I20260709 13:11:58.412954 27041 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.414762 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.415369 27065 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.415871 27065 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.418732 27065 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.419502 19300 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 9 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:58.250845 26835 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.425005 19292 raft_consensus.cc:1275] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:58.428181 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.429427 26848 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.429903 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.430917 26829 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:58.431838 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:58.432588 19222 raft_consensus.cc:2368] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:58.432711 26831 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:58.370064 27053 log.cc:927] Time spent T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:11:58.438604 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.438652 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.439431 19219 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:58.439913 19220 raft_consensus.cc:2410] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:11:58.360265 27042 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.442057 27042 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.442533 27042 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.425057 26920 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:58.447053 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.449739 19897 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:11:58.449955 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:58.451014 19866 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.442983 27042 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.460368 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:58.462630 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.456751 19222 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:58.464679 27041 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:58.468060 26941 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:58.469553 26920 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.469650 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.470202 26920 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.472465 26876 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.472942 26876 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.474926 26876 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.475605 26920 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.477779 26941 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:58.481173 27070 consensus_queue.cc:1059] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:58.483007 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.483431 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.485074 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.485877 19219 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:58.506913 26604 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 22. Current term is 23.
I20260709 13:11:58.511448 27042 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.515872 26604 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.516619 26604 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.519760 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.522274 26604 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:58.556819 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 286268us
I20260709 13:11:58.559978 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:58.560807 26869 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:58.561717 26990 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:58.568147 26965 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:58.570094 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:58.571542 26990 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:58.586098 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:58.586211 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:58.586885 19897 raft_consensus.cc:2393] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 19: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:11:58.587297 19900 raft_consensus.cc:2393] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 15: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:58.593940 19300 raft_consensus.cc:1275] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:58.595641 26941 consensus_queue.cc:1048] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:58.615811 27074 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:11:58.616796 26959 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.617664 26959 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.618392 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:58.618660 26963 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.619216 26963 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.619899 26959 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.621722 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.622242 26963 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.622731 19221 raft_consensus.cc:2410] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:11:58.625639 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.625746 19300 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:11:58.626442 19221 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:58.627292 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:58.627838 19296 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:58.629554 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:11:58.632500 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.633762 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.638161 19191 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:58.639245 26990 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:58.640314 26990 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:58.641448 26990 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.645021 19296 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:58.656706 27018 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.657258 27018 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.658150 26833 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:58.658878 26833 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.659514 27018 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:58.661134 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:58.661609 26833 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.661698 19370 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:58.662376 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.663878 19373 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:58.669225 26950 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:58.669821 26950 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.673630 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.674830 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.674983 19373 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:58.675450 19374 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
W20260709 13:11:58.678462 19337 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.682703 27027 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.683228 27027 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.696754 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.697482 19365 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:58.700976 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.702291 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.707074 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.707576 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.707692 19367 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:11:58.708599 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.708765 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.710273 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:58.717988 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:58.719298 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.723740 27011 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.724195 26950 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.737226 27011 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.741338 27011 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.746968 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.747673 19265 leader_election.cc:400] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:58.748047 19265 leader_election.cc:403] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.748699 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:58.749550 19265 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:58.750687 26251 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875) with higher term. Message: Invalid argument: T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for earlier term 21. Current term is 22.
I20260709 13:11:58.751691 26251 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:58.750700 26994 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:58.752326 26994 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.752665 26994 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.752708 26925 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:58.753475 26925 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:58.753798 26925 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.754289 26925 raft_consensus.cc:3060] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:58.761289 19900 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:58.726258 27027 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.762522 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:58.764086 26710 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:58.760895 26830 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:58.765800 26830 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:58.766220 26830 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:58.767127 26830 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:58.768685 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 49463.1us
I20260709 13:11:58.775086 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.776000 26930 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:58.776455 26930 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:58.776907 26930 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:58.778936 27057 log.cc:927] Time spent T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.528s	user 0.000s	sys 0.011s
I20260709 13:11:58.786741 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.788694 26830 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.792212 26995 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:11:58.792753 26995 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:58.794046 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 44821.5us
I20260709 13:11:58.794790 26995 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:58.798521 19370 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 22.
I20260709 13:11:58.799746 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:58.800673 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:58.806258 26950 consensus_queue.cc:1048] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:58.806711 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.803740 26994 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.810972 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:58.811520 19217 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:58.811550 26985 raft_consensus.cc:3055] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:58.812034 26985 raft_consensus.cc:740] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:11:58.812821 26985 consensus_queue.cc:260] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.814280 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.817559 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.818825 26985 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:58.820423 19217 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:58.830322 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:11:58.830585 26994 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.830495 19118 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 15 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.838667 26880 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:58.839174 26880 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:58.840009 26880 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:58.845438 26948 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:58.852837 26925 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.854105 27039 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Committing config change with OpId 19.15: config changed from index 9 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:58.950537 26925 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:11:58.858358 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 57788.8us
I20260709 13:11:58.952746 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:58.862195 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.863863 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.955379 19220 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:11:58.956727 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:58.957533 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:58.866812 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.960196 26930 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.867781 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:11:58.964481 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 47662.1us
I20260709 13:11:58.868929 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.969602 19224 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 20: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:11:58.875699 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.877275 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.880041 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:58.881924 19300 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:58.886250 19118 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:58.972535 26831 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:58.972903 19118 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:58.888018 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:58.896821 19223 raft_consensus.cc:1217] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Deduplicated request from leader. Original: 18.13->[19.14-21.16]   Dedup: 19.14->[19.15-21.16]
I20260709 13:11:58.977126 19223 pending_rounds.cc:85] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Aborting all ops after (but not including) 14
I20260709 13:11:58.977414 19223 pending_rounds.cc:107] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:11:58.977671 19223 raft_consensus.cc:2889] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.917601 27068 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:58.979313 27068 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:11:58.928393 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 291244us
I20260709 13:11:58.982929 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:58.985342 27068 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:58.985996 26990 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:58.992671 26930 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:58.993434 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:58.993822 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:58.994659 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
W20260709 13:11:58.997349 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 253) took 23002 ms (client timeout 15000 ms). Trace:
I20260709 13:11:58.997591 26869 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:58.998410 26869 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:58.998863 26869 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
W20260709 13:11:58.997759 19117 rpcz_store.cc:269] 0709 13:11:35.994894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.831155 (+1836261us) service_pool.cc:224] Handling call
0709 13:11:58.997267 (+21166112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:52.843035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:52.843694 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:52.843742 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:52.843760 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:52.845823 (+  2063us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:52.845938 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:52.845975 (+    37us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:11:52.854719 (+  8744us) tablet.cc:701] Row locks acquired
0709 13:11:52.854775 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:11:52.854932 (+   157us) write_op.cc:270] Start()
0709 13:11:52.855084 (+   152us) write_op.cc:276] Timestamp: P: 1783602712854874 usec, L: 0
0709 13:11:52.855123 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:11:53.164355 (+309232us) log.cc:844] Serialized 10725 byte log entry
0709 13:11:54.260488 (+1096133us) op_driver.cc:464] REPLICATION: finished
0709 13:11:54.394299 (+133811us) write_op.cc:301] APPLY: starting
0709 13:11:54.394437 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:55.284075 (+889638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:55.284295 (+   220us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:56.166881 (+882586us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:56.167337 (+   456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:11:56.167398 (+    61us) write_op.cc:312] APPLY: finished
0709 13:11:56.167915 (+   517us) log.cc:844] Serialized 236 byte log entry
0709 13:11:56.538813 (+370898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:56.584785 (+ 45972us) write_op.cc:454] Released schema lock
0709 13:11:56.584889 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:56.585460 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:56.585490 (+    30us) write_op.cc:454] Released schema lock
0709 13:11:57.192145 (+606655us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4ceec85 00007fe8d4cef6a2 00007fe8d7a611db 00007fe8d7a5caaf 00007fe8d7a5086e 00007fe8d7a4fbb6 00007fe8d7a4f7d8 00007fe8d7a59221 00007fe8d7a591d9 00007fe8d7a59169
Metrics: {"mutex_wait_us":2891378,"reported_tablets":51,"spinlock_wait_cycles":8064,"child_traces":[["op",{"apply.queue_time_us":133417,"apply.run_cpu_time_us":71456,"apply.run_wall_time_us":2191177,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116879,"num_ops":27,"prepare.queue_time_us":239171,"prepare.run_cpu_time_us":40922,"prepare.run_wall_time_us":860963,"raft.queue_time_us":93694,"raft.run_cpu_time_us":27956,"raft.run_wall_time_us":133478,"replication_time_us":1405139,"spinlock_wait_cycles":71405952,"thread_start_us":1074505,"threads_started":5,"wal-append.queue_time_us":1180741,"wal-append.run_cpu_time_us":31138,"wal-append.run_wall_time_us":2836607}]]}
I20260709 13:11:59.013779 19903 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 29.
I20260709 13:11:58.929937 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:58.937544 26259 raft_consensus.cc:3055] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:59.016180 26259 raft_consensus.cc:740] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:11:59.017117 26259 consensus_queue.cc:260] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.018152 26259 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:59.018676 19365 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:11:58.939801 19898 raft_consensus.cc:1240] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:11:59.019913 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:59.020843 27042 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:58.999692 26869 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:59.021521 27042 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:59.022485 27042 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.026984 19369 raft_consensus.cc:2468] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
I20260709 13:11:59.028285 19869 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:11:59.029284 26820 raft_consensus.cc:2804] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:59.029878 26820 raft_consensus.cc:697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:11:59.030709 19896 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:11:59.030825 26820 consensus_queue.cc:237] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:58.975507 19118 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 18, now has a pending config: VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194), VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 18 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.043989 19118 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 19, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 19 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.035655 26259 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:11:58.929488 26417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.004s	sys 0.011s
W20260709 13:11:59.074935 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 122268us
I20260709 13:11:59.081825 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:59.070977 19118 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.044996 19903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37382 (request call id 1264) took 1342 ms. Trace:
I20260709 13:11:59.098630 19903 rpcz_store.cc:276] 0709 13:11:57.702582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.717997 (+ 15415us) service_pool.cc:224] Handling call
0709 13:11:59.030222 (+1312225us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54006a5c54. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb92fa 00007fe8dce7ab17 00007fe8d63f56d4 00007fe8d63f5662 00007fe8d63f5591 00007fe8d63f550c 00007fe8d63f47c2 00007fe8d61f048c 00007fe8d61ef8c6 00007fe8d61ef26f
0709 13:11:59.044925 (+ 14703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2961404288}
W20260709 13:11:59.074249 26417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.004s	sys 0.012s
W20260709 13:11:59.088550 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 112384us
I20260709 13:11:59.089181 19118 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 17 to 19, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 19 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.103655 19118 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 19 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.105194 19118 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 18 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.107028 19118 catalog_manager.cc:5697] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.108397 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:11:59.109258 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 116906us
I20260709 13:11:59.082079 19900 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 9 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.117985 19266 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:59.118077 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:59.121488 19220 raft_consensus.cc:2393] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:59.124418 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:59.125099 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:11:59.126946 19219 raft_consensus.cc:2393] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 24: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:11:59.125685 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:59.087525 26848 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:59.130827 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:59.142419 19369 raft_consensus.cc:1275] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:11:59.143563 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:11:59.144116 19365 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:59.142058 19118 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 14 to 15, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 15 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:59.149612 19118 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 19 to 20, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 20 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.151371 19365 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:11:59.149931 19339 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:59.160825 19118 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.108594 26817 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:11:59.168486 19118 catalog_manager.cc:5697] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 18, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 18 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:59.166795 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:11:59.173959 19266 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:59.147032 26936 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:59.147217 26830 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:59.209707 19263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:59.227993 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 61271.2us
I20260709 13:11:59.229439 19339 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:59.228897 19118 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 19 to 21, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 21 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.188452 19292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:11:59.231382 19118 catalog_manager.cc:5697] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 20 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:59.233366 19339 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:59.235016 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 61133.2us
I20260709 13:11:59.236203 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:11:59.236503 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 59902.7us
I20260709 13:11:59.239210 19118 catalog_manager.cc:5697] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 11 to 17, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 17 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:59.165035 26710 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:59.230765 19292 raft_consensus.cc:606] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:59.206914 27059 log.cc:927] Time spent T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:59.171497 26786 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:59.243085 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:11:59.165512 26995 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:11:59.244846 19118 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 17 to 19, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 19 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:11:59.165776 26835 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:59.271915 19339 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:59.241720 26950 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:59.243598 26930 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:11:59.314385 27068 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:59.314852 26930 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.241508 27018 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:59.277702 19118 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 16 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 20 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:11:59.334524 19118 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 18 to 19, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 19 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.339715 19118 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 19 to 20, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:59.248255 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 71883.4us
I20260709 13:11:59.317904 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:59.242811 26259 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:59.276899 26964 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:59.370447 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 237884us
I20260709 13:11:59.244916 26829 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:59.278759 27017 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:59.363687 27018 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.427722 27018 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:59.439373 26964 raft_consensus.cc:993] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
W20260709 13:11:59.444383 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53927.4us
I20260709 13:11:59.410921 26791 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:11:59.413499 26930 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:59.518504 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:59.528944 19223 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
W20260709 13:11:59.526603 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56569.5us
I20260709 13:11:59.465322 26990 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:59.516446 26791 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:11:59.544763 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 233657us
I20260709 13:11:59.608803 19266 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:59.634271 19266 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:11:59.609444 26964 raft_consensus.cc:1081] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
W20260709 13:11:59.632331 27099 log.cc:927] Time spent T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:59.637769 26835 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:59.569571 26985 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:11:59.549832 26990 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:59.657270 26679 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.670132 27105 log.cc:927] Time spent T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:59.670486 26679 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.671294 26990 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:11:59.678097 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:11:59.680893 19365 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:59.686774 26679 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:11:59.693634 26791 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:11:59.696421 26848 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.005s
I20260709 13:11:59.702518 19366 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:11:59.703269 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 71500.2us
I20260709 13:11:59.715149 19339 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:11:59.725683 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 159404us
I20260709 13:11:59.719219 26804 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.667028 26985 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:11:59.718897 26848 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:59.742434 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:59.718849 27017 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:59.743152 26959 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:59.731508 26835 consensus_queue.cc:1048] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:11:59.736816 26804 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.784525 19296 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:11:59.786300 19370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:41484
I20260709 13:11:59.788513 19370 raft_consensus.cc:606] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:11:59.849933 19300 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:59.857013 19897 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
W20260709 13:11:59.885370 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 158159us
I20260709 13:11:59.910475 26804 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:11:59.913849 26888 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.914534 26888 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.917935 27018 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:11:59.919318 19216 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:59.921747 19366 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:59.926690 19368 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:59.926990 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:11:59.927603 19217 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:11:59.930935 19224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:11:59.959481 19224 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.960669 19224 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:59.959189 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 180031us
W20260709 13:11:59.965149 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 192111us
W20260709 13:11:59.975642 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 52133.7us
I20260709 13:11:59.984944 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:59.986912 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:11:59.987577 19300 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:11:59.989411 19292 raft_consensus.cc:2410] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:11:59.992262 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:11:59.992990 19903 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 25.
I20260709 13:11:59.986630 19224 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:00.020777 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 43949.7us
I20260709 13:12:00.022343 19224 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.021234 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:00.028848 26738 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:12:00.029341 26738 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.029742 26738 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:12:00.029889 27123 log.cc:927] Time spent T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:00.031152 26817 raft_consensus.cc:993] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:12:00.032584 26888 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.038314 26738 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.041426 27018 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.046496 26936 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:00.047492 26985 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.063539 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:12:00.064247 26963 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:12:00.064707 19220 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:00.080904 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.082325 19296 raft_consensus.cc:2410] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:12:00.059955 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:00.074434 19224 raft_consensus.cc:2955] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 9 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:00.107084 19220 raft_consensus.cc:2468] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 25.
I20260709 13:12:00.106596 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:00.076756 26817 raft_consensus.cc:1081] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:12:00.123677 19339 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:00.128247 27115 raft_consensus.cc:2804] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:12:00.128849 27115 raft_consensus.cc:697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:00.129859 27115 consensus_queue.cc:237] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.135983 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.137602 27125 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:00.138062 27125 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.138415 27125 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:00.145579 26710 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.146366 26710 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:00.151283 27126 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:12:00.151990 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:00.157528 19216 raft_consensus.cc:1275] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:12:00.160524 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.161705 19218 raft_consensus.cc:2410] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:12:00.167301 19370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.169299 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:00.170935 19218 raft_consensus.cc:1240] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 24. Current term is 25. Ops: []
W20260709 13:12:00.155635 27133 log.cc:927] Time spent T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.107s	user 0.000s	sys 0.003s
I20260709 13:12:00.162853 26710 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.171092 26985 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:12:00.176527 27127 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:00.210398 27125 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.211549 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:12:00.212190 19297 raft_consensus.cc:606] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:00.212523 19297 raft_consensus.cc:614] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:00.213657 27125 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:00.195188 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:00.215911 27118 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:00.216672 27118 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:00.171275 26824 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:12:00.278596 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:12:00.279572 19218 raft_consensus.cc:2393] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate d50eb2dab6754df8bcbed1445f2e8430 in current term 20: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:12:00.272374 19868 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:00.282347 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:12:00.283092 19297 raft_consensus.cc:606] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Received request to transfer leadership to TS d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:00.283422 19297 raft_consensus.cc:614] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:00.268261 26824 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.281963 27125 consensus_queue.cc:1048] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 13:12:00.344794 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d825739f94b747959f93597edca9200a"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:12:00.345420 19297 raft_consensus.cc:606] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:00.345777 19297 raft_consensus.cc:614] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:00.340118 26985 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.319693 27119 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:12:00.348234 26985 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.288282 26804 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:00.288049 27114 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.343262 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:12:00.355654 19297 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "0316f581086f40549fea44a772fc2dec"
mode: GRACEFUL
new_leader_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:37812
I20260709 13:12:00.360716 19297 raft_consensus.cc:606] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Received request to transfer leadership to TS 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:00.363485 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 390746us
I20260709 13:12:00.297153 26963 consensus_queue.cc:1059] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.061s
I20260709 13:12:00.380625 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:00.382678 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:00.343504 26824 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.363839 27114 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.408871 26995 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:12:00.435309 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 311686us
W20260709 13:12:00.445621 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 69191.1us
I20260709 13:12:00.455040 19369 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:12:00.455816 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:00.456081 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.456195 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.456492 19367 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:00.438763 26995 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:00.464744 27101 log.cc:927] Time spent T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:00.461951 27138 raft_consensus.cc:493] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:00.466707 27138 raft_consensus.cc:515] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.461791 27132 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:00.471118 27132 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:00.471567 27132 raft_consensus.cc:3060] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:00.460009 26979 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.476115 26979 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.478677 26979 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:00.479470 26824 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.485654 27114 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:00.493242 27138 leader_election.cc:290] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:00.539352 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 160653us
I20260709 13:12:00.545426 19371 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:12:00.565137 19897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37370
I20260709 13:12:00.536000 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:12:00.573670 19221 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:12:00.577052 27072 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.578045 26995 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.578155 27072 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.589354 27127 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.590373 27127 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.591341 26738 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.594626 26804 raft_consensus.cc:3055] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:12:00.595249 26804 raft_consensus.cc:740] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:00.597397 27116 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.598609 27116 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.498930 27132 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.602067 27148 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:00.603251 27132 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.603011 27148 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.604497 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.604652 26804 consensus_queue.cc:260] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.605793 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.606791 19365 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:12:00.607510 26804 raft_consensus.cc:3060] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:00.609952 27148 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.610281 27076 raft_consensus.cc:993] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: : Instructing follower 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:12:00.610355 26925 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:00.611081 27076 raft_consensus.cc:1081] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Signalling peer 56df67425e6f45d3b2b42441e3c143ba to start an election
I20260709 13:12:00.628625 26824 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.629784 26824 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.630892 27116 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.633450 27127 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:00.637996 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 46866us
I20260709 13:12:00.650555 26985 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.659364 19899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:00.659850 19367 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 25.
I20260709 13:12:00.667496 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:12:00.671680 19897 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.673182 19897 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:12:00.684226 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54070.9us
W20260709 13:12:00.685249 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 90638.3us
I20260709 13:12:00.611447 26925 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.692574 19373 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 24. Current term is 25. Ops: []
W20260709 13:12:00.698521 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 46415.1us
I20260709 13:12:00.709304 19218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226"
dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
 from {username='slave'} at 127.0.0.1:47368
I20260709 13:12:00.710132 19218 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.710186 27120 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.710670 19218 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:00.710914 27120 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.716755 26824 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.710202 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:00.718557 19903 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:12:00.692865 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 53844.6us
I20260709 13:12:00.683743 27072 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.720427 19217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.709208 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.724436 19900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:00.741482 19225 raft_consensus.cc:2468] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 18.
I20260709 13:12:00.755733 19221 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 26.
I20260709 13:12:00.756302 26995 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.758064 26995 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.771735 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.692093 26925 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.742362 27120 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:00.798247 26259 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.798377 19896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:00.812922 19896 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:12:00.812497 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.824528 19903 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 26.
I20260709 13:12:00.836215 26995 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:00.836999 26995 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:00.837435 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.839118 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.839953 19293 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 20.
I20260709 13:12:00.840402 19337 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:00.841133 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.827454 26259 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.842007 26848 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:12:00.842890 19297 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:12:00.842029 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.843139 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:00.842597 26848 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:00.843860 26259 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.844755 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.844990 26848 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.847471 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.842607 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.853014 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.843868 19292 raft_consensus.cc:3055] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:12:00.856410 19292 raft_consensus.cc:740] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:00.857466 19292 consensus_queue.cc:260] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.858539 19292 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:00.861924 19265 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:12:00.865890 27157 raft_consensus.cc:2804] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:00.866511 27157 raft_consensus.cc:697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:00.867156 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:00.867955 27157 consensus_queue.cc:237] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.851677 19897 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.889096 19903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:00.889853 19903 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 26.
I20260709 13:12:00.894887 19897 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:00.894598 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.900864 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0169774f68846529d675fe580574195" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.902711 19901 raft_consensus.cc:1240] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:00.906912 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.911303 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.914181 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.918107 19225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.919618 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:00.920393 27116 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:00.925480 19868 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:00.938341 19373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:00.939097 19373 raft_consensus.cc:3055] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:12:00.939404 19373 raft_consensus.cc:740] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:00.939690 19188 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:12:00.940555 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 62231.3us
I20260709 13:12:00.940760 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.942078 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.939796 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.940270 19373 consensus_queue.cc:260] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:00.941874 26710 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:00.954881 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:00.959559 19373 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:00.962003 19218 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.967567 19292 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 25.
I20260709 13:12:00.949118 27116 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:00.948743 26710 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.948802 26925 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:00.978192 19191 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:00.988698 19219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.989601 19220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:00.989929 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:00.990335 19223 raft_consensus.cc:1240] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 24. Current term is 25. Ops: []
I20260709 13:12:00.990706 19366 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:12:00.995532 27017 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:00.996093 26831 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.996685 26831 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:00.999225 26831 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:01.000478 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:01.001294 19218 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:01.002025 19373 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
W20260709 13:12:01.003783 19265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.003635 19295 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 20.
I20260709 13:12:00.970970 27116 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:01.005647 27116 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:01.006510 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 44974.9us
I20260709 13:12:01.007297 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:01.008999 26985 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:12:01.009488 26824 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:01.010241 19224 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:12:01.001104 19372 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:12:01.018390 19188 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:01.004393 19869 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:00.982481 26710 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:01.034117 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:01.039575 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:01.040292 19292 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 22.
W20260709 13:12:01.058597 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54298.3us
I20260709 13:12:01.062222 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:00.996110 27017 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.064745 26930 raft_consensus.cc:2804] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:01.082801 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:01.097556 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:01.092015 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:01.096333 27027 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:12:01.100514 19292 raft_consensus.cc:3060] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:01.091658 19266 leader_election.cc:304] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:01.105170 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 86886.8us
I20260709 13:12:01.048578 26985 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 25 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:12:01.106029 19369 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:01.127166 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:01.127956 19897 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 19.
I20260709 13:12:01.117507 26930 raft_consensus.cc:697] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:01.129616 26995 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:01.117254 27165 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:12:01.127017 26830 raft_consensus.cc:2749] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:01.131685 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:01.134680 27017 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:01.134828 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:01.124336 26831 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:01.143744 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:01.148343 19222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:01.149587 27170 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:12:01.150091 27170 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.150450 27170 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:12:01.151858 26941 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:01.152877 26888 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:01.154600 26930 consensus_queue.cc:237] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:01.156438 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:01.156734 26995 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:01.157320 19902 raft_consensus.cc:2393] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 18: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:12:01.159791 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
W20260709 13:12:01.173053 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 90454.5us
I20260709 13:12:01.173862 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:01.180745 26804 consensus_meta.cc:287] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.006s
I20260709 13:12:01.186555 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:01.193640 19369 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 24.
W20260709 13:12:01.198060 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 77245.6us
I20260709 13:12:01.198269 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:01.221452 19292 raft_consensus.cc:2468] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 24.
I20260709 13:12:01.223835 19898 raft_consensus.cc:1275] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 20. (term mismatch)
I20260709 13:12:01.224278 19898 pending_rounds.cc:85] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 19
I20260709 13:12:01.224512 19898 pending_rounds.cc:107] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 24.20
I20260709 13:12:01.224587 26251 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:01.224834 19898 raft_consensus.cc:2889] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:01.225009 26251 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.225394 26251 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:01.222862 26888 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:01.227602 26888 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:01.223405 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:12:01.232846 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 88036.3us
I20260709 13:12:01.232640 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:01.232144 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:01.197598 26710 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:01.239974 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:01.238016 27157 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:12:01.252593 27157 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.253042 27157 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:01.253759 26828 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:01.238891 26848 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:01.242180 27171 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:01.273680 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 100663us
I20260709 13:12:01.280668 27027 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:12:01.292466 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 72866.5us
I20260709 13:12:01.232426 26985 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:01.290871 27168 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 13:12:01.288503 27017 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:01.296027 27027 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.271936 26888 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:01.311523 26710 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:01.316411 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:12:01.334621 27175 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:01.339891 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:01.344084 26710 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:01.344307 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:01.345613 26710 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:01.343370 27116 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.346727 19224 raft_consensus.cc:1240] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:01.348763 27116 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:01.352252 27174 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 13:12:01.391961 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:01.402184 19901 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:12:01.403105 27017 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:01.403708 27017 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:01.404002 27132 consensus_queue.cc:1059] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:01.408560 26339 raft_consensus.cc:3055] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:01.409044 26339 raft_consensus.cc:740] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:01.411907 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:01.420768 27176 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:12:01.426441 27120 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:12:01.426726 26831 consensus_queue.cc:1048] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:12:01.501518 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 157323us
I20260709 13:12:01.503299 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:01.504366 27171 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:01.511771 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 302649us
I20260709 13:12:01.513293 27171 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:01.514003 27171 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.516297 27171 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:01.519523 19369 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24. Ops: []
W20260709 13:12:01.523681 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 117551us
I20260709 13:12:01.533303 19191 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:12:01.535517 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 240737us
I20260709 13:12:01.539645 27116 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:01.550978 27116 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:12:01.551976 27116 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.560526 27027 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:01.566738 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:01.570096 27178 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:01.559577 27017 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.594864 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:01.597995 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:01.600502 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:01.600312 27170 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:01.601063 19294 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:01.606400 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:01.607120 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:01.621496 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:01.567781 26339 consensus_queue.cc:260] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.624256 26259 consensus_queue.cc:1059] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:12:01.628458 27119 consensus_queue.cc:1175] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" responder_term: 20 status { last_received { term: 20 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 20 index: 12 } }
I20260709 13:12:01.636514 26251 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.639027 19299 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:12:01.645426 19294 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:12:01.608515 27170 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 27 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:01.660296 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 54349.1us
I20260709 13:12:01.624326 26339 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:01.665930 19191 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:01.667331 27170 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:01.668475 27170 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:12:01.669701 27170 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:01.670238 27169 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:12:01.676386 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 65677.9us
I20260709 13:12:01.677165 27017 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:01.693341 19224 raft_consensus.cc:1240] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 26. Current term is 27. Ops: []
I20260709 13:12:01.697767 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:12:01.678833 27169 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:01.790414 26995 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:01.791126 26995 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:01.793367 26995 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:01.889422 27179 log.cc:927] Time spent T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:12:01.894181 26251 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:01.932103 27157 consensus_meta.cc:287] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.011s
I20260709 13:12:02.005172 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
W20260709 13:12:02.003299 27181 log.cc:927] Time spent T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:12:02.008026 27157 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:02.017355 27157 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:02.029471 19901 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:02.038189 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:02.040465 19898 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:12:02.042829 27161 log.cc:927] Time spent T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:12:02.049592 27169 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:02.050870 19898 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
W20260709 13:12:02.071341 27193 log.cc:927] Time spent T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:02.078559 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:02.095151 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 54170.4us
I20260709 13:12:02.098834 19263 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:02.098456 26251 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:02.112691 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:02.114688 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:02.115180 19292 raft_consensus.cc:3055] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:12:02.115583 19292 raft_consensus.cc:740] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:02.116556 26791 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:12:02.116453 19292 consensus_queue.cc:260] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.117218 26791 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
W20260709 13:12:02.118147 19266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.115598 19299 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 23: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:12:02.117460 19292 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:02.127418 19296 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:12:02.131691 27201 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
I20260709 13:12:02.136703 26791 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:02.137234 19291 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 21.
I20260709 13:12:02.145413 19292 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 24.
W20260709 13:12:02.151150 26959 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:12:02.161386 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:02.162444 19296 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:12:02.168059 19222 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:02.171599 19221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba"
I20260709 13:12:02.181739 19223 raft_consensus.cc:1275] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:12:02.191817 19296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:02.192509 19298 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:02.225857 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:02.260726 26995 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:02.219506 27171 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 13:12:02.267771 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 72129.5us
I20260709 13:12:02.268056 19368 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 22. Current term is 23. Ops: []
I20260709 13:12:02.268922 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:02.227478 26985 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:12:02.280471 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 83295.9us
I20260709 13:12:02.270079 26995 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:12:02.303785 27210 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:02.310132 27125 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:12:02.317361 19216 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:02.306628 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:02.333762 19297 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:12:02.339260 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:12:02.346935 27206 log.cc:927] Time spent T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:12:02.347409 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:02.348138 19365 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:12:02.331238 27170 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:02.302975 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:02.359259 19292 raft_consensus.cc:1240] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Rejecting Update request from peer d50eb2dab6754df8bcbed1445f2e8430 for earlier term 20. Current term is 21. Ops: []
I20260709 13:12:02.276352 27061 consensus_queue.cc:1048] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:12:02.365149 19191 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:02.369843 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:02.383351 19368 raft_consensus.cc:1240] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Rejecting Update request from peer 0316f581086f40549fea44a772fc2dec for earlier term 23. Current term is 24. Ops: []
I20260709 13:12:02.380728 26985 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:02.402887 19368 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:12:02.382619 27125 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:12:02.418143 27125 consensus_queue.cc:1243] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer 56df67425e6f45d3b2b42441e3c143ba log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:12:02.381997 26824 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:12:02.413125 19368 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:12:02.432466 19365 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:12:02.431751 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:02.422637 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:02.405907 26985 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:12:02.453023 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:02.444939 27017 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:02.449975 27190 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:02.462049 19371 raft_consensus.cc:1275] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:12:02.443521 26995 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:12:02.450690 27076 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:12:02.438787 27171 consensus_queue.cc:1059] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:12:02.470674 27172 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:02.497043 27221 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:02.498636 26830 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:02.508631 26830 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.510982 26830 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:02.470881 27017 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.481457 27190 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:02.529193 26888 consensus_queue.cc:1048] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:12:02.543118 27215 log.cc:927] Time spent T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:02.551483 27017 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:02.556113 27190 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:02.507447 27076 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:02.558043 27076 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.524765 26985 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.565518 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:02.567458 19218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:02.568136 19218 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 17.
I20260709 13:12:02.571324 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:12:02.573659 26251 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:02.574085 26251 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:02.574455 26251 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:02.593406 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:02.604532 27076 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:02.612296 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:02.618186 19299 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 21: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:12:02.581029 27192 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.625303 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 163396us
I20260709 13:12:02.627019 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:02.631127 26259 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:02.638170 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:02.635778 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:02.636662 26259 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.638134 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:02.645722 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 117539us
I20260709 13:12:02.660305 27115 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:12:02.635388 26848 consensus_queue.cc:1059] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 13:12:02.668433 27225 raft_consensus.cc:3055] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:12:02.668905 27225 raft_consensus.cc:740] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:02.669585 27212 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:02.670289 27212 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.669874 27225 consensus_queue.cc:260] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:02.671797 27225 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:12:02.689411 26251 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.695837 27212 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:02.696597 19296 raft_consensus.cc:1240] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 17. Current term is 18. Ops: []
I20260709 13:12:02.679693 19224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:02.629400 27192 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.712795 19902 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:12:02.719250 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 75109.4us
I20260709 13:12:02.724293 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:02.727166 27169 raft_consensus.cc:3055] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:12:02.727592 27169 raft_consensus.cc:740] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:12:02.728785 26259 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:02.728484 27169 consensus_queue.cc:260] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.729765 27169 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:02.732189 27192 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:02.735188 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:02.734524 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:02.741285 19266 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:02.721102 27212 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.753850 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 46366us
I20260709 13:12:02.744853 26925 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:12:02.832307 27205 log.cc:927] Time spent T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:12:02.840445 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 79557.7us
W20260709 13:12:02.843241 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 102018us
I20260709 13:12:02.756618 27212 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:02.759050 27231 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.100s
I20260709 13:12:02.835361 26925 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:02.902325 27197 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.897992 27230 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:02.915452 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 63367.4us
I20260709 13:12:02.907326 27228 consensus_queue.cc:1059] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.190s
I20260709 13:12:02.909410 27203 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:02.912899 27197 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:02.936535 19223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
I20260709 13:12:02.936931 26925 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:02.951517 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 106467us
I20260709 13:12:02.953634 19898 raft_consensus.cc:3055] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:12:02.955287 19898 raft_consensus.cc:740] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:02.953554 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:02.956799 19898 consensus_queue.cc:260] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.005178 27212 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.036907 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:12:03.042321 19216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56df67425e6f45d3b2b42441e3c143ba" is_pre_election: true
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
W20260709 13:12:03.043984 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 53012.6us
I20260709 13:12:03.039512 27212 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.047883 27212 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.049690 27196 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.050261 27196 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.057045 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:12:03.050191 27212 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.062708 26251 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.066592 27196 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:03.073376 19265 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.076928 27219 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:03.077323 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:03.084688 19368 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:12:03.093111 26251 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:03.110281 27195 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:03.123828 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.124236 19369 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:03.125931 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.128245 19339 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:03.131246 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.131682 19371 raft_consensus.cc:1240] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Rejecting Update request from peer 56df67425e6f45d3b2b42441e3c143ba for earlier term 22. Current term is 23. Ops: []
I20260709 13:12:03.149267 19369 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:12:03.157071 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:03.158624 19265 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:03.159170 27148 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.159880 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.160770 19295 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:12:03.152971 27017 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:03.153082 26985 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:12:03.117529 27195 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.176959 27195 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:03.178117 27195 consensus_queue.cc:1059] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:03.159745 27148 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.179486 27019 raft_consensus.cc:3055] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:12:03.179881 27019 raft_consensus.cc:740] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:03.180766 27019 consensus_queue.cc:260] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.183099 27019 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:03.183837 27197 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:03.184487 27148 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.186671 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.190860 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.191614 19294 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 14.
W20260709 13:12:03.207324 19188 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.204715 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.215051 19291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:03.217368 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 58771us
W20260709 13:12:03.220420 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54577us
W20260709 13:12:03.233009 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 64661.1us
I20260709 13:12:03.234056 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:03.235252 27222 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:03.246760 19898 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:03.248581 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.259375 27196 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:03.259840 27196 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.260326 27196 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:03.260224 27222 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:03.210809 27192 raft_consensus.cc:493] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.263383 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:03.264650 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.221552 27169 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:12:03.271178 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.213752 26824 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.285099 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.286274 26824 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.286885 27169 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.283056 27192 raft_consensus.cc:515] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:03.288806 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.289464 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.290323 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.290355 27192 leader_election.cc:290] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:03.290984 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.295333 27209 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:03.300871 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.304749 19898 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:12:03.305258 19898 pending_rounds.cc:85] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Aborting all ops after (but not including) 15
W20260709 13:12:03.305383 19868 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:03.306010 19868 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.306852 27236 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:03.308190 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.308789 19868 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:03.309147 19868 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:03.309854 27236 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:03.310557 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:03.312114 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.312475 27192 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:03.305559 19898 pending_rounds.cc:107] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:12:03.318867 19898 raft_consensus.cc:2889] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:03.322113 26804 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:12:03.347779 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1a12d65a24a9cbdd9846e6437132d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.323334 26995 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:12:03.383347 19340 leader_election.cc:304] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:03.380347 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 215348us
W20260709 13:12:03.388218 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.412930 19265 leader_election.cc:336] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:03.372725 27196 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.427840 27196 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.429471 19297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:03.434558 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.445519 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.448024 27169 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.448302 27212 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:03.448642 27169 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:03.424048 19265 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.455503 26251 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:12:03.456547 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 43662.4us
W20260709 13:12:03.461051 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.462541 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.448982 27212 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:12:03.463248 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.474562 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.478565 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.479616 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:12:03.484496 19265 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.493054 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.497010 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.506373 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.510718 19339 consensus_peers.cc:597] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.517288 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.518110 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.523900 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.524605 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.515944 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.532482 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.533200 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.541302 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.543084 27197 raft_consensus.cc:2749] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:03.562300 19339 leader_election.cc:336] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:03.533447 19117 catalog_manager.cc:5697] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.562865 19339 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:03.570771 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.578285 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.573310 27195 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:03.599089 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.609279 26804 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:03.610373 26824 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.616293 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:03.630970 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.667562 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.668042 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 87800us
W20260709 13:12:03.668717 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.669319 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.669816 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.685487 26995 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.686064 26995 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:03.686560 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.688516 27212 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.689623 27251 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.690151 27251 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.690948 26995 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:03.692997 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 266) took 21245 ms (client timeout 15000 ms). Trace:
I20260709 13:12:03.694202 27251 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.696203 19117 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 12 to 19, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 19 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.693828 26995 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.698046 26995 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.698863 27251 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.698429 19117 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 21, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 21 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:03.699405 27251 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.700875 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.689365 27212 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.701458 26995 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.702442 27170 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.703003 27212 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.702955 27170 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.704875 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.705044 27170 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.713398 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.718855 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.720942 27251 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.723258 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.736068 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.700805 19117 catalog_manager.cc:5697] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 20, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 20 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.749693 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.753952 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.756397 19117 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:03.762089 19901 raft_consensus.cc:1240] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Rejecting Update request from peer c6a09cefdddd4ca8a10b66682ed27dad for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:03.765293 19117 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 20, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 20 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.768502 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.766515 27211 consensus_queue.cc:1059] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:12:03.771632 27211 raft_consensus.cc:3055] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:03.772017 27211 raft_consensus.cc:740] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:12:03.693449 19118 rpcz_store.cc:269] 0709 13:11:42.447493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.309452 (+8861959us) service_pool.cc:224] Handling call
0709 13:12:03.692781 (+12383329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:59.772418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:59.997370 (+224952us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:00.007447 (+ 10077us) write_op.cc:435] Acquired schema lock
0709 13:12:00.012399 (+  4952us) tablet.cc:662] Decoding operations
0709 13:12:00.052320 (+ 39921us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:00.052381 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:00.052407 (+    26us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:12:00.053860 (+  1453us) tablet.cc:701] Row locks acquired
0709 13:12:00.053882 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:12:00.054038 (+   156us) write_op.cc:270] Start()
0709 13:12:00.054166 (+   128us) write_op.cc:276] Timestamp: P: 1783602720053988 usec, L: 0
0709 13:12:00.054188 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:00.075633 (+ 21445us) log.cc:844] Serialized 8644 byte log entry
0709 13:12:00.497093 (+421460us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.498834 (+  1741us) write_op.cc:301] APPLY: starting
0709 13:12:00.498936 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.939510 (+440574us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:01.005489 (+ 65979us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:01.323360 (+317871us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:01.323782 (+   422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:12:01.323847 (+    65us) write_op.cc:312] APPLY: finished
0709 13:12:01.324525 (+   678us) log.cc:844] Serialized 188 byte log entry
0709 13:12:01.331222 (+  6697us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:01.331532 (+   310us) write_op.cc:454] Released schema lock
0709 13:12:01.331606 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:01.349822 (+ 18216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:01.349861 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129947,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1440,"apply.run_cpu_time_us":35384,"apply.run_wall_time_us":850892,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91823,"num_ops":21,"prepare.queue_time_us":212433,"prepare.run_cpu_time_us":36404,"prepare.run_wall_time_us":644741,"raft.queue_time_us":29722,"raft.run_cpu_time_us":1059,"raft.run_wall_time_us":2968,"replication_time_us":442727,"spinlock_wait_cycles":41600,"thread_start_us":448598,"threads_started":4,"wal-append.queue_time_us":366245,"wal-append.run_cpu_time_us":17367,"wal-append.run_wall_time_us":1897053}]]}
I20260709 13:12:03.772897 27211 consensus_queue.cc:260] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.779310 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.792920 26995 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:03.793133 27170 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:03.793644 26995 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.794560 27212 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:03.795076 27212 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.793756 27170 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.796046 26985 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:03.796192 26995 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.796746 26995 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:03.796655 26985 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.797103 27212 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.797303 26995 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.797787 27170 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.798790 26985 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.800948 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.803822 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.805605 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:03.806885 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.809110 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.813272 19188 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:03.815248 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.815966 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.816133 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:03.818018 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.822937 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:03.828799 19117 catalog_manager.cc:5697] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.807787 26995 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.833211 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.832132 19117 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 13 to 24. New cstate: current_term: 24 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:03.836793 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.811761 27170 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.831902 27212 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:03.857103 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:03.836328 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.859580 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:03.859614 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.817001 27251 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:03.863618 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:03.864064 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.865447 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:12:03.868532 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.873971 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.876417 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:03.864614 26824 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:03.867614 27211 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:03.856490 27170 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.867762 27221 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:03.878695 26985 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:03.877771 27251 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.889374 27221 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:03.889690 27170 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.889974 27221 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.885296 26995 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:03.891592 19117 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 22, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 22 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:03.891999 27221 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.894496 19117 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:03.915283 19339 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.915133 19117 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.921409 27170 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.921968 27170 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.923817 26985 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.924428 26985 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:03.887705 27251 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.940963 19117 catalog_manager.cc:5697] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 13 to 16, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 16 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:12:03.947500 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.956634 27251 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:03.952732 26804 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:03.959287 26804 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:03.961512 26804 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.964885 26985 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.975829 27170 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:03.997118 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:03.997866 19365 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 27.
I20260709 13:12:03.999538 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:04.002010 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.002945 27240 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:12:04.003365 27240 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.003722 27240 raft_consensus.cc:3060] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:12:04.063781 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 187417us
I20260709 13:12:04.066478 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.068137 26985 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:04.070559 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.074152 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.068769 26985 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.076300 27221 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:04.072135 27251 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:04.072255 27169 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.077545 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.078636 27240 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.091125 26824 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:04.091718 26824 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.093883 26824 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.099172 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.097641 27169 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:04.104759 27169 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.106801 27169 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.108435 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.108661 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.111855 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.113842 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.110224 26824 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:04.114845 27221 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:04.119029 27270 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:04.113047 27169 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.126611 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.127949 26985 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.131522 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.132488 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.133407 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.133709 27221 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.133651 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.134339 27221 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.136524 27221 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.138196 27221 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:04.138255 26835 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.138756 27221 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.138829 26835 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.140190 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.141031 26835 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.141381 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.143925 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.146920 19371 raft_consensus.cc:2410] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:12:04.149129 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:04.147001 19265 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:04.152921 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.153308 27221 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.154955 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.157151 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.158739 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.158943 19365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.161247 27132 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:04.162781 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.165479 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:04.167486 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.169974 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.163926 26824 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:04.164815 27240 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.182375 27169 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:04.183341 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.185866 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.193284 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.184957 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.170702 27251 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:04.183894 19366 raft_consensus.cc:2468] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 27.
I20260709 13:12:04.196736 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.200528 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.201748 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.202601 27270 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:04.203269 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.204212 27212 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:04.204478 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.205585 26995 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.205744 27222 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:04.206838 19869 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:04.203307 27270 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.211160 26804 raft_consensus.cc:2804] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:12:04.211711 26804 raft_consensus.cc:697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:04.212594 26804 consensus_queue.cc:237] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.183058 27170 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.240542 27212 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:04.241140 27212 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.243412 27212 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.232219 27169 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.245209 27169 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.246294 27212 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.246944 27212 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.247433 27169 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.206279 27222 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.249074 27212 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.268321 27212 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:04.268903 27212 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.271076 27212 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.225967 27170 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.291049 27170 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.301093 27222 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.303406 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.303956 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.305747 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.342245 27222 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.342911 27222 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.345032 27222 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:04.411026 27273 log.cc:927] Time spent T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:12:04.413165 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 207084us
W20260709 13:12:04.526340 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 109590us
W20260709 13:12:04.527608 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 110920us
I20260709 13:12:04.582495 27169 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.583175 27169 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.586858 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.588081 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.588984 27169 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.589390 26995 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:04.589622 27169 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.589772 26985 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:04.590660 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.590951 27169 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.593765 27169 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.589568 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.596056 26995 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:04.601289 26995 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.601964 26995 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:04.602705 19868 leader_election.cc:336] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:04.605530 19868 leader_election.cc:336] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:04.604725 26995 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.612134 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.612597 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.613584 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.614853 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.615990 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.617655 26995 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:04.618014 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.618892 19292 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:12:04.621546 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.630877 27027 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.631729 27027 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.634989 27027 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:04.640776 27272 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.641738 27170 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.641595 27272 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.642510 27170 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.644570 27272 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.646512 26985 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.647182 26985 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.652328 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.653762 26985 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.656546 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.654410 27170 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.659556 26995 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.660106 26995 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.662437 27170 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.663038 27170 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.665726 27170 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.667421 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.668578 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.669286 19299 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 23.
I20260709 13:12:04.670850 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: 
I20260709 13:12:04.668828 26995 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.700474 27184 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.701097 27184 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.703655 27184 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:04.693985 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.708420 19298 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:12:04.713254 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.716903 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.718616 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.719853 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:04.720553 19294 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 18.
I20260709 13:12:04.727639 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.717522 19371 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 18.
I20260709 13:12:04.730975 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.733731 19371 raft_consensus.cc:2410] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for term 28 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 13:12:04.689815 27272 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:12:04.736106 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.739991 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.735082 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:04.743403 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.742242 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.751780 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.755390 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.748584 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:04.759568 19368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.760787 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.761264 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:04.760957 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.741719 27272 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.769887 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.772395 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.750278 27211 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:12:04.776963 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.788120 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:12:04.791265 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 57878.7us
I20260709 13:12:04.763154 27209 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:12:04.793377 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:12:04.773769 27272 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:04.806347 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.806785 19188 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.799256 27170 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:04.791154 26995 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:04.786811 27211 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.822769 19368 raft_consensus.cc:1275] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:12:04.804497 27209 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.829795 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.808025 27251 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:04.835413 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.837733 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.826274 27211 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:04.841645 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.826043 26995 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:04.830948 27170 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:04.834748 26824 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:12:04.861925 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:04.833067 27209 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:04.835453 27251 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.844478 27212 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:04.848016 27221 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:04.868012 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 129962us
I20260709 13:12:04.873298 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:04.871932 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 77161.4us
I20260709 13:12:04.865386 27169 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.868764 27251 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:04.869124 27241 consensus_queue.cc:1048] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 13:12:04.882938 26995 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:04.908517 27271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.030s	sys 0.035s
I20260709 13:12:04.905645 27272 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:04.910983 27272 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:04.871470 27222 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.913894 27211 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:04.914796 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 112496us
I20260709 13:12:04.915171 19366 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:12:04.916128 27211 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:04.925782 19263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 44242.9us
W20260709 13:12:04.909092 27271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.030s	sys 0.035s
W20260709 13:12:04.927956 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 46896us
I20260709 13:12:04.948956 27132 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:04.949656 27132 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:04.951804 27132 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:04.959888 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:04.967176 19294 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:04.964406 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:04.968518 19369 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:12:04.970155 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.971109 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:04.995234 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:12:04.998570 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:04.999923 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:05.003006 19372 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 24: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:12:04.982100 27270 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:04.982967 27222 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:05.019016 27251 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.003655 27282 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:05.022328 27282 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:05.022823 27282 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:05.023000 27251 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.030817 19294 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56df67425e6f45d3b2b42441e3c143ba in term 24.
I20260709 13:12:05.043143 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.043990 19897 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:12:05.045208 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:05.045981 19293 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 24: Already voted for candidate 56df67425e6f45d3b2b42441e3c143ba in this term.
I20260709 13:12:05.038605 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:05.046581 19298 raft_consensus.cc:2393] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba in current term 18: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:12:05.050781 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:12:05.051710 19339 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:05.053035 19339 leader_election.cc:336] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:05.058876 27282 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.065692 19191 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.067122 27270 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:05.067654 27270 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Becoming Leader. State: Replica: 56df67425e6f45d3b2b42441e3c143ba, State: Running, Role: LEADER
I20260709 13:12:05.070505 27270 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.076926 27209 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.078275 19371 raft_consensus.cc:2368] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19.
I20260709 13:12:05.080506 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:05.094079 27209 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:05.094413 27222 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:05.095010 27222 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.097178 27222 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.109972 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:05.120409 18095 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 19250)
I20260709 13:12:05.120618 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:05.121169 19298 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:12:05.131999 19339 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:05.137384 19298 raft_consensus.cc:2468] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 19.
I20260709 13:12:05.140002 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:05.140257 19372 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 15.
I20260709 13:12:05.141937 19897 raft_consensus.cc:2393] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 15: Already voted for candidate d50eb2dab6754df8bcbed1445f2e8430 in this term.
I20260709 13:12:05.138185 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:05.143291 19266 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:05.139406 19340 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:05.147879 26339 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:05.144218 27285 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:12:05.148628 27120 raft_consensus.cc:2804] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:12:05.149242 27120 raft_consensus.cc:697] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:05.150170 27120 consensus_queue.cc:237] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.163261 26339 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:05.137267 27282 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 15 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.183331 19191 leader_election.cc:400] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19.
I20260709 13:12:05.184131 26339 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.186193 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.183722 19191 leader_election.cc:403] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.198136 27251 raft_consensus.cc:3060] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:12:05.225847 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.227849 27251 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545) with higher term. Message: Invalid argument: T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 56df67425e6f45d3b2b42441e3c143ba for earlier term 18. Current term is 19.
W20260709 13:12:05.242082 19339 leader_election.cc:336] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:05.246248 27270 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:05.428951 19117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 267) took 20071 ms (client timeout 15000 ms). Trace:
W20260709 13:12:05.429494 19117 rpcz_store.cc:269] 0709 13:11:45.357094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.015044 (+13657950us) service_pool.cc:224] Handling call
0709 13:11:59.053668 (+ 38624us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:12:05.428841 (+6375173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:04.107923 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:04.154845 (+ 46922us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:04.154899 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:12:04.154920 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:04.156236 (+  1316us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:04.157958 (+  1722us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:04.158476 (+   518us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:12:04.292790 (+134314us) tablet.cc:701] Row locks acquired
0709 13:12:04.292847 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:12:04.293000 (+   153us) write_op.cc:270] Start()
0709 13:12:04.293162 (+   162us) write_op.cc:276] Timestamp: P: 1783602724292945 usec, L: 0
0709 13:12:04.293186 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:04.293882 (+   696us) log.cc:844] Serialized 4803 byte log entry
0709 13:12:04.960245 (+666363us) op_driver.cc:464] REPLICATION: finished
0709 13:12:05.042397 (+ 82152us) write_op.cc:301] APPLY: starting
0709 13:12:05.042505 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:05.090150 (+ 47645us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:05.090294 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:05.103619 (+ 13325us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb232a 00007fe8d7e37f14 00007fe8d7e37ec3 00007fe8d7e37e38 00007fe8d7e37df3 00007fe8d7e370dc 00007fe8d7e60e16 00007fe8d7e48cbb 00007fe8d7e3339d 00007fe8d7e36d75
0709 13:12:05.309362 (+205743us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:05.309667 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:12:05.309720 (+    53us) write_op.cc:312] APPLY: finished
0709 13:12:05.310085 (+   365us) log.cc:844] Serialized 113 byte log entry
0709 13:12:05.325443 (+ 15358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.334082 (+  8639us) write_op.cc:454] Released schema lock
0709 13:12:05.334148 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:05.334679 (+   531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.337059 (+  2380us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":374855,"reported_tablets":50,"spinlock_wait_cycles":58998016,"child_traces":[["op",{"apply.queue_time_us":81905,"apply.run_cpu_time_us":18200,"apply.run_wall_time_us":292221,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":105547,"prepare.run_cpu_time_us":72819,"prepare.run_wall_time_us":858224,"raft.queue_time_us":94976,"raft.run_cpu_time_us":27268,"raft.run_wall_time_us":197142,"replication_time_us":666846,"spinlock_wait_cycles":122371456,"thread_start_us":831534,"threads_started":4,"wal-append.queue_time_us":514852}]]}
I20260709 13:12:05.440763 27251 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.441363 27251 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.443555 27251 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.445789 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.446767 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.451941 19191 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:05.454008 27251 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:05.456255 27222 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:05.456755 27222 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.458847 27222 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.461529 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.463935 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.443785 19115 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 20 to 21, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 21 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:05.465720 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.466928 27222 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:05.466756 19115 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 15 to 17, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 17 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:05.476598 19372 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:12:05.478233 27251 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:05.487910 19115 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 4 to 8, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 8 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:05.494643 19115 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 11 to 13, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 13 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:12:05.489223 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.500871 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.572201 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.596573 19265 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.601533 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.601739 19897 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:05.603595 26339 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:05.610298 19298 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer 56df67425e6f45d3b2b42441e3c143ba: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:12:05.611480 27270 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:05.664345 26995 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:05.664897 26995 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.667059 26995 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:05.671307 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.674881 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.691256 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.695855 26995 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:05.703507 26995 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.705657 26995 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.708982 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.712503 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.734724 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.745383 19191 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:05.746410 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.748682 27221 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:05.749953 27222 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:05.765079 19299 raft_consensus.cc:1275] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:12:05.765735 26995 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:05.786497 26995 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.783630 19372 raft_consensus.cc:1275] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:12:05.789664 26995 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.792697 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.794445 27275 consensus_queue.cc:1048] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:05.801167 26339 consensus_queue.cc:1048] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:12:05.802141 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.809289 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.813788 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:05.814723 27222 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:05.819239 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.825913 27222 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:05.826752 27222 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.829718 27222 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.832659 27221 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:05.833261 27221 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.835791 27221 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.836583 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.839107 27251 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:12:05.842754 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.843638 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:05.843201 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.848410 27251 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:05.849419 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.841039 26995 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:05.854168 27251 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.854087 26995 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:05.855067 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.856683 26995 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.839325 27270 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:05.861334 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.861210 27270 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:05.862955 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.863528 27270 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.863698 19114 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 4 to 16. New cstate: current_term: 16 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:05.866113 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.873009 27270 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:05.873715 27270 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.875385 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.877720 27270 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:05.892714 19115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 265) took 44722 ms (client timeout 15000 ms). Trace:
W20260709 13:12:05.893303 19115 rpcz_store.cc:269] 0709 13:11:21.170522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.170845 (+   323us) service_pool.cc:224] Handling call
0709 13:12:05.892611 (+44721766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:05.552863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:05.553442 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:05.553475 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:12:05.553492 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:05.554105 (+   613us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:05.554177 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:05.554215 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:12:05.554610 (+   395us) tablet.cc:701] Row locks acquired
0709 13:12:05.554627 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:05.554783 (+   156us) write_op.cc:270] Start()
0709 13:12:05.554891 (+   108us) write_op.cc:276] Timestamp: P: 1783602725554741 usec, L: 0
0709 13:12:05.554916 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:05.555540 (+   624us) log.cc:844] Serialized 1703 byte log entry
0709 13:12:05.557902 (+  2362us) op_driver.cc:464] REPLICATION: finished
0709 13:12:05.558410 (+   508us) write_op.cc:301] APPLY: starting
0709 13:12:05.558499 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:05.561045 (+  2546us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:05.561155 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:05.564653 (+  3498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:05.565650 (+   997us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:12:05.565715 (+    65us) write_op.cc:312] APPLY: finished
0709 13:12:05.565985 (+   270us) log.cc:844] Serialized 49 byte log entry
0709 13:12:05.571888 (+  5903us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.572002 (+   114us) write_op.cc:454] Released schema lock
0709 13:12:05.572054 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:05.572494 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.572529 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":773700,"reported_tablets":50,"spinlock_wait_cycles":19712,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":6709,"apply.run_wall_time_us":14011,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16704,"num_ops":4,"prepare.queue_time_us":40751,"prepare.run_cpu_time_us":2997,"prepare.run_wall_time_us":2998,"replication_time_us":2839,"thread_start_us":32676,"threads_started":1}]]}
W20260709 13:12:05.902745 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.903666 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:05.910737 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.912446 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.912736 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.919278 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:05.920262 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:05.923534 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.928709 27270 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:05.929472 27270 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:05.931972 27270 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:05.933179 27270 raft_consensus.cc:493] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:05.933812 27270 raft_consensus.cc:515] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.939586 27270 leader_election.cc:290] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.940730 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.943480 27221 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:05.942543 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.944070 27221 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:05.944972 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.945837 27251 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:05.946308 27221 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:05.946576 27251 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:05.949489 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:05.949990 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:05.961292 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:05.982788 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:05.985462 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.988493 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.990269 27270 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:05.985767 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:05.991432 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:05.991874 27270 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:06.000444 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.000614 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce726108fd4e452b9a0b91d535939c7d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.002625 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.005301 27251 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.005924 27251 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.008139 27251 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.009511 27221 raft_consensus.cc:493] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:06.010097 27221 raft_consensus.cc:515] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.012581 27221 leader_election.cc:290] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:06.018009 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:06.018690 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.023561 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.024365 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:06.043637 19114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 252) took 56911 ms (client timeout 15000 ms). Trace:
W20260709 13:12:06.048475 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:06.066430 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.069447 27270 raft_consensus.cc:493] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:06.070163 27270 raft_consensus.cc:515] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.082042 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:06.067553 19114 rpcz_store.cc:269] 0709 13:11:09.132619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.136367 (+  3748us) service_pool.cc:224] Handling call
0709 13:11:09.241656 (+105289us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b5400002490. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d4c50db1 00007fe8d4d90b71 00007fe8d4d910b2 00007fe8ddd0aa89 00007fe8ddca2da6 00007fe8ddc74088 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc
0709 13:12:06.043542 (+56801886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:05.917782 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:05.918375 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:05.918412 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:12:05.918433 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:05.918775 (+   342us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:05.918836 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:05.918872 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:05.919066 (+   194us) tablet.cc:701] Row locks acquired
0709 13:12:05.919085 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:05.919226 (+   141us) write_op.cc:270] Start()
0709 13:12:05.919350 (+   124us) write_op.cc:276] Timestamp: P: 1783602725919178 usec, L: 0
0709 13:12:05.919375 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:05.920011 (+   636us) log.cc:844] Serialized 539 byte log entry
0709 13:12:05.925678 (+  5667us) op_driver.cc:464] REPLICATION: finished
0709 13:12:05.927167 (+  1489us) write_op.cc:301] APPLY: starting
0709 13:12:05.927258 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:05.928072 (+   814us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:05.928189 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:05.928950 (+   761us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:05.929126 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:12:05.929183 (+    57us) write_op.cc:312] APPLY: finished
0709 13:12:05.929399 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 13:12:05.929586 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.929694 (+   108us) write_op.cc:454] Released schema lock
0709 13:12:05.929739 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:05.930104 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.930136 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1432741,"reported_tablets":51,"spinlock_wait_cycles":11603072,"child_traces":[["op",{"apply.queue_time_us":1243,"apply.run_cpu_time_us":2903,"apply.run_wall_time_us":2902,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":167,"prepare.run_cpu_time_us":2562,"prepare.run_wall_time_us":7083,"replication_time_us":6151}]]}
W20260709 13:12:06.090340 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.095151 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5150fb077a470497ba70512f18f476" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:06.100085 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.100960 27270 leader_election.cc:290] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.108067 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:06.121083 18095 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 19250)
W20260709 13:12:06.122788 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.124303 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:12:06.128051 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.139063 27270 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:06.135569 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.143481 19119 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 17 to 20, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 20 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.147042 19119 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.172937 27251 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:06.174973 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.179699 19191 leader_election.cc:304] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:06.187625 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.202270 27221 raft_consensus.cc:2749] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:06.196745 27270 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.182736 27251 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:06.202839 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:06.201032 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.203732 27270 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.208359 27270 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.210124 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.202761 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.186326 19119 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 7 to 14, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 14 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.224500 27270 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:06.227485 19191 leader_election.cc:304] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.228750 27251 raft_consensus.cc:2749] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:06.232241 19339 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.244324 27304 raft_consensus.cc:493] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:06.244921 27304 raft_consensus.cc:515] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.245254 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c7a109008641aaa9e738f35f1abf42" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.247202 27304 leader_election.cc:290] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.247423 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43f1e515be64813bb797fabd579621f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:06.249567 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.249692 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:06.251320 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.256045 27251 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.256682 27251 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.260778 27251 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:06.276027 19116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 251) took 79666 ms (client timeout 15000 ms). Trace:
I20260709 13:12:06.278548 27251 raft_consensus.cc:493] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:06.279141 27251 raft_consensus.cc:515] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:06.278043 19116 rpcz_store.cc:269] 0709 13:10:46.609515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.609802 (+   287us) service_pool.cc:224] Handling call
0709 13:12:06.275920 (+79666118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267775,"reported_tablets":51}
I20260709 13:12:06.281490 27251 leader_election.cc:290] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.283767 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.288342 26995 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.288938 26995 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.304737 26995 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:06.326596 19119 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 163) took 37765 ms (client timeout 15000 ms). Trace:
I20260709 13:12:06.327252 26995 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.360517 26995 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.362664 26995 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.327922 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:06.333820 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.366083 19191 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.367022 27251 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:06.368116 27270 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:06.373631 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d1dbf9a24f4b489920281c72245ab4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.387040 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efca40b3ba4ad5b0122303a9a227a2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.387233 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.387782 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.388501 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:06.382839 19119 rpcz_store.cc:269] 0709 13:11:28.570464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.573229 (+  2765us) service_pool.cc:224] Handling call
0709 13:12:06.326517 (+37753288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:06.274656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:06.275214 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:06.275249 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:12:06.275270 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:06.275810 (+   540us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:06.275869 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:06.275893 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:12:06.276242 (+   349us) tablet.cc:701] Row locks acquired
0709 13:12:06.276258 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:12:06.276401 (+   143us) write_op.cc:270] Start()
0709 13:12:06.276542 (+   141us) write_op.cc:276] Timestamp: P: 1783602726276355 usec, L: 0
0709 13:12:06.276564 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:06.277249 (+   685us) log.cc:844] Serialized 1311 byte log entry
0709 13:12:06.280238 (+  2989us) op_driver.cc:464] REPLICATION: finished
0709 13:12:06.280686 (+   448us) write_op.cc:301] APPLY: starting
0709 13:12:06.280783 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:06.282679 (+  1896us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:06.282785 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:06.286207 (+  3422us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:06.286389 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:12:06.286439 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:06.286667 (+   228us) log.cc:844] Serialized 41 byte log entry
0709 13:12:06.290828 (+  4161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.290929 (+   101us) write_op.cc:454] Released schema lock
0709 13:12:06.290971 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:06.291303 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.291333 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":99210,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":5242,"apply.run_wall_time_us":10585,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2922,"prepare.run_wall_time_us":2921,"replication_time_us":3513}]]}
W20260709 13:12:06.402865 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.403956 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.405558 19114 catalog_manager.cc:5697] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.425081 19114 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 23, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 23 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.409896 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.411311 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3301e091b13b45e8833e94ab3073d14a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:06.419927 19339 consensus_peers.cc:597] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.403097 19191 leader_election.cc:304] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.427614 27270 raft_consensus.cc:2749] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:06.442330 26995 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.442898 26995 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:06.444355 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:06.445240 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.448997 26995 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.450620 19191 leader_election.cc:304] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.455417 26995 raft_consensus.cc:2749] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:06.453081 19114 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 11 to 14, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 14 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.466080 27221 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.466740 27221 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.466140 19191 leader_election.cc:304] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.471057 27221 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.472438 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.472651 27221 raft_consensus.cc:2749] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:06.473071 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.473897 26995 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:06.474280 19191 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.467170 19114 catalog_manager.cc:5697] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.476598 19114 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.481297 19114 catalog_manager.cc:5697] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.482535 27270 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:06.483773 27251 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.493603 27251 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.495705 27251 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.484550 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.497509 27251 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:06.499116 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:06.503053 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.503662 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.504441 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.505910 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.506225 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.507725 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.508411 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.509270 27251 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:06.515576 27251 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.516109 27251 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.511266 19114 catalog_manager.cc:5697] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 12 to 16, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 16 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.520017 27251 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.520545 19114 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 21, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 21 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.521499 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.523175 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994bf3418aeb467ea0f5718bd6226a66" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.525279 19114 catalog_manager.cc:5697] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 20, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 20 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.528952 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.531350 27251 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:06.532061 19114 catalog_manager.cc:5697] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.534505 19114 catalog_manager.cc:5697] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.535815 19114 catalog_manager.cc:5697] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.537158 19114 catalog_manager.cc:5697] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 23, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 23 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.533516 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.539983 27251 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:06.542703 19191 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.544073 27270 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:06.548774 19114 catalog_manager.cc:5697] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 16 to 23. New cstate: current_term: 23 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.551896 27251 raft_consensus.cc:493] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.552497 27251 raft_consensus.cc:515] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.555473 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.550355 19114 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 25 to 29, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 29 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.558125 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bef21d2e4214a018d420d2f02b90db2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.554776 27251 leader_election.cc:290] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.559104 19114 catalog_manager.cc:5697] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 22, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 22 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.561163 19191 leader_election.cc:304] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.562041 27251 raft_consensus.cc:2749] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:06.561293 19114 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.565927 19114 catalog_manager.cc:5697] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 22, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 22 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.567662 19114 catalog_manager.cc:5697] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 22, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 22 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.569538 19114 catalog_manager.cc:5697] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 22, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 22 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.571154 19114 catalog_manager.cc:5697] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 23, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 23 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.572887 19114 catalog_manager.cc:5697] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 24 to 26, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 26 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.574445 19114 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 23, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 23 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.588806 19114 catalog_manager.cc:5697] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.608989 19114 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 22 to 25, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 25 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.610759 19114 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 20, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 20 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.612763 19114 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.614202 19114 catalog_manager.cc:5697] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 24, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 24 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.627439 27270 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:06.628227 27270 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.632980 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.615777 19114 catalog_manager.cc:5697] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 22 to 24, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 24 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.640116 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.640743 19114 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index 9 to 15, term changed from 18 to 21, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193), VOTER 0316f581086f40549fea44a772fc2dec (127.17.171.194), VOTER c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195), VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.643306 19188 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.642966 19114 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 21 to 24, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 24 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.644321 27251 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:06.648587 27270 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.669811 19114 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.671324 19114 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.672909 19114 catalog_manager.cc:5697] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.674736 19114 catalog_manager.cc:5697] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 8 to 13, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 13 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.676805 19114 catalog_manager.cc:5697] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 15 to 17, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 17 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.678519 19114 catalog_manager.cc:5697] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 21 to 23, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 23 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.680194 19114 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 17 to 20, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 20 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:06.681617 19114 catalog_manager.cc:5697] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 17 to 21, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.683595 19114 catalog_manager.cc:5697] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:06.760107 27251 raft_consensus.cc:493] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.760845 27251 raft_consensus.cc:515] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.763348 27251 leader_election.cc:290] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.764328 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.765234 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bda02534b549db92f2a72e046dedf4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.766978 19191 leader_election.cc:304] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.767683 27251 raft_consensus.cc:2749] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:06.778580 27251 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.784808 27251 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.807742 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.808197 27251 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.836179 27270 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.836748 27270 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.838905 27270 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.845460 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.848766 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.851894 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.854595 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:06.855340 27270 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:06.875397 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.884557 27251 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:06.886658 27270 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.897884 27270 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.899999 27270 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.904368 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.910815 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.912601 19191 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.915020 27251 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:06.915714 27251 raft_consensus.cc:493] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.916150 27251 raft_consensus.cc:515] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.918190 27251 leader_election.cc:290] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.921216 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.921767 27270 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:06.922417 27270 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:06.924660 27270 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:06.928764 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.934365 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52aa7e17e68407492d15e97e52d910d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:06.936102 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:06.951298 19191 leader_election.cc:304] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.953855 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:06.955529 27270 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:06.953696 27251 raft_consensus.cc:2749] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:06.983742 27251 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:06.984475 27251 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:06.993609 27251 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:06.995100 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:06.995095 19114 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58832 (request call id 268) took 3443 ms. Trace:
I20260709 13:12:06.995924 19114 rpcz_store.cc:276] 0709 13:12:03.551692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.094571 (+2542879us) service_pool.cc:224] Handling call
0709 13:12:06.995002 (+900431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:06.699687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:06.700281 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:06.700320 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:12:06.700344 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:06.703616 (+  3272us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:06.703694 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:06.703729 (+    35us) tablet.cc:685] Acquiring locks for 40 operations
0709 13:12:06.708943 (+  5214us) tablet.cc:701] Row locks acquired
0709 13:12:06.708965 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:12:06.709114 (+   149us) write_op.cc:270] Start()
0709 13:12:06.709255 (+   141us) write_op.cc:276] Timestamp: P: 1783602726709070 usec, L: 0
0709 13:12:06.709287 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:12:06.710208 (+   921us) log.cc:844] Serialized 15760 byte log entry
0709 13:12:06.774411 (+ 64203us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b180039fd60. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8ddc90de1 00007fe8ddc9d5b1 00007fe8db8ec41d 00007fe8db8ee71a 00007fe8db8ee6a8 00007fe8db8ee628 00007fe8db8ee5e3 00007fe8db8ed7fc 00007fe8ddd20626 00007fe8ddd1add8 00007fe8d7ec1310
0709 13:12:06.774475 (+    64us) op_driver.cc:464] REPLICATION: finished
0709 13:12:06.774877 (+   402us) write_op.cc:301] APPLY: starting
0709 13:12:06.774969 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:06.888364 (+113395us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:06.888390 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:06.923118 (+ 34728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:06.923575 (+   457us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=80,key_file_lookups=80,delta_file_lookups=80,mrs_lookups=0
0709 13:12:06.923642 (+    67us) write_op.cc:312] APPLY: finished
0709 13:12:06.924297 (+   655us) log.cc:844] Serialized 340 byte log entry
0709 13:12:06.925140 (+   843us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.925433 (+   293us) write_op.cc:454] Released schema lock
0709 13:12:06.925518 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:06.925927 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:06.925957 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1212,"reported_tablets":50,"spinlock_wait_cycles":543616,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":49824,"apply.run_wall_time_us":150995,"cfile_cache_hit":160,"cfile_cache_hit_bytes":167040,"num_ops":40,"prepare.queue_time_us":124,"prepare.run_cpu_time_us":9036,"prepare.run_wall_time_us":29519,"replication_time_us":20403,"spinlock_wait_cycles":60013952}]]}
I20260709 13:12:06.996482 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88904f118f462b924e48beec293ae5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.008817 19191 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:07.009398 19372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:12:07.010216 19372 raft_consensus.cc:606] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Received request to transfer leadership
I20260709 13:12:07.010493 27270 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:07.015908 19372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:12:07.022789 19372 raft_consensus.cc:606] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Received request to transfer leadership
I20260709 13:12:07.041399 19367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396"
dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50702
I20260709 13:12:07.042035 19367 raft_consensus.cc:606] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Received request to transfer leadership
W20260709 13:12:07.104141 19120 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 263) took 86715 ms (client timeout 15000 ms). Trace:
W20260709 13:12:07.104698 19120 rpcz_store.cc:269] 0709 13:10:40.388966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.390615 (+  1649us) service_pool.cc:224] Handling call
0709 13:12:07.103916 (+86713301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3877,"reported_tablets":50,"spinlock_wait_cycles":1920}
W20260709 13:12:07.121618 18095 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 19250)
W20260709 13:12:07.126650 19171 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:12:07.127202 19171 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 1668ce4cb86e4e9daf99a53a2be8a396 already in progress
W20260709 13:12:07.127560 19171 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 1668ce4cb86e4e9daf99a53a2be8a396 already in progress
I20260709 13:12:07.156499 19114 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 14 to 15, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 15 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.159312 27209 raft_consensus.cc:993] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: : Instructing follower d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:12:07.158601 19114 catalog_manager.cc:5697] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:07.160148 27120 raft_consensus.cc:1081] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Signalling peer d50eb2dab6754df8bcbed1445f2e8430 to start an election
I20260709 13:12:07.161270 19114 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 19 to 24, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 24 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:07.162388 19902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396"
dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
 from {username='slave'} at 127.0.0.1:37370
I20260709 13:12:07.163026 19902 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:07.163386 19902 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:07.167290 27270 raft_consensus.cc:493] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:07.167909 27270 raft_consensus.cc:515] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.170296 27270 leader_election.cc:290] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.165453 19114 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 16 to 21, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 21 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } }
I20260709 13:12:07.172034 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:07.173123 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3326b22da5604cba90d4a58baab1ac81" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.176188 27270 raft_consensus.cc:493] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:07.176779 27270 raft_consensus.cc:515] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.177387 19191 leader_election.cc:304] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.178810 27251 raft_consensus.cc:2749] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:07.179721 27270 leader_election.cc:290] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.181707 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.182358 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc29620a3fdb42269ab707a442ca6096" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:07.183918 19191 leader_election.cc:304] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.184679 27270 raft_consensus.cc:2749] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:12:07.184031 19902 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:07.199775 19902 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.200340 27270 raft_consensus.cc:493] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.200932 27270 raft_consensus.cc:515] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:07.202175 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:07.202907 19372 raft_consensus.cc:3055] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:12:07.203138 27270 leader_election.cc:290] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:07.204877 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:07.207098 19121 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 161) took 88019 ms (client timeout 15000 ms). Trace:
I20260709 13:12:07.214084 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:07.222837 19299 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:07.230935 19299 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
W20260709 13:12:07.231419 19121 rpcz_store.cc:269] 0709 13:10:39.187394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.187652 (+   258us) service_pool.cc:224] Handling call
0709 13:12:07.206889 (+88019237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77550,"reported_tablets":28}
I20260709 13:12:07.203272 19372 raft_consensus.cc:740] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:07.241217 19372 consensus_queue.cc:260] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:07.243465 19372 raft_consensus.cc:3060] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:07.254896 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff34caf0ca44db08f7c49f51ca52966" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.272923 19191 leader_election.cc:304] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:07.274035 27270 raft_consensus.cc:2749] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:12:07.318033 19868 leader_election.cc:336] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:07.346552 19372 raft_consensus.cc:2468] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:12:07.353838 19869 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:07.356245 27248 raft_consensus.cc:2804] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:12:07.356817 27248 raft_consensus.cc:697] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:07.357785 27248 consensus_queue.cc:237] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:07.375720 27251 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:07.376366 27251 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.378587 27251 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:07.446151 19188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 70661.9us
I20260709 13:12:07.467568 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:07.472070 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f20bf866b6473ca02552904ffcbe5a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.487118 19191 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.505735 27270 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:07.507161 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:07.617280 27270 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:07.618304 27270 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.621706 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:07.654301 19122 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 262) took 109507 ms (client timeout 15000 ms). Trace:
W20260709 13:12:07.655934 19122 rpcz_store.cc:269] 0709 13:10:18.146848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.147277 (+   429us) service_pool.cc:224] Handling call
0709 13:12:07.654033 (+109506756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7039,"reported_tablets":50}
I20260709 13:12:07.657889 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.658303 27270 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.664602 19191 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.665596 27270 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:07.661469 19118 catalog_manager.cc:5697] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.679334 27270 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:07.680156 27270 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.682499 27270 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.683472 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.683943 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95788528f474a568f6df71dd9018575" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:07.684962 19118 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 21 to 22, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 22 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.686502 19191 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.687363 27270 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:07.687578 19118 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 12 to 14, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 14 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.734817 19118 catalog_manager.cc:5697] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.736888 19118 catalog_manager.cc:5697] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 15 to 19, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 19 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:07.768821 26995 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:07.769506 26995 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.772949 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:07.781508 26995 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.782497 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.785322 19191 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.786360 26995 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:07.783934 19123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 261) took 132019 ms (client timeout 15000 ms). Trace:
W20260709 13:12:07.801216 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.801803 19123 rpcz_store.cc:269] 0709 13:09:55.764113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.764384 (+   271us) service_pool.cc:224] Handling call
0709 13:09:56.002704 (+238320us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:12:07.783703 (+131780999us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43588,"reported_tablets":50,"spinlock_wait_cycles":28252928}
I20260709 13:12:07.831286 26995 raft_consensus.cc:493] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:07.831933 26995 raft_consensus.cc:515] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:07.834004 26995 leader_election.cc:290] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:07.835407 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:07.836058 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86cbc75bead4640b156a7262753a86d" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:07.838410 19191 leader_election.cc:304] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:07.839304 26995 raft_consensus.cc:2749] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:07.857630 19371 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:12:07.860687 27248 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:12:07.923218 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:07.924204 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:07.929208 19118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 164) took 16019 ms (client timeout 15000 ms). Trace:
I20260709 13:12:07.933544 19294 raft_consensus.cc:1275] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Refusing update from remote peer d50eb2dab6754df8bcbed1445f2e8430: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:12:07.929708 19118 rpcz_store.cc:269] 0709 13:11:51.981492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.808547 (+11827055us) service_pool.cc:224] Handling call
0709 13:12:03.862263 (+ 53716us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:12:07.929105 (+4066842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:07.773663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:07.774364 (+   701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:07.774415 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:12:07.774440 (+    25us) tablet.cc:662] Decoding operations
0709 13:12:07.775302 (+   862us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:07.775405 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:07.775443 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:12:07.776103 (+   660us) tablet.cc:701] Row locks acquired
0709 13:12:07.776122 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:07.792347 (+ 16225us) write_op.cc:270] Start()
0709 13:12:07.792478 (+   131us) write_op.cc:276] Timestamp: P: 1783602727792287 usec, L: 0
0709 13:12:07.792507 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:12:07.793224 (+   717us) log.cc:844] Serialized 2084 byte log entry
0709 13:12:07.818026 (+ 24802us) op_driver.cc:464] REPLICATION: finished
0709 13:12:07.831061 (+ 13035us) write_op.cc:301] APPLY: starting
0709 13:12:07.831169 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:07.844211 (+ 13042us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:07.844340 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:07.870455 (+ 26115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:07.870760 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:12:07.870813 (+    53us) write_op.cc:312] APPLY: finished
0709 13:12:07.871079 (+   266us) log.cc:844] Serialized 57 byte log entry
0709 13:12:07.871283 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:07.871390 (+   107us) write_op.cc:454] Released schema lock
0709 13:12:07.871429 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:07.871821 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:07.871849 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":90203,"reported_tablets":29,"spinlock_wait_cycles":44989824,"child_traces":[["op",{"apply.queue_time_us":12719,"apply.run_cpu_time_us":9052,"apply.run_wall_time_us":40771,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25007,"num_ops":5,"prepare.queue_time_us":20413,"prepare.run_cpu_time_us":3914,"prepare.run_wall_time_us":25989,"replication_time_us":25357,"thread_start_us":32535,"threads_started":2}]]}
I20260709 13:12:07.945811 27248 consensus_queue.cc:1048] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:12:07.951462 19117 catalog_manager.cc:5697] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 18 to 21, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.957283 19117 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 20 to 24, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 24 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.064364 27251 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.064745 26995 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.065071 27251 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.065351 26995 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.067306 27251 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.067384 26995 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.068315 26995 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.068794 26995 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.070808 26995 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.081099 19117 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 20 to 23, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 23 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.089553 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.091471 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.104785 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32ecd0e2df44d9eace43b19017215ee" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.105954 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbaa5acb8ba24137bd7a86d1598250e1" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:08.109472 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.110121 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.122116 18095 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 19250)
I20260709 13:12:08.122128 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.148000 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8639f6119a14d6bb7cd841127c14e48" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.162449 19188 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.163703 19188 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.165028 26995 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:08.165752 26995 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:08.180440 27251 raft_consensus.cc:493] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.181010 27251 raft_consensus.cc:515] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.183105 27251 leader_election.cc:290] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.186012 19191 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.186951 27251 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:08.188874 19868 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 391 similar messages]
W20260709 13:12:08.202170 19265 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.210918 27251 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.211520 27251 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.213630 27251 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.223592 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:08.229176 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.231233 19115 catalog_manager.cc:5697] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:12:08.237615 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.260751 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 80564.8us
I20260709 13:12:08.262012 19115 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba reported cstate change: term changed from 14 to 15, leader changed from d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) to 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193). New cstate: current_term: 15 leader_uuid: "56df67425e6f45d3b2b42441e3c143ba" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.266014 19117 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58842 (request call id 254) took 11077 ms. Trace:
I20260709 13:12:08.270896 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.268298 19117 rpcz_store.cc:276] 0709 13:11:57.188788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.450604 (+8261816us) service_pool.cc:224] Handling call
0709 13:12:05.474614 (+ 24010us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1f090 00007fe8d7ebdf3a 00007fe8ddc741cc 00007fe8ddd7237e 00007fe8dc2332a4 00007fe8dc233232 00007fe8dc233161 00007fe8dc2330dc 00007fe8dc232392 00007fe8d61f048c 00007fe8d61ef8c6
0709 13:12:08.265945 (+2791331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:08.116106 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:08.116729 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:08.116772 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:12:08.116795 (+    23us) tablet.cc:662] Decoding operations
0709 13:12:08.117367 (+   572us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:08.117424 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:08.117458 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:12:08.117786 (+   328us) tablet.cc:701] Row locks acquired
0709 13:12:08.117804 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:12:08.117965 (+   161us) write_op.cc:270] Start()
0709 13:12:08.118090 (+   125us) write_op.cc:276] Timestamp: P: 1783602728117917 usec, L: 0
0709 13:12:08.118114 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:08.118786 (+   672us) log.cc:844] Serialized 1311 byte log entry
0709 13:12:08.121051 (+  2265us) op_driver.cc:464] REPLICATION: finished
0709 13:12:08.121452 (+   401us) write_op.cc:301] APPLY: starting
0709 13:12:08.121521 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:08.123342 (+  1821us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:08.123434 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:08.125431 (+  1997us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:08.125634 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:12:08.125689 (+    55us) write_op.cc:312] APPLY: finished
0709 13:12:08.125905 (+   216us) log.cc:844] Serialized 41 byte log entry
0709 13:12:08.126818 (+   913us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.126921 (+   103us) write_op.cc:454] Released schema lock
0709 13:12:08.126965 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:08.127310 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.127356 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5,"reported_tablets":51,"spinlock_wait_cycles":21594368,"child_traces":[["op",{"apply.queue_time_us":224,"apply.run_cpu_time_us":5090,"apply.run_wall_time_us":5804,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":2970,"prepare.run_wall_time_us":2978,"replication_time_us":2828}]]}
I20260709 13:12:08.296830 19118 catalog_manager.cc:5697] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 21 to 22, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 22 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:08.299993 27251 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:08.300642 27251 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.303129 27251 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.306612 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.310707 27251 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.311359 27251 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.312312 26995 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.312834 26995 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.313766 27251 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.314661 26995 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.324813 26995 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.325363 26995 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.328245 26995 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.335656 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.335911 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.336105 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.337502 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba44c11bd3fc411ca166bf56c457490f" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.340988 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.368995 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc8043164d78443493704a95fae3b832" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.371080 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.395709 19371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.397071 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.402392 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.409858 19191 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.419122 26995 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:08.420485 19191 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.425793 26995 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:08.495247 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.496671 19115 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58822 (request call id 267) took 7344 ms. Trace:
I20260709 13:12:08.500780 19119 catalog_manager.cc:5697] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 24 to 27, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 27 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.507213 19119 catalog_manager.cc:5697] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:12:08.510591 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 85864us
I20260709 13:12:08.517596 27251 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.523617 27251 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.525818 27251 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.518863 19191 leader_election.cc:304] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.497151 19115 rpcz_store.cc:276] 0709 13:12:01.152869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.901196 (+4748327us) service_pool.cc:224] Handling call
0709 13:12:08.496599 (+2595403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:08.283739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:08.284346 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:08.284447 (+   101us) write_op.cc:435] Acquired schema lock
0709 13:12:08.284471 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:08.284927 (+   456us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:08.284990 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:08.285021 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:08.285372 (+   351us) tablet.cc:701] Row locks acquired
0709 13:12:08.285393 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:08.285547 (+   154us) write_op.cc:270] Start()
0709 13:12:08.285664 (+   117us) write_op.cc:276] Timestamp: P: 1783602728285499 usec, L: 0
0709 13:12:08.285687 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:12:08.288944 (+  3257us) log.cc:844] Serialized 925 byte log entry
0709 13:12:08.290750 (+  1806us) op_driver.cc:464] REPLICATION: finished
0709 13:12:08.290905 (+   155us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5400068954. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eb0e28 00007fe8db8eb581 00007fe8db8ead58 00007fe8db8ef9f1 00007fe8db8ef9a9 00007fe8db8ef939 00007fe8db8ef901 00007fe8db8eeb2d 000000000038f354 000000000038f199
0709 13:12:08.291214 (+   309us) write_op.cc:301] APPLY: starting
0709 13:12:08.291288 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:08.292557 (+  1269us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:08.292600 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:08.293935 (+  1335us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:08.294114 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:12:08.294166 (+    52us) write_op.cc:312] APPLY: finished
0709 13:12:08.294376 (+   210us) log.cc:844] Serialized 33 byte log entry
0709 13:12:08.294584 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.294676 (+    92us) write_op.cc:454] Released schema lock
0709 13:12:08.294731 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:08.295057 (+   326us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.295084 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28534,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":274,"apply.run_cpu_time_us":3810,"apply.run_wall_time_us":3809,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8352,"num_ops":2,"prepare.queue_time_us":15415,"prepare.run_cpu_time_us":4947,"prepare.run_wall_time_us":7346,"replication_time_us":4949,"spinlock_wait_cycles":5844352}]]}
I20260709 13:12:08.532856 27251 raft_consensus.cc:2749] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:08.534142 19191 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.535663 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:08.539215 27251 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:08.539718 18095 tablet_replica.cc:333] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.521430 19119 catalog_manager.cc:5697] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 20 to 21, leader changed from c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 21 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.540795 18095 raft_consensus.cc:2243] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.545549 19191 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.545910 18095 raft_consensus.cc:2272] T fa469320af8e4483baa8a2bb6187b226 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.565598 27251 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.584497 27251 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.586565 27251 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.586694 26995 raft_consensus.cc:493] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.587221 18095 tablet_replica.cc:333] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.589104 18095 raft_consensus.cc:2243] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.590206 18095 raft_consensus.cc:2272] T d8f20bf866b6473ca02552904ffcbe5a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.565843 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:08.587585 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.587230 26995 raft_consensus.cc:515] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.596264 26995 leader_election.cc:290] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.599411 18095 tablet_replica.cc:333] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.612573 26995 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:08.612692 19191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 67222.8us
I20260709 13:12:08.614598 19191 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.615288 27251 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:08.620575 18095 raft_consensus.cc:2243] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.621480 18095 raft_consensus.cc:2272] T 0bef21d2e4214a018d420d2f02b90db2 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.623646 18095 tablet_replica.cc:333] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.624929 18095 raft_consensus.cc:2243] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.626130 18095 raft_consensus.cc:2272] T b95788528f474a568f6df71dd9018575 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.627750 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.631523 19293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.633390 27326 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.633987 27326 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:08.581007 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.635628 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 54679.4us
I20260709 13:12:08.640178 26995 raft_consensus.cc:493] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:08.640655 26995 raft_consensus.cc:515] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:08.640944 27326 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.643985 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:08.644881 26995 leader_election.cc:290] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:08.648509 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00a643f3a9e471980d5a732c373a17c" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.650010 18095 tablet_replica.cc:333] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.650080 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03d4cdd71fcc4422813ad324c5c5f5e5" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.651388 18095 raft_consensus.cc:2243] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.652136 18095 raft_consensus.cc:2272] T 04d6d17ab159434aa4497a703c6856d6 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.653440 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d40258a53ba4865adc2a744f3aa6256" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.654898 26995 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:08.655373 26995 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.657176 26995 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.658768 18095 tablet_replica.cc:333] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.659713 18095 raft_consensus.cc:2243] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.660494 18095 raft_consensus.cc:2272] T 3326b22da5604cba90d4a58baab1ac81 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.660967 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.663247 19119 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36688 (request call id 165) took 1883 ms. Trace:
W20260709 13:12:08.668737 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.661806 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.663398 18095 tablet_replica.cc:333] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
W20260709 13:12:08.670094 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.670630 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.663698 19119 rpcz_store.cc:276] 0709 13:12:06.779891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.780445 (+   554us) service_pool.cc:224] Handling call
0709 13:12:08.663159 (+1882714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:08.570848 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:08.571416 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:08.571456 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:12:08.571476 (+    20us) tablet.cc:662] Decoding operations
0709 13:12:08.572003 (+   527us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:08.572067 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:08.572092 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:12:08.572457 (+   365us) tablet.cc:701] Row locks acquired
0709 13:12:08.572476 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:08.572619 (+   143us) write_op.cc:270] Start()
0709 13:12:08.572735 (+   116us) write_op.cc:276] Timestamp: P: 1783602728572571 usec, L: 0
0709 13:12:08.572757 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:08.573388 (+   631us) log.cc:844] Serialized 1311 byte log entry
0709 13:12:08.575464 (+  2076us) op_driver.cc:464] REPLICATION: finished
0709 13:12:08.575881 (+   417us) write_op.cc:301] APPLY: starting
0709 13:12:08.575957 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:08.577742 (+  1785us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:08.577832 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:08.579748 (+  1916us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:08.579912 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:12:08.579955 (+    43us) write_op.cc:312] APPLY: finished
0709 13:12:08.580149 (+   194us) log.cc:844] Serialized 41 byte log entry
0709 13:12:08.580962 (+   813us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.581050 (+    88us) write_op.cc:454] Released schema lock
0709 13:12:08.581093 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:08.581590 (+   497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.581616 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72574,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":4906,"apply.run_wall_time_us":5671,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":4931,"prepare.run_cpu_time_us":2821,"prepare.run_wall_time_us":2822,"replication_time_us":2600}]]}
W20260709 13:12:08.673331 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.673503 18095 raft_consensus.cc:2243] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.675565 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.676296 18095 raft_consensus.cc:2272] T ba44c11bd3fc411ca166bf56c457490f P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.679252 18095 tablet_replica.cc:333] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.680510 18095 raft_consensus.cc:2243] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.681149 18095 raft_consensus.cc:2272] T 4a94e7b00544419ab2f3f84812c9b155 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.684095 18095 tablet_replica.cc:333] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.685055 18095 raft_consensus.cc:2243] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.686049 18095 raft_consensus.cc:2272] T ce726108fd4e452b9a0b91d535939c7d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.669392 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.694394 18095 tablet_replica.cc:333] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
W20260709 13:12:08.694999 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.695427 18095 raft_consensus.cc:2243] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:08.695606 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.696199 18095 raft_consensus.cc:2272] T d5c7a109008641aaa9e738f35f1abf42 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.697084 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.699250 18095 tablet_replica.cc:333] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.699856 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.700227 18095 raft_consensus.cc:2243] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.700903 18095 raft_consensus.cc:2272] T 6c88904f118f462b924e48beec293ae5 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.701689 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.704576 18095 tablet_replica.cc:333] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.705446 18095 raft_consensus.cc:2243] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.706105 18095 raft_consensus.cc:2272] T cbaa5acb8ba24137bd7a86d1598250e1 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.704421 19191 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.707244 26995 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:08.710575 19191 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.711925 26995 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:08.712093 19191 leader_election.cc:304] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.712761 18095 tablet_replica.cc:333] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.714183 27251 raft_consensus.cc:2749] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:08.713884 18095 raft_consensus.cc:2243] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.717254 18095 raft_consensus.cc:2272] T c72e44ed47fd497bb5b8eb2891ce261a P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.722028 18095 tablet_replica.cc:333] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.726999 18095 raft_consensus.cc:2243] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:08.728336 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.728986 18095 raft_consensus.cc:2272] T f00a643f3a9e471980d5a732c373a17c P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.735824 18095 tablet_replica.cc:333] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.736752 18095 raft_consensus.cc:2243] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.737792 18095 raft_consensus.cc:2272] T 1ecbfdae2bef4b75b68f71759bd60f98 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.729627 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.741544 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.742139 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.744187 18095 tablet_replica.cc:333] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.745061 18095 raft_consensus.cc:2243] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.746337 18095 raft_consensus.cc:2272] T c79ddd82cd084684a0080d4432222b09 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.749104 18095 tablet_replica.cc:333] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.749900 18095 raft_consensus.cc:2243] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.750861 18095 raft_consensus.cc:2272] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.753803 18095 tablet_replica.cc:333] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.756568 18095 raft_consensus.cc:2243] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.758145 18095 raft_consensus.cc:2272] T bc29620a3fdb42269ab707a442ca6096 P 56df67425e6f45d3b2b42441e3c143ba [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.758967 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1ac12e26544cfc823327c519f83882" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.760563 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e795450462624104a515893162f51e61" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.761077 18095 tablet_replica.cc:333] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.761965 18095 raft_consensus.cc:2243] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.762691 18095 raft_consensus.cc:2272] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.763538 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.765506 18095 tablet_replica.cc:333] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.766377 18095 raft_consensus.cc:2243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.767338 18095 raft_consensus.cc:2272] T 1668ce4cb86e4e9daf99a53a2be8a396 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.772835 18095 tablet_replica.cc:333] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.773775 18095 raft_consensus.cc:2243] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.774335 18095 raft_consensus.cc:2272] T 95709490503b42e39a7b595994f42990 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.777873 18095 tablet_replica.cc:333] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.779727 18095 raft_consensus.cc:2243] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.782138 18095 raft_consensus.cc:2272] T a9a6e62faf9e420795c6070c3109c9e4 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.785010 18095 tablet_replica.cc:333] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.785794 18095 raft_consensus.cc:2243] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.786430 18095 raft_consensus.cc:2272] T aff34caf0ca44db08f7c49f51ca52966 P 56df67425e6f45d3b2b42441e3c143ba [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.809315 18095 tablet_replica.cc:333] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.810091 18095 raft_consensus.cc:2243] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.811668 18095 raft_consensus.cc:2272] T f43f1e515be64813bb797fabd579621f P 56df67425e6f45d3b2b42441e3c143ba [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.814128 18095 tablet_replica.cc:333] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.814847 18095 raft_consensus.cc:2243] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.815485 18095 raft_consensus.cc:2272] T d825739f94b747959f93597edca9200a P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.820251 18095 tablet_replica.cc:333] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.821018 18095 raft_consensus.cc:2243] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.821810 18095 raft_consensus.cc:2272] T df30e48897304c19b2d4f8683acbae54 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.833966 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.839669 18095 tablet_replica.cc:333] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.840647 18095 raft_consensus.cc:2243] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.841359 18095 raft_consensus.cc:2272] T 6f5150fb077a470497ba70512f18f476 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.844460 18095 tablet_replica.cc:333] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.845239 18095 raft_consensus.cc:2243] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.845988 18095 raft_consensus.cc:2272] T 1d40258a53ba4865adc2a744f3aa6256 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.848651 18095 tablet_replica.cc:333] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.849378 18095 raft_consensus.cc:2243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.850185 18095 raft_consensus.cc:2272] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.852566 18095 tablet_replica.cc:333] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.853286 18095 raft_consensus.cc:2243] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.853952 18095 raft_consensus.cc:2272] T dc8043164d78443493704a95fae3b832 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.856629 18095 tablet_replica.cc:333] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.857370 18095 raft_consensus.cc:2243] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:12:08.857532 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.858284 18095 raft_consensus.cc:2272] T f2c0dc5e5d2542c88c79527e70d218e3 P 56df67425e6f45d3b2b42441e3c143ba [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.869356 19191 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:12:08.870039 19191 raft_consensus.cc:2686] T 3a1ac12e26544cfc823327c519f83882 P 56df67425e6f45d3b2b42441e3c143ba: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:08.870941 19191 leader_election.cc:304] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:08.871980 27251 raft_consensus.cc:2749] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:08.873172 19191 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:12:08.875279 19191 raft_consensus.cc:2686] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 56df67425e6f45d3b2b42441e3c143ba: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:08.882795 18095 tablet_replica.cc:333] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.885210 18095 raft_consensus.cc:2243] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.885902 18095 raft_consensus.cc:2272] T 3301e091b13b45e8833e94ab3073d14a P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.889686 27251 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.890215 27251 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.892318 27251 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.893745 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:08.890244 18095 tablet_replica.cc:333] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.903424 18095 raft_consensus.cc:2243] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.904141 18095 raft_consensus.cc:2272] T 50bda02534b549db92f2a72e046dedf4 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.905748 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.906627 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.907303 18095 tablet_replica.cc:333] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
W20260709 13:12:08.907305 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.908386 18095 raft_consensus.cc:2243] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.909083 18095 raft_consensus.cc:2272] T c86cbc75bead4640b156a7262753a86d P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.912137 18095 tablet_replica.cc:333] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.912981 18095 raft_consensus.cc:2243] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.914371 18095 raft_consensus.cc:2272] T f52aa7e17e68407492d15e97e52d910d P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.917448 18095 tablet_replica.cc:333] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
W20260709 13:12:08.922402 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:08.923069 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.925365 19372 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:08.927147 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.929181 19191 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.930270 27251 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:08.945395 27251 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:08.946002 27251 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:08.948222 27251 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:08.950657 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:08.952075 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:08.952791 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16746551ccf4c97861c6a0bab8d2847" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:08.954250 19191 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:08.955418 27251 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:08.918285 18095 raft_consensus.cc:2243] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.971024 18095 raft_consensus.cc:2272] T 994bf3418aeb467ea0f5718bd6226a66 P 56df67425e6f45d3b2b42441e3c143ba [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.992726 18095 tablet_replica.cc:333] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:08.994174 18095 raft_consensus.cc:2243] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.002127 18095 raft_consensus.cc:2272] T a7547528ebe74640917580adfe8092bd P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.004957 18095 tablet_replica.cc:333] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
W20260709 13:12:09.005167 19337 consensus_peers.cc:597] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8f20bf866b6473ca02552904ffcbe5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.005745 18095 raft_consensus.cc:2243] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:09.009797 18095 raft_consensus.cc:2272] T 596e24ea147d4840a5e4645f5bac6bf1 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.010141 19299 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:12:09.011577 27317 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:12:09.012986 19339 consensus_peers.cc:597] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.028507 18095 tablet_replica.cc:333] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.029628 18095 raft_consensus.cc:2243] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.030345 18095 raft_consensus.cc:2272] T c32ecd0e2df44d9eace43b19017215ee P 56df67425e6f45d3b2b42441e3c143ba [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.040346 18095 tablet_replica.cc:333] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.041203 18095 raft_consensus.cc:2243] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.041967 18095 raft_consensus.cc:2272] T eba0c928a13f4f5ab22f30b9971564fd P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:09.043196 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:09.045097 18095 tablet_replica.cc:333] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.045966 18095 raft_consensus.cc:2243] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.046722 18095 raft_consensus.cc:2272] T 03d4cdd71fcc4422813ad324c5c5f5e5 P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.050009 18095 tablet_replica.cc:333] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.053493 27251 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:09.053265 27209 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.054065 27251 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:09.056281 27251 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:09.060253 19294 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index -1 to 14, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.066439 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:09.068509 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0355f53de74ee2afbb9a27c7449d75" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:09.075541 19191 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:09.050781 18095 raft_consensus.cc:2243] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:09.076714 27251 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:09.077276 18095 raft_consensus.cc:2272] T de803894748b488d81cb5c7007c78cce P 56df67425e6f45d3b2b42441e3c143ba [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.081645 27251 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:09.082365 27251 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:09.083390 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:09.086999 27251 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:09.088557 18095 tablet_replica.cc:333] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.090417 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:09.091957 18095 raft_consensus.cc:2243] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.092685 18095 raft_consensus.cc:2272] T 78d1dbf9a24f4b489920281c72245ab4 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.094458 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d425f48ed5b488e9080214e593ef6fc" candidate_uuid: "56df67425e6f45d3b2b42441e3c143ba" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:09.095443 18095 tablet_replica.cc:333] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.095973 19191 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56df67425e6f45d3b2b42441e3c143ba; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:09.097396 27251 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:09.096231 18095 raft_consensus.cc:2243] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.098709 18095 raft_consensus.cc:2272] T e795450462624104a515893162f51e61 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.101651 18095 tablet_replica.cc:333] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.102367 18095 raft_consensus.cc:2243] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.103171 18095 raft_consensus.cc:2272] T 03efca40b3ba4ad5b0122303a9a227a2 P 56df67425e6f45d3b2b42441e3c143ba [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.106607 19115 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec reported cstate change: config changed from index -1 to 14, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 24 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.113528 18095 tablet_replica.cc:333] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.114358 18095 raft_consensus.cc:2243] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.115000 18095 raft_consensus.cc:2272] T 5d425f48ed5b488e9080214e593ef6fc P 56df67425e6f45d3b2b42441e3c143ba [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.117821 18095 tablet_replica.cc:333] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.118505 18095 raft_consensus.cc:2243] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.119184 18095 raft_consensus.cc:2272] T f16746551ccf4c97861c6a0bab8d2847 P 56df67425e6f45d3b2b42441e3c143ba [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.140250 18095 tablet_replica.cc:333] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.140964 18095 raft_consensus.cc:2243] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:09.141350 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:09.141662 18095 raft_consensus.cc:2272] T b8639f6119a14d6bb7cd841127c14e48 P 56df67425e6f45d3b2b42441e3c143ba [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.144528 18095 tablet_replica.cc:333] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.145174 18095 raft_consensus.cc:2243] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.145715 18095 raft_consensus.cc:2272] T 475b307cc1294b0da1fe31955e1eabc2 P 56df67425e6f45d3b2b42441e3c143ba [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.148231 18095 tablet_replica.cc:333] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba: stopping tablet replica
I20260709 13:12:09.148823 18095 raft_consensus.cc:2243] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:09.149372 18095 raft_consensus.cc:2272] T 3a0355f53de74ee2afbb9a27c7449d75 P 56df67425e6f45d3b2b42441e3c143ba [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:09.207839 19294 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:09.252074 19369 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:12:09.254312 19263 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7547528ebe74640917580adfe8092bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.256103 27300 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:12:09.265595 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.304525 19372 raft_consensus.cc:2955] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.299209 27300 raft_consensus.cc:2955] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.333634 19119 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 15, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.356688 19299 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:09.381019 19372 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:12:09.381484 19263 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 475b307cc1294b0da1fe31955e1eabc2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.382705 27300 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:12:09.400491 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:09.406147 19265 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.426302 27337 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.428184 19369 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.448073 19119 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 15, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.470171 19299 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
W20260709 13:12:09.538295 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.540702 19372 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 13:12:09.544643 19263 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805): Couldn't send request to peer d50eb2dab6754df8bcbed1445f2e8430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eba0c928a13f4f5ab22f30b9971564fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.544870 27337 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:09.578768 27349 ts_tablet_manager.cc:933] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:09.583374 27349 tablet_copy_client.cc:323] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.195:46545
I20260709 13:12:09.586971 19383 tablet_copy_service.cc:140] P c6a09cefdddd4ca8a10b66682ed27dad: Received BeginTabletCopySession request for tablet d8f20bf866b6473ca02552904ffcbe5a from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:49022)
I20260709 13:12:09.587617 19383 tablet_copy_service.cc:161] P c6a09cefdddd4ca8a10b66682ed27dad: Beginning new tablet copy session on tablet d8f20bf866b6473ca02552904ffcbe5a from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:49022: session id = d50eb2dab6754df8bcbed1445f2e8430-d8f20bf866b6473ca02552904ffcbe5a
I20260709 13:12:09.592384 27347 raft_consensus.cc:2955] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Committing config change with OpId 23.12: config changed from index -1 to 12, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.596822 19369 raft_consensus.cc:2955] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Committing config change with OpId 23.12: config changed from index -1 to 12, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.619560 19383 tablet_copy_source_session.cc:215] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:09.629315 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f20bf866b6473ca02552904ffcbe5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:09.629841 19119 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index -1 to 12, NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) added. New cstate: current_term: 23 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } } }
I20260709 13:12:09.687161 27349 tablet_copy_client.cc:806] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:09.687973 27349 tablet_copy_client.cc:670] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:09.695343 27349 tablet_copy_client.cc:538] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:09.726082 27349 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:12:09.759887 27347 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:09.760509 27347 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:09.763594 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:09.771695 19265 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:09.772686 27347 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:09.772303 19265 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:09.779049 27347 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:09.841055 27355 ts_tablet_manager.cc:933] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:09.848784 27209 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:09.849382 27209 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:09.851303 27209 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:09.853598 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:09.854256 19299 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:12:09.858619 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:12:09.860055 19339 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:09.862015 27330 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:09.862445 27330 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:09.862824 27330 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:09.866905 27248 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:09.867448 27248 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:09.871560 27330 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:09.874228 27248 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:09.874271 27354 ts_tablet_manager.cc:933] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:09.879160 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:09.885591 19868 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:09.886060 19868 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:09.887356 27248 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:09.888604 27330 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:09.892364 19339 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:09.895424 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:09.896039 19299 raft_consensus.cc:3060] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:09.905429 27330 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:09.905717 27337 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:09.906075 27330 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:09.906350 27337 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:09.908313 27330 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:09.922245 19339 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:09.924779 27337 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:09.927394 27355 tablet_copy_client.cc:323] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:12:09.928367 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:09.928550 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:09.934877 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:09.937089 27209 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:09.938898 19299 raft_consensus.cc:2468] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 25.
I20260709 13:12:09.938161 27349 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:09.942634 19340 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:09.942898 19310 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet a7547528ebe74640917580adfe8092bd from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:12:09.943493 19310 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet a7547528ebe74640917580adfe8092bd from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-a7547528ebe74640917580adfe8092bd
I20260709 13:12:09.944005 27209 raft_consensus.cc:2804] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:12:09.944578 27209 raft_consensus.cc:697] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:09.945300 27209 consensus_queue.cc:237] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:09.947659 19265 leader_election.cc:336] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:09.948244 19265 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:09.949061 27347 raft_consensus.cc:2749] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:09.956418 27354 tablet_copy_client.cc:323] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:12:09.958595 19309 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet 475b307cc1294b0da1fe31955e1eabc2 from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:12:09.959240 19309 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet 475b307cc1294b0da1fe31955e1eabc2 from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-475b307cc1294b0da1fe31955e1eabc2
I20260709 13:12:09.962973 19310 tablet_copy_source_session.cc:215] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:09.969192 27349 tablet_bootstrap.cc:492] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:12:09.970136 27349 ts_tablet_manager.cc:1403] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.244s	user 0.048s	sys 0.010s
I20260709 13:12:09.982972 27355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7547528ebe74640917580adfe8092bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:09.986413 27349 raft_consensus.cc:359] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:09.987459 27349 raft_consensus.cc:740] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:12:09.988252 27349 consensus_queue.cc:260] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:10.014030 19309 tablet_copy_source_session.cc:215] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:10.020524 27349 ts_tablet_manager.cc:1434] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.003s
I20260709 13:12:10.023258 19115 catalog_manager.cc:5697] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 24 to 25, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 25 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.063274 27361 ts_tablet_manager.cc:933] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: Initiating tablet copy from peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.036016 27355 tablet_copy_client.cc:806] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:10.067325 27355 tablet_copy_client.cc:670] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
W20260709 13:12:10.083900 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:10.094103 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 84837.2us
I20260709 13:12:10.098572 19383 tablet_copy_service.cc:342] P c6a09cefdddd4ca8a10b66682ed27dad: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-d8f20bf866b6473ca02552904ffcbe5a received from {username='slave'} at 127.0.0.1:49022
I20260709 13:12:10.099046 19383 tablet_copy_service.cc:434] P c6a09cefdddd4ca8a10b66682ed27dad: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-d8f20bf866b6473ca02552904ffcbe5a on tablet d8f20bf866b6473ca02552904ffcbe5a with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:10.108973 27361 tablet_copy_client.cc:323] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Beginning tablet copy session from remote peer at address 127.17.171.194:37985
I20260709 13:12:10.110064 27354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475b307cc1294b0da1fe31955e1eabc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:10.123350 19309 tablet_copy_service.cc:140] P 0316f581086f40549fea44a772fc2dec: Received BeginTabletCopySession request for tablet eba0c928a13f4f5ab22f30b9971564fd from peer d50eb2dab6754df8bcbed1445f2e8430 ({username='slave'} at 127.0.0.1:36770)
I20260709 13:12:10.123979 19309 tablet_copy_service.cc:161] P 0316f581086f40549fea44a772fc2dec: Beginning new tablet copy session on tablet eba0c928a13f4f5ab22f30b9971564fd from peer d50eb2dab6754df8bcbed1445f2e8430 at {username='slave'} at 127.0.0.1:36770: session id = d50eb2dab6754df8bcbed1445f2e8430-eba0c928a13f4f5ab22f30b9971564fd
I20260709 13:12:10.124725 27355 tablet_copy_client.cc:538] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:10.131294 27347 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.131970 27347 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.139202 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:10.140092 19369 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
W20260709 13:12:10.140364 19265 leader_election.cc:336] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.138792 19309 tablet_copy_source_session.cc:215] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:10.141320 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.139070 27347 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.142293 27337 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:12:10.143188 27337 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.143543 27337 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:10.145078 27361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba0c928a13f4f5ab22f30b9971564fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:10.153573 27337 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:10.161998 19265 leader_election.cc:336] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.171077 27361 tablet_copy_client.cc:806] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:10.171851 27361 tablet_copy_client.cc:670] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:10.175485 27347 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.176024 27347 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:10.178313 27347 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:10.182909 19265 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.185623 27355 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:12:10.193871 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:10.194592 19901 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:12:10.195400 27337 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.197135 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d6d17ab159434aa4497a703c6856d6" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:10.197701 27347 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.198297 27347 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.197825 19369 raft_consensus.cc:3060] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:10.204259 27354 tablet_copy_client.cc:806] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:10.204864 27354 tablet_copy_client.cc:670] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:10.208529 27347 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.210168 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:10.210868 19366 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 20.
I20260709 13:12:10.211992 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:10.213662 27347 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:10.214088 27347 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.214588 27347 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:10.222003 19369 raft_consensus.cc:2468] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
I20260709 13:12:10.223609 19266 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.231519 27337 raft_consensus.cc:2804] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:10.232115 27337 raft_consensus.cc:697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:10.233302 27363 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.233610 27337 consensus_queue.cc:237] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.233946 27363 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.236297 27363 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.237905 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:10.255174 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.256379 27330 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.257097 27330 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.261927 27330 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:10.265332 19339 leader_election.cc:336] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.266333 27330 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.266820 27330 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.269001 27330 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.269917 27363 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:10.270382 27363 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.270745 27363 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:12:10.273782 19339 leader_election.cc:336] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.278519 27363 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:10.280874 27363 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:10.286167 27355 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:10.286602 27360 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.287142 27355 tablet_bootstrap.cc:492] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:12:10.287218 27360 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:10.293092 27361 tablet_copy_client.cc:538] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:10.294075 27354 tablet_copy_client.cc:538] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:10.294706 27360 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.296310 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:10.299362 19868 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.299795 19868 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:10.301725 27248 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:10.304277 27361 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:12:10.306124 27355 ts_tablet_manager.cc:1403] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.121s	user 0.049s	sys 0.019s
I20260709 13:12:10.308686 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79ddd82cd084684a0080d4432222b09" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:10.309301 19901 raft_consensus.cc:3060] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:10.317612 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:10.318311 19295 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:12:10.319308 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:10.320046 19300 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 23.
I20260709 13:12:10.320537 19901 raft_consensus.cc:2468] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:12:10.323709 27330 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:12:10.324882 19265 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.325620 19263 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:10.326187 27330 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.326786 27359 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.330717 27359 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.338404 27359 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.323902 27354 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap starting.
I20260709 13:12:10.341068 19115 catalog_manager.cc:5697] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 23 to 24, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 24 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:10.347357 19339 leader_election.cc:336] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.347970 27347 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.359198 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.360601 27209 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:10.360963 27209 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.360855 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:10.361474 27209 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:10.361541 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:10.362170 19299 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 25.
I20260709 13:12:10.355922 27330 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:10.367333 18095 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19246)
I20260709 13:12:10.369902 27209 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.358587 27351 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.376964 27209 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.379134 27367 raft_consensus.cc:2804] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:12:10.387337 19339 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:10.390573 19339 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:10.394181 19339 leader_election.cc:336] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.400700 27367 raft_consensus.cc:697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:10.408142 27367 consensus_queue.cc:237] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:10.386969 27355 raft_consensus.cc:359] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:10.411572 27355 raft_consensus.cc:740] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:12:10.412315 27355 consensus_queue.cc:260] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:10.426229 27347 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.428059 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecbfdae2bef4b75b68f71759bd60f98" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:10.428740 19366 raft_consensus.cc:3060] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:10.430111 27355 ts_tablet_manager.cc:1434] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.000s
I20260709 13:12:10.377677 27351 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.435497 19300 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:12:10.439013 27351 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.442037 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:10.442701 19369 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 24.
W20260709 13:12:10.445772 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:10.446357 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:10.447299 27371 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:10.449731 27371 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.450081 27371 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:10.469061 19366 raft_consensus.cc:2468] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:12:10.470700 19266 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:12:10.471122 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 110823us
I20260709 13:12:10.472195 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.474937 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-a7547528ebe74640917580adfe8092bd received from {username='slave'} at 127.0.0.1:36770
I20260709 13:12:10.475441 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-a7547528ebe74640917580adfe8092bd on tablet a7547528ebe74640917580adfe8092bd with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:10.474979 27369 raft_consensus.cc:2804] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:10.476156 27369 raft_consensus.cc:697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:10.478096 27369 consensus_queue.cc:237] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.481164 27371 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.487628 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.489133 27373 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:12:10.503578 27209 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:12:10.503960 27209 raft_consensus.cc:493] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.504345 27209 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:12:10.505671 19901 raft_consensus.cc:1217] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.13->[24.14-24.14]   Dedup: 24.14->[]
W20260709 13:12:10.488531 19265 leader_election.cc:336] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.507702 19265 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:10.500108 27373 raft_consensus.cc:493] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.503417 27318 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
W20260709 13:12:10.519767 19265 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.515364 27373 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:12:10.524402 27209 raft_consensus.cc:515] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.513797 27372 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.542843 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.547646 27209 leader_election.cc:290] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.559108 27209 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:10.560009 27209 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.560518 27209 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:10.526487 27368 raft_consensus.cc:2749] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:10.576970 19339 leader_election.cc:336] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.582283 27371 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.553445 27372 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.582645 19119 catalog_manager.cc:5697] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 21 to 22, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.584313 19119 catalog_manager.cc:5697] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 20 to 21, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.588933 27372 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:10.526844 27318 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.602351 27318 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.621831 19300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:10.622504 19300 raft_consensus.cc:3060] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:10.625128 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596e24ea147d4840a5e4645f5bac6bf1" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:10.625560 19295 raft_consensus.cc:1275] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:12:10.625825 19299 raft_consensus.cc:3060] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:12:10.626430 27318 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.626926 27318 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:10.629328 27318 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:10.634954 19300 raft_consensus.cc:2468] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 25.
W20260709 13:12:10.636453 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 112545us
I20260709 13:12:10.640153 27209 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.653101 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:10.640929 19299 raft_consensus.cc:2468] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 26.
I20260709 13:12:10.653937 19298 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
I20260709 13:12:10.662161 27209 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.661688 19340 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.665223 27209 raft_consensus.cc:2804] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:12:10.665804 27209 raft_consensus.cc:697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:10.665866 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:10.640332 27373 raft_consensus.cc:515] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.685596 27209 consensus_queue.cc:237] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.665526 27330 consensus_queue.cc:1048] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:12:10.704885 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:10.705552 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:10.706198 19372 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 21.
I20260709 13:12:10.705793 19369 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 25: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:12:10.666706 19901 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 15.
I20260709 13:12:10.707104 27373 leader_election.cc:290] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:10.708590 19340 leader_election.cc:304] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:10.709306 27209 raft_consensus.cc:2804] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:12:10.709728 27209 raft_consensus.cc:697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:10.710495 27209 consensus_queue.cc:237] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.731465 27361 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:10.768287 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:10.779296 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:10.783128 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:10.790421 19299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:10.796952 27318 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:12:10.797425 19265 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.797675 27318 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.798218 27318 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:10.802867 27363 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:12:10.803449 27363 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.804601 27363 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:12:10.808837 27359 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:10.809477 27359 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56df67425e6f45d3b2b42441e3c143ba)
I20260709 13:12:10.809952 27359 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:10.815263 19299 raft_consensus.cc:2393] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 25: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
I20260709 13:12:10.818830 19298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72e44ed47fd497bb5b8eb2891ce261a" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:10.819741 19298 raft_consensus.cc:3060] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:12:10.832465 27354 log.cc:927] Time spent T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:12:10.849077 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:10.855734 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:10.855818 19339 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:10.857025 19265 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:10.857532 19339 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.854002 27361 tablet_bootstrap.cc:492] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:12:10.877668 19298 raft_consensus.cc:2468] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 24.
I20260709 13:12:10.885480 19119 catalog_manager.cc:5697] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 24 to 25, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 25 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.899835 27361 ts_tablet_manager.cc:1403] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.596s	user 0.055s	sys 0.014s
I20260709 13:12:10.902380 19340 leader_election.cc:304] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
W20260709 13:12:10.910992 19339 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.912099 27393 raft_consensus.cc:2804] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:12:10.916750 27393 raft_consensus.cc:697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
W20260709 13:12:10.916517 19337 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38805, user_credentials={real_user=slave}} blocked reactor thread for 133857us
I20260709 13:12:10.918370 27393 consensus_queue.cc:237] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:10.918531 27359 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:10.921607 27361 raft_consensus.cc:359] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:10.922654 27361 raft_consensus.cc:740] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:12:10.923354 27361 consensus_queue.cc:260] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:10.923699 27359 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:10.923755 19339 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:10.924872 19265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 67929.7us
W20260709 13:12:10.960007 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 49084.7us
I20260709 13:12:10.960062 27359 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:12:10.974689 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0dc5e5d2542c88c79527e70d218e3" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:10.975570 19897 raft_consensus.cc:3060] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:10.979560 27354 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:10.983348 27363 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:10.986351 19265 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.994688 27361 ts_tablet_manager.cc:1434] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 13:12:10.983871 19897 raft_consensus.cc:2468] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 16.
W20260709 13:12:11.002388 19339 leader_election.cc:336] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:10.915925 27318 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:11.005661 19265 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:11.012846 19367 raft_consensus.cc:1275] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:12:11.024396 27369 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:12:11.032325 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.039225 19265 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:11.043268 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:11.044230 19369 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0316f581086f40549fea44a772fc2dec in current term 22: Already voted for candidate c6a09cefdddd4ca8a10b66682ed27dad in this term.
I20260709 13:12:11.045845 19901 raft_consensus.cc:1275] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:12:11.048207 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45832.8us
I20260709 13:12:11.059820 27354 tablet_bootstrap.cc:492] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Bootstrap complete.
I20260709 13:12:11.061082 27354 ts_tablet_manager.cc:1403] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent bootstrapping tablet: real 0.740s	user 0.051s	sys 0.020s
I20260709 13:12:11.065318 27354 raft_consensus.cc:359] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:11.068352 27354 raft_consensus.cc:740] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Initialized, Role: LEARNER
I20260709 13:12:11.069142 27354 consensus_queue.cc:260] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: NON_VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: true } }
I20260709 13:12:11.070025 27363 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:11.070271 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.073016 27318 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:11.075320 19119 catalog_manager.cc:5697] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 25 to 26, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 26 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.077320 19119 catalog_manager.cc:5697] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 23 to 24, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 24 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.083786 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-eba0c928a13f4f5ab22f30b9971564fd received from {username='slave'} at 127.0.0.1:36770
I20260709 13:12:11.084481 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-eba0c928a13f4f5ab22f30b9971564fd on tablet eba0c928a13f4f5ab22f30b9971564fd with peer d50eb2dab6754df8bcbed1445f2e8430
W20260709 13:12:11.084626 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.089349 19897 raft_consensus.cc:1217] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 13:12:11.091133 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec"
I20260709 13:12:11.091681 27354 ts_tablet_manager.cc:1434] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:12:11.092000 19292 raft_consensus.cc:2393] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c6a09cefdddd4ca8a10b66682ed27dad in current term 22: Already voted for candidate 0316f581086f40549fea44a772fc2dec in this term.
W20260709 13:12:11.098762 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:11.100312 19339 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:11.101068 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.101203 27337 consensus_queue.cc:1048] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260709 13:12:11.113992 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.122496 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 113026us
W20260709 13:12:11.123288 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.104383 19265 consensus_peers.cc:597] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.134589 19366 raft_consensus.cc:1275] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:12:11.139211 19337 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:11.140000 27318 raft_consensus.cc:2804] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:11.140545 27318 raft_consensus.cc:697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:11.141579 27318 consensus_queue.cc:237] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:11.143551 19339 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:11.144090 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.127419 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.146713 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.156038 27372 consensus_queue.cc:1048] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:11.149413 19265 consensus_peers.cc:597] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.159837 19265 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:11.160420 19265 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:11.162878 27383 consensus_queue.cc:1048] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:12:11.173992 19897 raft_consensus.cc:1217] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
W20260709 13:12:11.176156 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.176890 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.178539 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:11.179448 19310 tablet_copy_service.cc:342] P 0316f581086f40549fea44a772fc2dec: Request end of tablet copy session d50eb2dab6754df8bcbed1445f2e8430-475b307cc1294b0da1fe31955e1eabc2 received from {username='slave'} at 127.0.0.1:36770
I20260709 13:12:11.179967 19310 tablet_copy_service.cc:434] P 0316f581086f40549fea44a772fc2dec: ending tablet copy session d50eb2dab6754df8bcbed1445f2e8430-475b307cc1294b0da1fe31955e1eabc2 on tablet 475b307cc1294b0da1fe31955e1eabc2 with peer d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:11.180712 27330 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:12:11.182263 19293 raft_consensus.cc:1275] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:12:11.183538 27330 consensus_queue.cc:1048] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:12:11.169716 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.194190 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.204509 27391 raft_consensus.cc:1064] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
W20260709 13:12:11.213631 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.222585 27391 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 12, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:11.192080 27337 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:12:11.226087 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.226614 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.227617 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.252521 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.253149 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.257511 19300 raft_consensus.cc:1275] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:12:11.262158 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.257382 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.265982 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.282946 27391 consensus_queue.cc:1048] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:11.287717 19897 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEARNER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:12:11.297482 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.298138 27391 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:11.301921 19119 catalog_manager.cc:5697] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 15 to 16, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 16 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.309947 19299 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:12:11.319689 27318 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:12:11.342394 19902 raft_consensus.cc:1217] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.11->[23.12-23.12]   Dedup: 23.12->[]
W20260709 13:12:11.346655 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.347096 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.348399 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 50967.4us
W20260709 13:12:11.356611 19339 consensus_peers.cc:597] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.360270 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.371459 18095 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 19246)
I20260709 13:12:11.414198 27359 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index 14 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:11.416636 19902 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:11.424852 19300 raft_consensus.cc:1275] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:12:11.445478 27386 consensus_queue.cc:1048] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:11.448460 19300 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:11.467027 19118 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 14 to 15, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:12:11.530176 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.538506 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.539067 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.541709 19902 raft_consensus.cc:1275] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:11.543167 27359 consensus_queue.cc:1048] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:12:11.585668 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.614916 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.667629 27372 raft_consensus.cc:1064] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:12:11.667294 19369 consensus_queue.cc:237] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:11.671008 27372 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:11.682709 19897 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:12:11.684384 27386 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:12:11.705277 19300 raft_consensus.cc:1275] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:12:11.709586 19902 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
W20260709 13:12:11.709401 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.720572 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.703352 27359 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:11.747781 27351 raft_consensus.cc:1064] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:12:11.717785 27386 consensus_queue.cc:1048] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
W20260709 13:12:11.761088 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.794404 27351 consensus_queue.cc:237] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:11.809532 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 56060.2us
I20260709 13:12:11.818632 19123 catalog_manager.cc:5697] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 15 to 16, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 24 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:11.843215 19902 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:12:11.848451 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:11.854398 19265 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.859405 19369 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:12:11.861203 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8f20bf866b6473ca02552904ffcbe5a with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:11.877450 19300 raft_consensus.cc:2955] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:11.880249 27413 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:12:11.890147 27347 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:12:11.897549 27337 raft_consensus.cc:1064] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: attempting to promote NON_VOTER d50eb2dab6754df8bcbed1445f2e8430 to VOTER
I20260709 13:12:11.900410 19902 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:11.901508 27337 consensus_queue.cc:237] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 10, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:11.911206 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:11.911521 27413 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:12:11.928895 19367 raft_consensus.cc:1275] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:11.949885 27351 consensus_queue.cc:1048] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:12:11.951151 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:12.014449 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f20bf866b6473ca02552904ffcbe5a: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:12.026227 19897 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEARNER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:12:12.028478 19369 raft_consensus.cc:1275] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:12:12.032198 27351 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:12.033695 27372 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.044901 19369 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.055058 27368 consensus_queue.cc:1048] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:12.073150 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:12.106962 19123 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.121145 27413 raft_consensus.cc:2955] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.134367 19367 raft_consensus.cc:2955] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.139307 19902 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } attrs { replace: true } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.196128 27351 raft_consensus.cc:2955] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Committing config change with OpId 23.13: config changed from index 12 to 13, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.223658 19123 catalog_manager.cc:5697] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.230479 19902 raft_consensus.cc:2955] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index 12 to 13, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.250535 19897 raft_consensus.cc:2955] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.287236 19367 raft_consensus.cc:2955] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index 12 to 13, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.329912 19123 catalog_manager.cc:5697] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: config changed from index 12 to 13, d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.363371 19294 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:12.372007 18095 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 19246)
I20260709 13:12:12.388101 19367 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:12:12.389426 27416 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:12:12.410699 19897 raft_consensus.cc:1275] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:12:12.414170 27368 consensus_queue.cc:1048] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:12:12.415241 27337 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.416101 19369 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.424964 19902 raft_consensus.cc:2955] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.441205 19110 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 475b307cc1294b0da1fe31955e1eabc2 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:12.448764 19123 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: config changed from index 16 to 17, VOTER 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) evicted. New cstate: current_term: 22 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } } }
I20260709 13:12:12.574395 27337 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.574998 27337 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:12.583391 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:12.584321 19369 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 25.
I20260709 13:12:12.586563 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 
I20260709 13:12:12.587376 27368 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:12:12.587780 27368 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.588107 27368 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:12:12.588477 19265 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:12.589425 27337 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:12.604501 27368 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:12.608018 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:12.608676 19369 raft_consensus.cc:3060] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:12:12.611069 19265 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:12.615913 19369 raft_consensus.cc:2468] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 26.
I20260709 13:12:12.617466 19266 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:12.618450 27337 raft_consensus.cc:2804] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:12:12.618994 27337 raft_consensus.cc:697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 26 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:12.619976 27337 consensus_queue.cc:237] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:12.625993 27368 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:12.671495 19123 catalog_manager.cc:5697] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 24 to 26, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 26 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:12.765494 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:12.903359 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:13.016638 27368 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.017182 27368 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:13.019351 27368 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:13.024519 19265 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:13.025485 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:13.026132 19367 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 22.
I20260709 13:12:13.029974 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:13.031723 27337 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:13.032086 27337 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.032457 27337 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:12:13.065791 27337 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:13.075259 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:13.075855 19367 raft_consensus.cc:3060] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:12:13.078492 19265 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:13.083976 27337 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Requested vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:13.085909 19367 raft_consensus.cc:2468] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0316f581086f40549fea44a772fc2dec in term 23.
I20260709 13:12:13.087280 19266 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad; no voters: 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:13.091043 27337 raft_consensus.cc:2804] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:12:13.092259 27337 raft_consensus.cc:697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Becoming Leader. State: Replica: 0316f581086f40549fea44a772fc2dec, State: Running, Role: LEADER
I20260709 13:12:13.093050 27337 consensus_queue.cc:237] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:13.107069 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 475b307cc1294b0da1fe31955e1eabc2: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:13.127049 19123 catalog_manager.cc:5697] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec reported cstate change: term changed from 21 to 23, leader changed from 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193) to 0316f581086f40549fea44a772fc2dec (127.17.171.194). New cstate: current_term: 23 leader_uuid: "0316f581086f40549fea44a772fc2dec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:13.152099 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.175935 19265 consensus_peers.cc:597] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:13.187789 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.196508 19868 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111) [suppressed 473 similar messages]
W20260709 13:12:13.217013 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:13.225811 19367 raft_consensus.cc:1275] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:12:13.228380 27412 consensus_queue.cc:1048] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:12:13.236554 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:13.250289 19339 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.280783 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.309975 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.310787 19265 consensus_peers.cc:597] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.372519 18095 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:13.421960 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.512890 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.534783 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.541352 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.544358 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.579784 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 71175.3us
W20260709 13:12:13.584803 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.585865 19265 consensus_peers.cc:597] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:13.587085 19367 raft_consensus.cc:1275] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Refusing update from remote peer 0316f581086f40549fea44a772fc2dec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:12:13.589107 27435 consensus_queue.cc:1048] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:12:13.602404 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.604795 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.616083 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.620936 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.628027 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.639591 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.643015 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.648885 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.683117 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.687107 19265 consensus_peers.cc:597] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.710330 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.729233 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.777244 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.790125 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.835758 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.846560 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.897459 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.900121 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.924057 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.961478 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.986541 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.993276 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.134413 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:14.212939 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:14.262617 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:14.334585 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.373076 18095 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:14.383229 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f20bf866b6473ca02552904ffcbe5a: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:14.415233 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:14.437512 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:14.531248 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:14.728818 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.169803 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.373687 18095 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:15.404024 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:15.428041 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.451803 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:15.692945 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:15.700901 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:15.742183 19265 consensus_peers.cc:597] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:15.802627 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:15.882860 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:15.976438 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.035691 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.039230 19265 consensus_peers.cc:597] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.045775 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.046303 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.049675 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.374300 18095 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:16.525933 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f20bf866b6473ca02552904ffcbe5a: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:16.601727 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.602519 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.669771 19265 consensus_peers.cc:597] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:16.683240 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.723839 19339 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.724295 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.725082 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.746747 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.747408 19265 consensus_peers.cc:597] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.775468 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.778167 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.782907 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.790851 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.793998 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.798636 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.799312 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.799774 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.798121 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.800220 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.800844 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.802630 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.829002 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.949211 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.988065 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:16.991633 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:17.009099 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:17.171854 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080036d7e0 after lost signal to thread 18098
W20260709 13:12:17.172999 19154 debug-util.cc:398] Leaking SignalData structure 0x7b0800346780 after lost signal to thread 19157
W20260709 13:12:17.174290 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080008a760 after lost signal to thread 19324
W20260709 13:12:17.175410 19154 debug-util.cc:398] Leaking SignalData structure 0x7b0800091f00 after lost signal to thread 19398
W20260709 13:12:17.179304 19154 debug-util.cc:398] Leaking SignalData structure 0x7b080030fd60 after lost signal to thread 19927
W20260709 13:12:17.291085 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 56316.7us
W20260709 13:12:17.318161 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:17.375209 18095 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 19246)
I20260709 13:12:18.149438 27468 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:18.150105 27468 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:18.208410 19265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111) [suppressed 363 similar messages]
I20260709 13:12:18.226316 27466 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:18.234470 27466 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:18.223610 27468 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:18.280193 27450 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:18.280766 27450 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.282768 27450 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:18.301383 27436 raft_consensus.cc:493] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:18.302009 27436 raft_consensus.cc:515] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.304787 27436 leader_election.cc:290] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:18.309725 19339 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:18.311162 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 981783us
I20260709 13:12:18.317451 27452 raft_consensus.cc:493] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:12:18.320818 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.318557 27449 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:18.315858 27434 raft_consensus.cc:493] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
W20260709 13:12:18.327239 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:18.331223 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.331831 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:18.325510 27471 raft_consensus.cc:493] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:18.336428 27471 raft_consensus.cc:515] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:18.338819 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003d38c0 after lost signal to thread 18098
W20260709 13:12:18.340103 19321 debug-util.cc:398] Leaking SignalData structure 0x7b08003065a0 after lost signal to thread 19157
W20260709 13:12:18.341670 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800133100 after lost signal to thread 19324
W20260709 13:12:18.343156 19321 debug-util.cc:398] Leaking SignalData structure 0x7b0800319300 after lost signal to thread 19398
W20260709 13:12:18.344673 19321 debug-util.cc:398] Leaking SignalData structure 0x7b080008a520 after lost signal to thread 19927
I20260709 13:12:18.322873 27452 raft_consensus.cc:515] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.347323 27452 leader_election.cc:290] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:18.325650 27434 raft_consensus.cc:515] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.372659 27482 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:18.373380 27482 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:18.374023 27471 leader_election.cc:290] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:18.376179 18095 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 19246)
I20260709 13:12:18.373390 27434 leader_election.cc:290] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:18.366739 27475 raft_consensus.cc:493] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:18.379535 27475 raft_consensus.cc:515] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.382165 27475 leader_election.cc:290] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:18.383117 27466 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:18.384404 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.385303 27478 raft_consensus.cc:493] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:18.385973 27478 raft_consensus.cc:515] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.326337 27449 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:18.390547 27449 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:18.396283 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.397338 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:18.397790 19339 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.404621 27482 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:18.405542 27478 leader_election.cc:290] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:18.405682 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:18.419265 19265 leader_election.cc:336] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.421622 27449 raft_consensus.cc:493] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:18.422336 27449 raft_consensus.cc:515] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:18.425518 27449 leader_election.cc:290] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:18.425539 27483 raft_consensus.cc:493] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d50eb2dab6754df8bcbed1445f2e8430)
I20260709 13:12:18.426337 27483 raft_consensus.cc:515] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:18.429906 27483 leader_election.cc:290] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:18.438815 19295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c15d7cf03241ffbeffba5fcfbb9d47" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:18.440518 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95709490503b42e39a7b595994f42990" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:18.453361 19868 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.453630 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5df46c0c944a9ba1bf0fd628f9e9b3" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.453915 19868 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.460358 27454 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:18.460988 27454 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:18.463410 27454 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:18.465036 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
W20260709 13:12:18.469110 19339 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.469313 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:18.470000 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa469320af8e4483baa8a2bb6187b226" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.472350 27482 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:18.474817 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a6e62faf9e420795c6070c3109c9e4" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:18.476306 19868 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.484362 19868 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.484884 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a94e7b00544419ab2f3f84812c9b155" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:18.485170 27482 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:18.476946 19372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df30e48897304c19b2d4f8683acbae54" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.469313 19367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d825739f94b747959f93597edca9200a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.476991 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.488834 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb03123528514382bd026ba70cefa81a" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:18.478354 19265 leader_election.cc:336] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.479311 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:18.480369 19369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
W20260709 13:12:18.497411 19265 leader_election.cc:336] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.498365 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1668ce4cb86e4e9daf99a53a2be8a396" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:18.499806 19266 leader_election.cc:304] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.499892 19898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aeada323a94b289fcf904795167d43" candidate_uuid: "0316f581086f40549fea44a772fc2dec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:18.501819 19265 leader_election.cc:336] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.504511 27483 raft_consensus.cc:2749] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:18.508574 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:18.509899 27479 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:18.511664 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:18.512836 27479 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:18.515026 19266 leader_election.cc:304] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
W20260709 13:12:18.524456 19265 leader_election.cc:336] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.525116 27436 raft_consensus.cc:2749] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:18.531479 19265 leader_election.cc:336] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:18.534580 19265 leader_election.cc:336] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:18.533669 19266 leader_election.cc:304] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.536129 27436 raft_consensus.cc:2749] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:18.537405 19266 leader_election.cc:304] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.538223 27436 raft_consensus.cc:2749] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:18.539383 19266 leader_election.cc:304] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.540243 27436 raft_consensus.cc:2749] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:18.542032 19266 leader_election.cc:304] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:18.542860 27436 raft_consensus.cc:2749] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:18.554267 19263 leader_election.cc:304] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: 56df67425e6f45d3b2b42441e3c143ba, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:18.555305 27483 raft_consensus.cc:2749] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:18.566660 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:18.572935 19263 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:18.578898 27483 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:18.582043 19263 leader_election.cc:304] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0316f581086f40549fea44a772fc2dec; no voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:18.583357 27483 raft_consensus.cc:2749] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:18.590641 19292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de803894748b488d81cb5c7007c78cce" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:18.597412 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:18.598791 27479 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:18.738384 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.890738 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:18.946038 27480 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:18.946593 27480 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:18.950395 27480 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:18.951642 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:18.952184 19294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0316f581086f40549fea44a772fc2dec" is_pre_election: true
I20260709 13:12:18.954202 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:18.955899 27480 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:19.093165 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.120285 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.265848 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.310698 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.345563 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.368597 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.369204 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.375402 19265 consensus_peers.cc:597] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:19.376628 18095 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:19.487013 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.491155 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.567363 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.588145 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.621428 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.641702 19265 consensus_peers.cc:597] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.653918 19265 consensus_peers.cc:597] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:19.658490 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:19.667872 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.702170 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.743089 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.746876 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.767720 19339 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.810892 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.820621 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.870982 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.917099 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:19.946031 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.959896 19265 consensus_peers.cc:597] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:19.983194 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.017409 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.023315 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.046178 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.088003 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.129758 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.130403 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.142110 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.377071 18095 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:20.528228 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:20.758878 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f20bf866b6473ca02552904ffcbe5a: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:21.013785 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.076244 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 85309.5us
W20260709 13:12:21.172755 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.200062 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:21.210067 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.321288 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.322907 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.326095 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.359766 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.377803 18095 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:21.437909 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:21.444674 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:21.696034 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:21.876693 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:21.894392 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:21.942411 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:21.954212 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.065876 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.100693 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.255383 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.266981 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.278759 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.381580 18095 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:22.389875 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.400799 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.412195 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.427196 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.439119 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:22.525359 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.564352 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:22.580238 19265 consensus_peers.cc:597] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:22.584699 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:22.594964 19265 consensus_peers.cc:597] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:22.629974 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.736379 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:22.740767 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.748471 19266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 66255.9us
W20260709 13:12:22.782895 19265 consensus_peers.cc:597] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:22.825361 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.833002 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.909168 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:22.926266 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.030664 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.036482 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:23.041255 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:23.061801 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.109933 19265 consensus_peers.cc:597] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:23.125857 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.130752 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.135360 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.177475 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.219565 19265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111) [suppressed 462 similar messages]
W20260709 13:12:23.240983 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:23.277014 19339 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:23.351056 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.382441 18095 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:23.414790 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.535635 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.630045 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.755395 19265 consensus_peers.cc:597] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:23.858240 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.884724 19265 consensus_peers.cc:597] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:23.916759 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:24.003710 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:24.212291 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:24.313745 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.382936 18095 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 19246)
W20260709 13:12:24.445626 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.492920 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.507750 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.519621 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.639634 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.641922 19265 consensus_peers.cc:597] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.711855 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:24.726487 19265 consensus_peers.cc:597] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.848624 19265 consensus_peers.cc:597] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:24.871001 19265 consensus_peers.cc:597] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.955492 19265 consensus_peers.cc:597] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:24.988751 19265 consensus_peers.cc:597] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.082100 19265 consensus_peers.cc:597] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.090356 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.134357 19265 consensus_peers.cc:597] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:25.160701 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.209797 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.233899 19265 consensus_peers.cc:597] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:25.234652 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.255607 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.268352 19265 consensus_peers.cc:597] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:25.275195 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.283841 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.332079 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:25.343176 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:25.358889 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.359615 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:25.382643 19265 consensus_peers.cc:597] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:25.404783 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
W20260709 13:12:25.464720 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:25.621075 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:25.625428 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
W20260709 13:12:25.646224 19869 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.647917 19340 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.684257 19340 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.706810 19265 consensus_peers.cc:597] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.713213 19340 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.762692 19340 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.770495 19265 consensus_peers.cc:597] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:25.785539 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.793787 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.803637 19340 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.809634 19265 consensus_peers.cc:597] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:25.811805 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:25.814865 18095 tablet_replica.cc:333] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.815948 18095 raft_consensus.cc:2243] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.816920 18095 raft_consensus.cc:2272] T fa469320af8e4483baa8a2bb6187b226 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:25.819796 19339 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:25.820021 18095 tablet_replica.cc:333] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.823421 18095 raft_consensus.cc:2243] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:25.824643 19340 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.824753 18095 raft_consensus.cc:2272] T d8f20bf866b6473ca02552904ffcbe5a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.831262 18095 tablet_replica.cc:333] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.835433 18095 raft_consensus.cc:2243] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:25.835749 19340 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.836467 18095 raft_consensus.cc:2272] T e0169774f68846529d675fe580574195 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:25.832518 19265 consensus_peers.cc:597] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:25.839576 18095 tablet_replica.cc:333] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.840623 18095 raft_consensus.cc:2243] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.841796 18095 raft_consensus.cc:2272] T b95788528f474a568f6df71dd9018575 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:25.850678 19340 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.854996 19265 consensus_peers.cc:597] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:25.858193 18095 tablet_replica.cc:333] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.859200 18095 raft_consensus.cc:2243] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.861217 18095 raft_consensus.cc:2272] T 0bef21d2e4214a018d420d2f02b90db2 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.864292 18095 tablet_replica.cc:333] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.865221 18095 raft_consensus.cc:2243] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.865935 18095 raft_consensus.cc:2272] T 3326b22da5604cba90d4a58baab1ac81 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:25.870672 19869 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.873271 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:25.891227 19869 consensus_peers.cc:597] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.895684 18095 tablet_replica.cc:333] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
W20260709 13:12:25.896989 19265 consensus_peers.cc:597] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:25.897904 18095 raft_consensus.cc:2243] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:12:25.899961 19340 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.901122 18095 raft_consensus.cc:2272] T cbaa5acb8ba24137bd7a86d1598250e1 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.904402 18095 tablet_replica.cc:333] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.905364 18095 raft_consensus.cc:2243] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.906704 18095 raft_consensus.cc:2272] T ba44c11bd3fc411ca166bf56c457490f P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.909664 18095 tablet_replica.cc:333] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.910589 18095 raft_consensus.cc:2243] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.912501 18095 raft_consensus.cc:2272] T f00a643f3a9e471980d5a732c373a17c P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.915308 18095 tablet_replica.cc:333] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.916283 18095 raft_consensus.cc:2243] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.918334 18095 raft_consensus.cc:2272] T 1ecbfdae2bef4b75b68f71759bd60f98 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.921320 18095 tablet_replica.cc:333] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.922266 18095 raft_consensus.cc:2243] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.922992 18095 raft_consensus.cc:2272] T 4a94e7b00544419ab2f3f84812c9b155 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.928949 18095 tablet_replica.cc:333] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.929834 18095 raft_consensus.cc:2243] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.930655 18095 raft_consensus.cc:2272] T c72e44ed47fd497bb5b8eb2891ce261a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.933408 18095 tablet_replica.cc:333] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
W20260709 13:12:25.937129 19340 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.934914 18095 raft_consensus.cc:2243] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:12:25.944635 19340 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.946146 18095 raft_consensus.cc:2272] T c79ddd82cd084684a0080d4432222b09 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.950018 18095 tablet_replica.cc:333] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.950929 18095 raft_consensus.cc:2243] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.951743 18095 raft_consensus.cc:2272] T de5df46c0c944a9ba1bf0fd628f9e9b3 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.954919 18095 tablet_replica.cc:333] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.956089 18095 raft_consensus.cc:2243] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.958215 18095 raft_consensus.cc:2272] T bc29620a3fdb42269ab707a442ca6096 P 0316f581086f40549fea44a772fc2dec [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.960951 18095 tablet_replica.cc:333] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.962447 18095 raft_consensus.cc:2243] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.963191 18095 raft_consensus.cc:2272] T a9a6e62faf9e420795c6070c3109c9e4 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:25.963591 19340 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.966058 18095 tablet_replica.cc:333] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.966956 18095 raft_consensus.cc:2243] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:25.969086 18095 raft_consensus.cc:2272] T f43f1e515be64813bb797fabd579621f P 0316f581086f40549fea44a772fc2dec [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.971823 18095 tablet_replica.cc:333] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.972826 18095 raft_consensus.cc:2243] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:12:25.978384 19340 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.974095 18095 raft_consensus.cc:2272] T 3a1ac12e26544cfc823327c519f83882 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:25.981734 18095 tablet_replica.cc:333] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.982671 18095 raft_consensus.cc:2243] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.983963 18095 raft_consensus.cc:2272] T d825739f94b747959f93597edca9200a P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:25.990969 19869 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.995012 19340 consensus_peers.cc:597] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.997414 18095 tablet_replica.cc:333] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:25.998498 18095 raft_consensus.cc:2243] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:25.999282 18095 raft_consensus.cc:2272] T df30e48897304c19b2d4f8683acbae54 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.002976 18095 tablet_replica.cc:333] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.004006 18095 raft_consensus.cc:2243] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.004733 18095 raft_consensus.cc:2272] T 1d40258a53ba4865adc2a744f3aa6256 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.007941 18095 tablet_replica.cc:333] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.008876 18095 raft_consensus.cc:2243] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.011230 18095 raft_consensus.cc:2272] T 04d6d17ab159434aa4497a703c6856d6 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.014308 18095 tablet_replica.cc:333] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.015812 18095 raft_consensus.cc:2243] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.017941 18095 raft_consensus.cc:2272] T d5f7f3521ddc43959640091aefee2a11 P 0316f581086f40549fea44a772fc2dec [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:26.018072 19340 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.021826 18095 tablet_replica.cc:333] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.022776 18095 raft_consensus.cc:2243] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.024065 18095 raft_consensus.cc:2272] T 95709490503b42e39a7b595994f42990 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.026899 18095 tablet_replica.cc:333] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.027788 18095 raft_consensus.cc:2243] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.028505 18095 raft_consensus.cc:2272] T 1668ce4cb86e4e9daf99a53a2be8a396 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.031590 18095 tablet_replica.cc:333] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.036242 18095 raft_consensus.cc:2243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.038157 18095 raft_consensus.cc:2272] T b9c15d7cf03241ffbeffba5fcfbb9d47 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:26.040711 19340 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.041742 18095 tablet_replica.cc:333] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.042753 18095 raft_consensus.cc:2243] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.043622 18095 raft_consensus.cc:2272] T dc8043164d78443493704a95fae3b832 P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.046648 18095 tablet_replica.cc:333] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.047509 18095 raft_consensus.cc:2243] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.048277 18095 raft_consensus.cc:2272] T f52aa7e17e68407492d15e97e52d910d P 0316f581086f40549fea44a772fc2dec [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.051632 18095 tablet_replica.cc:333] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.052515 18095 raft_consensus.cc:2243] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.053668 18095 raft_consensus.cc:2272] T 994bf3418aeb467ea0f5718bd6226a66 P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.056404 18095 tablet_replica.cc:333] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.057229 18095 raft_consensus.cc:2243] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.057962 18095 raft_consensus.cc:2272] T 596e24ea147d4840a5e4645f5bac6bf1 P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.066701 18095 tablet_replica.cc:333] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
W20260709 13:12:26.067050 19869 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.067749 18095 raft_consensus.cc:2243] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.070487 18095 raft_consensus.cc:2272] T eba0c928a13f4f5ab22f30b9971564fd P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.074955 18095 tablet_replica.cc:333] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.075894 18095 raft_consensus.cc:2243] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.077168 18095 raft_consensus.cc:2272] T c32ecd0e2df44d9eace43b19017215ee P 0316f581086f40549fea44a772fc2dec [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.080267 18095 tablet_replica.cc:333] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.081113 18095 raft_consensus.cc:2243] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.082237 18095 raft_consensus.cc:2272] T 3a0355f53de74ee2afbb9a27c7449d75 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.090626 18095 tablet_replica.cc:333] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
W20260709 13:12:26.091069 19869 consensus_peers.cc:597] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.091518 18095 raft_consensus.cc:2243] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.093117 18095 raft_consensus.cc:2272] T 443db347d2a7465e8845fc3facf2ea26 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.097218 18095 tablet_replica.cc:333] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.098099 18095 raft_consensus.cc:2243] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.099465 18095 raft_consensus.cc:2272] T c86cbc75bead4640b156a7262753a86d P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.102528 18095 tablet_replica.cc:333] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.103372 18095 raft_consensus.cc:2243] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.104666 18095 raft_consensus.cc:2272] T 3301e091b13b45e8833e94ab3073d14a P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.107585 18095 tablet_replica.cc:333] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.108361 18095 raft_consensus.cc:2243] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.109091 18095 raft_consensus.cc:2272] T 50bda02534b549db92f2a72e046dedf4 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.112277 18095 tablet_replica.cc:333] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.113247 18095 raft_consensus.cc:2243] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.114741 18095 raft_consensus.cc:2272] T a7547528ebe74640917580adfe8092bd P 0316f581086f40549fea44a772fc2dec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.117556 18095 tablet_replica.cc:333] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.118381 18095 raft_consensus.cc:2243] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.119554 18095 raft_consensus.cc:2272] T 475b307cc1294b0da1fe31955e1eabc2 P 0316f581086f40549fea44a772fc2dec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.122388 18095 tablet_replica.cc:333] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.123178 18095 raft_consensus.cc:2243] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.123885 18095 raft_consensus.cc:2272] T 2348394564c140f3aec293661379e650 P 0316f581086f40549fea44a772fc2dec [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.127849 18095 tablet_replica.cc:333] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
W20260709 13:12:26.128091 19340 consensus_peers.cc:597] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.128595 18095 raft_consensus.cc:2243] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.129451 18095 raft_consensus.cc:2272] T 5ed1a12d65a24a9cbdd9846e6437132d P 0316f581086f40549fea44a772fc2dec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.133298 18095 tablet_replica.cc:333] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.134050 18095 raft_consensus.cc:2243] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 29 LEADER]: Raft consensus shutting down.
W20260709 13:12:26.134419 19869 consensus_peers.cc:597] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.135232 18095 raft_consensus.cc:2272] T 539f966b2e414ce2b1c2096d339a2147 P 0316f581086f40549fea44a772fc2dec [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.138866 18095 tablet_replica.cc:333] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.140292 18095 raft_consensus.cc:2243] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:12:26.141431 19869 consensus_peers.cc:597] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.141609 18095 raft_consensus.cc:2272] T de803894748b488d81cb5c7007c78cce P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.144549 18095 tablet_replica.cc:333] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.145336 18095 raft_consensus.cc:2243] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.146032 18095 raft_consensus.cc:2272] T 78d1dbf9a24f4b489920281c72245ab4 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.148669 18095 tablet_replica.cc:333] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.149351 18095 raft_consensus.cc:2243] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.150081 18095 raft_consensus.cc:2272] T 52be2d3fd44446e288f920256640822f P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.152698 18095 tablet_replica.cc:333] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.153425 18095 raft_consensus.cc:2243] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.154345 18095 raft_consensus.cc:2272] T cb03123528514382bd026ba70cefa81a P 0316f581086f40549fea44a772fc2dec [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:26.157166 18095 tablet_replica.cc:333] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.157840 18095 raft_consensus.cc:2243] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:26.159307 18095 raft_consensus.cc:2272] T f16746551ccf4c97861c6a0bab8d2847 P 0316f581086f40549fea44a772fc2dec [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:26.160600 19339 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:26.162134 18095 tablet_replica.cc:333] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.163713 18095 raft_consensus.cc:2243] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.164615 18095 raft_consensus.cc:2272] T f5aeada323a94b289fcf904795167d43 P 0316f581086f40549fea44a772fc2dec [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:26.164976 19869 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.167289 18095 tablet_replica.cc:333] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec: stopping tablet replica
I20260709 13:12:26.174333 18095 raft_consensus.cc:2243] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:26.175024 18095 raft_consensus.cc:2272] T 03efca40b3ba4ad5b0122303a9a227a2 P 0316f581086f40549fea44a772fc2dec [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:26.215794 19339 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:26.320281 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:26.518858 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:26.586267 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:26.689922 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:26.771288 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:26.811863 19339 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:26.841424 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:27.033149 27516 raft_consensus.cc:493] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.033812 27516 raft_consensus.cc:515] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.064759 27516 leader_election.cc:290] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:27.069458 19340 leader_election.cc:336] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.078002 27517 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.084208 27517 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.079496 27518 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.088138 27518 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.090631 27518 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.093169 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:27.101812 19339 leader_election.cc:336] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.102746 19339 leader_election.cc:304] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.105840 27513 raft_consensus.cc:2749] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:27.124243 27505 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.124866 27505 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.127157 27505 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.128592 27517 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:27.130633 27513 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.137583 27513 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.140493 27513 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:27.144483 19868 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.135226 19340 leader_election.cc:336] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.147784 19340 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:27.163117 27504 raft_consensus.cc:2749] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:27.164877 27504 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.165397 27504 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.169432 27504 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:27.157804 27513 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.170830 27513 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.175105 27513 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
W20260709 13:12:27.150645 19869 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.177407 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.179441 27518 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:27.183199 19901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:27.183864 19901 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 20.
I20260709 13:12:27.186014 19897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:27.189801 27516 raft_consensus.cc:493] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.190523 27516 raft_consensus.cc:515] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.193584 27516 leader_election.cc:290] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.210201 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:27.216153 19868 leader_election.cc:336] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.233556 27509 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.236552 27509 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.242729 27509 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.218184 27513 raft_consensus.cc:493] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.222633 27505 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.243719 27505 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.246397 27505 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.247231 27517 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.247896 27517 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.250891 27517 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:27.251860 27513 raft_consensus.cc:515] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.254844 27513 leader_election.cc:290] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.259631 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
W20260709 13:12:27.261794 19869 leader_election.cc:336] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.262447 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.263381 27505 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:27.272049 27517 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:27.272749 27517 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.273355 27517 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:27.258545 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 44324.1us
W20260709 13:12:27.279305 19339 consensus_peers.cc:597] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:27.290351 27505 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.291303 27505 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.295732 27505 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:27.298020 27521 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
W20260709 13:12:27.326647 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 55044.8us
I20260709 13:12:27.311455 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba0c928a13f4f5ab22f30b9971564fd" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:27.327576 19374 raft_consensus.cc:2468] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:12:27.320425 27518 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.326304 27521 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.331122 27521 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:27.331933 27518 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.334213 27518 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.334514 27504 raft_consensus.cc:493] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.343015 27504 raft_consensus.cc:515] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.345273 27504 leader_election.cc:290] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.335739 27516 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.346705 27516 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.349099 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
I20260709 13:12:27.351130 27516 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:27.352897 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430" is_pre_election: true
W20260709 13:12:27.317035 19340 leader_election.cc:336] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:27.355050 19340 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.355623 19340 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:27.356786 27516 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:27.358093 19340 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.358752 19340 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:27.359879 27516 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:27.389264 27517 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:27.402240 19339 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.403983 27518 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.420794 27518 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.423467 27518 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.406265 27521 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.424211 27521 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.426764 27521 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:27.413618 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7547528ebe74640917580adfe8092bd" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:27.427801 19374 raft_consensus.cc:2468] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 21.
W20260709 13:12:27.429750 19339 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.430832 19339 leader_election.cc:336] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.416034 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:27.433347 19868 leader_election.cc:336] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.444723 19868 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.450325 19340 leader_election.cc:336] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.458565 19340 leader_election.cc:304] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:27.465533 19869 leader_election.cc:336] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.466429 27522 raft_consensus.cc:493] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.478809 27522 raft_consensus.cc:515] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.483224 27522 leader_election.cc:290] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.462000 27517 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196:38805)
I20260709 13:12:27.469342 27513 raft_consensus.cc:2749] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:27.485481 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:27.490509 19340 leader_election.cc:336] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.491180 27505 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.496555 27505 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.493681 27521 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:27.500385 27505 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:27.502229 19340 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:27.510460 27517 raft_consensus.cc:2749] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:27.494532 19869 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.508329 19902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443db347d2a7465e8845fc3facf2ea26" candidate_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d50eb2dab6754df8bcbed1445f2e8430"
I20260709 13:12:27.511552 19902 raft_consensus.cc:3060] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:27.521884 19902 raft_consensus.cc:2468] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6a09cefdddd4ca8a10b66682ed27dad in term 21.
W20260709 13:12:27.495795 19339 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.529918 19339 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:27.531059 19340 leader_election.cc:336] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.522455 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.535034 27505 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:27.509305 19868 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.538658 27513 raft_consensus.cc:493] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.539247 27513 raft_consensus.cc:515] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.541893 27513 leader_election.cc:290] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.542631 27513 raft_consensus.cc:493] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.543219 27513 raft_consensus.cc:515] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.545894 27513 leader_election.cc:290] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:27.536155 19868 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.547214 19869 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.547786 27522 raft_consensus.cc:493] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.557925 27522 raft_consensus.cc:515] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.560900 27522 leader_election.cc:290] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.564039 19340 leader_election.cc:304] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:27.555840 19868 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.565101 19869 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.573449 27505 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:27.580387 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:27.581897 27522 raft_consensus.cc:493] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.583159 19337 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:27.583773 27504 raft_consensus.cc:2749] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:27.599669 27504 raft_consensus.cc:2804] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:27.600224 27504 raft_consensus.cc:697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Becoming Leader. State: Replica: c6a09cefdddd4ca8a10b66682ed27dad, State: Running, Role: LEADER
I20260709 13:12:27.601087 27504 consensus_queue.cc:237] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.606448 27522 raft_consensus.cc:515] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.610122 27522 leader_election.cc:290] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:27.585388 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 75144.3us
I20260709 13:12:27.585776 27513 raft_consensus.cc:493] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.594269 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:27.611937 19374 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 22.
I20260709 13:12:27.613386 27513 raft_consensus.cc:515] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
W20260709 13:12:27.625949 19868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 45617.8us
W20260709 13:12:27.626546 19868 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.629292 19339 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.632380 27513 leader_election.cc:290] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.634351 27504 raft_consensus.cc:493] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.634924 27504 raft_consensus.cc:515] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } }
I20260709 13:12:27.636863 27504 leader_election.cc:290] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:27.638188 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:27.640306 27505 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.640843 27505 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.644025 27505 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:27.651333 19339 leader_election.cc:336] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.652128 19339 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.652667 19339 leader_election.cc:336] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.653574 19339 leader_election.cc:336] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:27.653101 19117 catalog_manager.cc:5697] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad reported cstate change: term changed from 20 to 21, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195). New cstate: current_term: 21 leader_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.667143 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:27.667866 19374 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 15.
W20260709 13:12:27.672389 19869 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.673916 19869 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:27.662499 19339 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.677687 19339 leader_election.cc:336] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.678294 19339 leader_election.cc:336] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:27.685101 19340 leader_election.cc:336] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.688264 27521 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:27.689114 19869 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.691776 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.692644 27521 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.694166 19340 leader_election.cc:304] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.708894 27517 raft_consensus.cc:2749] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:27.712424 19340 leader_election.cc:336] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.713006 19340 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, d50eb2dab6754df8bcbed1445f2e8430
I20260709 13:12:27.722259 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" is_pre_election: true
I20260709 13:12:27.723222 19374 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 29.
I20260709 13:12:27.726210 19869 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:27.727632 27509 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:12:27.728044 27509 raft_consensus.cc:493] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.729387 27509 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:12:27.739372 19339 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:27.741551 27517 raft_consensus.cc:2749] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:12:27.746274 27509 raft_consensus.cc:515] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.748715 27509 leader_election.cc:290] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:27.779026 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51624.8us
I20260709 13:12:27.779963 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:27.781026 27505 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:27.781450 27505 raft_consensus.cc:493] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.781792 27505 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:27.781556 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:27.784977 27527 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:12:27.785328 27527 raft_consensus.cc:493] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:27.785665 27527 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:12:27.789103 19340 leader_election.cc:336] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:27.790100 19340 leader_election.cc:336] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.790856 19340 leader_election.cc:304] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.791651 27517 raft_consensus.cc:2749] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:27.790692 27505 raft_consensus.cc:515] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.802461 27505 leader_election.cc:290] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Requested vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:27.803326 19339 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:27.792904 19340 leader_election.cc:336] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.804742 19340 leader_election.cc:304] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.815306 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475b307cc1294b0da1fe31955e1eabc2" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:27.816083 19374 raft_consensus.cc:3060] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:12:27.816047 19869 leader_election.cc:336] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:27.825013 19869 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.827955 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.825505 19374 raft_consensus.cc:2468] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 23.
I20260709 13:12:27.829519 27505 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:27.830166 27513 raft_consensus.cc:2749] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:27.829913 19340 leader_election.cc:336] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:27.831630 19869 leader_election.cc:336] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.831939 19340 leader_election.cc:304] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
W20260709 13:12:27.832391 19869 leader_election.cc:336] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.840427 27513 raft_consensus.cc:2749] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:27.840651 19340 leader_election.cc:336] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.841207 19340 leader_election.cc:304] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.842069 27513 raft_consensus.cc:2749] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:27.847687 19339 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:27.849249 19374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f7f3521ddc43959640091aefee2a11" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
I20260709 13:12:27.849910 19374 raft_consensus.cc:3060] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:27.853068 19340 leader_election.cc:336] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.855297 19340 leader_election.cc:304] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.856127 27517 raft_consensus.cc:2749] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:27.858757 19340 leader_election.cc:336] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.854410 27527 raft_consensus.cc:515] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.861239 27527 leader_election.cc:290] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 30 election: Requested vote from peers c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
I20260709 13:12:27.861824 19340 leader_election.cc:304] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.881028 27513 raft_consensus.cc:2749] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:27.880450 19869 leader_election.cc:304] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:27.883170 27527 raft_consensus.cc:2804] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:12:27.885093 19869 leader_election.cc:336] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.886133 27527 raft_consensus.cc:697] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:27.888644 27527 consensus_queue.cc:237] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.893215 19366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "539f966b2e414ce2b1c2096d339a2147" candidate_uuid: "d50eb2dab6754df8bcbed1445f2e8430" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c6a09cefdddd4ca8a10b66682ed27dad"
W20260709 13:12:27.890095 19340 leader_election.cc:336] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.893875 19366 raft_consensus.cc:3060] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:12:27.894117 19340 leader_election.cc:304] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:27.895013 27513 raft_consensus.cc:2749] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:27.896308 19374 raft_consensus.cc:2468] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 16.
I20260709 13:12:27.900085 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
I20260709 13:12:27.904064 19366 raft_consensus.cc:2468] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d50eb2dab6754df8bcbed1445f2e8430 in term 30.
W20260709 13:12:27.900297 19869 leader_election.cc:336] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:27.916570 19869 leader_election.cc:304] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec
I20260709 13:12:27.917529 27505 raft_consensus.cc:2804] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:27.918004 27505 raft_consensus.cc:697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:27.918776 27505 consensus_queue.cc:237] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:27.926728 19869 leader_election.cc:304] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6a09cefdddd4ca8a10b66682ed27dad, d50eb2dab6754df8bcbed1445f2e8430; no voters: 
I20260709 13:12:27.933341 19117 catalog_manager.cc:5697] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 22 to 23, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 23 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:27.934926 19339 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:27.978173 19869 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:46545, user_credentials={real_user=slave}} blocked reactor thread for 51528.2us
I20260709 13:12:27.979167 27505 raft_consensus.cc:2804] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:12:27.979683 27505 raft_consensus.cc:697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 30 LEADER]: Becoming Leader. State: Replica: d50eb2dab6754df8bcbed1445f2e8430, State: Running, Role: LEADER
I20260709 13:12:27.980513 27505 consensus_queue.cc:237] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:27.985225 19869 leader_election.cc:336] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:27.990973 19339 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:28.009440 19339 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:28.018975 19117 catalog_manager.cc:5697] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 15 to 16, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 16 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.021114 19117 catalog_manager.cc:5697] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 reported cstate change: term changed from 29 to 30, leader changed from 0316f581086f40549fea44a772fc2dec (127.17.171.194) to d50eb2dab6754df8bcbed1445f2e8430 (127.17.171.196). New cstate: current_term: 30 leader_uuid: "d50eb2dab6754df8bcbed1445f2e8430" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.028103 19902 raft_consensus.cc:1275] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Refusing update from remote peer c6a09cefdddd4ca8a10b66682ed27dad: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:12:28.031952 27513 consensus_queue.cc:1048] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:12:28.064093 19340 consensus_peers.cc:597] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.187700 19340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:37985, user_credentials={real_user=slave}} blocked reactor thread for 123384us
W20260709 13:12:28.065158 19339 consensus_peers.cc:597] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:28.184219 19112 maintenance_manager.cc:419] P 2d55bdccad9c419a8710b6e2897c2f38: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033356
W20260709 13:12:28.192709 19339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:44875, user_credentials={real_user=slave}} blocked reactor thread for 127576us
W20260709 13:12:28.209123 19339 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:28.213706 19339 consensus_peers.cc:597] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:28.215924 19340 consensus_peers.cc:597] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.226787 19339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111) [suppressed 570 similar messages]
W20260709 13:12:28.231499 19869 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.236737 19340 consensus_peers.cc:597] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.247839 19869 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.258198 19339 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:28.266786 19339 consensus_peers.cc:597] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:28.267341 19339 consensus_peers.cc:597] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:28.290249 19340 consensus_peers.cc:597] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.295499 19340 consensus_peers.cc:597] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.288113 19111 maintenance_manager.cc:643] P 2d55bdccad9c419a8710b6e2897c2f38: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.095s	user 0.034s	sys 0.005s Metrics: {"bytes_written":7048,"delete_count":0,"lbm_write_time_us":888,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":281}
I20260709 13:12:28.299706 19112 maintenance_manager.cc:419] P 2d55bdccad9c419a8710b6e2897c2f38: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.343287
W20260709 13:12:28.349334 19869 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.351379 19340 consensus_peers.cc:597] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.351953 19340 consensus_peers.cc:597] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.400986 19339 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:28.401721 19340 consensus_peers.cc:597] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.402240 19340 consensus_peers.cc:597] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.414837 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
W20260709 13:12:28.439049 19869 consensus_peers.cc:597] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.441707 19340 consensus_peers.cc:597] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.446506 19869 consensus_peers.cc:597] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.449307 19869 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.454640 19869 consensus_peers.cc:597] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.482869 19340 consensus_peers.cc:597] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.491362 19869 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.496853 19340 consensus_peers.cc:597] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.507740 19340 consensus_peers.cc:597] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.528852 19869 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.546730 19869 consensus_peers.cc:597] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.560007 19869 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.560590 19869 consensus_peers.cc:597] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:28.561302 19869 consensus_peers.cc:597] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.561944 19111 maintenance_manager.cc:643] P 2d55bdccad9c419a8710b6e2897c2f38: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.261s	user 0.115s	sys 0.013s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28379,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":44066,"dirs.run_cpu_time_us":633,"dirs.run_wall_time_us":1710,"lbm_read_time_us":2186,"lbm_reads_lt_1ms":25,"lbm_write_time_us":1932,"lbm_writes_lt_1ms":12,"peak_mem_usage":307366,"reinsert_count":0,"thread_start_us":82785,"threads_started":1,"update_count":296}
I20260709 13:12:28.564596 19112 maintenance_manager.cc:419] P 2d55bdccad9c419a8710b6e2897c2f38: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:12:28.565796 19111 maintenance_manager.cc:643] P 2d55bdccad9c419a8710b6e2897c2f38: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:12:28.581804 19340 consensus_peers.cc:597] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.582269 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:28.583611 18095 tablet_replica.cc:333] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.584705 18095 raft_consensus.cc:2243] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.586431 18095 raft_consensus.cc:2272] T fa469320af8e4483baa8a2bb6187b226 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.588547 19869 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.589285 18095 tablet_replica.cc:333] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.590049 18095 raft_consensus.cc:2243] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.591051 18095 raft_consensus.cc:2272] T d8f20bf866b6473ca02552904ffcbe5a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.598635 18095 tablet_replica.cc:333] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.599310 18095 raft_consensus.cc:2243] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.600050 18095 raft_consensus.cc:2272] T b95788528f474a568f6df71dd9018575 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.602927 18095 tablet_replica.cc:333] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.603694 18095 raft_consensus.cc:2243] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.604768 18095 raft_consensus.cc:2272] T 0bef21d2e4214a018d420d2f02b90db2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.607311 18095 tablet_replica.cc:333] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.608070 18095 raft_consensus.cc:2243] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.609105 18095 raft_consensus.cc:2272] T 6c88904f118f462b924e48beec293ae5 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.611627 18095 tablet_replica.cc:333] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.612437 18095 raft_consensus.cc:2243] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.613035 18095 raft_consensus.cc:2272] T 04d6d17ab159434aa4497a703c6856d6 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.615608 18095 tablet_replica.cc:333] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.616431 18095 raft_consensus.cc:2243] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.617048 18095 raft_consensus.cc:2272] T e0169774f68846529d675fe580574195 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.619555 18095 tablet_replica.cc:333] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.620371 18095 raft_consensus.cc:2243] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.621411 18095 raft_consensus.cc:2272] T 3326b22da5604cba90d4a58baab1ac81 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.624010 18095 tablet_replica.cc:333] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.624747 18095 raft_consensus.cc:2243] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.628837 18095 raft_consensus.cc:2272] T ce726108fd4e452b9a0b91d535939c7d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.633783 18095 tablet_replica.cc:333] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.634835 18095 raft_consensus.cc:2243] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.635434 18095 raft_consensus.cc:2272] T d5c7a109008641aaa9e738f35f1abf42 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.638262 19869 consensus_peers.cc:597] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.644120 18095 tablet_replica.cc:333] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.645179 18095 raft_consensus.cc:2243] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.646425 18095 raft_consensus.cc:2272] T c72e44ed47fd497bb5b8eb2891ce261a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.649434 18095 tablet_replica.cc:333] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.650220 18095 raft_consensus.cc:2243] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.650990 18095 raft_consensus.cc:2272] T 3a1ac12e26544cfc823327c519f83882 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.653797 18095 tablet_replica.cc:333] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.654663 18095 raft_consensus.cc:2243] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.655273 18095 raft_consensus.cc:2272] T d5f7f3521ddc43959640091aefee2a11 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.661408 19340 consensus_peers.cc:597] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.662602 18095 tablet_replica.cc:333] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.663552 18095 raft_consensus.cc:2243] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.664261 18095 raft_consensus.cc:2272] T 95709490503b42e39a7b595994f42990 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.666898 18095 tablet_replica.cc:333] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.667673 18095 raft_consensus.cc:2243] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.668303 18095 raft_consensus.cc:2272] T f00a643f3a9e471980d5a732c373a17c P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.668927 19869 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.670989 18095 tablet_replica.cc:333] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.671897 18095 raft_consensus.cc:2243] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.672720 18095 raft_consensus.cc:2272] T 1ecbfdae2bef4b75b68f71759bd60f98 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.679569 19869 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.685483 18095 tablet_replica.cc:333] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
W20260709 13:12:28.689569 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:28.690657 18095 raft_consensus.cc:2243] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.692950 18095 raft_consensus.cc:2272] T a9a6e62faf9e420795c6070c3109c9e4 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.695573 18095 tablet_replica.cc:333] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.696349 18095 raft_consensus.cc:2243] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.696938 18095 raft_consensus.cc:2272] T aff34caf0ca44db08f7c49f51ca52966 P c6a09cefdddd4ca8a10b66682ed27dad [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.699975 18095 tablet_replica.cc:333] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.700834 18095 raft_consensus.cc:2243] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.701921 18095 raft_consensus.cc:2272] T de5df46c0c944a9ba1bf0fd628f9e9b3 P c6a09cefdddd4ca8a10b66682ed27dad [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.704366 18095 tablet_replica.cc:333] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.705152 18095 raft_consensus.cc:2243] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.706298 18095 raft_consensus.cc:2272] T bc29620a3fdb42269ab707a442ca6096 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.709060 18095 tablet_replica.cc:333] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.709882 18095 raft_consensus.cc:2243] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.710485 18095 raft_consensus.cc:2272] T 1668ce4cb86e4e9daf99a53a2be8a396 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.713177 18095 tablet_replica.cc:333] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.713961 18095 raft_consensus.cc:2243] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.714946 18095 raft_consensus.cc:2272] T d825739f94b747959f93597edca9200a P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.717578 18095 tablet_replica.cc:333] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.718664 18095 raft_consensus.cc:2243] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:12:28.718942 19340 consensus_peers.cc:597] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.719937 18095 raft_consensus.cc:2272] T df30e48897304c19b2d4f8683acbae54 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.722760 18095 tablet_replica.cc:333] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.723639 18095 raft_consensus.cc:2243] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.724413 18095 raft_consensus.cc:2272] T 6f5150fb077a470497ba70512f18f476 P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.726763 18095 tablet_replica.cc:333] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.727488 18095 raft_consensus.cc:2243] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.728590 18095 raft_consensus.cc:2272] T 1d40258a53ba4865adc2a744f3aa6256 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.731123 18095 tablet_replica.cc:333] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.731943 18095 raft_consensus.cc:2243] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.733071 18095 raft_consensus.cc:2272] T f52aa7e17e68407492d15e97e52d910d P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.733613 19869 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.735682 18095 tablet_replica.cc:333] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.736572 18095 raft_consensus.cc:2243] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.737201 18095 raft_consensus.cc:2272] T b9c15d7cf03241ffbeffba5fcfbb9d47 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.739785 18095 tablet_replica.cc:333] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.740567 18095 raft_consensus.cc:2243] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.741600 18095 raft_consensus.cc:2272] T dc8043164d78443493704a95fae3b832 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.744028 18095 tablet_replica.cc:333] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.745576 18095 raft_consensus.cc:2243] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.746486 18095 raft_consensus.cc:2272] T a7547528ebe74640917580adfe8092bd P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.748993 18095 tablet_replica.cc:333] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
W20260709 13:12:28.755537 19869 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.753695 18095 raft_consensus.cc:2243] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:12:28.762164 19869 consensus_peers.cc:597] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:28.764815 19869 consensus_peers.cc:597] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.765441 18095 raft_consensus.cc:2272] T 596e24ea147d4840a5e4645f5bac6bf1 P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.768230 18095 tablet_replica.cc:333] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.769044 18095 raft_consensus.cc:2243] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.770608 18095 raft_consensus.cc:2272] T eba0c928a13f4f5ab22f30b9971564fd P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.773450 18095 tablet_replica.cc:333] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.774271 18095 raft_consensus.cc:2243] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.775632 18095 raft_consensus.cc:2272] T f2c0dc5e5d2542c88c79527e70d218e3 P c6a09cefdddd4ca8a10b66682ed27dad [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.780881 19869 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.782362 18095 tablet_replica.cc:333] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.783320 18095 raft_consensus.cc:2243] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.784138 18095 raft_consensus.cc:2272] T 3301e091b13b45e8833e94ab3073d14a P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.786769 18095 tablet_replica.cc:333] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.787607 18095 raft_consensus.cc:2243] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.789661 18095 raft_consensus.cc:2272] T 50bda02534b549db92f2a72e046dedf4 P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.796713 19869 consensus_peers.cc:597] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.798667 18095 tablet_replica.cc:333] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.799760 18095 raft_consensus.cc:2243] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:12:28.800037 19339 consensus_peers.cc:597] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:28.801069 18095 raft_consensus.cc:2272] T c86cbc75bead4640b156a7262753a86d P c6a09cefdddd4ca8a10b66682ed27dad [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.806221 19869 consensus_peers.cc:597] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.806907 18095 tablet_replica.cc:333] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.807936 18095 raft_consensus.cc:2243] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.809753 18095 raft_consensus.cc:2272] T cb03123528514382bd026ba70cefa81a P c6a09cefdddd4ca8a10b66682ed27dad [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.815994 18095 tablet_replica.cc:333] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.817138 18095 raft_consensus.cc:2243] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.817857 18095 raft_consensus.cc:2272] T f16746551ccf4c97861c6a0bab8d2847 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.821544 19869 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:28.822539 18095 tablet_replica.cc:333] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.823576 18095 raft_consensus.cc:2243] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.824824 18095 raft_consensus.cc:2272] T b8639f6119a14d6bb7cd841127c14e48 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.828095 18095 tablet_replica.cc:333] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.828927 18095 raft_consensus.cc:2243] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:12:28.829540 19338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.830899 18095 raft_consensus.cc:2272] T 443db347d2a7465e8845fc3facf2ea26 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.837775 18095 tablet_replica.cc:333] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.838639 18095 raft_consensus.cc:2243] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.839257 18095 raft_consensus.cc:2272] T 3a0355f53de74ee2afbb9a27c7449d75 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.841900 18095 tablet_replica.cc:333] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.842696 18095 raft_consensus.cc:2243] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.843369 18095 raft_consensus.cc:2272] T 2348394564c140f3aec293661379e650 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.846017 18095 tablet_replica.cc:333] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.846737 18095 raft_consensus.cc:2243] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.847297 18095 raft_consensus.cc:2272] T 5ed1a12d65a24a9cbdd9846e6437132d P c6a09cefdddd4ca8a10b66682ed27dad [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.853399 19869 consensus_peers.cc:597] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.854044 18095 tablet_replica.cc:333] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.854938 18095 raft_consensus.cc:2243] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.855978 18095 raft_consensus.cc:2272] T 5d425f48ed5b488e9080214e593ef6fc P c6a09cefdddd4ca8a10b66682ed27dad [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.857738 19868 consensus_peers.cc:597] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:28.861663 18095 tablet_replica.cc:333] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.862478 18095 raft_consensus.cc:2243] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.863128 18095 raft_consensus.cc:2272] T e795450462624104a515893162f51e61 P c6a09cefdddd4ca8a10b66682ed27dad [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.865513 18095 tablet_replica.cc:333] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.866276 18095 raft_consensus.cc:2243] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.867020 18095 raft_consensus.cc:2272] T 539f966b2e414ce2b1c2096d339a2147 P c6a09cefdddd4ca8a10b66682ed27dad [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.869789 18095 tablet_replica.cc:333] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.870596 18095 raft_consensus.cc:2243] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.871717 18095 raft_consensus.cc:2272] T 03d4cdd71fcc4422813ad324c5c5f5e5 P c6a09cefdddd4ca8a10b66682ed27dad [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.874315 18095 tablet_replica.cc:333] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.875030 18095 raft_consensus.cc:2243] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.875641 18095 raft_consensus.cc:2272] T de803894748b488d81cb5c7007c78cce P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.878042 18095 tablet_replica.cc:333] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.878791 18095 raft_consensus.cc:2243] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.879665 18095 raft_consensus.cc:2272] T 52be2d3fd44446e288f920256640822f P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.882014 18095 tablet_replica.cc:333] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.882665 18095 raft_consensus.cc:2243] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.883502 18095 raft_consensus.cc:2272] T 475b307cc1294b0da1fe31955e1eabc2 P c6a09cefdddd4ca8a10b66682ed27dad [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.886013 18095 tablet_replica.cc:333] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad: stopping tablet replica
I20260709 13:12:28.886650 18095 raft_consensus.cc:2243] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.887328 18095 raft_consensus.cc:2272] T f5aeada323a94b289fcf904795167d43 P c6a09cefdddd4ca8a10b66682ed27dad [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:28.899675 19868 consensus_peers.cc:597] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:29.029999 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f20bf866b6473ca02552904ffcbe5a: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:29.074994 27527 raft_consensus.cc:493] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.075649 27527 raft_consensus.cc:515] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.077728 27527 leader_election.cc:290] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:29.083704 19868 leader_election.cc:336] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.102649 19869 leader_election.cc:336] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.103235 19869 leader_election.cc:304] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.104027 27527 raft_consensus.cc:2749] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:12:29.246287 27527 raft_consensus.cc:493] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.246867 27527 raft_consensus.cc:515] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:29.256346 19868 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:29.257279 27505 raft_consensus.cc:493] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.257752 27505 raft_consensus.cc:515] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } attrs { replace: true } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.272292 27505 leader_election.cc:290] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:29.272047 27527 leader_election.cc:290] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:29.282964 19868 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.296384 19869 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.300352 19869 leader_election.cc:304] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.302861 27505 raft_consensus.cc:2749] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:29.305538 19868 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:29.311852 19868 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:29.313539 27505 raft_consensus.cc:493] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.315454 27505 raft_consensus.cc:515] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.317487 27505 leader_election.cc:290] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:29.314762 19869 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.326407 19869 leader_election.cc:304] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.332647 27505 raft_consensus.cc:2749] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:29.334017 27505 raft_consensus.cc:493] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.334540 27505 raft_consensus.cc:515] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:29.337218 19869 leader_election.cc:336] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:29.341437 27505 leader_election.cc:290] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:29.340092 19869 leader_election.cc:336] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
W20260709 13:12:29.371876 19868 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.381439 19868 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.388615 19868 consensus_peers.cc:597] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:29.394076 19869 leader_election.cc:336] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.394694 19869 leader_election.cc:304] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.395473 27505 raft_consensus.cc:2749] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:29.396790 19869 leader_election.cc:336] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.397277 19869 leader_election.cc:304] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.398033 27505 raft_consensus.cc:2749] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:29.408069 27505 raft_consensus.cc:493] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.408571 27505 raft_consensus.cc:515] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.410557 27505 leader_election.cc:290] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:29.431520 19868 leader_election.cc:336] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:29.438472 27505 raft_consensus.cc:493] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.438951 27505 raft_consensus.cc:515] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.440828 27505 leader_election.cc:290] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:29.446410 19868 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.454828 19869 leader_election.cc:336] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.455454 19869 leader_election.cc:304] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.456279 27505 raft_consensus.cc:2749] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:29.469203 19869 leader_election.cc:336] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.469750 19869 leader_election.cc:304] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.470538 27505 raft_consensus.cc:2749] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:29.626916 27505 raft_consensus.cc:493] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0316f581086f40549fea44a772fc2dec)
I20260709 13:12:29.627429 27505 raft_consensus.cc:515] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.629412 27505 leader_election.cc:290] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985)
W20260709 13:12:29.636463 19868 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.643566 19869 leader_election.cc:336] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
I20260709 13:12:29.644097 19869 leader_election.cc:304] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, 56df67425e6f45d3b2b42441e3c143ba
I20260709 13:12:29.644857 27505 raft_consensus.cc:2749] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:29.723477 19868 consensus_peers.cc:597] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:29.730101 27505 raft_consensus.cc:493] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:29.730630 27505 raft_consensus.cc:515] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.732455 27505 leader_election.cc:290] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
I20260709 13:12:29.742930 27505 raft_consensus.cc:493] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:29.743381 27505 raft_consensus.cc:515] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.745667 27505 leader_election.cc:290] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:29.751317 19869 leader_election.cc:336] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:29.752068 19869 leader_election.cc:336] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:29.752537 19869 leader_election.cc:304] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:29.753237 27505 raft_consensus.cc:2749] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:29.760794 19869 leader_election.cc:336] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:29.763091 19869 leader_election.cc:336] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:29.763548 19869 leader_election.cc:304] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:29.764254 27505 raft_consensus.cc:2749] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:29.814567 27505 raft_consensus.cc:493] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:29.815035 27505 raft_consensus.cc:515] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.817055 27505 leader_election.cc:290] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:29.821765 19868 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.836369 19869 leader_election.cc:336] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:29.836900 19869 leader_election.cc:304] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:29.837622 27505 raft_consensus.cc:2749] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:29.863291 19868 consensus_peers.cc:597] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:29.903190 27505 raft_consensus.cc:493] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:29.903689 27505 raft_consensus.cc:515] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.905613 27505 leader_election.cc:290] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:29.910880 19868 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.920254 19869 leader_election.cc:336] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:29.920799 19869 leader_election.cc:304] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:29.921527 27505 raft_consensus.cc:2749] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:29.929168 19868 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:29.975216 27505 raft_consensus.cc:493] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:29.975725 27505 raft_consensus.cc:515] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:29.977653 27505 leader_election.cc:290] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:29.983085 19868 leader_election.cc:336] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
W20260709 13:12:29.991308 19869 leader_election.cc:336] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:29.991843 19869 leader_election.cc:304] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:29.992632 27542 raft_consensus.cc:2749] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:30.182394 27542 raft_consensus.cc:493] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:30.182914 27542 raft_consensus.cc:515] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:30.185202 27542 leader_election.cc:290] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:30.189783 19868 leader_election.cc:336] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:30.192010 27542 raft_consensus.cc:493] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:30.192612 27542 raft_consensus.cc:515] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56df67425e6f45d3b2b42441e3c143ba" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 44875 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
W20260709 13:12:30.199240 19868 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:30.199915 27542 leader_election.cc:290] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:30.204989 19869 leader_election.cc:336] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:30.205564 19869 leader_election.cc:304] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:30.206323 27542 raft_consensus.cc:2749] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:30.219744 19869 leader_election.cc:336] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:30.220301 19869 leader_election.cc:304] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 56df67425e6f45d3b2b42441e3c143ba, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:30.221066 27542 raft_consensus.cc:2749] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:30.254046 27542 raft_consensus.cc:493] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c6a09cefdddd4ca8a10b66682ed27dad)
I20260709 13:12:30.254616 27542 raft_consensus.cc:515] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0316f581086f40549fea44a772fc2dec" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 37985 } } peers { permanent_uuid: "c6a09cefdddd4ca8a10b66682ed27dad" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 46545 } } peers { permanent_uuid: "d50eb2dab6754df8bcbed1445f2e8430" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38805 } attrs { promote: false } }
I20260709 13:12:30.257017 27542 leader_election.cc:290] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985), c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545)
W20260709 13:12:30.265878 19869 leader_election.cc:336] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111)
W20260709 13:12:30.266601 19869 leader_election.cc:336] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111)
I20260709 13:12:30.267011 19869 leader_election.cc:304] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d50eb2dab6754df8bcbed1445f2e8430; no voters: 0316f581086f40549fea44a772fc2dec, c6a09cefdddd4ca8a10b66682ed27dad
I20260709 13:12:30.267741 27542 raft_consensus.cc:2749] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:30.610670 19869 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:30.611423 19869 consensus_peers.cc:597] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:30.737285 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
W20260709 13:12:30.786218 19869 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:30.852010 19869 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:30.879482 18095 tablet_server.cc:179] TabletServer@127.17.171.196:0 shutting down...
W20260709 13:12:30.899098 19869 consensus_peers.cc:597] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:30.924441 19869 consensus_peers.cc:597] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:30.956203 19869 consensus_peers.cc:597] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:30.959416 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:30.963358 18095 tablet_replica.cc:333] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.964123 18095 raft_consensus.cc:2243] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:12:30.966612 19869 consensus_peers.cc:597] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:30.968386 18095 pending_rounds.cc:70] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Trying to abort 1 pending ops.
I20260709 13:12:30.968655 18095 pending_rounds.cc:77] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430: Aborting op as it isn't in flight: id { term: 23 index: 18 } timestamp: 7305636855402172416 op_type: NO_OP noop_request { }
I20260709 13:12:30.968991 18095 raft_consensus.cc:2889] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:30.969292 18095 raft_consensus.cc:2272] T 475b307cc1294b0da1fe31955e1eabc2 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:30.971863 18095 tablet_replica.cc:333] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.972602 18095 raft_consensus.cc:2243] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:30.973127 18095 raft_consensus.cc:2272] T eba0c928a13f4f5ab22f30b9971564fd P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:30.975764 18095 tablet_replica.cc:333] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.976701 18095 raft_consensus.cc:2243] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:30.977412 18095 raft_consensus.cc:2272] T a7547528ebe74640917580adfe8092bd P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:30.981307 18095 tablet_replica.cc:333] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.982153 18095 raft_consensus.cc:2243] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:30.983716 18095 raft_consensus.cc:2272] T 1668ce4cb86e4e9daf99a53a2be8a396 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:30.986145 19869 consensus_peers.cc:597] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 0316f581086f40549fea44a772fc2dec (127.17.171.194:37985): Couldn't send request to peer 0316f581086f40549fea44a772fc2dec. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:37985: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:30.987613 18095 tablet_replica.cc:333] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.988535 18095 raft_consensus.cc:2243] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:30.989624 18095 raft_consensus.cc:2272] T 78d1dbf9a24f4b489920281c72245ab4 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:30.993057 18095 tablet_replica.cc:333] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.993894 18095 raft_consensus.cc:2243] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:30.994836 18095 raft_consensus.cc:2272] T ba44c11bd3fc411ca166bf56c457490f P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:30.997824 18095 tablet_replica.cc:333] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:30.998735 18095 raft_consensus.cc:2243] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:30.999907 18095 raft_consensus.cc:2272] T e0169774f68846529d675fe580574195 P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:31.000984 19869 consensus_peers.cc:597] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:31.002544 18095 tablet_replica.cc:333] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.003197 18095 raft_consensus.cc:2243] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.003732 18095 raft_consensus.cc:2272] T 443db347d2a7465e8845fc3facf2ea26 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.005715 18095 tablet_replica.cc:333] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.006337 18095 raft_consensus.cc:2243] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.006875 18095 raft_consensus.cc:2272] T c32ecd0e2df44d9eace43b19017215ee P d50eb2dab6754df8bcbed1445f2e8430 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.009305 18095 tablet_replica.cc:333] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.009904 18095 raft_consensus.cc:2243] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.010350 18095 raft_consensus.cc:2272] T 5d425f48ed5b488e9080214e593ef6fc P d50eb2dab6754df8bcbed1445f2e8430 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.012694 18095 tablet_replica.cc:333] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.013293 18095 raft_consensus.cc:2243] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.014150 18095 raft_consensus.cc:2272] T f5aeada323a94b289fcf904795167d43 P d50eb2dab6754df8bcbed1445f2e8430 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.016342 18095 tablet_replica.cc:333] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.017060 18095 raft_consensus.cc:2243] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.017923 18095 raft_consensus.cc:2272] T 03efca40b3ba4ad5b0122303a9a227a2 P d50eb2dab6754df8bcbed1445f2e8430 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.020602 18095 tablet_replica.cc:333] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.021397 18095 raft_consensus.cc:2243] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.022254 18095 raft_consensus.cc:2272] T 6c88904f118f462b924e48beec293ae5 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.025126 18095 tablet_replica.cc:333] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
W20260709 13:12:31.025516 19869 consensus_peers.cc:597] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:31.025956 18095 raft_consensus.cc:2243] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.026981 18095 raft_consensus.cc:2272] T 5ed1a12d65a24a9cbdd9846e6437132d P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.029558 18095 tablet_replica.cc:333] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.030673 18095 raft_consensus.cc:2243] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.031903 18095 raft_consensus.cc:2272] T 2348394564c140f3aec293661379e650 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.035238 18095 tablet_replica.cc:333] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.036036 18095 raft_consensus.cc:2243] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.036912 18095 raft_consensus.cc:2272] T d8f20bf866b6473ca02552904ffcbe5a P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.040206 18095 tablet_replica.cc:333] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.041082 18095 raft_consensus.cc:2243] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.042444 18095 raft_consensus.cc:2272] T d5c7a109008641aaa9e738f35f1abf42 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.045868 18095 tablet_replica.cc:333] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.046973 18095 raft_consensus.cc:2243] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.047752 18095 raft_consensus.cc:2272] T c79ddd82cd084684a0080d4432222b09 P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.051268 18095 tablet_replica.cc:333] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.081455 18095 raft_consensus.cc:2243] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.085729 18095 raft_consensus.cc:2272] T ce726108fd4e452b9a0b91d535939c7d P d50eb2dab6754df8bcbed1445f2e8430 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.096418 18095 tablet_replica.cc:333] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.098114 18095 raft_consensus.cc:2243] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.099253 18095 raft_consensus.cc:2272] T cb03123528514382bd026ba70cefa81a P d50eb2dab6754df8bcbed1445f2e8430 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:31.102560 19868 consensus_peers.cc:597] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 -> Peer 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): Couldn't send request to peer 56df67425e6f45d3b2b42441e3c143ba. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:31.103904 19869 consensus_peers.cc:597] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 -> Peer c6a09cefdddd4ca8a10b66682ed27dad (127.17.171.195:46545): Couldn't send request to peer c6a09cefdddd4ca8a10b66682ed27dad. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:46545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:31.104063 18095 tablet_replica.cc:333] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.105211 18095 raft_consensus.cc:2243] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.106427 18095 raft_consensus.cc:2272] T cbaa5acb8ba24137bd7a86d1598250e1 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.111027 18095 tablet_replica.cc:333] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.112236 18095 raft_consensus.cc:2243] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.114766 18095 pending_rounds.cc:70] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Trying to abort 1 pending ops.
I20260709 13:12:31.115125 18095 pending_rounds.cc:77] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430: Aborting op as it isn't in flight: id { term: 16 index: 14 } timestamp: 7305636855489417216 op_type: NO_OP noop_request { }
I20260709 13:12:31.115928 18095 raft_consensus.cc:2889] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:31.116505 18095 raft_consensus.cc:2272] T d5f7f3521ddc43959640091aefee2a11 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.119982 18095 tablet_replica.cc:333] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.121379 18095 raft_consensus.cc:2243] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.122645 18095 raft_consensus.cc:2272] T b8639f6119a14d6bb7cd841127c14e48 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.126399 18095 tablet_replica.cc:333] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.127843 18095 raft_consensus.cc:2243] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.130779 18095 raft_consensus.cc:2272] T 52be2d3fd44446e288f920256640822f P d50eb2dab6754df8bcbed1445f2e8430 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.134663 18095 tablet_replica.cc:333] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.135747 18095 raft_consensus.cc:2243] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.138381 18095 raft_consensus.cc:2272] T e795450462624104a515893162f51e61 P d50eb2dab6754df8bcbed1445f2e8430 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.142278 18095 tablet_replica.cc:333] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.143437 18095 raft_consensus.cc:2243] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.144538 18095 raft_consensus.cc:2272] T 03d4cdd71fcc4422813ad324c5c5f5e5 P d50eb2dab6754df8bcbed1445f2e8430 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.148944 18095 tablet_replica.cc:333] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.149860 18095 raft_consensus.cc:2243] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.152290 18095 pending_rounds.cc:70] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Trying to abort 1 pending ops.
I20260709 13:12:31.152585 18095 pending_rounds.cc:77] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430: Aborting op as it isn't in flight: id { term: 30 index: 19 } timestamp: 7305636855736377344 op_type: NO_OP noop_request { }
I20260709 13:12:31.153007 18095 raft_consensus.cc:2889] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 30 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:31.153486 18095 raft_consensus.cc:2272] T 539f966b2e414ce2b1c2096d339a2147 P d50eb2dab6754df8bcbed1445f2e8430 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.157656 18095 tablet_replica.cc:333] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.158542 18095 raft_consensus.cc:2243] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.160182 18095 raft_consensus.cc:2272] T 994bf3418aeb467ea0f5718bd6226a66 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.164497 18095 tablet_replica.cc:333] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.165335 18095 raft_consensus.cc:2243] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.167770 18095 raft_consensus.cc:2272] T aff34caf0ca44db08f7c49f51ca52966 P d50eb2dab6754df8bcbed1445f2e8430 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.171964 18095 tablet_replica.cc:333] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.172744 18095 raft_consensus.cc:2243] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.173908 18095 raft_consensus.cc:2272] T f43f1e515be64813bb797fabd579621f P d50eb2dab6754df8bcbed1445f2e8430 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.177433 18095 tablet_replica.cc:333] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.178267 18095 raft_consensus.cc:2243] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:31.180955 18095 raft_consensus.cc:2272] T 4a94e7b00544419ab2f3f84812c9b155 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.184660 18095 tablet_replica.cc:333] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.185309 18095 raft_consensus.cc:2243] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:12:31.186641 19869 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.187404 18095 raft_consensus.cc:2272] T 6f5150fb077a470497ba70512f18f476 P d50eb2dab6754df8bcbed1445f2e8430 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:31.191080 18095 tablet_replica.cc:333] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430: stopping tablet replica
I20260709 13:12:31.191732 18095 raft_consensus.cc:2243] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:31.192687 18095 raft_consensus.cc:2272] T f2c0dc5e5d2542c88c79527e70d218e3 P d50eb2dab6754df8bcbed1445f2e8430 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:32.299372 18095 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 19924)
I20260709 13:12:32.871080 18095 tablet_server.cc:196] TabletServer@127.17.171.196:0 shutdown complete.
I20260709 13:12:32.959697 18095 master.cc:562] Master@127.17.171.254:34425 shutting down...
W20260709 13:12:33.008704 19171 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:33.008983 19171 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:33.009204 19171 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:45.453437 19109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111) [suppressed 278 similar messages]
W20260709 13:12:45.456985 19109 catalog_manager.cc:4755] TS 56df67425e6f45d3b2b42441e3c143ba (127.17.171.193:44875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f20bf866b6473ca02552904ffcbe5a: Network error: Client connection negotiation failed: client connection to 127.17.171.193:44875: connect: Connection refused (error 111)
I20260709 13:12:46.628129 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.629199 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.629601 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2d55bdccad9c419a8710b6e2897c2f38: stopping tablet replica
I20260709 13:12:46.763103 18095 master.cc:584] Master@127.17.171.254:34425 shutdown complete.
I20260709 13:12:46.817437 18095 test_util.cc:182] -----------------------------------------------
I20260709 13:12:46.817658 18095 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602479336840-18095-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (264393 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:46.821237 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:33607
I20260709 13:12:46.822306 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:46.827917 27553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:46.827930 27552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:46.829480 27555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:46.830782 18095 server_base.cc:1061] running on GCE node
I20260709 13:12:46.833528 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:46.833730 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:46.833913 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602766833885 us; error 0 us; skew 500 ppm
I20260709 13:12:46.834488 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:46.836975 18095 webserver.cc:533] Webserver started at http://127.17.171.254:41999/ using document root <none> and password file <none>
I20260709 13:12:46.837507 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:46.837699 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:46.837970 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:46.839255 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "d265e9c49c694535930056cd56280bd3"
format_stamp: "Formatted at 2026-07-09 13:12:46 on dist-test-slave-jhlz"
I20260709 13:12:46.843588 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:12:46.846859 27560 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:46.847568 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:46.847862 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "d265e9c49c694535930056cd56280bd3"
format_stamp: "Formatted at 2026-07-09 13:12:46 on dist-test-slave-jhlz"
I20260709 13:12:46.848106 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:46.878398 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:46.879637 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:46.919598 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:33607
I20260709 13:12:46.919734 27611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:33607 every 8 connection(s)
I20260709 13:12:46.923846 27612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:46.936570 27612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3: Bootstrap starting.
I20260709 13:12:46.941605 27612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.945851 27612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3: No bootstrap required, opened a new log
I20260709 13:12:46.948025 27612 raft_consensus.cc:359] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d265e9c49c694535930056cd56280bd3" member_type: VOTER }
I20260709 13:12:46.948549 27612 raft_consensus.cc:385] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.948736 27612 raft_consensus.cc:740] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d265e9c49c694535930056cd56280bd3, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.949323 27612 consensus_queue.cc:260] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d265e9c49c694535930056cd56280bd3" member_type: VOTER }
I20260709 13:12:46.949837 27612 raft_consensus.cc:399] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:46.950110 27612 raft_consensus.cc:493] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:46.950381 27612 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.955243 27612 raft_consensus.cc:515] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d265e9c49c694535930056cd56280bd3" member_type: VOTER }
I20260709 13:12:46.955811 27612 leader_election.cc:304] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d265e9c49c694535930056cd56280bd3; no voters: 
I20260709 13:12:46.957005 27612 leader_election.cc:290] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:46.957396 27615 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.958732 27615 raft_consensus.cc:697] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 1 LEADER]: Becoming Leader. State: Replica: d265e9c49c694535930056cd56280bd3, State: Running, Role: LEADER
I20260709 13:12:46.959450 27615 consensus_queue.cc:237] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d265e9c49c694535930056cd56280bd3" member_type: VOTER }
I20260709 13:12:46.959965 27612 sys_catalog.cc:565] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:46.965837 27616 sys_catalog.cc:455] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d265e9c49c694535930056cd56280bd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d265e9c49c694535930056cd56280bd3" member_type: VOTER } }
I20260709 13:12:46.965808 27617 sys_catalog.cc:455] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d265e9c49c694535930056cd56280bd3. Latest consensus state: current_term: 1 leader_uuid: "d265e9c49c694535930056cd56280bd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d265e9c49c694535930056cd56280bd3" member_type: VOTER } }
I20260709 13:12:46.966596 27616 sys_catalog.cc:458] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:46.966706 27617 sys_catalog.cc:458] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:46.968935 27623 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:46.977306 27623 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:46.982465 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:46.988871 27623 catalog_manager.cc:1383] Generated new cluster ID: 7f6ca1e9bfe2480db3a913d0512871d6
I20260709 13:12:46.989178 27623 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:47.010411 27623 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:47.011758 27623 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:47.027735 27623 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3: Generated new TSK 0
I20260709 13:12:47.028437 27623 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:47.050046 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.056196 27633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.057161 27634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.058595 27636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.059336 18095 server_base.cc:1061] running on GCE node
I20260709 13:12:47.062475 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.062687 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.062860 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602767062839 us; error 0 us; skew 500 ppm
I20260709 13:12:47.063413 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.065683 18095 webserver.cc:533] Webserver started at http://127.17.171.193:45749/ using document root <none> and password file <none>
I20260709 13:12:47.066154 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.066345 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.066602 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.067782 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "1da14a10b312403c91c2ff8aa9d0338a"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.072317 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:12:47.075558 27641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.076817 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:47.077127 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "1da14a10b312403c91c2ff8aa9d0338a"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.077414 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.092346 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.093570 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.095067 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.097563 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.097786 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.098028 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.098220 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.139863 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:35225
I20260709 13:12:47.139991 27703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:35225 every 8 connection(s)
I20260709 13:12:47.145210 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.154227 27709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.156251 27708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.158710 27711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.159580 18095 server_base.cc:1061] running on GCE node
I20260709 13:12:47.161921 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.162140 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.162318 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602767162304 us; error 0 us; skew 500 ppm
I20260709 13:12:47.162947 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.165970 18095 webserver.cc:533] Webserver started at http://127.17.171.194:35015/ using document root <none> and password file <none>
I20260709 13:12:47.166590 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.166815 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.166877 27704 heartbeater.cc:344] Connected to a master server at 127.17.171.254:33607
I20260709 13:12:47.167152 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.167305 27704 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.168376 27704 heartbeater.cc:507] Master 127.17.171.254:33607 requested a full tablet report, sending...
I20260709 13:12:47.168942 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "dabb1961ed804fee806c7e46eedef86d"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.170866 27577 ts_manager.cc:194] Registered new tserver with Master: 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:47.173419 27577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50358
I20260709 13:12:47.174976 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:12:47.178725 27716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.179595 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:47.179909 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "dabb1961ed804fee806c7e46eedef86d"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.180248 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.194438 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.195753 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.197266 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.199576 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.199796 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.200045 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.200248 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:47.241391 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:38543
I20260709 13:12:47.241501 27778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:38543 every 8 connection(s)
I20260709 13:12:47.246330 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.254235 27782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.256654 27783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.257558 27785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.258519 18095 server_base.cc:1061] running on GCE node
I20260709 13:12:47.259575 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:47.259841 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.260025 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602767260009 us; error 0 us; skew 500 ppm
I20260709 13:12:47.260685 27779 heartbeater.cc:344] Connected to a master server at 127.17.171.254:33607
I20260709 13:12:47.260691 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.261157 27779 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.262032 27779 heartbeater.cc:507] Master 127.17.171.254:33607 requested a full tablet report, sending...
I20260709 13:12:47.263634 18095 webserver.cc:533] Webserver started at http://127.17.171.195:36775/ using document root <none> and password file <none>
I20260709 13:12:47.264201 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.264415 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.264304 27577 ts_manager.cc:194] Registered new tserver with Master: dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:47.264849 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.265952 27577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50366
I20260709 13:12:47.266098 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "591cc7bfde9f4ddfbf2460174879d675"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.270953 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:47.274688 27790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.275476 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:47.275813 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "591cc7bfde9f4ddfbf2460174879d675"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.276106 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.302388 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.303757 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.305343 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.307638 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.307871 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.308117 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.308307 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:47.350016 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:42137
I20260709 13:12:47.350169 27852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:42137 every 8 connection(s)
I20260709 13:12:47.355166 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:47.362392 27856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:47.363574 27857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.366133 18095 server_base.cc:1061] running on GCE node
W20260709 13:12:47.366979 27859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:47.367585 27853 heartbeater.cc:344] Connected to a master server at 127.17.171.254:33607
I20260709 13:12:47.367971 27853 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.368696 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:47.368964 27853 heartbeater.cc:507] Master 127.17.171.254:33607 requested a full tablet report, sending...
W20260709 13:12:47.368980 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:47.369415 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602767369396 us; error 0 us; skew 500 ppm
I20260709 13:12:47.370201 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:47.371516 27577 ts_manager.cc:194] Registered new tserver with Master: 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:47.373025 18095 webserver.cc:533] Webserver started at http://127.17.171.196:33147/ using document root <none> and password file <none>
I20260709 13:12:47.373636 27577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50370
I20260709 13:12:47.373811 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:47.374123 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:47.374483 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:47.375761 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-3-root/instance:
uuid: "68036e839a414adf854b602c1ee70066"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.380589 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:12:47.384047 27864 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.384994 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:47.385305 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-3-root
uuid: "68036e839a414adf854b602c1ee70066"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:12:47.385592 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:47.412279 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:47.413837 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:47.415565 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:47.418169 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:47.418457 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.418762 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:47.418962 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:47.464521 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.196:38641
I20260709 13:12:47.464645 27926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.196:38641 every 8 connection(s)
I20260709 13:12:47.479501 27927 heartbeater.cc:344] Connected to a master server at 127.17.171.254:33607
I20260709 13:12:47.479894 27927 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:47.480701 27927 heartbeater.cc:507] Master 127.17.171.254:33607 requested a full tablet report, sending...
I20260709 13:12:47.482820 27577 ts_manager.cc:194] Registered new tserver with Master: 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:47.483014 18095 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015102875s
I20260709 13:12:47.484668 27577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50372
I20260709 13:12:47.510351 27577 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50388:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:47.759809 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 26d5a3b562d24f8ba2e682e4964efc43 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:47.761307 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d5a3b562d24f8ba2e682e4964efc43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.771970 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 6450cda50a0047b79eed2a54d82b1f72 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:47.773165 27892 tablet_service.cc:1511] Processing CreateTablet for tablet 26d5a3b562d24f8ba2e682e4964efc43 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:47.773782 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6450cda50a0047b79eed2a54d82b1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.774672 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d5a3b562d24f8ba2e682e4964efc43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.774403 27891 tablet_service.cc:1511] Processing CreateTablet for tablet c01d0b46b4fd44288bc03adbf43521de (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:47.776099 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01d0b46b4fd44288bc03adbf43521de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.778779 27816 tablet_service.cc:1511] Processing CreateTablet for tablet b227f398fd164b8b8d69bd00c1ead78c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:47.780278 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b227f398fd164b8b8d69bd00c1ead78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.785965 27815 tablet_service.cc:1511] Processing CreateTablet for tablet 71f2dcad5345411ba79433efc6545618 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:47.787412 27815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f2dcad5345411ba79433efc6545618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.792610 27814 tablet_service.cc:1511] Processing CreateTablet for tablet 0a06c2def27d4ed89f8469619a9c3c8b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:47.794090 27814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a06c2def27d4ed89f8469619a9c3c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.798777 27813 tablet_service.cc:1511] Processing CreateTablet for tablet a2fb03199ba945afb863bc4d9e97011b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:47.800335 27813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fb03199ba945afb863bc4d9e97011b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.805261 27812 tablet_service.cc:1511] Processing CreateTablet for tablet cfa72a1976674cb2b73ab182d717bc93 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:47.806797 27812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa72a1976674cb2b73ab182d717bc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.809064 27669 tablet_service.cc:1511] Processing CreateTablet for tablet 6450cda50a0047b79eed2a54d82b1f72 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:47.810527 27669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6450cda50a0047b79eed2a54d82b1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.814054 27668 tablet_service.cc:1511] Processing CreateTablet for tablet c01d0b46b4fd44288bc03adbf43521de (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:47.815583 27668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01d0b46b4fd44288bc03adbf43521de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.815819 27665 tablet_service.cc:1511] Processing CreateTablet for tablet 16fbe94a3d414e7aa7c648a08e086a32 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:47.817353 27665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fbe94a3d414e7aa7c648a08e086a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.817437 27667 tablet_service.cc:1511] Processing CreateTablet for tablet b227f398fd164b8b8d69bd00c1ead78c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:47.818866 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b227f398fd164b8b8d69bd00c1ead78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.821445 27664 tablet_service.cc:1511] Processing CreateTablet for tablet 0a06c2def27d4ed89f8469619a9c3c8b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:47.822873 27664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a06c2def27d4ed89f8469619a9c3c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.824337 27666 tablet_service.cc:1511] Processing CreateTablet for tablet 71f2dcad5345411ba79433efc6545618 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:47.825769 27666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f2dcad5345411ba79433efc6545618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.825505 27663 tablet_service.cc:1511] Processing CreateTablet for tablet cfa72a1976674cb2b73ab182d717bc93 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:47.826859 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa72a1976674cb2b73ab182d717bc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.829425 27662 tablet_service.cc:1511] Processing CreateTablet for tablet ce354a66175a49b48f20aba6ef8d8f16 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:47.830904 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce354a66175a49b48f20aba6ef8d8f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.833484 27744 tablet_service.cc:1511] Processing CreateTablet for tablet 26d5a3b562d24f8ba2e682e4964efc43 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:47.834925 27744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d5a3b562d24f8ba2e682e4964efc43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.837478 27743 tablet_service.cc:1511] Processing CreateTablet for tablet 6450cda50a0047b79eed2a54d82b1f72 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:47.838930 27743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6450cda50a0047b79eed2a54d82b1f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.841408 27742 tablet_service.cc:1511] Processing CreateTablet for tablet c01d0b46b4fd44288bc03adbf43521de (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:47.843673 27741 tablet_service.cc:1511] Processing CreateTablet for tablet 71f2dcad5345411ba79433efc6545618 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:47.846056 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 16fbe94a3d414e7aa7c648a08e086a32 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:47.848284 27739 tablet_service.cc:1511] Processing CreateTablet for tablet a2fb03199ba945afb863bc4d9e97011b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:47.850530 27738 tablet_service.cc:1511] Processing CreateTablet for tablet cfa72a1976674cb2b73ab182d717bc93 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:47.853736 27737 tablet_service.cc:1511] Processing CreateTablet for tablet ce354a66175a49b48f20aba6ef8d8f16 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:47.854961 27890 tablet_service.cc:1511] Processing CreateTablet for tablet b227f398fd164b8b8d69bd00c1ead78c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:47.855304 27886 tablet_service.cc:1511] Processing CreateTablet for tablet ce354a66175a49b48f20aba6ef8d8f16 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:47.857419 27889 tablet_service.cc:1511] Processing CreateTablet for tablet 16fbe94a3d414e7aa7c648a08e086a32 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:47.859740 27888 tablet_service.cc:1511] Processing CreateTablet for tablet 0a06c2def27d4ed89f8469619a9c3c8b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:47.862076 27887 tablet_service.cc:1511] Processing CreateTablet for tablet a2fb03199ba945afb863bc4d9e97011b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:47.864027 27890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b227f398fd164b8b8d69bd00c1ead78c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.871114 27737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce354a66175a49b48f20aba6ef8d8f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.876572 27886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce354a66175a49b48f20aba6ef8d8f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.887312 27947 tablet_bootstrap.cc:492] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:47.896130 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1db39393c244cabaa23bd30f42faf0 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:47.897590 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1db39393c244cabaa23bd30f42faf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.911388 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1db39393c244cabaa23bd30f42faf0 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:47.912289 27738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa72a1976674cb2b73ab182d717bc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.913080 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fbe94a3d414e7aa7c648a08e086a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.914086 27817 tablet_service.cc:1511] Processing CreateTablet for tablet a0d816cb7fb741e4a64bc9a6b69d4d26 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:47.915473 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d816cb7fb741e4a64bc9a6b69d4d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.917444 27736 tablet_service.cc:1511] Processing CreateTablet for tablet a0d816cb7fb741e4a64bc9a6b69d4d26 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:47.919097 27948 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:47.919418 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1db39393c244cabaa23bd30f42faf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.883788 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a06c2def27d4ed89f8469619a9c3c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.926455 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fbe94a3d414e7aa7c648a08e086a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.926935 27741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f2dcad5345411ba79433efc6545618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.927775 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1db39393c244cabaa23bd30f42faf0 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:47.928510 27736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d816cb7fb741e4a64bc9a6b69d4d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.929203 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1db39393c244cabaa23bd30f42faf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.932526 27887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fb03199ba945afb863bc4d9e97011b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.940562 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01d0b46b4fd44288bc03adbf43521de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.944533 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fb03199ba945afb863bc4d9e97011b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.947513 27892 tablet_service.cc:1511] Processing CreateTablet for tablet a0d816cb7fb741e4a64bc9a6b69d4d26 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:47.948900 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d816cb7fb741e4a64bc9a6b69d4d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.951524 27735 tablet_service.cc:1511] Processing CreateTablet for tablet b767b8bc36f64a1a88db4639a82afa4d (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:47.959291 27947 tablet_bootstrap.cc:654] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.960565 27735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b767b8bc36f64a1a88db4639a82afa4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.961326 27668 tablet_service.cc:1511] Processing CreateTablet for tablet b767b8bc36f64a1a88db4639a82afa4d (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:47.962836 27668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b767b8bc36f64a1a88db4639a82afa4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:47.972203 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:47.979490 27816 tablet_service.cc:1511] Processing CreateTablet for tablet b767b8bc36f64a1a88db4639a82afa4d (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:47.989060 27885 tablet_service.cc:1511] Processing CreateTablet for tablet 017321988c03432fa294e969af945a82 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:47.990485 27885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 017321988c03432fa294e969af945a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:47.980973 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b767b8bc36f64a1a88db4639a82afa4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.018813 27949 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:48.028915 27948 tablet_bootstrap.cc:654] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.032102 27814 tablet_service.cc:1511] Processing CreateTablet for tablet dd13b4c8384d40b4a3d039b69415bce3 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:48.033681 27814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd13b4c8384d40b4a3d039b69415bce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.025211 27743 tablet_service.cc:1511] Processing CreateTablet for tablet 017321988c03432fa294e969af945a82 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:48.047250 27950 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:48.073367 27743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 017321988c03432fa294e969af945a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.117202 27667 tablet_service.cc:1511] Processing CreateTablet for tablet 017321988c03432fa294e969af945a82 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:48.118724 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 017321988c03432fa294e969af945a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.126442 27892 tablet_service.cc:1511] Processing CreateTablet for tablet dd13b4c8384d40b4a3d039b69415bce3 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:48.127810 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd13b4c8384d40b4a3d039b69415bce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.128846 27661 tablet_service.cc:1511] Processing CreateTablet for tablet dd13b4c8384d40b4a3d039b69415bce3 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:48.130692 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd13b4c8384d40b4a3d039b69415bce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.142349 27947 tablet_bootstrap.cc:492] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:48.142932 27947 ts_tablet_manager.cc:1403] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.256s	user 0.025s	sys 0.035s
I20260709 13:12:48.144289 27950 tablet_bootstrap.cc:654] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.152362 27744 tablet_service.cc:1511] Processing CreateTablet for tablet c7e8866752254eff89e9da91504747ba (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:48.152755 27815 tablet_service.cc:1511] Processing CreateTablet for tablet c7e8866752254eff89e9da91504747ba (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:48.154592 27744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e8866752254eff89e9da91504747ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.158119 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 064de8ca801f46a093830449c4b59008 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:48.159552 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064de8ca801f46a093830449c4b59008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.155835 27815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e8866752254eff89e9da91504747ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.156561 27889 tablet_service.cc:1511] Processing CreateTablet for tablet c7e8866752254eff89e9da91504747ba (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:48.165572 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7e8866752254eff89e9da91504747ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.165834 27743 tablet_service.cc:1511] Processing CreateTablet for tablet 064de8ca801f46a093830449c4b59008 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:48.167196 27743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064de8ca801f46a093830449c4b59008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.166075 27947 raft_consensus.cc:359] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.167989 27947 raft_consensus.cc:385] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.171772 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 064de8ca801f46a093830449c4b59008 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:48.174878 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064de8ca801f46a093830449c4b59008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.175696 27667 tablet_service.cc:1511] Processing CreateTablet for tablet f33c97dcdaeb465b8c80a8eb0fb78390 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:48.176384 27704 heartbeater.cc:499] Master 127.17.171.254:33607 was elected leader, sending a full tablet report...
I20260709 13:12:48.177055 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33c97dcdaeb465b8c80a8eb0fb78390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.173451 27892 tablet_service.cc:1511] Processing CreateTablet for tablet f33c97dcdaeb465b8c80a8eb0fb78390 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:48.183012 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33c97dcdaeb465b8c80a8eb0fb78390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.184994 27742 tablet_service.cc:1511] Processing CreateTablet for tablet f33c97dcdaeb465b8c80a8eb0fb78390 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:48.186318 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f33c97dcdaeb465b8c80a8eb0fb78390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.181022 27947 raft_consensus.cc:740] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.189265 27947 consensus_queue.cc:260] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.195184 27948 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:48.195749 27948 ts_tablet_manager.cc:1403] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.277s	user 0.042s	sys 0.020s
I20260709 13:12:48.197439 27949 tablet_bootstrap.cc:654] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.199131 27948 raft_consensus.cc:359] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.199924 27948 raft_consensus.cc:385] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.203961 27816 tablet_service.cc:1511] Processing CreateTablet for tablet c748896fe9414667aaa260600a04970e (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:48.206842 27888 tablet_service.cc:1511] Processing CreateTablet for tablet c748896fe9414667aaa260600a04970e (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:48.207751 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c748896fe9414667aaa260600a04970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.208271 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c748896fe9414667aaa260600a04970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.209400 27814 tablet_service.cc:1511] Processing CreateTablet for tablet 91d25e8c307f46b7aa029d102bdc0b0b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:48.210704 27814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d25e8c307f46b7aa029d102bdc0b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.210383 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 91d25e8c307f46b7aa029d102bdc0b0b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:48.212003 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d25e8c307f46b7aa029d102bdc0b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.214716 27663 tablet_service.cc:1511] Processing CreateTablet for tablet c748896fe9414667aaa260600a04970e (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:48.216216 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c748896fe9414667aaa260600a04970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.230206 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 8fbeba4a6dff4488b1e0e1c3768235c4 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:48.231644 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fbeba4a6dff4488b1e0e1c3768235c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.223766 27950 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:48.200809 27948 raft_consensus.cc:740] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.243156 27950 ts_tablet_manager.cc:1403] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.196s	user 0.020s	sys 0.002s
I20260709 13:12:48.248849 27950 raft_consensus.cc:359] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.249617 27950 raft_consensus.cc:385] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.250082 27950 raft_consensus.cc:740] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.251011 27950 consensus_queue.cc:260] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.253101 27744 tablet_service.cc:1511] Processing CreateTablet for tablet 91d25e8c307f46b7aa029d102bdc0b0b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:48.262287 27779 heartbeater.cc:499] Master 127.17.171.254:33607 was elected leader, sending a full tablet report...
I20260709 13:12:48.269505 27741 tablet_service.cc:1511] Processing CreateTablet for tablet 8fbeba4a6dff4488b1e0e1c3768235c4 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:48.268090 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 8fbeba4a6dff4488b1e0e1c3768235c4 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:48.295079 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fbeba4a6dff4488b1e0e1c3768235c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.300279 27744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d25e8c307f46b7aa029d102bdc0b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.321626 27950 ts_tablet_manager.cc:1434] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.008s
I20260709 13:12:48.323180 27950 tablet_bootstrap.cc:492] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:48.272758 27948 consensus_queue.cc:260] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.353430 27741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fbeba4a6dff4488b1e0e1c3768235c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.354439 27947 ts_tablet_manager.cc:1434] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.211s	user 0.049s	sys 0.053s
I20260709 13:12:48.355217 27927 heartbeater.cc:499] Master 127.17.171.254:33607 was elected leader, sending a full tablet report...
I20260709 13:12:48.368856 27892 tablet_service.cc:1511] Processing CreateTablet for tablet 0c73c86edb0f46ce9fd0547671f4ff22 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:48.370235 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c73c86edb0f46ce9fd0547671f4ff22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.370486 27949 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:48.371002 27949 ts_tablet_manager.cc:1403] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.355s	user 0.025s	sys 0.016s
W20260709 13:12:48.352262 27561 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 67143.1us
I20260709 13:12:48.374840 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 0c73c86edb0f46ce9fd0547671f4ff22 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:48.376147 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c73c86edb0f46ce9fd0547671f4ff22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.376714 27949 raft_consensus.cc:359] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.377501 27949 raft_consensus.cc:385] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.377759 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 0c73c86edb0f46ce9fd0547671f4ff22 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:48.379076 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c73c86edb0f46ce9fd0547671f4ff22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.379985 27663 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc1089a2ae7406393d4586c2eae87b2 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:48.381337 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc1089a2ae7406393d4586c2eae87b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.381666 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc1089a2ae7406393d4586c2eae87b2 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:48.382956 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc1089a2ae7406393d4586c2eae87b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.383024 27853 heartbeater.cc:499] Master 127.17.171.254:33607 was elected leader, sending a full tablet report...
I20260709 13:12:48.385298 27816 tablet_service.cc:1511] Processing CreateTablet for tablet 8fc1089a2ae7406393d4586c2eae87b2 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:48.386659 27957 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.386929 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fc1089a2ae7406393d4586c2eae87b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.387207 27957 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.387728 27955 raft_consensus.cc:493] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.388245 27955 raft_consensus.cc:515] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.390621 27955 leader_election.cc:290] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:48.390702 27739 tablet_service.cc:1511] Processing CreateTablet for tablet e1baec7715c34422b3103684a51711f1 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:48.392568 27889 tablet_service.cc:1511] Processing CreateTablet for tablet e1baec7715c34422b3103684a51711f1 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:48.394646 27814 tablet_service.cc:1511] Processing CreateTablet for tablet e1baec7715c34422b3103684a51711f1 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:48.396297 27814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1baec7715c34422b3103684a51711f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.398267 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7b585542d94b0880f652f4ef59c27b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:48.399541 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7b585542d94b0880f652f4ef59c27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.392061 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1baec7715c34422b3103684a51711f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.387102 27947 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:48.429111 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1baec7715c34422b3103684a51711f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.429482 27958 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.430236 27958 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.433779 27958 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:48.377800 27949 raft_consensus.cc:740] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.405427 27957 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
W20260709 13:12:48.469810 27928 tablet.cc:2406] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:48.473583 27947 tablet_bootstrap.cc:654] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.477717 27950 tablet_bootstrap.cc:654] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.480373 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7b585542d94b0880f652f4ef59c27b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:48.481711 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7b585542d94b0880f652f4ef59c27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.496428 27949 consensus_queue.cc:260] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.503715 27888 tablet_service.cc:1511] Processing CreateTablet for tablet db71274402644eb0801ecfeda9b1ae53 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:48.505172 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db71274402644eb0801ecfeda9b1ae53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.526327 27667 tablet_service.cc:1511] Processing CreateTablet for tablet db71274402644eb0801ecfeda9b1ae53 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:48.527774 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db71274402644eb0801ecfeda9b1ae53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.535589 27948 ts_tablet_manager.cc:1434] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.340s	user 0.013s	sys 0.011s
I20260709 13:12:48.547546 27948 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:48.555694 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d5a3b562d24f8ba2e682e4964efc43" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:48.557726 27866 leader_election.cc:343] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.561537 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 0caeff718eac4a82bb75e0f96911c2a6 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:48.563079 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caeff718eac4a82bb75e0f96911c2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.563745 27948 tablet_bootstrap.cc:654] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.594019 27968 raft_consensus.cc:493] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.594633 27968 raft_consensus.cc:515] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.602285 27950 tablet_bootstrap.cc:492] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:48.602838 27950 ts_tablet_manager.cc:1403] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.280s	user 0.013s	sys 0.005s
I20260709 13:12:48.606009 27950 raft_consensus.cc:359] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.606727 27950 raft_consensus.cc:385] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.607026 27950 raft_consensus.cc:740] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.607738 27950 consensus_queue.cc:260] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.612478 27947 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:48.613058 27947 ts_tablet_manager.cc:1403] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.226s	user 0.016s	sys 0.011s
I20260709 13:12:48.619848 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 0caeff718eac4a82bb75e0f96911c2a6 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:48.621019 27947 raft_consensus.cc:359] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.627539 27947 raft_consensus.cc:385] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.627866 27947 raft_consensus.cc:740] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.628697 27947 consensus_queue.cc:260] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.629381 27740 tablet_service.cc:1511] Processing CreateTablet for tablet db71274402644eb0801ecfeda9b1ae53 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:48.630790 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db71274402644eb0801ecfeda9b1ae53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.631006 27947 ts_tablet_manager.cc:1434] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:48.636230 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:48.652367 27717 leader_election.cc:343] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.636340 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caeff718eac4a82bb75e0f96911c2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.638013 27950 ts_tablet_manager.cc:1434] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:12:48.662591 27950 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:48.632134 27947 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:48.667124 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 603fce887130421f8625960b354f5220 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:48.673303 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603fce887130421f8625960b354f5220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.672876 27888 tablet_service.cc:1511] Processing CreateTablet for tablet 603fce887130421f8625960b354f5220 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:48.675732 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603fce887130421f8625960b354f5220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.680274 27950 tablet_bootstrap.cc:654] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.675715 27949 ts_tablet_manager.cc:1434] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.304s	user 0.011s	sys 0.023s
I20260709 13:12:48.691381 27663 tablet_service.cc:1511] Processing CreateTablet for tablet 62682940e2d74241925b8bfb53838357 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:48.693331 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62682940e2d74241925b8bfb53838357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.676934 27889 tablet_service.cc:1511] Processing CreateTablet for tablet 0caeff718eac4a82bb75e0f96911c2a6 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:48.700296 27741 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7b585542d94b0880f652f4ef59c27b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:48.702270 27741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7b585542d94b0880f652f4ef59c27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.709563 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caeff718eac4a82bb75e0f96911c2a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.681877 27968 leader_election.cc:290] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:48.721279 27949 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:48.722429 27948 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:48.722973 27948 ts_tablet_manager.cc:1403] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.016s
I20260709 13:12:48.725031 27957 raft_consensus.cc:493] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.725566 27957 raft_consensus.cc:515] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.726013 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d5a3b562d24f8ba2e682e4964efc43" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:48.727902 27957 leader_election.cc:290] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:48.728116 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 603fce887130421f8625960b354f5220 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:48.729559 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 603fce887130421f8625960b354f5220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.729799 27742 tablet_service.cc:1511] Processing CreateTablet for tablet 62682940e2d74241925b8bfb53838357 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:48.731076 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62682940e2d74241925b8bfb53838357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.736512 27948 raft_consensus.cc:359] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.737473 27948 raft_consensus.cc:385] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.738327 27949 tablet_bootstrap.cc:654] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.738628 27948 raft_consensus.cc:740] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
W20260709 13:12:48.738132 27865 leader_election.cc:343] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.739249 27865 leader_election.cc:304] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:48.740993 27948 consensus_queue.cc:260] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.748485 27948 ts_tablet_manager.cc:1434] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.003s
I20260709 13:12:48.743320 27956 raft_consensus.cc:2749] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.744885 27955 raft_consensus.cc:493] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.761229 27948 tablet_bootstrap.cc:492] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:48.761147 27955 raft_consensus.cc:515] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.741274 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:48.750734 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d816cb7fb741e4a64bc9a6b69d4d26" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:48.753460 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:48.765198 27828 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:48.765369 27754 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:48.766625 27718 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:48.767571 27957 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.767887 27791 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:48.768249 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 62682940e2d74241925b8bfb53838357 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:48.767938 27957 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.769688 27957 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.770054 27955 leader_election.cc:290] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:48.772907 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:48.769618 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62682940e2d74241925b8bfb53838357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.781870 27959 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.782488 27959 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.782935 27959 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.785297 27957 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:48.780921 27791 leader_election.cc:343] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.787953 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:48.789726 27717 leader_election.cc:343] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.791587 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d0b46b4fd44288bc03adbf43521de" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:48.792755 27957 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
W20260709 13:12:48.793138 27865 leader_election.cc:343] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.799248 27959 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.801152 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d0b46b4fd44288bc03adbf43521de" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:48.801904 27959 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:12:48.802399 27718 leader_election.cc:343] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.801499 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b227f398fd164b8b8d69bd00c1ead78c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:48.803299 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:48.804128 27754 raft_consensus.cc:2393] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
W20260709 13:12:48.804927 27643 leader_election.cc:343] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.806568 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:48.806978 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:48.807902 27827 raft_consensus.cc:2393] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
W20260709 13:12:48.808440 27791 leader_election.cc:343] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.809079 27791 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:48.811681 27959 raft_consensus.cc:2749] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.812636 27947 tablet_bootstrap.cc:654] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:48.812649 27865 leader_election.cc:343] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.813084 27718 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:48.812971 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 630a85e09f9445509a4ef98bcd31013a (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:48.813417 27865 leader_election.cc:304] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:48.814390 27955 raft_consensus.cc:2749] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.814549 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630a85e09f9445509a4ef98bcd31013a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.819548 27950 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:48.822311 27950 ts_tablet_manager.cc:1403] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.022s
I20260709 13:12:48.820246 27957 raft_consensus.cc:2749] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.825819 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 630a85e09f9445509a4ef98bcd31013a (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:48.827186 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630a85e09f9445509a4ef98bcd31013a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.826930 27950 raft_consensus.cc:359] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.827536 27948 tablet_bootstrap.cc:654] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.837110 27949 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:48.837697 27949 ts_tablet_manager.cc:1403] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.117s	user 0.004s	sys 0.012s
I20260709 13:12:48.828919 27950 raft_consensus.cc:385] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.838219 27950 raft_consensus.cc:740] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.839639 27950 consensus_queue.cc:260] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.840994 27947 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:48.841594 27947 ts_tablet_manager.cc:1403] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.210s	user 0.005s	sys 0.012s
I20260709 13:12:48.841951 27950 ts_tablet_manager.cc:1434] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:12:48.844475 27950 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:48.846655 27947 raft_consensus.cc:359] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.847460 27947 raft_consensus.cc:385] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.847836 27947 raft_consensus.cc:740] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.848623 27947 consensus_queue.cc:260] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.851213 27950 tablet_bootstrap.cc:654] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.855628 27949 raft_consensus.cc:359] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.862938 27949 raft_consensus.cc:385] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.863380 27949 raft_consensus.cc:740] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.867704 27949 consensus_queue.cc:260] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:48.870812 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 630a85e09f9445509a4ef98bcd31013a (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:48.873313 27949 ts_tablet_manager.cc:1434] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:12:48.873966 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630a85e09f9445509a4ef98bcd31013a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.875233 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b227f398fd164b8b8d69bd00c1ead78c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:48.874177 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d816cb7fb741e4a64bc9a6b69d4d26" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:48.877307 27645 leader_election.cc:343] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.877775 27645 leader_election.cc:304] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:48.879027 27968 raft_consensus.cc:2749] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:48.880383 27720 leader_election.cc:343] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.880940 27720 leader_election.cc:304] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:48.882136 27957 raft_consensus.cc:2749] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.874516 27949 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:48.888463 27947 ts_tablet_manager.cc:1434] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:12:48.891587 27949 tablet_bootstrap.cc:654] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.891752 27947 tablet_bootstrap.cc:492] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:48.896708 27889 tablet_service.cc:1511] Processing CreateTablet for tablet 6a146802808647fbbdee0f0788daf5f7 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:48.898140 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a146802808647fbbdee0f0788daf5f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.900058 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 290bd7625b0a4ccab3894dc7aacf43b8 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:48.900820 27741 tablet_service.cc:1511] Processing CreateTablet for tablet 290bd7625b0a4ccab3894dc7aacf43b8 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:48.901654 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290bd7625b0a4ccab3894dc7aacf43b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.901566 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 6a146802808647fbbdee0f0788daf5f7 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:48.903185 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a146802808647fbbdee0f0788daf5f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.902136 27741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290bd7625b0a4ccab3894dc7aacf43b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.912346 27959 raft_consensus.cc:493] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.913113 27959 raft_consensus.cc:515] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.913877 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 6a146802808647fbbdee0f0788daf5f7 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:48.915237 27959 leader_election.cc:290] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:48.915725 27948 tablet_bootstrap.cc:492] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:48.918548 27948 ts_tablet_manager.cc:1403] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.158s	user 0.026s	sys 0.012s
I20260709 13:12:48.919029 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:48.920645 27791 leader_election.cc:343] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.918668 27888 tablet_service.cc:1511] Processing CreateTablet for tablet 290bd7625b0a4ccab3894dc7aacf43b8 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:48.922132 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290bd7625b0a4ccab3894dc7aacf43b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.922309 27948 raft_consensus.cc:359] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.923194 27948 raft_consensus.cc:385] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.923269 27663 tablet_service.cc:1511] Processing CreateTablet for tablet 51ff1f63fbf04422b661a09729f3285f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:48.924795 27663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff1f63fbf04422b661a09729f3285f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.925829 27950 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:48.926455 27950 ts_tablet_manager.cc:1403] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.005s
I20260709 13:12:48.918025 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:48.929881 27950 raft_consensus.cc:359] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:48.930558 27791 leader_election.cc:343] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.930740 27950 raft_consensus.cc:385] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.931083 27791 leader_election.cc:304] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:48.931764 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 51ff1f63fbf04422b661a09729f3285f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:48.918036 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a146802808647fbbdee0f0788daf5f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.933367 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff1f63fbf04422b661a09729f3285f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.933779 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0ecc1a707d48a3b7862009ff9feded (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:48.934875 27958 raft_consensus.cc:2749] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.935086 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0ecc1a707d48a3b7862009ff9feded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.923637 27948 raft_consensus.cc:740] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.923982 27947 tablet_bootstrap.cc:654] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.931131 27950 raft_consensus.cc:740] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.942715 27950 consensus_queue.cc:260] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.944315 27667 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0ecc1a707d48a3b7862009ff9feded (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:48.945432 27950 ts_tablet_manager.cc:1434] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:12:48.945904 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0ecc1a707d48a3b7862009ff9feded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.946661 27950 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:48.948500 27948 consensus_queue.cc:260] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:48.951087 27948 ts_tablet_manager.cc:1434] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:12:48.952267 27948 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:48.954056 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 51ff1f63fbf04422b661a09729f3285f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:48.955549 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ff1f63fbf04422b661a09729f3285f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.959666 27742 tablet_service.cc:1511] Processing CreateTablet for tablet 7f0ecc1a707d48a3b7862009ff9feded (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:48.961210 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f0ecc1a707d48a3b7862009ff9feded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.965293 27949 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:48.965916 27949 ts_tablet_manager.cc:1403] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.000s
I20260709 13:12:48.969403 27949 raft_consensus.cc:359] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:48.970232 27949 raft_consensus.cc:385] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.971539 27814 tablet_service.cc:1511] Processing CreateTablet for tablet e59461d3068941fb9f7e72054188b650 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:48.972872 27814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59461d3068941fb9f7e72054188b650. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:48.974977 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:48.989554 27889 tablet_service.cc:1511] Processing CreateTablet for tablet e59461d3068941fb9f7e72054188b650 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:48.991091 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59461d3068941fb9f7e72054188b650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:48.999078 27950 tablet_bootstrap.cc:654] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.999387 27662 tablet_service.cc:1511] Processing CreateTablet for tablet e59461d3068941fb9f7e72054188b650 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:49.000231 27949 raft_consensus.cc:740] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.000880 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59461d3068941fb9f7e72054188b650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.001250 27949 consensus_queue.cc:260] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.003891 27949 ts_tablet_manager.cc:1434] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:12:49.005990 27947 tablet_bootstrap.cc:492] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:49.019222 27947 ts_tablet_manager.cc:1403] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.000s
I20260709 13:12:49.021580 27741 tablet_service.cc:1511] Processing CreateTablet for tablet 4bdab5ff078a49dcbcb94c0229037b27 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:49.006361 27740 tablet_service.cc:1511] Processing CreateTablet for tablet f64a4cec1f6f4dc2a7457fe97b3b2cb2 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:49.012844 27816 tablet_service.cc:1511] Processing CreateTablet for tablet f64a4cec1f6f4dc2a7457fe97b3b2cb2 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:49.016022 27948 tablet_bootstrap.cc:654] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.022926 27741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bdab5ff078a49dcbcb94c0229037b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.024575 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64a4cec1f6f4dc2a7457fe97b3b2cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.022948 27947 raft_consensus.cc:359] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.016312 27892 tablet_service.cc:1511] Processing CreateTablet for tablet f64a4cec1f6f4dc2a7457fe97b3b2cb2 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:49.025684 27947 raft_consensus.cc:385] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.026057 27947 raft_consensus.cc:740] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.026499 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64a4cec1f6f4dc2a7457fe97b3b2cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.026958 27947 consensus_queue.cc:260] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.027503 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64a4cec1f6f4dc2a7457fe97b3b2cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.029721 27947 ts_tablet_manager.cc:1434] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:49.030797 27947 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:49.018224 27667 tablet_service.cc:1511] Processing CreateTablet for tablet 4bdab5ff078a49dcbcb94c0229037b27 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:49.037212 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bdab5ff078a49dcbcb94c0229037b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.040637 27888 tablet_service.cc:1511] Processing CreateTablet for tablet 91f6da6c29164c54a83cb71cb4069456 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:49.042044 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f6da6c29164c54a83cb71cb4069456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.044445 27949 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:49.050622 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 4bdab5ff078a49dcbcb94c0229037b27 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:49.057981 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bdab5ff078a49dcbcb94c0229037b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.061969 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 91f6da6c29164c54a83cb71cb4069456 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:49.062961 27947 tablet_bootstrap.cc:654] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.063941 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f6da6c29164c54a83cb71cb4069456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.062500 27818 tablet_service.cc:1511] Processing CreateTablet for tablet b5017019a2944f28b6055421fe3a6e4f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:49.065042 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5017019a2944f28b6055421fe3a6e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.067360 27949 tablet_bootstrap.cc:654] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.070461 27891 tablet_service.cc:1511] Processing CreateTablet for tablet b5017019a2944f28b6055421fe3a6e4f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:49.071847 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5017019a2944f28b6055421fe3a6e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.077190 27661 tablet_service.cc:1511] Processing CreateTablet for tablet b5017019a2944f28b6055421fe3a6e4f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:49.078660 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5017019a2944f28b6055421fe3a6e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.071796 27662 tablet_service.cc:1511] Processing CreateTablet for tablet 91f6da6c29164c54a83cb71cb4069456 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:49.084981 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f6da6c29164c54a83cb71cb4069456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.084900 27950 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:49.089525 27950 ts_tablet_manager.cc:1403] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.004s
I20260709 13:12:49.092921 27950 raft_consensus.cc:359] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.093725 27950 raft_consensus.cc:385] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.094079 27950 raft_consensus.cc:740] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.094926 27950 consensus_queue.cc:260] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.082231 27948 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:49.096581 27948 ts_tablet_manager.cc:1403] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.003s
I20260709 13:12:49.100041 27948 raft_consensus.cc:359] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.100859 27948 raft_consensus.cc:385] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.101179 27948 raft_consensus.cc:740] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.102077 27948 consensus_queue.cc:260] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.103827 27742 tablet_service.cc:1511] Processing CreateTablet for tablet b550130fa7644a86adb90f6194db6006 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:49.108997 27948 ts_tablet_manager.cc:1434] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:12:49.110773 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b550130fa7644a86adb90f6194db6006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.111238 27948 tablet_bootstrap.cc:492] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:49.124244 27816 tablet_service.cc:1511] Processing CreateTablet for tablet b550130fa7644a86adb90f6194db6006 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:49.127290 27892 tablet_service.cc:1511] Processing CreateTablet for tablet b550130fa7644a86adb90f6194db6006 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:49.128937 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b550130fa7644a86adb90f6194db6006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.129940 27949 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:49.130488 27949 ts_tablet_manager.cc:1403] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.005s
I20260709 13:12:49.133085 27959 raft_consensus.cc:493] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.133659 27959 raft_consensus.cc:515] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.139292 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b550130fa7644a86adb90f6194db6006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.141484 27959 leader_election.cc:290] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.142839 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a06c2def27d4ed89f8469619a9c3c8b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.141672 27950 ts_tablet_manager.cc:1434] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.003s
I20260709 13:12:49.146798 27948 tablet_bootstrap.cc:654] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:49.147810 27791 leader_election.cc:343] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.150244 27667 tablet_service.cc:1511] Processing CreateTablet for tablet b7605f0caec04cc29194d200cb76dc6c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:49.154417 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a06c2def27d4ed89f8469619a9c3c8b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:49.133562 27949 raft_consensus.cc:359] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.154609 27742 tablet_service.cc:1511] Processing CreateTablet for tablet b7605f0caec04cc29194d200cb76dc6c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:49.159858 27817 tablet_service.cc:1511] Processing CreateTablet for tablet b7605f0caec04cc29194d200cb76dc6c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:49.161057 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7605f0caec04cc29194d200cb76dc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.161813 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7605f0caec04cc29194d200cb76dc6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:49.163775 27794 leader_election.cc:343] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.164306 27794 leader_election.cc:304] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:12:49.164453 27955 raft_consensus.cc:493] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.164994 27955 raft_consensus.cc:515] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.166996 27955 leader_election.cc:290] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:49.168130 27959 raft_consensus.cc:2749] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.169222 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce354a66175a49b48f20aba6ef8d8f16" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.170396 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce354a66175a49b48f20aba6ef8d8f16" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:49.171664 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7605f0caec04cc29194d200cb76dc6c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:49.172267 27865 leader_election.cc:343] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:49.172979 27865 leader_election.cc:343] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.173388 27865 leader_election.cc:304] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.174108 27891 tablet_service.cc:1511] Processing CreateTablet for tablet ecb8c7f462a245618d096e6e8d01bd6a (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:49.175539 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb8c7f462a245618d096e6e8d01bd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.174429 27955 raft_consensus.cc:2749] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.186273 27662 tablet_service.cc:1511] Processing CreateTablet for tablet ecb8c7f462a245618d096e6e8d01bd6a (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:49.158407 27949 raft_consensus.cc:385] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.191686 27949 raft_consensus.cc:740] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.196439 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb8c7f462a245618d096e6e8d01bd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.196712 27947 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:49.196880 27739 tablet_service.cc:1511] Processing CreateTablet for tablet ecb8c7f462a245618d096e6e8d01bd6a (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:49.197290 27947 ts_tablet_manager.cc:1403] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.167s	user 0.021s	sys 0.004s
I20260709 13:12:49.198222 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb8c7f462a245618d096e6e8d01bd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.199996 27948 tablet_bootstrap.cc:492] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:49.208791 27948 ts_tablet_manager.cc:1403] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.005s
I20260709 13:12:49.211928 27948 raft_consensus.cc:359] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.212198 27891 tablet_service.cc:1511] Processing CreateTablet for tablet f3132e52c1c645a1883133f963c50b24 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:49.212749 27948 raft_consensus.cc:385] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.213094 27948 raft_consensus.cc:740] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.213663 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3132e52c1c645a1883133f963c50b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.213382 27661 tablet_service.cc:1511] Processing CreateTablet for tablet f3132e52c1c645a1883133f963c50b24 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:49.213830 27948 consensus_queue.cc:260] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.214630 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3132e52c1c645a1883133f963c50b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.201224 27947 raft_consensus.cc:359] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.216112 27948 ts_tablet_manager.cc:1434] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:49.202221 27950 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:49.204447 27949 consensus_queue.cc:260] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.216454 27947 raft_consensus.cc:385] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.216784 27947 raft_consensus.cc:740] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.217715 27947 consensus_queue.cc:260] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.218312 27949 ts_tablet_manager.cc:1434] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.001s
I20260709 13:12:49.219390 27949 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:49.222869 27947 ts_tablet_manager.cc:1434] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:12:49.227350 27957 raft_consensus.cc:493] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.227869 27957 raft_consensus.cc:515] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.230453 27957 leader_election.cc:290] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.230342 27817 tablet_service.cc:1511] Processing CreateTablet for tablet f3132e52c1c645a1883133f963c50b24 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:49.231043 27968 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.231609 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3132e52c1c645a1883133f963c50b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.231554 27968 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.232565 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d0b46b4fd44288bc03adbf43521de" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:49.233233 27902 raft_consensus.cc:2468] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:49.234704 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d0b46b4fd44288bc03adbf43521de" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.235088 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:49.235369 27679 raft_consensus.cc:2468] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:49.236317 27948 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:49.236555 27720 leader_election.cc:304] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
W20260709 13:12:49.236702 27643 leader_election.cc:343] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.239751 27957 raft_consensus.cc:2804] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.240142 27957 raft_consensus.cc:493] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.240527 27957 raft_consensus.cc:3060] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.243256 27742 tablet_service.cc:1511] Processing CreateTablet for tablet 1487f7f5bd2f44a3a7b1ff7dd221f441 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:49.244393 27816 tablet_service.cc:1511] Processing CreateTablet for tablet 1487f7f5bd2f44a3a7b1ff7dd221f441 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:49.245697 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1487f7f5bd2f44a3a7b1ff7dd221f441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.244747 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1487f7f5bd2f44a3a7b1ff7dd221f441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.249069 27892 tablet_service.cc:1511] Processing CreateTablet for tablet 1487f7f5bd2f44a3a7b1ff7dd221f441 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:49.250380 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1487f7f5bd2f44a3a7b1ff7dd221f441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.253701 27968 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:49.257138 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:49.257959 27754 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:49.258285 27947 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:49.258517 27948 tablet_bootstrap.cc:654] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.259545 27642 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:49.260516 27968 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.260947 27968 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.261323 27968 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.264575 27818 tablet_service.cc:1511] Processing CreateTablet for tablet 0194dc3b668440ceaa960a9b2ffbf646 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:49.265887 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0194dc3b668440ceaa960a9b2ffbf646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.266584 27949 tablet_bootstrap.cc:654] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.271867 27888 tablet_service.cc:1511] Processing CreateTablet for tablet bb8e70233e82420d90243b593b58b06b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:49.273419 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8e70233e82420d90243b593b58b06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.273115 27662 tablet_service.cc:1511] Processing CreateTablet for tablet bb8e70233e82420d90243b593b58b06b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:49.274670 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8e70233e82420d90243b593b58b06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.282137 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 0194dc3b668440ceaa960a9b2ffbf646 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:49.288065 27950 tablet_bootstrap.cc:654] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.297995 27814 tablet_service.cc:1511] Processing CreateTablet for tablet 65d3519d610d4f459ce05058f1eea874 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:49.301754 27814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d3519d610d4f459ce05058f1eea874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.304708 27968 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.307067 27968 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:49.308702 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:49.309844 27957 raft_consensus.cc:515] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:49.310700 27643 leader_election.cc:343] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.312641 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d0b46b4fd44288bc03adbf43521de" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:49.313318 27679 raft_consensus.cc:3060] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.292423 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 995243704b794d67a15048bce788b7fe (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:49.294090 27889 tablet_service.cc:1511] Processing CreateTablet for tablet 995243704b794d67a15048bce788b7fe (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:49.288118 27739 tablet_service.cc:1511] Processing CreateTablet for tablet 0194dc3b668440ceaa960a9b2ffbf646 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:49.317068 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995243704b794d67a15048bce788b7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.317386 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0194dc3b668440ceaa960a9b2ffbf646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.294986 27959 raft_consensus.cc:493] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.320919 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0194dc3b668440ceaa960a9b2ffbf646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.321456 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995243704b794d67a15048bce788b7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.338105 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:49.339512 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 65d3519d610d4f459ce05058f1eea874 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:49.325399 27959 raft_consensus.cc:515] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.340652 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d3519d610d4f459ce05058f1eea874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.340888 27947 tablet_bootstrap.cc:654] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.340413 27754 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.349387 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 995243704b794d67a15048bce788b7fe (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:49.351366 27741 tablet_service.cc:1511] Processing CreateTablet for tablet bb8e70233e82420d90243b593b58b06b (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:49.368602 27993 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.353159 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:49.346096 27957 leader_election.cc:290] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.351358 27959 leader_election.cc:290] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.354511 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:49.356032 27667 tablet_service.cc:1511] Processing CreateTablet for tablet 189c1d4fe48745baac57eb71662d27b1 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:49.373669 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 189c1d4fe48745baac57eb71662d27b1 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:49.356648 27948 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:49.375125 27948 ts_tablet_manager.cc:1403] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.011s
I20260709 13:12:49.373036 27993 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:49.374198 27791 leader_election.cc:343] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.356925 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d0b46b4fd44288bc03adbf43521de" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:49.373683 27902 raft_consensus.cc:2468] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:49.379304 27754 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:49.379416 27901 raft_consensus.cc:3060] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.380015 27993 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:49.380749 27642 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:49.381615 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:49.382648 27794 leader_election.cc:304] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.383316 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.383903 27959 raft_consensus.cc:2804] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:49.384202 27718 leader_election.cc:343] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.384326 27959 raft_consensus.cc:493] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:49.384820 27717 leader_election.cc:343] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.357010 27949 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:49.369114 27741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8e70233e82420d90243b593b58b06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.389534 27744 tablet_service.cc:1511] Processing CreateTablet for tablet aba13104713a49c6afab7d69cec33275 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:49.390882 27744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba13104713a49c6afab7d69cec33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.392521 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189c1d4fe48745baac57eb71662d27b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.395344 27901 raft_consensus.cc:2468] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:49.369776 27968 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.370606 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995243704b794d67a15048bce788b7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.371862 27742 tablet_service.cc:1511] Processing CreateTablet for tablet 65d3519d610d4f459ce05058f1eea874 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:49.398393 27968 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.399019 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65d3519d610d4f459ce05058f1eea874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.400471 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189c1d4fe48745baac57eb71662d27b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.378257 27948 raft_consensus.cc:359] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.402511 27948 raft_consensus.cc:385] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.402825 27948 raft_consensus.cc:740] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.366063 27950 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:49.384891 27959 raft_consensus.cc:3060] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.405061 27968 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:49.385305 27717 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:49.389182 27949 ts_tablet_manager.cc:1403] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.170s	user 0.011s	sys 0.006s
I20260709 13:12:49.343534 27679 raft_consensus.cc:2468] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:49.413105 27720 leader_election.cc:304] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:49.414048 27957 raft_consensus.cc:2749] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.414198 27888 tablet_service.cc:1511] Processing CreateTablet for tablet aba13104713a49c6afab7d69cec33275 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:49.414799 27957 raft_consensus.cc:2804] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.415333 27957 raft_consensus.cc:697] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:49.415679 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba13104713a49c6afab7d69cec33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.415532 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:49.416222 27957 consensus_queue.cc:237] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.416463 27827 raft_consensus.cc:2393] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:49.418500 27816 tablet_service.cc:1511] Processing CreateTablet for tablet 82ca1906db13410aac9f2a4d0d6969ed (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:49.419803 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ca1906db13410aac9f2a4d0d6969ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.405635 27968 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.420498 27968 raft_consensus.cc:697] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:12:49.421311 27968 consensus_queue.cc:237] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.422375 27891 tablet_service.cc:1511] Processing CreateTablet for tablet 82ca1906db13410aac9f2a4d0d6969ed (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:49.396863 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 189c1d4fe48745baac57eb71662d27b1 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:49.425011 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189c1d4fe48745baac57eb71662d27b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.428004 27739 tablet_service.cc:1511] Processing CreateTablet for tablet a699d843fce043cea91638fe4622003f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:49.429196 27739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a699d843fce043cea91638fe4622003f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.429028 27949 raft_consensus.cc:359] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.429818 27949 raft_consensus.cc:385] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.430133 27949 raft_consensus.cc:740] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.430956 27949 consensus_queue.cc:260] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.432379 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ca1906db13410aac9f2a4d0d6969ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.432523 27950 ts_tablet_manager.cc:1403] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.231s	user 0.014s	sys 0.009s
I20260709 13:12:49.466984 27818 tablet_service.cc:1511] Processing CreateTablet for tablet a699d843fce043cea91638fe4622003f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:49.468281 27818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a699d843fce043cea91638fe4622003f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.471669 27947 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:49.472273 27947 ts_tablet_manager.cc:1403] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.214s	user 0.008s	sys 0.009s
I20260709 13:12:49.475438 27947 raft_consensus.cc:359] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:49.460155 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 78438.6us
I20260709 13:12:49.478341 27947 raft_consensus.cc:385] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.478885 27947 raft_consensus.cc:740] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.480762 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:49.480908 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 82ca1906db13410aac9f2a4d0d6969ed (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:49.481611 27754 raft_consensus.cc:2393] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:49.479789 27947 consensus_queue.cc:260] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.482159 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ca1906db13410aac9f2a4d0d6969ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.482230 27667 tablet_service.cc:1511] Processing CreateTablet for tablet aba13104713a49c6afab7d69cec33275 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:49.483587 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba13104713a49c6afab7d69cec33275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.489061 27947 ts_tablet_manager.cc:1434] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:49.490141 27947 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:49.490084 27959 raft_consensus.cc:515] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.491920 27949 ts_tablet_manager.cc:1434] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.073s	user 0.013s	sys 0.009s
I20260709 13:12:49.492774 27642 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.493264 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
W20260709 13:12:49.501552 27791 leader_election.cc:343] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.441629 27948 consensus_queue.cc:260] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.502807 28000 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.507920 27950 raft_consensus.cc:359] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.509003 27950 raft_consensus.cc:385] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.509366 27950 raft_consensus.cc:740] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.510320 27950 consensus_queue.cc:260] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.512432 28000 raft_consensus.cc:2749] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.498840 27947 tablet_bootstrap.cc:654] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.511967 27575 catalog_manager.cc:5697] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.515393 27949 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:49.537446 27947 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:49.537952 27947 ts_tablet_manager.cc:1403] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.005s
I20260709 13:12:49.546365 27959 leader_election.cc:290] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.541790 27955 raft_consensus.cc:493] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.547488 27955 raft_consensus.cc:515] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.547901 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:49.548871 27901 raft_consensus.cc:3060] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.554106 27888 tablet_service.cc:1511] Processing CreateTablet for tablet a699d843fce043cea91638fe4622003f (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:49.555073 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a06c2def27d4ed89f8469619a9c3c8b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:49.556514 27827 raft_consensus.cc:2468] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:49.557968 27866 leader_election.cc:304] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:49.555554 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 3124bdaf6fc1485fb3c6dfe99582b4fd (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:49.559960 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a699d843fce043cea91638fe4622003f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.562180 27948 ts_tablet_manager.cc:1434] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.187s	user 0.019s	sys 0.013s
I20260709 13:12:49.562938 27955 leader_election.cc:290] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.563244 27948 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:49.563505 27955 raft_consensus.cc:493] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.563943 27955 raft_consensus.cc:515] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.565318 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a06c2def27d4ed89f8469619a9c3c8b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.565976 27679 raft_consensus.cc:2468] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:49.567422 27950 ts_tablet_manager.cc:1434] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.002s
I20260709 13:12:49.568500 27950 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:49.569453 27959 raft_consensus.cc:493] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.570007 27959 raft_consensus.cc:515] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.571143 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3124bdaf6fc1485fb3c6dfe99582b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.571939 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.573014 27959 leader_election.cc:290] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
W20260709 13:12:49.573309 27865 leader_election.cc:343] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.575088 27740 tablet_service.cc:1511] Processing CreateTablet for tablet 3124bdaf6fc1485fb3c6dfe99582b4fd (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:49.572585 27947 raft_consensus.cc:359] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.575994 27947 raft_consensus.cc:385] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.576274 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d5a3b562d24f8ba2e682e4964efc43" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:12:49.578015 27791 leader_election.cc:343] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.575088 27891 tablet_service.cc:1511] Processing CreateTablet for tablet f7d135ee8d4e4b30a625e909937c9a2d (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:49.576399 27947 raft_consensus.cc:740] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.576622 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3124bdaf6fc1485fb3c6dfe99582b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.583479 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 3124bdaf6fc1485fb3c6dfe99582b4fd (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:49.584736 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3124bdaf6fc1485fb3c6dfe99582b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.587718 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d5a3b562d24f8ba2e682e4964efc43" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:49.588317 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:49.589608 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d135ee8d4e4b30a625e909937c9a2d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:49.589964 27865 leader_election.cc:343] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.590463 27865 leader_election.cc:304] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.588454 27902 raft_consensus.cc:2468] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:49.592373 27794 leader_election.cc:304] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.593712 28001 raft_consensus.cc:2804] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.594182 28001 raft_consensus.cc:493] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.597105 27577 catalog_manager.cc:5697] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 1 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.594599 28001 raft_consensus.cc:3060] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.602847 27667 tablet_service.cc:1511] Processing CreateTablet for tablet f7d135ee8d4e4b30a625e909937c9a2d (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:49.604043 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d135ee8d4e4b30a625e909937c9a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.610821 27742 tablet_service.cc:1511] Processing CreateTablet for tablet f7d135ee8d4e4b30a625e909937c9a2d (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:49.611405 27816 tablet_service.cc:1511] Processing CreateTablet for tablet b8ec45e6ca9c4c98bd3a36fa21d7ee67 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:49.612116 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d135ee8d4e4b30a625e909937c9a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.612552 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ec45e6ca9c4c98bd3a36fa21d7ee67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.614346 27949 tablet_bootstrap.cc:654] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.582962 27955 leader_election.cc:290] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:49.624185 27955 raft_consensus.cc:2804] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.624554 27955 raft_consensus.cc:493] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.624902 27955 raft_consensus.cc:3060] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.625219 27888 tablet_service.cc:1511] Processing CreateTablet for tablet b8ec45e6ca9c4c98bd3a36fa21d7ee67 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:49.626430 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ec45e6ca9c4c98bd3a36fa21d7ee67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:49.631860 27866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 73975.8us
I20260709 13:12:49.653049 27950 tablet_bootstrap.cc:654] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.653344 27667 tablet_service.cc:1511] Processing CreateTablet for tablet b8ec45e6ca9c4c98bd3a36fa21d7ee67 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:49.654644 27667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ec45e6ca9c4c98bd3a36fa21d7ee67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.638144 27947 consensus_queue.cc:260] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.661594 27947 ts_tablet_manager.cc:1434] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.123s	user 0.009s	sys 0.000s
I20260709 13:12:49.661789 28005 raft_consensus.cc:2749] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.662698 27947 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:49.664835 27901 raft_consensus.cc:2468] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:49.666623 27794 leader_election.cc:304] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.667815 27959 raft_consensus.cc:2804] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.668447 27948 tablet_bootstrap.cc:654] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.674547 27817 tablet_service.cc:1511] Processing CreateTablet for tablet bf0954ebc4144a79b312f1d47bb6d167 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:49.671599 28001 raft_consensus.cc:515] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.675819 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0954ebc4144a79b312f1d47bb6d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.677623 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d5a3b562d24f8ba2e682e4964efc43" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
W20260709 13:12:49.679212 27791 leader_election.cc:343] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.681178 27742 tablet_service.cc:1511] Processing CreateTablet for tablet bf0954ebc4144a79b312f1d47bb6d167 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:49.683750 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d5a3b562d24f8ba2e682e4964efc43" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:49.684512 27949 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:49.685341 27661 tablet_service.cc:1511] Processing CreateTablet for tablet f2aca4291bad45cc9d8413a65298e541 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:49.693614 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2aca4291bad45cc9d8413a65298e541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.684276 28001 leader_election.cc:290] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.692840 27901 raft_consensus.cc:3060] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.700894 27955 raft_consensus.cc:515] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.705689 27816 tablet_service.cc:1511] Processing CreateTablet for tablet f2aca4291bad45cc9d8413a65298e541 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:49.707034 27816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2aca4291bad45cc9d8413a65298e541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.707896 27901 raft_consensus.cc:2468] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:49.706730 27891 tablet_service.cc:1511] Processing CreateTablet for tablet b70470ccb3c14f3eb3ea2c9ad9232f40 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:49.710850 27891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70470ccb3c14f3eb3ea2c9ad9232f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.689217 27742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0954ebc4144a79b312f1d47bb6d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.711865 27662 tablet_service.cc:1511] Processing CreateTablet for tablet b70470ccb3c14f3eb3ea2c9ad9232f40 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:49.712481 27949 ts_tablet_manager.cc:1403] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.197s	user 0.002s	sys 0.013s
I20260709 13:12:49.713219 27662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70470ccb3c14f3eb3ea2c9ad9232f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.708264 28001 raft_consensus.cc:493] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.713850 28001 raft_consensus.cc:515] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.685716 27888 tablet_service.cc:1511] Processing CreateTablet for tablet bf0954ebc4144a79b312f1d47bb6d167 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:49.716881 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b227f398fd164b8b8d69bd00c1ead78c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.717581 27679 raft_consensus.cc:2468] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:49.718592 28001 leader_election.cc:290] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.719017 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b227f398fd164b8b8d69bd00c1ead78c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:49.719732 27791 leader_election.cc:304] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:49.716876 27888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0954ebc4144a79b312f1d47bb6d167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.720906 27740 tablet_service.cc:1511] Processing CreateTablet for tablet f2aca4291bad45cc9d8413a65298e541 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:49.722043 27950 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:49.709936 27947 tablet_bootstrap.cc:654] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.732576 27902 raft_consensus.cc:2468] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:49.735414 27740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2aca4291bad45cc9d8413a65298e541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.715763 27949 raft_consensus.cc:359] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.746263 27794 leader_election.cc:304] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:49.746711 27744 tablet_service.cc:1511] Processing CreateTablet for tablet b70470ccb3c14f3eb3ea2c9ad9232f40 (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:49.740744 27949 raft_consensus.cc:385] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.748039 27744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70470ccb3c14f3eb3ea2c9ad9232f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.748288 27949 raft_consensus.cc:740] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.748682 27889 tablet_service.cc:1511] Processing CreateTablet for tablet 28693539a08d46a585b795a22f78252c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:49.749114 27949 consensus_queue.cc:260] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.750015 27889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28693539a08d46a585b795a22f78252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.751524 27949 ts_tablet_manager.cc:1434] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.003s
I20260709 13:12:49.753189 27817 tablet_service.cc:1511] Processing CreateTablet for tablet 28693539a08d46a585b795a22f78252c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:49.754420 27817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28693539a08d46a585b795a22f78252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.754719 28010 raft_consensus.cc:2804] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.756134 27955 leader_election.cc:290] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.743171 27950 ts_tablet_manager.cc:1403] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.175s	user 0.019s	sys 0.006s
I20260709 13:12:49.742380 28001 raft_consensus.cc:2804] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.772380 28001 raft_consensus.cc:493] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.772946 28001 raft_consensus.cc:3060] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.733034 27959 raft_consensus.cc:697] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:49.759481 27957 raft_consensus.cc:493] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.765846 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a06c2def27d4ed89f8469619a9c3c8b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:49.766062 27661 tablet_service.cc:1511] Processing CreateTablet for tablet 28693539a08d46a585b795a22f78252c (DEFAULT_TABLE table=test-workload [id=06c1938357f14c84955ad0578ddd9a11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:49.777663 27679 raft_consensus.cc:3060] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.778258 27661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28693539a08d46a585b795a22f78252c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:49.767091 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a06c2def27d4ed89f8469619a9c3c8b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:49.780272 27827 raft_consensus.cc:3060] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.786201 27949 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:49.793815 27950 raft_consensus.cc:359] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.794806 27950 raft_consensus.cc:385] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.795187 27950 raft_consensus.cc:740] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.776659 27957 raft_consensus.cc:515] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.802567 28010 raft_consensus.cc:697] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
W20260709 13:12:49.816520 27643 consensus_peers.cc:597] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.817807 27957 leader_election.cc:290] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.818394 27959 consensus_queue.cc:237] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.820704 28010 consensus_queue.cc:237] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.821393 27948 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:49.822456 27948 ts_tablet_manager.cc:1403] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.259s	user 0.012s	sys 0.013s
I20260709 13:12:49.823689 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce354a66175a49b48f20aba6ef8d8f16" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.824446 27678 raft_consensus.cc:2468] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:49.825619 27948 raft_consensus.cc:359] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.806753 27950 consensus_queue.cc:260] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.818675 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce354a66175a49b48f20aba6ef8d8f16" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:49.828095 27950 ts_tablet_manager.cc:1434] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 13:12:49.828313 27902 raft_consensus.cc:2468] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:49.829236 27950 tablet_bootstrap.cc:492] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:49.830188 27947 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:49.830703 27947 ts_tablet_manager.cc:1403] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.168s	user 0.002s	sys 0.010s
I20260709 13:12:49.827149 27717 leader_election.cc:304] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:49.832468 27993 raft_consensus.cc:2804] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.832918 27993 raft_consensus.cc:493] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.833376 27993 raft_consensus.cc:3060] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.833868 27947 raft_consensus.cc:359] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.834609 27947 raft_consensus.cc:385] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.834869 27947 raft_consensus.cc:740] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.835567 27948 raft_consensus.cc:385] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.835546 27947 consensus_queue.cc:260] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.836081 27948 raft_consensus.cc:740] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.842872 27948 consensus_queue.cc:260] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.845520 27948 ts_tablet_manager.cc:1434] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:12:49.845824 27679 raft_consensus.cc:2468] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:49.846824 27948 tablet_bootstrap.cc:492] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:49.836933 27950 tablet_bootstrap.cc:654] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.847412 27865 leader_election.cc:304] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:49.856696 27955 raft_consensus.cc:2804] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.857236 27955 raft_consensus.cc:697] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:49.858116 27955 consensus_queue.cc:237] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.860466 27947 ts_tablet_manager.cc:1434] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:12:49.839998 27949 tablet_bootstrap.cc:654] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.861414 27947 tablet_bootstrap.cc:492] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:49.862767 28001 raft_consensus.cc:515] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.868757 27955 raft_consensus.cc:493] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.869419 27955 raft_consensus.cc:515] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.872182 27948 tablet_bootstrap.cc:654] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.874145 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1db39393c244cabaa23bd30f42faf0" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:49.883551 27828 raft_consensus.cc:2468] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:49.884359 27957 raft_consensus.cc:493] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.885023 27957 raft_consensus.cc:515] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.887763 27957 leader_election.cc:290] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:49.883468 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1db39393c244cabaa23bd30f42faf0" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.866086 27993 raft_consensus.cc:515] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:49.885357 27866 leader_election.cc:304] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:49.890300 28005 raft_consensus.cc:2804] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.890493 27950 tablet_bootstrap.cc:492] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:49.890702 28005 raft_consensus.cc:493] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.890969 27950 ts_tablet_manager.cc:1403] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.006s
I20260709 13:12:49.891058 28005 raft_consensus.cc:3060] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.883447 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b227f398fd164b8b8d69bd00c1ead78c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:49.898507 28001 leader_election.cc:290] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:49.898649 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:49.899657 27828 raft_consensus.cc:2468] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
W20260709 13:12:49.899959 27865 leader_election.cc:343] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.901432 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b227f398fd164b8b8d69bd00c1ead78c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:49.901535 27718 leader_election.cc:304] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:49.901750 27950 raft_consensus.cc:359] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.902154 27902 raft_consensus.cc:3060] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.902480 27950 raft_consensus.cc:385] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.902757 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce354a66175a49b48f20aba6ef8d8f16" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:49.903469 27901 raft_consensus.cc:3060] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.902798 27950 raft_consensus.cc:740] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.914433 27575 catalog_manager.cc:5697] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.896550 27679 raft_consensus.cc:3060] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.916646 27950 consensus_queue.cc:260] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.917611 27576 catalog_manager.cc:5697] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.890869 27993 leader_election.cc:290] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.878561 27955 leader_election.cc:290] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.930987 27827 raft_consensus.cc:2468] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:49.904964 27957 consensus_queue.cc:1048] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260709 13:12:49.927667 27717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 43727.6us
I20260709 13:12:49.938414 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:49.939848 27993 raft_consensus.cc:2804] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.940454 27993 raft_consensus.cc:493] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.940909 27993 raft_consensus.cc:3060] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.941049 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce354a66175a49b48f20aba6ef8d8f16" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:49.941748 27678 raft_consensus.cc:3060] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.927335 28005 raft_consensus.cc:515] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:49.953387 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1db39393c244cabaa23bd30f42faf0" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:49.953701 27717 leader_election.cc:343] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.949352 27957 consensus_queue.cc:1048] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:12:49.959152 27865 leader_election.cc:343] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.960955 27679 raft_consensus.cc:2468] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:49.950235 28005 leader_election.cc:290] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:49.963611 27791 leader_election.cc:304] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:49.964398 27950 ts_tablet_manager.cc:1434] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.009s
I20260709 13:12:49.964557 28001 raft_consensus.cc:2804] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.965178 28001 raft_consensus.cc:697] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:49.965969 27950 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:49.966054 28001 consensus_queue.cc:237] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:49.980716 27948 tablet_bootstrap.cc:492] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:49.969096 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1db39393c244cabaa23bd30f42faf0" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:49.981506 27948 ts_tablet_manager.cc:1403] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.007s
I20260709 13:12:49.985126 27827 raft_consensus.cc:3060] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.971079 27901 raft_consensus.cc:2468] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:49.991688 27949 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:49.992300 27949 ts_tablet_manager.cc:1403] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.018s
I20260709 13:12:49.995085 27678 raft_consensus.cc:2468] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:49.995850 27949 raft_consensus.cc:359] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.996906 27949 raft_consensus.cc:385] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.997327 27949 raft_consensus.cc:740] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.998499 27949 consensus_queue.cc:260] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.002046 27947 tablet_bootstrap.cc:654] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.006585 27993 raft_consensus.cc:515] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:49.975476 27902 raft_consensus.cc:2468] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:50.010033 27993 leader_election.cc:290] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:50.011474 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:50.012375 27828 raft_consensus.cc:3060] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.046844 27828 raft_consensus.cc:2468] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.055078 27948 raft_consensus.cc:359] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.058818 27948 raft_consensus.cc:385] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.059278 27948 raft_consensus.cc:740] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.060247 27948 consensus_queue.cc:260] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.072960 27949 ts_tablet_manager.cc:1434] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:12:50.074301 27949 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:50.192553 27950 tablet_bootstrap.cc:654] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.201995 27949 tablet_bootstrap.cc:654] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.231585 27948 ts_tablet_manager.cc:1434] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.249s	user 0.007s	sys 0.003s
I20260709 13:12:50.235044 27948 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:50.268967 27947 tablet_bootstrap.cc:492] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:50.269706 27947 ts_tablet_manager.cc:1403] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.408s	user 0.032s	sys 0.020s
I20260709 13:12:50.272830 27948 tablet_bootstrap.cc:654] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.273576 27947 raft_consensus.cc:359] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.274331 27947 raft_consensus.cc:385] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.274607 27947 raft_consensus.cc:740] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.275012 28001 consensus_queue.cc:1048] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.275348 27947 consensus_queue.cc:260] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.278072 27947 ts_tablet_manager.cc:1434] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:50.280493 27950 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:50.281136 27950 ts_tablet_manager.cc:1403] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.316s	user 0.013s	sys 0.007s
I20260709 13:12:50.284204 27950 raft_consensus.cc:359] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.284938 27950 raft_consensus.cc:385] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.285280 27950 raft_consensus.cc:740] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.285776 27947 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:50.286087 27950 consensus_queue.cc:260] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.290447 27950 ts_tablet_manager.cc:1434] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:50.291498 27950 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:50.293512 27720 leader_election.cc:304] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.294369 27993 raft_consensus.cc:2804] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.298223 27950 tablet_bootstrap.cc:654] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.298381 27948 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:50.299193 27948 ts_tablet_manager.cc:1403] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.008s
I20260709 13:12:50.299580 27947 tablet_bootstrap.cc:654] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.300810 27827 raft_consensus.cc:2468] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:50.302407 27866 leader_election.cc:304] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:50.305553 27993 raft_consensus.cc:697] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:50.306432 28005 raft_consensus.cc:2804] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.306526 27993 consensus_queue.cc:237] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.307310 28005 raft_consensus.cc:697] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:50.309072 27948 raft_consensus.cc:359] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.309247 28005 consensus_queue.cc:237] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.310003 27948 raft_consensus.cc:385] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.310428 27948 raft_consensus.cc:740] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.311542 27948 consensus_queue.cc:260] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.314600 27948 ts_tablet_manager.cc:1434] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:50.316016 27948 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:50.316687 27718 leader_election.cc:304] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.317859 28020 raft_consensus.cc:2804] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.318323 28020 raft_consensus.cc:697] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:50.322594 28001 consensus_queue.cc:1048] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.319396 28020 consensus_queue.cc:237] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.318334 27949 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:50.337141 27949 ts_tablet_manager.cc:1403] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.263s	user 0.017s	sys 0.002s
I20260709 13:12:50.354192 27949 raft_consensus.cc:359] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.355425 27949 raft_consensus.cc:385] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.355841 27949 raft_consensus.cc:740] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.395776 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:50.470325 27753 raft_consensus.cc:3060] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:50.479338 28037 log.cc:927] Time spent T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
I20260709 13:12:50.479584 27947 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:50.509708 27947 ts_tablet_manager.cc:1403] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.224s	user 0.022s	sys 0.022s
I20260709 13:12:50.509408 27949 consensus_queue.cc:260] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.511723 27949 ts_tablet_manager.cc:1434] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.174s	user 0.007s	sys 0.002s
I20260709 13:12:50.512447 28001 consensus_queue.cc:1048] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.512686 27949 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:50.517534 27993 raft_consensus.cc:493] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.512771 27947 raft_consensus.cc:359] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.484822 28005 consensus_queue.cc:1048] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.488986 27968 raft_consensus.cc:493] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.490850 27791 consensus_peers.cc:597] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.520393 27968 raft_consensus.cc:515] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.495924 28021 raft_consensus.cc:493] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.521435 28001 consensus_queue.cc:1048] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.521636 28021 raft_consensus.cc:515] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.522873 27968 leader_election.cc:290] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:50.524381 27676 raft_consensus.cc:3060] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.524863 27947 raft_consensus.cc:385] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.525346 27947 raft_consensus.cc:740] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.524149 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:50.524061 27575 catalog_manager.cc:5697] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.526348 27947 consensus_queue.cc:260] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.527815 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d816cb7fb741e4a64bc9a6b69d4d26" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:50.528481 27827 raft_consensus.cc:2468] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:50.520040 27950 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:50.529567 27950 ts_tablet_manager.cc:1403] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.005s
I20260709 13:12:50.529801 27947 ts_tablet_manager.cc:1434] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:12:50.479606 28040 consensus_queue.cc:1048] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.533926 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d816cb7fb741e4a64bc9a6b69d4d26" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:50.534472 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:50.534600 27901 raft_consensus.cc:2468] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:50.535753 27947 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:50.536958 27959 consensus_queue.cc:1048] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.536072 27720 leader_election.cc:304] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.518307 27993 raft_consensus.cc:515] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.530567 28043 consensus_queue.cc:1048] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.538563 27957 raft_consensus.cc:2804] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.538980 27957 raft_consensus.cc:493] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.539341 27957 raft_consensus.cc:3060] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.539189 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa72a1976674cb2b73ab182d717bc93" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:50.535320 27950 raft_consensus.cc:359] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.543543 27950 raft_consensus.cc:385] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.543802 27950 raft_consensus.cc:740] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.523990 28021 leader_election.cc:290] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:50.554270 27950 consensus_queue.cc:260] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.564122 27827 raft_consensus.cc:2393] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:50.572342 27950 ts_tablet_manager.cc:1434] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:12:50.573699 27950 tablet_bootstrap.cc:492] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:50.576984 27947 tablet_bootstrap.cc:654] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.577145 28001 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.577909 28001 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.582397 27643 leader_election.cc:304] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:50.589643 27948 tablet_bootstrap.cc:654] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.606966 28050 raft_consensus.cc:493] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.607816 28050 raft_consensus.cc:515] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.620949 27949 tablet_bootstrap.cc:654] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.621950 27993 leader_election.cc:290] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:50.623031 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:50.624325 27827 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.625317 27676 raft_consensus.cc:2468] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.625883 28040 raft_consensus.cc:2749] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.626629 27950 tablet_bootstrap.cc:654] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.625465 27957 raft_consensus.cc:515] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.629257 28001 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:50.630182 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:50.630682 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d816cb7fb741e4a64bc9a6b69d4d26" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:50.631345 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbe94a3d414e7aa7c648a08e086a32" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:50.631966 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d816cb7fb741e4a64bc9a6b69d4d26" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:50.632295 27993 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.632648 27828 raft_consensus.cc:3060] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.632766 27993 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.635680 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:50.636791 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:50.636919 27677 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.637822 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbe94a3d414e7aa7c648a08e086a32" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:50.631283 27901 raft_consensus.cc:3060] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.617142 28050 leader_election.cc:290] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:50.639792 27718 leader_election.cc:304] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:50.632015 27902 raft_consensus.cc:2468] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:50.645244 28050 raft_consensus.cc:2749] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:50.647547 27720 leader_election.cc:304] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.646317 27717 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.650595 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:50.651467 28023 raft_consensus.cc:2804] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.651855 28023 raft_consensus.cc:493] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.660671 27791 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
W20260709 13:12:50.661511 27717 leader_election.cc:343] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.636355 27957 leader_election.cc:290] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:50.665767 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:50.666445 27826 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.658021 28023 raft_consensus.cc:3060] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.658162 28050 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:50.668195 27993 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:50.671171 27901 raft_consensus.cc:2468] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.668998 28050 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.672091 28050 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.672405 27720 leader_election.cc:304] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.673942 27993 raft_consensus.cc:2804] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.674575 27993 raft_consensus.cc:697] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:50.679132 28023 raft_consensus.cc:515] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.684327 28050 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.685034 27993 consensus_queue.cc:237] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.691170 28050 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:50.691509 28023 leader_election.cc:290] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:50.692461 27947 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:50.693018 27947 ts_tablet_manager.cc:1403] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.160s	user 0.026s	sys 0.018s
I20260709 13:12:50.693593 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:50.694200 27826 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.695925 27947 raft_consensus.cc:359] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.696695 27947 raft_consensus.cc:385] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.696962 27947 raft_consensus.cc:740] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.692832 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbe94a3d414e7aa7c648a08e086a32" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:50.697681 27947 consensus_queue.cc:260] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.698113 27901 raft_consensus.cc:3060] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.699755 27947 ts_tablet_manager.cc:1434] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:50.700750 27947 tablet_bootstrap.cc:492] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:50.701670 28045 raft_consensus.cc:493] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.702181 28045 raft_consensus.cc:515] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.706336 28045 leader_election.cc:290] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:50.704265 28010 raft_consensus.cc:2749] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.709939 27828 raft_consensus.cc:2468] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.710902 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:50.712357 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:50.712819 27679 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.712653 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbe94a3d414e7aa7c648a08e086a32" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:50.714496 27717 leader_election.cc:343] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.714440 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:50.716358 27865 leader_election.cc:343] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:50.721710 27866 leader_election.cc:343] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.722277 27901 raft_consensus.cc:2468] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.722584 27948 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:50.723055 27948 ts_tablet_manager.cc:1403] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.407s	user 0.023s	sys 0.015s
I20260709 13:12:50.722918 27866 leader_election.cc:304] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:50.725292 27720 leader_election.cc:304] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:50.720861 27949 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:50.726126 27948 raft_consensus.cc:359] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.727046 27948 raft_consensus.cc:385] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.727082 27949 ts_tablet_manager.cc:1403] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.215s	user 0.007s	sys 0.007s
I20260709 13:12:50.727613 28045 raft_consensus.cc:2749] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.729378 27947 tablet_bootstrap.cc:654] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.729955 27949 raft_consensus.cc:359] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.730679 27949 raft_consensus.cc:385] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.730919 27949 raft_consensus.cc:740] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.731606 27948 raft_consensus.cc:740] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.732424 27948 consensus_queue.cc:260] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.733407 27949 consensus_queue.cc:260] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.735998 27826 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:12:50.737834 27950 tablet_bootstrap.cc:492] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:50.738327 27950 ts_tablet_manager.cc:1403] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.165s	user 0.016s	sys 0.004s
I20260709 13:12:50.738554 27949 ts_tablet_manager.cc:1434] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:12:50.738593 27718 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:50.739663 28023 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.739648 27947 tablet_bootstrap.cc:492] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:50.740410 28023 raft_consensus.cc:697] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:50.740844 27947 ts_tablet_manager.cc:1403] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.006s
I20260709 13:12:50.741051 27950 raft_consensus.cc:359] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.741616 27948 ts_tablet_manager.cc:1434] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:50.741773 27950 raft_consensus.cc:385] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.741282 28023 consensus_queue.cc:237] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.742079 27950 raft_consensus.cc:740] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.742607 27948 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:50.739629 27949 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:50.744457 27950 consensus_queue.cc:260] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.732578 27993 raft_consensus.cc:2804] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.761005 27993 raft_consensus.cc:697] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:50.761942 27947 raft_consensus.cc:359] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.761883 27993 consensus_queue.cc:237] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.762647 27947 raft_consensus.cc:385] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.762943 27947 raft_consensus.cc:740] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.763616 27947 consensus_queue.cc:260] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.765838 27947 ts_tablet_manager.cc:1434] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:12:50.766676 27947 tablet_bootstrap.cc:492] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:50.769830 27679 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:12:50.773629 27950 ts_tablet_manager.cc:1434] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:12:50.774654 27950 tablet_bootstrap.cc:492] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:50.776122 27948 tablet_bootstrap.cc:654] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.784327 27949 tablet_bootstrap.cc:654] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.783407 27576 catalog_manager.cc:5697] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } }
I20260709 13:12:50.784327 27947 tablet_bootstrap.cc:654] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.806366 27950 tablet_bootstrap.cc:654] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.812896 27573 catalog_manager.cc:5697] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.821158 27949 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:50.821784 27949 ts_tablet_manager.cc:1403] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.011s
I20260709 13:12:50.824594 27949 raft_consensus.cc:359] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.825376 27949 raft_consensus.cc:385] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.825703 27949 raft_consensus.cc:740] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.826542 27949 consensus_queue.cc:260] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.831995 27574 catalog_manager.cc:5697] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.832962 27993 consensus_queue.cc:1048] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.833917 27574 catalog_manager.cc:5697] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.835938 27679 raft_consensus.cc:3060] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.842406 27948 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:50.843075 27948 ts_tablet_manager.cc:1403] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.101s	user 0.033s	sys 0.025s
I20260709 13:12:50.845808 27947 tablet_bootstrap.cc:492] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:50.846494 27947 ts_tablet_manager.cc:1403] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.017s
I20260709 13:12:50.849759 27947 raft_consensus.cc:359] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.850401 27947 raft_consensus.cc:385] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.850499 28045 consensus_queue.cc:1048] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.850782 27947 raft_consensus.cc:740] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.850558 27948 raft_consensus.cc:359] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.852272 27948 raft_consensus.cc:385] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.852692 27948 raft_consensus.cc:740] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.852283 27947 consensus_queue.cc:260] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.853389 27948 consensus_queue.cc:260] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:50.855096 27947 ts_tablet_manager.cc:1434] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:12:50.856067 27947 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:50.862591 28040 raft_consensus.cc:493] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.863132 28040 raft_consensus.cc:515] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.865571 27950 tablet_bootstrap.cc:492] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:50.866080 27950 ts_tablet_manager.cc:1403] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.020s
I20260709 13:12:50.868026 27948 ts_tablet_manager.cc:1434] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:12:50.870321 27947 tablet_bootstrap.cc:654] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.873178 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbe94a3d414e7aa7c648a08e086a32" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:50.874639 27901 raft_consensus.cc:2393] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:50.873246 28023 consensus_queue.cc:1048] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:50.875710 27993 raft_consensus.cc:493] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.873342 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbe94a3d414e7aa7c648a08e086a32" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:50.876241 27993 raft_consensus.cc:515] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.868152 28040 leader_election.cc:290] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:50.878605 27993 leader_election.cc:290] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:50.868712 27950 raft_consensus.cc:359] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.880005 27950 raft_consensus.cc:385] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.880394 27950 raft_consensus.cc:740] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.869012 27948 tablet_bootstrap.cc:492] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:50.881263 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:50.882858 27642 leader_election.cc:304] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
W20260709 13:12:50.884467 27717 leader_election.cc:343] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.886121 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:50.881274 27950 consensus_queue.cc:260] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:50.887172 27902 raft_consensus.cc:2468] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:50.891875 27720 leader_election.cc:304] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:50.893342 28050 raft_consensus.cc:2804] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.893721 28050 raft_consensus.cc:493] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.894068 28050 raft_consensus.cc:3060] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.894449 27950 ts_tablet_manager.cc:1434] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
I20260709 13:12:50.888278 28040 raft_consensus.cc:3060] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.906101 27753 raft_consensus.cc:3060] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.907572 27993 consensus_queue.cc:1048] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.910677 27950 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:50.910899 28005 consensus_queue.cc:1048] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.919020 27950 tablet_bootstrap.cc:654] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.923576 27949 ts_tablet_manager.cc:1434] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
I20260709 13:12:50.924714 27949 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:50.953307 28050 raft_consensus.cc:515] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.957167 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:50.957993 27902 raft_consensus.cc:3060] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.951231 27574 catalog_manager.cc:5697] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.960394 27993 consensus_queue.cc:1048] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.964908 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:50.971911 28040 raft_consensus.cc:2749] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.968762 28001 raft_consensus.cc:493] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.972853 28001 raft_consensus.cc:515] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:50.976435 27947 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:50.977938 27947 ts_tablet_manager.cc:1403] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.008s
I20260709 13:12:50.966078 28050 leader_election.cc:290] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:50.984791 28001 leader_election.cc:290] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:12:50.985560 27717 leader_election.cc:343] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.986291 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:50.986542 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:50.987234 27900 raft_consensus.cc:2468] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:50.989368 27947 raft_consensus.cc:359] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.990067 27947 raft_consensus.cc:385] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.990358 27947 raft_consensus.cc:740] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.991026 27947 consensus_queue.cc:260] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:50.991571 27794 leader_election.cc:304] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:50.994841 27902 raft_consensus.cc:2468] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:50.995483 27947 ts_tablet_manager.cc:1434] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:50.996104 27720 leader_election.cc:304] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:50.996479 27947 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:50.997319 28020 raft_consensus.cc:2804] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.997786 28020 raft_consensus.cc:697] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:50.998610 28020 consensus_queue.cc:237] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.001269 28005 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.001787 28005 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.003309 27959 raft_consensus.cc:2804] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.003727 27959 raft_consensus.cc:493] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.004119 27959 raft_consensus.cc:3060] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.004498 27574 catalog_manager.cc:5697] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 2, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 2 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.006517 27574 catalog_manager.cc:5697] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.008982 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:12:51.011750 27865 leader_election.cc:343] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.003834 28005 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.012436 27959 raft_consensus.cc:515] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.015503 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:51.015892 27948 tablet_bootstrap.cc:654] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.016147 27901 raft_consensus.cc:3060] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.017092 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:51.020155 27791 leader_election.cc:343] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.024930 27947 tablet_bootstrap.cc:654] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.025250 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:51.026721 27791 leader_election.cc:343] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.027446 27959 leader_election.cc:290] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:12:51.027697 27865 leader_election.cc:343] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.033310 27865 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:51.036470 28043 raft_consensus.cc:2749] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.030965 28050 raft_consensus.cc:493] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.041231 28050 raft_consensus.cc:515] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.072672 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e8866752254eff89e9da91504747ba" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.073870 27901 raft_consensus.cc:2468] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
W20260709 13:12:51.074050 27718 leader_election.cc:343] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.075047 27794 leader_election.cc:304] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:51.076269 27959 raft_consensus.cc:2804] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.076366 28050 leader_election.cc:290] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:51.076690 27947 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.076808 27959 raft_consensus.cc:697] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:51.077289 27947 ts_tablet_manager.cc:1403] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.007s
I20260709 13:12:51.077730 27959 consensus_queue.cc:237] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.080117 27947 raft_consensus.cc:359] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.080816 27947 raft_consensus.cc:385] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.081111 27947 raft_consensus.cc:740] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.076283 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e8866752254eff89e9da91504747ba" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:51.082901 27901 raft_consensus.cc:2468] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:51.081815 27947 consensus_queue.cc:260] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.084806 27720 leader_election.cc:304] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:51.086275 27947 ts_tablet_manager.cc:1434] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:12:51.088811 27947 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.093286 27950 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.093885 27950 ts_tablet_manager.cc:1403] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.191s	user 0.010s	sys 0.003s
I20260709 13:12:51.073894 27949 tablet_bootstrap.cc:654] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.099870 27947 tablet_bootstrap.cc:654] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.099769 28020 raft_consensus.cc:2804] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.102733 27950 raft_consensus.cc:359] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.103300 28020 raft_consensus.cc:493] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.103587 27950 raft_consensus.cc:385] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.103739 28020 raft_consensus.cc:3060] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.104089 27950 raft_consensus.cc:740] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.105091 27950 consensus_queue.cc:260] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.107641 27950 ts_tablet_manager.cc:1434] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:12:51.109817 27947 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.110597 27947 ts_tablet_manager.cc:1403] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:12:51.113252 27948 tablet_bootstrap.cc:492] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:51.113761 27948 ts_tablet_manager.cc:1403] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.245s	user 0.020s	sys 0.026s
I20260709 13:12:51.114142 27947 raft_consensus.cc:359] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.115244 27947 raft_consensus.cc:385] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.115734 27947 raft_consensus.cc:740] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.115032 28020 raft_consensus.cc:515] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.116797 27947 consensus_queue.cc:260] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.114152 27950 tablet_bootstrap.cc:492] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:51.123627 27947 ts_tablet_manager.cc:1434] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:12:51.117424 27948 raft_consensus.cc:359] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.120283 27959 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.120023 27575 catalog_manager.cc:5697] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.125083 27959 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.127152 27959 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.128867 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.128993 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:51.129535 27753 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:51.129701 27677 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:51.131270 27791 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:51.132293 27959 raft_consensus.cc:2804] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.132624 27959 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.132982 27959 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.136888 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e8866752254eff89e9da91504747ba" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
W20260709 13:12:51.138294 27718 leader_election.cc:343] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.140126 27959 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.141304 27947 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.141266 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e8866752254eff89e9da91504747ba" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:51.124735 27949 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:51.142400 27901 raft_consensus.cc:3060] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.142625 27949 ts_tablet_manager.cc:1403] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.009s
I20260709 13:12:51.142843 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:51.143425 27677 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.145536 27949 raft_consensus.cc:359] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.146222 27949 raft_consensus.cc:385] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.146489 27949 raft_consensus.cc:740] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.147248 27949 consensus_queue.cc:260] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.149431 27949 ts_tablet_manager.cc:1434] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:51.149549 27901 raft_consensus.cc:2468] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:51.150899 27720 leader_election.cc:304] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:51.151515 27948 raft_consensus.cc:385] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.151799 27948 raft_consensus.cc:740] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.151895 28050 raft_consensus.cc:2804] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.141260 28020 leader_election.cc:290] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:51.151026 27677 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:51.152482 28050 raft_consensus.cc:697] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:51.152529 27948 consensus_queue.cc:260] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.162668 28050 consensus_queue.cc:237] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.164108 27948 ts_tablet_manager.cc:1434] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:12:51.156629 27950 tablet_bootstrap.cc:654] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.155119 27959 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.165155 27948 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:51.159637 27791 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:51.159271 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:51.167693 27753 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.161079 27947 tablet_bootstrap.cc:654] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.152061 27949 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:51.171517 27948 tablet_bootstrap.cc:654] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.167090 27959 raft_consensus.cc:2804] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.174896 27959 raft_consensus.cc:697] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:51.175753 27959 consensus_queue.cc:237] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.176374 27949 tablet_bootstrap.cc:654] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.179008 27577 catalog_manager.cc:5697] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.182314 27574 catalog_manager.cc:5697] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.186746 27753 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:51.190716 27950 tablet_bootstrap.cc:492] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.191212 27950 ts_tablet_manager.cc:1403] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.008s
I20260709 13:12:51.194042 27950 raft_consensus.cc:359] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.194723 27950 raft_consensus.cc:385] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.194998 27950 raft_consensus.cc:740] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.196125 27950 consensus_queue.cc:260] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.197419 27947 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.197947 27947 ts_tablet_manager.cc:1403] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.009s
I20260709 13:12:51.199533 27950 ts_tablet_manager.cc:1434] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:51.200763 27947 raft_consensus.cc:359] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.202006 27947 raft_consensus.cc:385] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.202313 27947 raft_consensus.cc:740] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.202476 27950 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:51.203125 27677 raft_consensus.cc:1275] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:51.203303 27947 consensus_queue.cc:260] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.206723 27949 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:51.207214 27949 ts_tablet_manager.cc:1403] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.009s
I20260709 13:12:51.207274 28050 consensus_queue.cc:1048] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.207316 28020 consensus_queue.cc:1048] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:51.210166 27949 raft_consensus.cc:359] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.211144 27949 raft_consensus.cc:385] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.211521 27949 raft_consensus.cc:740] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.212368 28020 consensus_queue.cc:1048] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.215762 27950 tablet_bootstrap.cc:654] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.221796 27947 ts_tablet_manager.cc:1434] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:12:51.223120 27947 tablet_bootstrap.cc:492] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.231362 27949 consensus_queue.cc:260] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.233188 27950 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.233696 27950 ts_tablet_manager.cc:1403] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.003s
I20260709 13:12:51.234697 27949 ts_tablet_manager.cc:1434] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:12:51.236014 27949 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:51.239588 27950 raft_consensus.cc:359] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.240408 27950 raft_consensus.cc:385] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.240451 28023 consensus_queue.cc:1048] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:51.245371 28087 log.cc:927] Time spent T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:51.240787 27950 raft_consensus.cc:740] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.253248 27950 consensus_queue.cc:260] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.257091 27947 tablet_bootstrap.cc:654] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.257632 27950 ts_tablet_manager.cc:1434] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:12:51.257853 27827 raft_consensus.cc:1275] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:51.260035 28023 consensus_queue.cc:1048] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.261020 27950 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:51.262465 27949 tablet_bootstrap.cc:654] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.270608 27947 tablet_bootstrap.cc:492] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.271310 27947 ts_tablet_manager.cc:1403] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.005s
I20260709 13:12:51.275408 27950 tablet_bootstrap.cc:654] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.275084 27947 raft_consensus.cc:359] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.276125 27947 raft_consensus.cc:385] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.276525 27947 raft_consensus.cc:740] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.277431 27947 consensus_queue.cc:260] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.282780 27947 ts_tablet_manager.cc:1434] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:12:51.283850 27947 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.286309 27948 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:51.286809 27948 ts_tablet_manager.cc:1403] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.122s	user 0.035s	sys 0.039s
I20260709 13:12:51.288019 27949 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:51.288230 27950 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.288519 27949 ts_tablet_manager.cc:1403] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.000s
I20260709 13:12:51.288856 27950 ts_tablet_manager.cc:1403] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.010s
I20260709 13:12:51.289589 27948 raft_consensus.cc:359] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.290313 27948 raft_consensus.cc:385] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.290578 27948 raft_consensus.cc:740] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.291214 27949 raft_consensus.cc:359] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.291250 27948 consensus_queue.cc:260] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.291739 27950 raft_consensus.cc:359] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.292685 27950 raft_consensus.cc:385] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.348416 27948 ts_tablet_manager.cc:1434] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:12:51.351984 28050 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.339123 27950 raft_consensus.cc:740] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.353231 28050 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.354557 27950 consensus_queue.cc:260] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.335273 27968 raft_consensus.cc:493] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:51.359225 27849 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd280 after lost signal to thread 18098
I20260709 13:12:51.359141 28045 raft_consensus.cc:493] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.360535 28045 raft_consensus.cc:515] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
W20260709 13:12:51.362015 27849 debug-util.cc:398] Leaking SignalData structure 0x7b0800282640 after lost signal to thread 27611
I20260709 13:12:51.370136 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d25e8c307f46b7aa029d102bdc0b0b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.371611 27827 raft_consensus.cc:2468] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:51.372790 28050 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:51.375147 28020 consensus_queue.cc:1048] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:51.376394 27849 debug-util.cc:398] Leaking SignalData structure 0x7b080020f340 after lost signal to thread 27703
I20260709 13:12:51.364494 28045 leader_election.cc:290] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:51.377897 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:51.292040 27949 raft_consensus.cc:385] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.382058 27949 raft_consensus.cc:740] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
W20260709 13:12:51.386209 27849 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf460 after lost signal to thread 27778
I20260709 13:12:51.390486 28040 raft_consensus.cc:493] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.380939 27866 leader_election.cc:304] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:51.380676 27968 raft_consensus.cc:515] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.391880 28040 raft_consensus.cc:515] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.383512 27949 consensus_queue.cc:260] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.398224 27948 tablet_bootstrap.cc:492] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:51.401077 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:51.401746 28045 raft_consensus.cc:2804] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.393293 27950 ts_tablet_manager.cc:1434] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.104s	user 0.000s	sys 0.011s
I20260709 13:12:51.406503 27676 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:51.407649 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:51.408918 27900 raft_consensus.cc:2393] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:51.415130 28040 leader_election.cc:290] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.414181 27575 catalog_manager.cc:5697] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.415539 28010 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.416522 28010 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.417418 27901 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:51.417760 27717 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:51.418876 28050 raft_consensus.cc:493] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.419968 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d25e8c307f46b7aa029d102bdc0b0b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.420835 27753 raft_consensus.cc:2468] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:51.422026 28050 raft_consensus.cc:515] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.426064 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064de8ca801f46a093830449c4b59008" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:51.427946 27717 leader_election.cc:343] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.429284 28050 leader_election.cc:290] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:51.430091 27948 tablet_bootstrap.cc:654] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.405908 28045 raft_consensus.cc:493] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.432513 28045 raft_consensus.cc:3060] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.433828 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064de8ca801f46a093830449c4b59008" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.434214 28050 raft_consensus.cc:2804] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:51.434449 27849 debug-util.cc:398] Leaking SignalData structure 0x7b080028bb40 after lost signal to thread 27852
I20260709 13:12:51.434723 28050 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.435119 28050 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:51.436609 27849 debug-util.cc:398] Leaking SignalData structure 0x7b080014ca80 after lost signal to thread 27926
I20260709 13:12:51.438743 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "017321988c03432fa294e969af945a82" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.439517 27678 raft_consensus.cc:3060] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:51.441532 27718 leader_election.cc:343] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.442086 27718 leader_election.cc:304] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:51.443852 28102 raft_consensus.cc:2749] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.445442 27949 ts_tablet_manager.cc:1434] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.157s	user 0.008s	sys 0.002s
I20260709 13:12:51.446430 27968 leader_election.cc:290] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:51.446965 27949 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:51.448304 27642 leader_election.cc:304] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:51.448455 28045 raft_consensus.cc:515] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.440436 28010 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:51.451435 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.452692 28045 leader_election.cc:290] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:51.451531 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d25e8c307f46b7aa029d102bdc0b0b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:51.442198 27947 tablet_bootstrap.cc:700] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: Time spent opening tablet: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:12:51.456012 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:51.455556 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd13b4c8384d40b4a3d039b69415bce3" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:51.457561 27901 raft_consensus.cc:2468] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:51.458292 27900 raft_consensus.cc:2393] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:51.456216 27947 tablet_bootstrap.cc:654] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.461366 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:51.454988 27753 raft_consensus.cc:3060] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.467602 27645 leader_election.cc:304] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:51.472810 28046 raft_consensus.cc:3060] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.463967 27794 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:51.480316 28010 raft_consensus.cc:2804] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.480751 28010 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:51.480358 27791 leader_election.cc:343] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.481109 28010 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.482502 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91d25e8c307f46b7aa029d102bdc0b0b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:51.483165 27825 raft_consensus.cc:3060] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.490646 27993 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.491252 27993 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.492671 27950 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:51.493764 27993 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:51.498720 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:51.515689 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.526448 27825 raft_consensus.cc:2468] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:51.527877 27948 tablet_bootstrap.cc:492] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:51.528425 27948 ts_tablet_manager.cc:1403] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.006s
W20260709 13:12:51.532415 27718 leader_election.cc:343] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.533488 27717 leader_election.cc:343] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.533991 27717 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:51.535450 28103 raft_consensus.cc:2749] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.544759 27866 leader_election.cc:304] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:51.547806 28005 raft_consensus.cc:493] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.548677 28005 raft_consensus.cc:515] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.549451 28045 raft_consensus.cc:2804] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.551508 28005 leader_election.cc:290] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.553069 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.554603 28040 raft_consensus.cc:2749] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:51.555056 27865 leader_election.cc:343] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.556489 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:51.558077 27865 leader_election.cc:343] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.558511 27865 leader_election.cc:304] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:51.559846 28005 raft_consensus.cc:2749] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.561205 28050 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.562073 27947 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.563266 28046 raft_consensus.cc:2749] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.572546 27993 consensus_queue.cc:1048] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.577867 27950 tablet_bootstrap.cc:654] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.574582 27753 raft_consensus.cc:2468] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:51.582258 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:51.583101 27902 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.563407 28050 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:51.562801 27947 ts_tablet_manager.cc:1403] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.279s	user 0.017s	sys 0.000s
I20260709 13:12:51.564751 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:51.587215 27677 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.590169 27947 raft_consensus.cc:359] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.590925 27947 raft_consensus.cc:385] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.591187 27947 raft_consensus.cc:740] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.592156 27947 consensus_queue.cc:260] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.592964 28109 raft_consensus.cc:493] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.573134 28010 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.594894 27947 ts_tablet_manager.cc:1434] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:51.595716 28045 raft_consensus.cc:697] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:51.570055 27948 raft_consensus.cc:359] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.597463 28109 raft_consensus.cc:515] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.615813 28109 leader_election.cc:290] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.601630 27993 consensus_queue.cc:1048] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:12:51.596781 27949 tablet_bootstrap.cc:654] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.618216 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:12:51.619947 27865 leader_election.cc:343] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.616835 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:51.621887 27865 leader_election.cc:343] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.622326 27865 leader_election.cc:304] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:51.605170 28045 consensus_queue.cc:237] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.623452 28109 raft_consensus.cc:2749] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.605690 27948 raft_consensus.cc:385] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.624598 27948 raft_consensus.cc:740] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.625380 27948 consensus_queue.cc:260] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.626780 27902 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:51.627646 27948 ts_tablet_manager.cc:1434] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.002s
I20260709 13:12:51.629106 27948 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:51.607564 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:51.607652 28010 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:51.610008 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:51.634953 27900 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:51.635392 27791 leader_election.cc:343] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.599519 27947 tablet_bootstrap.cc:492] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.605520 27677 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:51.640619 27948 tablet_bootstrap.cc:654] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.637184 27720 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:51.645722 28050 raft_consensus.cc:2804] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.646281 28050 raft_consensus.cc:697] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:51.651253 28109 raft_consensus.cc:493] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.652763 28109 raft_consensus.cc:515] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.655176 28109 leader_election.cc:290] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:51.656001 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.647531 28050 consensus_queue.cc:237] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:51.657670 27865 leader_election.cc:343] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.609798 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:51.669402 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.669565 27577 catalog_manager.cc:5697] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.670595 28010 consensus_queue.cc:1048] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:12:51.676618 27866 leader_election.cc:343] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.677167 27866 leader_election.cc:304] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:51.678507 28109 raft_consensus.cc:2749] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.678826 27947 tablet_bootstrap.cc:654] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.679513 27959 consensus_queue.cc:1048] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.705719 27948 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:51.706293 27948 ts_tablet_manager.cc:1403] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.010s
I20260709 13:12:51.710469 27900 raft_consensus.cc:2468] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:51.712752 27577 catalog_manager.cc:5697] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.713764 27949 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:51.714388 27949 ts_tablet_manager.cc:1403] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.268s	user 0.014s	sys 0.006s
I20260709 13:12:51.717351 27794 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:51.718779 28010 raft_consensus.cc:2804] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.719328 28010 raft_consensus.cc:697] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:51.720260 28010 consensus_queue.cc:237] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.723443 28001 consensus_queue.cc:1048] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.728547 27950 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.729663 27950 ts_tablet_manager.cc:1403] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.238s	user 0.012s	sys 0.035s
I20260709 13:12:51.737850 27947 tablet_bootstrap.cc:492] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.739969 27947 ts_tablet_manager.cc:1403] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.007s
I20260709 13:12:51.746692 27959 consensus_queue.cc:1048] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.751223 28020 consensus_queue.cc:1048] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:51.752563 27950 raft_consensus.cc:359] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.753331 27950 raft_consensus.cc:385] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.752231 27577 catalog_manager.cc:5697] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.753645 27950 raft_consensus.cc:740] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.757969 27950 consensus_queue.cc:260] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.760416 27950 ts_tablet_manager.cc:1434] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:12:51.761598 27950 tablet_bootstrap.cc:492] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:51.767036 27948 raft_consensus.cc:359] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.770259 27948 raft_consensus.cc:385] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.770578 27948 raft_consensus.cc:740] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.767944 27949 raft_consensus.cc:359] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.768646 27825 raft_consensus.cc:3060] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.771106 27949 raft_consensus.cc:385] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.771626 27949 raft_consensus.cc:740] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.773854 27949 consensus_queue.cc:260] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.777384 27949 ts_tablet_manager.cc:1434] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:12:51.777343 27948 consensus_queue.cc:260] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.788681 27950 tablet_bootstrap.cc:654] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.793275 27948 ts_tablet_manager.cc:1434] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 13:12:51.798556 27948 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:51.806303 27948 tablet_bootstrap.cc:654] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.799250 27949 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:51.811151 27947 raft_consensus.cc:359] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.820286 27947 raft_consensus.cc:385] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.820073 28020 consensus_queue.cc:1048] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.820665 27947 raft_consensus.cc:740] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.821451 27949 tablet_bootstrap.cc:654] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.823581 27947 consensus_queue.cc:260] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.825953 27947 ts_tablet_manager.cc:1434] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 13:12:51.827180 27947 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.857409 27947 tablet_bootstrap.cc:654] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.869941 27950 tablet_bootstrap.cc:492] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.870560 27950 ts_tablet_manager.cc:1403] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.004s
I20260709 13:12:51.879137 27948 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:51.879741 27948 ts_tablet_manager.cc:1403] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.006s
I20260709 13:12:51.880622 27950 raft_consensus.cc:359] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.882965 27950 raft_consensus.cc:385] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.883286 27948 raft_consensus.cc:359] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.884470 27948 raft_consensus.cc:385] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.884773 27948 raft_consensus.cc:740] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.883306 27950 raft_consensus.cc:740] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.886215 27950 consensus_queue.cc:260] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.887385 27949 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:51.887193 27948 consensus_queue.cc:260] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.887826 27949 ts_tablet_manager.cc:1403] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.004s
I20260709 13:12:51.889679 27948 ts_tablet_manager.cc:1434] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:12:51.890915 27948 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:51.890821 27949 raft_consensus.cc:359] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.891690 27949 raft_consensus.cc:385] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.891963 27949 raft_consensus.cc:740] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.892694 27949 consensus_queue.cc:260] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.894942 27949 ts_tablet_manager.cc:1434] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:51.896075 27949 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:51.896225 27950 ts_tablet_manager.cc:1434] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:12:51.897328 27950 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:51.903409 28045 raft_consensus.cc:493] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.904047 28045 raft_consensus.cc:515] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:51.906361 28045 leader_election.cc:290] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:51.908151 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603fce887130421f8625960b354f5220" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.908231 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603fce887130421f8625960b354f5220" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.909616 27948 tablet_bootstrap.cc:654] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:51.909739 27865 leader_election.cc:343] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.910461 27866 leader_election.cc:343] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.910991 27866 leader_election.cc:304] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:51.911814 28045 raft_consensus.cc:2749] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.912286 27947 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.912802 27947 ts_tablet_manager.cc:1403] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.006s
I20260709 13:12:51.915817 27947 raft_consensus.cc:359] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.916603 27947 raft_consensus.cc:385] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.916904 27947 raft_consensus.cc:740] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.917764 27947 consensus_queue.cc:260] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.920274 27947 ts_tablet_manager.cc:1434] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:12:51.903690 27950 tablet_bootstrap.cc:654] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.926028 27949 tablet_bootstrap.cc:654] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.932054 27950 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:51.932641 27950 ts_tablet_manager.cc:1403] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.002s
I20260709 13:12:51.933656 27947 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.935365 27950 raft_consensus.cc:359] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:51.936029 27950 raft_consensus.cc:385] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.936322 27950 raft_consensus.cc:740] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.939643 27948 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:51.940145 27948 ts_tablet_manager.cc:1403] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.005s
I20260709 13:12:51.940256 27947 tablet_bootstrap.cc:654] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.941883 28010 raft_consensus.cc:493] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.942471 28010 raft_consensus.cc:515] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.946367 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064de8ca801f46a093830449c4b59008" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:51.947248 27678 raft_consensus.cc:2468] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:51.949190 27791 leader_election.cc:304] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:51.950156 27959 raft_consensus.cc:2804] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.950587 27959 raft_consensus.cc:493] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.950981 27959 raft_consensus.cc:3060] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.956293 28045 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.956691 27947 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:51.957201 27947 ts_tablet_manager.cc:1403] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 13:12:51.956851 28045 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.959003 28045 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:51.960196 27947 raft_consensus.cc:359] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.961476 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:51.961476 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:51.962944 27866 leader_election.cc:343] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.962054 28010 leader_election.cc:290] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:51.960911 27947 raft_consensus.cc:385] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.964002 27947 raft_consensus.cc:740] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
W20260709 13:12:51.964257 27865 leader_election.cc:343] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.964763 27865 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:51.964763 27947 consensus_queue.cc:260] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.965869 28109 raft_consensus.cc:2749] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.967125 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064de8ca801f46a093830449c4b59008" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:51.967775 27753 raft_consensus.cc:2468] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:51.968228 27947 ts_tablet_manager.cc:1434] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:51.969401 27947 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:51.974215 27948 raft_consensus.cc:359] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:51.974906 27948 raft_consensus.cc:385] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.975164 27948 raft_consensus.cc:740] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.975561 27947 tablet_bootstrap.cc:654] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.976445 27959 raft_consensus.cc:515] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.987979 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064de8ca801f46a093830449c4b59008" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:51.988605 27678 raft_consensus.cc:3060] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.996042 27678 raft_consensus.cc:2468] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:51.997378 27791 leader_election.cc:304] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:51.998224 28010 raft_consensus.cc:2804] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.999953 28010 raft_consensus.cc:697] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:52.001401 28010 consensus_queue.cc:237] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:51.937043 27950 consensus_queue.cc:260] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.016351 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "064de8ca801f46a093830449c4b59008" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:52.017314 27753 raft_consensus.cc:3060] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.025595 28046 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.026530 28046 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.039310 28045 consensus_queue.cc:1048] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.051007 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.051903 27902 raft_consensus.cc:2393] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:52.059975 28046 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:52.061437 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:52.063629 27643 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:52.064996 28040 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.074184 28040 raft_consensus.cc:2749] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.092622 27753 raft_consensus.cc:2468] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:52.102702 27575 catalog_manager.cc:5697] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.106752 28108 consensus_queue.cc:1048] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.121420 28103 consensus_queue.cc:1048] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.128069 28136 consensus_queue.cc:1048] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.138164 28136 consensus_queue.cc:1048] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.151121 28108 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.151669 28108 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.154901 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:52.156905 27865 leader_election.cc:343] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.159577 28108 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:52.159929 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:12:52.162109 27865 leader_election.cc:343] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.162804 27865 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:52.176469 28005 raft_consensus.cc:2749] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.189450 27993 raft_consensus.cc:493] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.190214 27993 raft_consensus.cc:515] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.195519 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.196599 27901 raft_consensus.cc:2468] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:52.198143 27720 leader_election.cc:304] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:52.199443 28103 raft_consensus.cc:2804] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.200008 28103 raft_consensus.cc:493] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.200726 28103 raft_consensus.cc:3060] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.203238 27950 ts_tablet_manager.cc:1434] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.270s	user 0.007s	sys 0.000s
I20260709 13:12:52.203119 27993 leader_election.cc:290] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:52.013067 27948 consensus_queue.cc:260] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.208632 28001 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.209260 28001 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.215459 28001 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.217141 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.218370 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:52.219120 27791 leader_election.cc:343] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.221397 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.222045 27901 raft_consensus.cc:2468] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
W20260709 13:12:52.223589 27718 leader_election.cc:343] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.224977 27794 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:52.222677 27950 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:52.227370 28010 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.228556 28001 raft_consensus.cc:2804] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.229300 28001 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.229718 28001 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.207558 27959 leader_election.cc:290] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:52.243235 27993 raft_consensus.cc:493] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.244215 27993 raft_consensus.cc:515] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.278898 28103 raft_consensus.cc:515] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.291368 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.316751 27949 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:52.281610 28108 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.317320 27949 ts_tablet_manager.cc:1403] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.422s	user 0.098s	sys 0.192s
I20260709 13:12:52.317307 28108 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.319991 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:52.320644 27901 raft_consensus.cc:3060] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.283246 28020 consensus_queue.cc:1048] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.294485 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.304384 27950 tablet_bootstrap.cc:654] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.330727 27949 raft_consensus.cc:359] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.331534 27949 raft_consensus.cc:385] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.331823 27949 raft_consensus.cc:740] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.332577 27949 consensus_queue.cc:260] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:52.333148 27717 leader_election.cc:343] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.334993 27949 ts_tablet_manager.cc:1434] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:12:52.337384 28108 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.227835 28010 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.345940 28010 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:12:52.286033 27794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 61121.9us
I20260709 13:12:52.316601 27900 raft_consensus.cc:2468] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:52.302457 27993 leader_election.cc:290] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.339078 27949 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:52.339764 28103 leader_election.cc:290] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:52.372711 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:52.373548 27753 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:52.375970 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.376297 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.376811 27678 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:52.378230 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:52.379693 27949 tablet_bootstrap.cc:654] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.379822 27718 leader_election.cc:343] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:52.380267 27865 leader_election.cc:343] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.384019 27791 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:52.364945 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:52.386682 27959 raft_consensus.cc:2804] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.387101 27959 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.387440 27959 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.388001 28001 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.411414 27720 leader_election.cc:304] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:52.412580 28020 raft_consensus.cc:2804] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.412999 28020 raft_consensus.cc:493] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.413338 28020 raft_consensus.cc:3060] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.421672 28103 raft_consensus.cc:493] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.422240 28103 raft_consensus.cc:515] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.425089 28103 leader_election.cc:290] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.419973 27950 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:52.432232 27950 ts_tablet_manager.cc:1403] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.212s	user 0.024s	sys 0.012s
I20260709 13:12:52.430119 28020 raft_consensus.cc:515] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:52.406535 27866 leader_election.cc:343] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.451543 27950 raft_consensus.cc:359] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.452188 27950 raft_consensus.cc:385] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.452497 27950 raft_consensus.cc:740] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.436280 27901 raft_consensus.cc:2468] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:52.454694 27950 consensus_queue.cc:260] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:52.450513 27717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 101741us
I20260709 13:12:52.463110 27949 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:52.463672 27949 ts_tablet_manager.cc:1403] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.128s	user 0.026s	sys 0.022s
I20260709 13:12:52.464697 27947 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:52.465220 27947 ts_tablet_manager.cc:1403] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.496s	user 0.089s	sys 0.158s
I20260709 13:12:52.467006 27949 raft_consensus.cc:359] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.467721 27949 raft_consensus.cc:385] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.450690 27866 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:52.468026 27949 raft_consensus.cc:740] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.467836 27947 raft_consensus.cc:359] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.469826 27947 raft_consensus.cc:385] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.470080 27947 raft_consensus.cc:740] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.472864 28108 raft_consensus.cc:2749] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.481478 27950 ts_tablet_manager.cc:1434] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:12:52.484710 27949 consensus_queue.cc:260] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.485092 27947 consensus_queue.cc:260] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.501492 27947 ts_tablet_manager.cc:1434] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:12:52.501845 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:52.503902 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:52.506574 27901 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:52.482609 27866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 76461.9us
I20260709 13:12:52.480387 28001 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.503000 27947 tablet_bootstrap.cc:492] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:52.520141 28147 consensus_queue.cc:1048] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:52.522279 27950 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:52.524768 27949 ts_tablet_manager.cc:1434] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.005s
I20260709 13:12:52.517879 28020 leader_election.cc:290] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.529822 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.529611 27720 leader_election.cc:304] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:52.530733 27947 tablet_bootstrap.cc:654] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.533458 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.534180 27899 raft_consensus.cc:2468] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:52.537998 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:52.538751 27899 raft_consensus.cc:3060] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.542922 27948 ts_tablet_manager.cc:1434] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.602s	user 0.014s	sys 0.036s
W20260709 13:12:52.543249 27948 ts_tablet_manager.cc:1467] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: Tablet startup took 602ms
I20260709 13:12:52.549691 27949 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:52.551744 27993 raft_consensus.cc:2804] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:52.549970 27717 leader_election.cc:343] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.553983 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:52.554201 27993 raft_consensus.cc:697] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:52.555344 27993 consensus_queue.cc:237] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
W20260709 13:12:52.546659 27948 ts_tablet_manager.cc:1469] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: Trace:
0709 13:12:48.380576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.384369 (+  3793us) service_pool.cc:224] Handling call
0709 13:12:48.386378 (+  2009us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:12:48.386509 (+   131us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:12:48.494747 (+108238us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:48.581043 (+ 86296us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:48.594705 (+ 13662us) inbound_call.cc:177] Queueing success response
0709 13:12:51.890422 (+3295717us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:12:51.940470 (+ 50048us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:12:51.940974 (+   504us) tablet_replica.cc:261] Starting instrumentation
0709 13:12:51.941514 (+   540us) tablet_replica.cc:280] Starting consensus
0709 13:12:52.459852 (+518338us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002d6754. stack: 00007fe8d4d96343 00007fe8d4d96240 00007fe8d47251d4 00007fe8de463304 00007fe8de463299 00007fe8d7e1e571 00007fe8d7eac12e 00007fe8d7eaac8d 00007fe8db8a7b2e 00007fe8dcec9d8a 00007fe8dceddd01 00007fe8dceddca9 00007fe8dceddc39 00007fe8dceddc01 00007fe8dcedcedd 000000000038f354
Metrics: {"mutex_wait_us":7041,"raft.queue_time_us":4145,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":9249,"spinlock_wait_cycles":359362304,"tablet-open.queue_time_us":3295759,"thread_start_us":56880,"threads_started":1}
W20260709 13:12:52.559777 27717 leader_election.cc:343] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.561067 28005 raft_consensus.cc:493] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.561908 27948 tablet_bootstrap.cc:492] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:52.561630 28005 raft_consensus.cc:515] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.566264 27959 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.567808 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a146802808647fbbdee0f0788daf5f7" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.568667 27948 tablet_bootstrap.cc:654] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.569377 27865 leader_election.cc:343] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:52.575770 27720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 46271.7us
I20260709 13:12:52.573865 28005 leader_election.cc:290] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.571374 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a146802808647fbbdee0f0788daf5f7" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:52.573998 27791 leader_election.cc:343] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:52.584293 27866 leader_election.cc:343] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.584848 27866 leader_election.cc:304] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:52.589524 27959 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:52.593832 27899 raft_consensus.cc:2468] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:52.594919 27949 tablet_bootstrap.cc:654] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.594695 28005 raft_consensus.cc:2749] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.603848 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:52.604552 27675 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.627071 27950 tablet_bootstrap.cc:654] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.626511 27720 leader_election.cc:304] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:52.634042 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:52.637861 27754 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.651734 27947 tablet_bootstrap.cc:492] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:52.652312 27947 ts_tablet_manager.cc:1403] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.009s
I20260709 13:12:52.643457 28146 consensus_queue.cc:1048] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:52.656766 27947 raft_consensus.cc:359] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.657461 27947 raft_consensus.cc:385] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.657713 27947 raft_consensus.cc:740] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.658375 27947 consensus_queue.cc:260] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.659386 27754 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:52.641948 27993 raft_consensus.cc:2804] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.665488 27993 raft_consensus.cc:493] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.665998 27993 raft_consensus.cc:3060] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.669210 27575 catalog_manager.cc:5697] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.674218 27948 tablet_bootstrap.cc:492] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:52.674795 27948 ts_tablet_manager.cc:1403] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.007s
I20260709 13:12:52.675936 27901 raft_consensus.cc:2468] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:52.677250 27791 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:52.677577 27794 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:52.678439 28146 raft_consensus.cc:2804] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.678946 28146 raft_consensus.cc:697] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:52.679405 28010 raft_consensus.cc:2804] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.679931 28010 raft_consensus.cc:697] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:52.679782 28146 consensus_queue.cc:237] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.680845 28010 consensus_queue.cc:237] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.684906 28108 raft_consensus.cc:493] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.688050 28108 raft_consensus.cc:515] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.690246 28108 leader_election.cc:290] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:52.691991 27948 raft_consensus.cc:359] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.695797 27948 raft_consensus.cc:385] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.696326 27948 raft_consensus.cc:740] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.700944 27720 leader_election.cc:304] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:52.701838 28050 raft_consensus.cc:2804] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.702344 28050 raft_consensus.cc:697] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:52.703204 28050 consensus_queue.cc:237] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.705193 27948 consensus_queue.cc:260] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.707369 27947 ts_tablet_manager.cc:1434] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
W20260709 13:12:52.708693 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:52.704546 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290bd7625b0a4ccab3894dc7aacf43b8" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:52.710708 27947 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
W20260709 13:12:52.712747 27866 leader_election.cc:343] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.687285 27675 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:52.691869 27993 raft_consensus.cc:515] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.732786 27948 ts_tablet_manager.cc:1434] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:12:52.752599 27948 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:52.753955 27949 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:52.754583 27949 ts_tablet_manager.cc:1403] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.007s
I20260709 13:12:52.768433 27948 tablet_bootstrap.cc:654] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.770748 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290bd7625b0a4ccab3894dc7aacf43b8" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:52.774592 27950 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:52.775516 27950 ts_tablet_manager.cc:1403] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.253s	user 0.015s	sys 0.006s
I20260709 13:12:52.781880 27950 raft_consensus.cc:359] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.782645 27950 raft_consensus.cc:385] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.782930 27950 raft_consensus.cc:740] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.783624 27950 consensus_queue.cc:260] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.786441 27950 ts_tablet_manager.cc:1434] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:12:52.787576 27950 tablet_bootstrap.cc:492] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:52.789336 27949 raft_consensus.cc:359] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.790194 27949 raft_consensus.cc:385] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.790472 27949 raft_consensus.cc:740] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.791164 27949 consensus_queue.cc:260] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.793357 27949 ts_tablet_manager.cc:1434] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
I20260709 13:12:52.794512 27949 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:52.802240 27947 tablet_bootstrap.cc:654] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.803622 27865 leader_election.cc:343] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.804198 27865 leader_election.cc:304] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
W20260709 13:12:52.825824 27866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 55732.9us
I20260709 13:12:52.828909 28164 raft_consensus.cc:2749] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.833376 27993 leader_election.cc:290] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:52.834957 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:52.837390 27717 leader_election.cc:343] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.851794 27950 tablet_bootstrap.cc:654] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.857697 27948 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:52.856191 27949 tablet_bootstrap.cc:654] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.859180 27948 ts_tablet_manager.cc:1403] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.122s	user 0.025s	sys 0.039s
I20260709 13:12:52.863798 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:52.864547 27899 raft_consensus.cc:3060] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.865973 27948 raft_consensus.cc:359] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.867035 27948 raft_consensus.cc:385] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.867442 27948 raft_consensus.cc:740] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.868593 27948 consensus_queue.cc:260] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.871886 27948 ts_tablet_manager.cc:1434] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:12:52.873102 27948 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:52.873070 28046 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.873826 28046 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:52.876042 28046 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:52.877574 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:52.880491 27948 tablet_bootstrap.cc:654] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.876087 27947 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:52.883452 27947 ts_tablet_manager.cc:1403] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.018s
I20260709 13:12:52.887516 27947 raft_consensus.cc:359] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.887996 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.893370 27899 raft_consensus.cc:2468] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:52.898489 27901 raft_consensus.cc:2393] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:52.897792 27947 raft_consensus.cc:385] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.899706 27947 raft_consensus.cc:740] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.899468 27720 leader_election.cc:304] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:52.900542 27947 consensus_queue.cc:260] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.901252 27993 raft_consensus.cc:2804] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.902137 27993 raft_consensus.cc:697] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:52.910295 27949 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:52.910887 27949 ts_tablet_manager.cc:1403] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.006s
I20260709 13:12:52.903326 27993 consensus_queue.cc:237] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.913364 27947 ts_tablet_manager.cc:1434] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:12:52.914662 27947 tablet_bootstrap.cc:492] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:52.914877 27645 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:52.916628 28046 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.920507 28050 raft_consensus.cc:493] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.921119 28050 raft_consensus.cc:515] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.923326 28050 leader_election.cc:290] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:52.925061 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:52.926760 27947 tablet_bootstrap.cc:654] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.927515 27718 leader_election.cc:343] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.928849 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:52.928649 27949 raft_consensus.cc:359] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.929406 27949 raft_consensus.cc:385] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.929684 27949 raft_consensus.cc:740] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.894208 27950 tablet_bootstrap.cc:492] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
W20260709 13:12:52.930332 27717 leader_election.cc:343] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.931082 27950 ts_tablet_manager.cc:1403] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.144s	user 0.025s	sys 0.005s
I20260709 13:12:52.931037 27717 leader_election.cc:304] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:52.930363 27949 consensus_queue.cc:260] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.934114 27950 raft_consensus.cc:359] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.934809 27950 raft_consensus.cc:385] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.935079 27950 raft_consensus.cc:740] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.935715 27949 ts_tablet_manager.cc:1434] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 13:12:52.935889 28050 raft_consensus.cc:2749] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.939424 27949 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:52.930188 28046 raft_consensus.cc:2749] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.935747 27950 consensus_queue.cc:260] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:52.950502 27950 ts_tablet_manager.cc:1434] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:12:52.951637 27950 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:52.956513 28046 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.957759 28046 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.960728 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:52.961417 27753 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:52.964143 27642 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:52.964447 27949 tablet_bootstrap.cc:654] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.965188 28040 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.965588 28040 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.965943 28040 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.975064 27950 tablet_bootstrap.cc:654] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.984951 28180 raft_consensus.cc:493] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.985450 28180 raft_consensus.cc:515] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.989735 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:52.990864 27899 raft_consensus.cc:2393] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:52.990953 28180 leader_election.cc:290] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:52.991153 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c73c86edb0f46ce9fd0547671f4ff22" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:52.992695 27642 leader_election.cc:304] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:52.993523 28180 raft_consensus.cc:3060] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.994218 27949 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:52.994740 27949 ts_tablet_manager.cc:1403] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.003s
I20260709 13:12:52.994521 27577 catalog_manager.cc:5697] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.989719 28040 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:52.997864 27950 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:52.998396 27950 ts_tablet_manager.cc:1403] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.003s
I20260709 13:12:52.998163 27949 raft_consensus.cc:359] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:52.998893 27949 raft_consensus.cc:385] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.999006 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:52.999651 27753 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.001278 27950 raft_consensus.cc:359] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.002000 27950 raft_consensus.cc:385] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.002262 27950 raft_consensus.cc:740] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.003170 28180 raft_consensus.cc:2749] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.003131 27950 consensus_queue.cc:260] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.006887 27950 ts_tablet_manager.cc:1434] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:53.007912 27950 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:53.009917 27753 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:53.013831 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.014096 27642 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.014413 28050 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.014780 27825 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:53.014935 28180 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.017659 27948 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:53.018168 27948 ts_tablet_manager.cc:1403] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.020s
I20260709 13:12:52.999212 27949 raft_consensus.cc:740] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.014889 28050 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.011047 28046 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:53.019744 27949 consensus_queue.cc:260] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.020738 28050 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:53.021986 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.022879 27899 raft_consensus.cc:2468] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:53.021988 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:53.024762 27717 leader_election.cc:343] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.026082 27949 ts_tablet_manager.cc:1434] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:12:53.026443 27720 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:53.017777 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:53.027339 27993 raft_consensus.cc:2804] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.027772 27993 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.027835 27825 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.028231 27993 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.013068 28040 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:53.035578 27993 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.036794 28136 raft_consensus.cc:493] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.033830 27948 raft_consensus.cc:359] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.037904 27948 raft_consensus.cc:385] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.037569 28136 raft_consensus.cc:515] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.038265 27948 raft_consensus.cc:740] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.038357 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:53.038967 27899 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.039148 27948 consensus_queue.cc:260] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.043038 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:53.046674 27899 raft_consensus.cc:2468] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:53.047241 27948 ts_tablet_manager.cc:1434] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:12:53.011525 27577 catalog_manager.cc:5697] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.048588 28136 leader_election.cc:290] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.048666 27720 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.049811 28144 raft_consensus.cc:2804] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.050293 28144 raft_consensus.cc:697] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:53.050912 28152 raft_consensus.cc:493] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.051159 28144 consensus_queue.cc:237] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.053259 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1baec7715c34422b3103684a51711f1" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.056469 27825 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:53.056751 27947 tablet_bootstrap.cc:492] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:53.057214 27947 ts_tablet_manager.cc:1403] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.143s	user 0.046s	sys 0.026s
I20260709 13:12:53.057951 27948 tablet_bootstrap.cc:492] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:53.060107 27947 raft_consensus.cc:359] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.061082 27947 raft_consensus.cc:385] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.061343 27947 raft_consensus.cc:740] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.062367 27950 tablet_bootstrap.cc:654] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.064100 27901 raft_consensus.cc:2393] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:53.064911 27993 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:53.065464 27794 leader_election.cc:304] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:53.067615 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:53.068657 28146 raft_consensus.cc:3060] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.061978 27947 consensus_queue.cc:260] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.074450 27947 ts_tablet_manager.cc:1434] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
W20260709 13:12:53.079901 27717 leader_election.cc:343] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.051615 28152 raft_consensus.cc:515] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.085004 28152 leader_election.cc:290] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.048580 28046 raft_consensus.cc:493] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.092581 28046 raft_consensus.cc:515] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.093403 27576 catalog_manager.cc:5697] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.101190 28136 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.101734 28136 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.095893 27576 catalog_manager.cc:5697] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.108426 27949 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:53.106055 28046 leader_election.cc:290] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:53.117398 27947 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:53.112957 28180 raft_consensus.cc:697] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:12:53.119282 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603fce887130421f8625960b354f5220" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.120852 28180 consensus_queue.cc:237] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.133476 27948 tablet_bootstrap.cc:654] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.139925 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.141052 27900 raft_consensus.cc:2393] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
W20260709 13:12:53.142503 27718 leader_election.cc:343] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.151669 28146 raft_consensus.cc:2749] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.151414 28144 consensus_queue.cc:1048] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.156272 28010 consensus_queue.cc:1048] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.157037 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603fce887130421f8625960b354f5220" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.158088 27901 raft_consensus.cc:2468] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:53.161551 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db71274402644eb0801ecfeda9b1ae53" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:53.163808 28136 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:53.167471 27898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.168131 27898 raft_consensus.cc:2468] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:53.171440 28152 consensus_queue.cc:1048] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.173619 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:53.176138 27791 leader_election.cc:343] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.179217 27794 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:53.180287 28146 raft_consensus.cc:2804] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.180672 28146 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.180997 28146 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.195796 27577 catalog_manager.cc:5697] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.205870 28146 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.208103 28146 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:53.198968 27720 leader_election.cc:304] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:53.215150 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:53.215983 28144 raft_consensus.cc:2804] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.216450 28144 raft_consensus.cc:493] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.200300 27642 leader_election.cc:304] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:53.227185 28144 raft_consensus.cc:3060] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.237565 27950 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:53.238862 27950 ts_tablet_manager.cc:1403] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.231s	user 0.043s	sys 0.047s
W20260709 13:12:53.239662 27791 leader_election.cc:343] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:53.242072 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 48502.9us
I20260709 13:12:53.244531 28181 raft_consensus.cc:3060] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.234987 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:53.245184 27899 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.248157 27950 raft_consensus.cc:359] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.252421 27950 raft_consensus.cc:385] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.252732 27950 raft_consensus.cc:740] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.257900 27949 tablet_bootstrap.cc:654] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.258889 27950 consensus_queue.cc:260] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.262013 27576 catalog_manager.cc:5697] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 1 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.270557 27947 tablet_bootstrap.cc:654] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.273159 27948 tablet_bootstrap.cc:492] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:53.273687 27948 ts_tablet_manager.cc:1403] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.216s	user 0.017s	sys 0.000s
I20260709 13:12:53.276666 27948 raft_consensus.cc:359] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.277433 27948 raft_consensus.cc:385] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.276852 28146 consensus_queue.cc:1048] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.277729 27948 raft_consensus.cc:740] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.278680 27948 consensus_queue.cc:260] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.286106 27950 ts_tablet_manager.cc:1434] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:12:53.297346 27950 tablet_bootstrap.cc:492] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:53.305068 27948 ts_tablet_manager.cc:1434] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:12:53.321044 27948 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:53.326454 27949 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:53.326984 27949 ts_tablet_manager.cc:1403] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.221s	user 0.014s	sys 0.005s
I20260709 13:12:53.334134 27948 tablet_bootstrap.cc:654] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.343910 27949 raft_consensus.cc:359] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.351132 27949 raft_consensus.cc:385] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.351576 27949 raft_consensus.cc:740] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.337482 28152 consensus_queue.cc:1048] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:12:53.353010 27949 consensus_queue.cc:260] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.357440 27899 raft_consensus.cc:2468] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:53.358165 27949 ts_tablet_manager.cc:1434] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:12:53.359360 27949 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:53.359442 27794 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:53.366047 27949 tablet_bootstrap.cc:654] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.347287 28010 consensus_queue.cc:1048] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:12:53.375043 28144 raft_consensus.cc:515] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.376258 28005 raft_consensus.cc:493] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.376811 28005 raft_consensus.cc:515] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.379598 27959 consensus_queue.cc:1048] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:53.393635 28181 raft_consensus.cc:2749] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.377393 28144 leader_election.cc:290] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.398021 28005 leader_election.cc:290] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:53.372299 28136 raft_consensus.cc:2804] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.370157 28020 consensus_queue.cc:1048] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:53.404073 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:53.404510 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:53.408058 27865 leader_election.cc:343] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:53.408906 27865 leader_election.cc:343] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.409323 27865 leader_election.cc:304] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:53.409816 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603fce887130421f8625960b354f5220" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:53.410444 27900 raft_consensus.cc:3060] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.412642 28164 raft_consensus.cc:2749] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.412951 28050 consensus_queue.cc:1048] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.414698 28144 consensus_queue.cc:1048] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:53.406028 28136 raft_consensus.cc:697] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:53.423939 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "603fce887130421f8625960b354f5220" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:53.427600 27950 tablet_bootstrap.cc:654] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.431747 27947 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:53.435276 27947 ts_tablet_manager.cc:1403] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.322s	user 0.009s	sys 0.012s
I20260709 13:12:53.433118 27948 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:53.435992 27948 ts_tablet_manager.cc:1403] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.004s
I20260709 13:12:53.438092 27825 raft_consensus.cc:3060] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.441002 27948 raft_consensus.cc:359] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.441815 27948 raft_consensus.cc:385] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.442111 27948 raft_consensus.cc:740] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.442919 27948 consensus_queue.cc:260] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.446637 27825 raft_consensus.cc:2468] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:53.446570 27947 raft_consensus.cc:359] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.456067 27947 raft_consensus.cc:385] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.457098 27947 raft_consensus.cc:740] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.460481 28005 raft_consensus.cc:493] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.461026 28005 raft_consensus.cc:515] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.461676 27948 ts_tablet_manager.cc:1434] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:12:53.462767 27948 tablet_bootstrap.cc:492] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:53.463225 28005 leader_election.cc:290] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:53.464480 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.458518 27947 consensus_queue.cc:260] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:12:53.468520 27866 leader_election.cc:343] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.465534 27718 leader_election.cc:304] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.471766 28152 raft_consensus.cc:2804] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.472455 28152 raft_consensus.cc:697] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:53.472652 28005 raft_consensus.cc:493] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.473132 28005 raft_consensus.cc:515] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.473325 28152 consensus_queue.cc:237] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.476991 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:12:53.484807 27865 leader_election.cc:343] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.485452 27865 leader_election.cc:304] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:53.486420 28164 raft_consensus.cc:2749] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.479434 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59461d3068941fb9f7e72054188b650" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:53.487473 27948 tablet_bootstrap.cc:654] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.479972 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59461d3068941fb9f7e72054188b650" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:53.487859 27865 leader_election.cc:343] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.477524 28005 leader_election.cc:290] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:12:53.490417 27866 leader_election.cc:343] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.490957 27866 leader_election.cc:304] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:53.491880 28164 raft_consensus.cc:2749] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.468127 27900 raft_consensus.cc:2468] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:53.493189 28136 consensus_queue.cc:237] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.504734 28180 consensus_queue.cc:1048] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.528946 27947 ts_tablet_manager.cc:1434] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:12:53.532955 27949 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:53.533716 27949 ts_tablet_manager.cc:1403] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.016s
I20260709 13:12:53.535136 28020 raft_consensus.cc:493] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.535674 28020 raft_consensus.cc:515] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.537891 28020 leader_election.cc:290] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:53.538843 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:53.539234 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:53.540696 27718 leader_election.cc:343] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:53.541249 27717 leader_election.cc:343] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.541925 27717 leader_election.cc:304] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:53.543278 28020 raft_consensus.cc:2749] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.537026 27949 raft_consensus.cc:359] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.546254 27949 raft_consensus.cc:385] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.546729 27949 raft_consensus.cc:740] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.547716 27949 consensus_queue.cc:260] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.553318 27949 ts_tablet_manager.cc:1434] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:12:53.566387 28181 consensus_queue.cc:1048] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.571345 28197 consensus_queue.cc:1048] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.586020 27947 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:53.594517 27950 tablet_bootstrap.cc:492] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:53.595119 27950 ts_tablet_manager.cc:1403] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.298s	user 0.020s	sys 0.016s
I20260709 13:12:53.611572 27950 raft_consensus.cc:359] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.612917 27950 raft_consensus.cc:385] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.613212 27950 raft_consensus.cc:740] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.620703 27950 consensus_queue.cc:260] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.623080 27949 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:53.628969 27947 tablet_bootstrap.cc:654] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.632117 27575 catalog_manager.cc:5697] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.636014 27948 tablet_bootstrap.cc:492] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:53.636554 27948 ts_tablet_manager.cc:1403] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.003s
I20260709 13:12:53.635710 27574 catalog_manager.cc:5697] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.640595 27950 ts_tablet_manager.cc:1434] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:12:53.652298 27948 raft_consensus.cc:359] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.653095 27948 raft_consensus.cc:385] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.653393 27948 raft_consensus.cc:740] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.654043 27948 consensus_queue.cc:260] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.656148 27948 ts_tablet_manager.cc:1434] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
W20260709 13:12:53.663354 27717 consensus_peers.cc:597] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.673377 27948 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:53.688457 28136 raft_consensus.cc:493] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.689070 28136 raft_consensus.cc:515] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.691433 28136 leader_election.cc:290] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:53.692786 28180 raft_consensus.cc:493] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.693359 28180 raft_consensus.cc:515] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.695664 28180 leader_election.cc:290] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:53.698581 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:53.699278 27753 raft_consensus.cc:2468] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:53.701108 27642 leader_election.cc:304] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.701987 28180 raft_consensus.cc:2804] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.702339 28180 raft_consensus.cc:493] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.702683 28180 raft_consensus.cc:3060] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.703572 27948 tablet_bootstrap.cc:654] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.703994 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:53.708931 28181 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.709491 28181 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.711695 28181 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.713272 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.716147 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:53.716899 27754 raft_consensus.cc:2468] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:53.717234 27949 tablet_bootstrap.cc:654] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.718163 27791 leader_election.cc:304] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.719324 27959 raft_consensus.cc:2804] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.719717 27959 raft_consensus.cc:493] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.720072 27959 raft_consensus.cc:3060] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.708464 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.722213 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.724906 27902 raft_consensus.cc:2393] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:53.722270 28180 raft_consensus.cc:515] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.726022 27645 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:53.727002 27677 raft_consensus.cc:2393] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate 1da14a10b312403c91c2ff8aa9d0338a in this term.
I20260709 13:12:53.727231 28181 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.727605 27950 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:53.727248 27959 raft_consensus.cc:515] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.732561 27827 raft_consensus.cc:2393] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:53.732976 28180 leader_election.cc:290] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:53.733714 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:53.734529 27825 raft_consensus.cc:2393] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:53.734601 28181 raft_consensus.cc:2749] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.735097 27959 leader_election.cc:290] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:53.737090 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:53.737183 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:53.737814 27753 raft_consensus.cc:3060] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.737090 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62682940e2d74241925b8bfb53838357" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:53.749191 27677 raft_consensus.cc:2393] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate 1da14a10b312403c91c2ff8aa9d0338a in this term.
I20260709 13:12:53.749493 27642 leader_election.cc:304] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:53.750365 28181 raft_consensus.cc:2749] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.754132 27753 raft_consensus.cc:2468] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:53.755659 27791 leader_election.cc:304] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:53.756502 27959 raft_consensus.cc:2804] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.756994 27959 raft_consensus.cc:697] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:53.757777 27959 consensus_queue.cc:237] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.768188 27947 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:53.768775 27947 ts_tablet_manager.cc:1403] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.211s	user 0.021s	sys 0.026s
I20260709 13:12:53.772811 27949 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:53.773512 27949 ts_tablet_manager.cc:1403] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.010s
I20260709 13:12:53.775022 27947 raft_consensus.cc:359] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.779475 27947 raft_consensus.cc:385] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.779821 27947 raft_consensus.cc:740] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.779121 27950 tablet_bootstrap.cc:654] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.777215 27949 raft_consensus.cc:359] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.790650 27947 consensus_queue.cc:260] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.792795 27948 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:53.793311 27948 ts_tablet_manager.cc:1403] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.004s
I20260709 13:12:53.793602 27947 ts_tablet_manager.cc:1434] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:12:53.794847 27947 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:53.795096 27577 catalog_manager.cc:5697] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:53.786744 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:53.802561 27947 tablet_bootstrap.cc:654] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.802585 28197 raft_consensus.cc:493] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.803270 28197 raft_consensus.cc:515] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.788002 27949 raft_consensus.cc:385] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.804526 27949 raft_consensus.cc:740] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.807626 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290bd7625b0a4ccab3894dc7aacf43b8" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.808050 27950 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:53.807916 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290bd7625b0a4ccab3894dc7aacf43b8" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.808670 27950 ts_tablet_manager.cc:1403] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.000s
I20260709 13:12:53.808611 27825 raft_consensus.cc:2468] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:53.809564 27949 consensus_queue.cc:260] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.805670 27948 raft_consensus.cc:359] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.810912 27948 raft_consensus.cc:385] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.810829 27718 leader_election.cc:304] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.811473 27948 raft_consensus.cc:740] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.811635 27950 raft_consensus.cc:359] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.808691 27902 raft_consensus.cc:2468] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:53.812770 27950 raft_consensus.cc:385] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.812295 28020 raft_consensus.cc:2804] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.813107 27950 raft_consensus.cc:740] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.813503 28020 raft_consensus.cc:493] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.813946 28020 raft_consensus.cc:3060] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.814049 27950 consensus_queue.cc:260] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.816182 27950 ts_tablet_manager.cc:1434] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:53.817314 27949 ts_tablet_manager.cc:1434] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:12:53.818349 27949 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:53.821107 28197 leader_election.cc:290] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.820788 27950 tablet_bootstrap.cc:492] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:53.823140 27948 consensus_queue.cc:260] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.833695 27950 tablet_bootstrap.cc:654] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.835049 28020 raft_consensus.cc:515] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.838065 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290bd7625b0a4ccab3894dc7aacf43b8" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:53.838678 27825 raft_consensus.cc:3060] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.844719 27950 tablet_bootstrap.cc:492] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:53.845234 27950 ts_tablet_manager.cc:1403] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:12:53.846098 27948 ts_tablet_manager.cc:1434] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:12:53.847147 27948 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:53.847960 27950 raft_consensus.cc:359] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.848764 27950 raft_consensus.cc:385] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.849009 27950 raft_consensus.cc:740] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.849859 27950 consensus_queue.cc:260] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.851361 27950 ts_tablet_manager.cc:1434] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:53.852360 27950 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:53.859287 27950 tablet_bootstrap.cc:654] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.862473 27949 tablet_bootstrap.cc:654] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.863783 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290bd7625b0a4ccab3894dc7aacf43b8" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:53.868155 27902 raft_consensus.cc:3060] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.870277 27950 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:53.870795 27950 ts_tablet_manager.cc:1403] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:12:53.873492 27950 raft_consensus.cc:359] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.874290 27950 raft_consensus.cc:385] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.874645 27950 raft_consensus.cc:740] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.875761 27950 consensus_queue.cc:260] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:53.864552 27825 raft_consensus.cc:2468] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:53.878472 27718 leader_election.cc:304] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:53.878824 27950 ts_tablet_manager.cc:1434] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:53.879449 28144 raft_consensus.cc:2804] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.879983 28144 raft_consensus.cc:697] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:53.880748 27950 tablet_bootstrap.cc:492] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:53.881147 27947 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:53.880816 28144 consensus_queue.cc:237] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.881603 27947 ts_tablet_manager.cc:1403] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.006s
I20260709 13:12:53.864974 28020 leader_election.cc:290] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.867610 27948 tablet_bootstrap.cc:654] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.875624 27902 raft_consensus.cc:2468] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:53.889024 27949 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:53.889528 27949 ts_tablet_manager.cc:1403] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.002s
I20260709 13:12:53.890290 27947 raft_consensus.cc:359] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.891048 27947 raft_consensus.cc:385] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.891305 27947 raft_consensus.cc:740] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.892729 27950 tablet_bootstrap.cc:654] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.894604 27949 raft_consensus.cc:359] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.895363 27949 raft_consensus.cc:385] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.895709 27949 raft_consensus.cc:740] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.896703 27947 consensus_queue.cc:260] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.905391 27576 catalog_manager.cc:5697] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.914324 27947 ts_tablet_manager.cc:1434] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:12:53.918951 27948 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:53.919732 27948 ts_tablet_manager.cc:1403] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 13:12:53.924535 28197 raft_consensus.cc:493] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.924940 27949 consensus_queue.cc:260] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.925088 28197 raft_consensus.cc:515] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.931924 28197 leader_election.cc:290] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:53.933565 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:53.935191 27717 leader_election.cc:343] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.936570 27947 tablet_bootstrap.cc:492] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:53.941375 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.942122 27902 raft_consensus.cc:2468] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:53.943317 27720 leader_election.cc:304] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:53.944818 28197 raft_consensus.cc:2804] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.945281 28197 raft_consensus.cc:493] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.945647 28197 raft_consensus.cc:3060] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.955396 28197 raft_consensus.cc:515] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:53.958463 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:53.959131 27902 raft_consensus.cc:3060] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.962482 27949 ts_tablet_manager.cc:1434] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:12:53.923561 27948 raft_consensus.cc:359] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.966938 27947 tablet_bootstrap.cc:654] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.965130 27949 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:53.971451 27959 consensus_queue.cc:1048] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:53.979753 27948 raft_consensus.cc:385] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.981743 27948 raft_consensus.cc:740] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.982478 27948 consensus_queue.cc:260] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:53.985289 27950 tablet_bootstrap.cc:492] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:53.985323 28020 raft_consensus.cc:493] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.986008 27950 ts_tablet_manager.cc:1403] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.106s	user 0.036s	sys 0.041s
I20260709 13:12:53.986038 28020 raft_consensus.cc:515] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.982601 28144 consensus_queue.cc:1048] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.988641 27949 tablet_bootstrap.cc:654] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.969190 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:53.989109 27950 raft_consensus.cc:359] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.989867 27950 raft_consensus.cc:385] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.990140 27950 raft_consensus.cc:740] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
W20260709 13:12:53.990149 27717 leader_election.cc:343] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.967295 27902 raft_consensus.cc:2468] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:53.990948 27950 consensus_queue.cc:260] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:53.991528 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:53.992276 28020 leader_election.cc:290] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:53.992333 27720 leader_election.cc:304] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:53.993300 28020 raft_consensus.cc:2804] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.994501 28197 leader_election.cc:290] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:53.995805 27948 ts_tablet_manager.cc:1434] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:12:53.996230 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:53.996903 27948 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:53.996905 27901 raft_consensus.cc:2468] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:53.997645 27947 tablet_bootstrap.cc:492] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:53.997936 27949 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:53.998121 27947 ts_tablet_manager.cc:1403] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.009s
I20260709 13:12:53.998474 27949 ts_tablet_manager.cc:1403] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
W20260709 13:12:53.993232 27718 leader_election.cc:343] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.999497 27720 leader_election.cc:304] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:54.000792 28144 raft_consensus.cc:2804] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.001168 28144 raft_consensus.cc:493] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.001545 28144 raft_consensus.cc:3060] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.001605 27949 raft_consensus.cc:359] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.002426 27949 raft_consensus.cc:385] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.002699 27949 raft_consensus.cc:740] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.003397 27949 consensus_queue.cc:260] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.004022 27948 tablet_bootstrap.cc:654] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.006444 27950 ts_tablet_manager.cc:1434] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:12:54.009039 28020 raft_consensus.cc:697] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:54.009181 27949 ts_tablet_manager.cc:1434] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:12:54.011955 27949 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:54.011665 28020 consensus_queue.cc:237] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.010488 28152 raft_consensus.cc:493] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.017068 28152 raft_consensus.cc:515] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.018432 27949 tablet_bootstrap.cc:654] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.021204 27948 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:54.021746 27948 ts_tablet_manager.cc:1403] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:12:54.009621 27950 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:54.022900 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.025556 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:54.025758 27948 raft_consensus.cc:359] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.026407 27948 raft_consensus.cc:385] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.026724 27948 raft_consensus.cc:740] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
W20260709 13:12:54.027079 27718 leader_election.cc:343] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.027384 27948 consensus_queue.cc:260] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:12:54.029716 27717 leader_election.cc:343] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.030267 27717 leader_election.cc:304] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:54.031070 28050 raft_consensus.cc:2749] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.019769 28152 leader_election.cc:290] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:54.037328 27950 tablet_bootstrap.cc:654] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.039286 28144 raft_consensus.cc:515] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.042637 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:54.042794 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:54.043232 27901 raft_consensus.cc:3060] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:54.046568 27718 leader_election.cc:343] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.044987 27947 raft_consensus.cc:359] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.047919 27947 raft_consensus.cc:385] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.048226 27947 raft_consensus.cc:740] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.049052 27947 consensus_queue.cc:260] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.049986 27949 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:54.050611 27901 raft_consensus.cc:2468] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:54.050868 27949 ts_tablet_manager.cc:1403] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.004s
I20260709 13:12:54.052103 27720 leader_election.cc:304] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:54.052579 27947 ts_tablet_manager.cc:1434] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:12:54.053506 28197 raft_consensus.cc:2804] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.054160 28197 raft_consensus.cc:697] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:54.054407 27949 raft_consensus.cc:359] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.055037 28197 consensus_queue.cc:237] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.055246 27949 raft_consensus.cc:385] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.056836 27993 consensus_queue.cc:1048] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.058142 27949 raft_consensus.cc:740] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.059226 27949 consensus_queue.cc:260] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.060065 28181 raft_consensus.cc:493] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.060545 28181 raft_consensus.cc:515] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.029711 27948 ts_tablet_manager.cc:1434] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:54.064602 27948 tablet_bootstrap.cc:492] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:54.068063 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.057548 27947 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:54.069214 27753 raft_consensus.cc:2468] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:54.070832 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:54.071815 27825 raft_consensus.cc:2468] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:54.074131 27643 leader_election.cc:304] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:54.075392 28180 raft_consensus.cc:2804] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.075904 28180 raft_consensus.cc:493] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.076501 28180 raft_consensus.cc:3060] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.084793 28136 consensus_queue.cc:1048] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.085250 28181 leader_election.cc:290] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:54.094033 27950 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:54.094563 27950 ts_tablet_manager.cc:1403] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.023s
I20260709 13:12:54.086650 27576 catalog_manager.cc:5697] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.087373 28180 raft_consensus.cc:515] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.100119 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:54.101190 27825 raft_consensus.cc:3060] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.108738 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:54.109416 27753 raft_consensus.cc:3060] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.113021 27950 raft_consensus.cc:359] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.113798 27950 raft_consensus.cc:385] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.114074 27950 raft_consensus.cc:740] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.099071 28180 leader_election.cc:290] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:54.118572 27950 consensus_queue.cc:260] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.120440 27950 ts_tablet_manager.cc:1434] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:12:54.121562 27950 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:54.100412 28144 leader_election.cc:290] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:54.137342 28164 raft_consensus.cc:493] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.149451 27950 tablet_bootstrap.cc:654] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.189369 27947 tablet_bootstrap.cc:654] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.126883 27753 raft_consensus.cc:2468] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:54.149451 28164 raft_consensus.cc:515] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.194177 27948 tablet_bootstrap.cc:654] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.195147 27577 catalog_manager.cc:5697] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.147428 27949 ts_tablet_manager.cc:1434] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.000s
I20260709 13:12:54.203410 27949 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:54.180828 27825 raft_consensus.cc:2468] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:54.211199 27643 leader_election.cc:304] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:54.211741 28164 leader_election.cc:290] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:54.212132 28180 raft_consensus.cc:2804] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:54.212442 27720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 63921us
I20260709 13:12:54.212728 28180 raft_consensus.cc:697] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:12:54.213987 28164 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.213711 28180 consensus_queue.cc:237] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.214614 28164 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.221246 28181 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.222064 28181 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.226140 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.227119 27753 raft_consensus.cc:2468] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:54.228092 28010 consensus_queue.cc:1048] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.229028 27865 leader_election.cc:304] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:54.231457 28181 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:54.235433 27677 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.236107 27993 raft_consensus.cc:493] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.236758 27993 raft_consensus.cc:515] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.245422 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.243829 28164 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:54.256500 27949 tablet_bootstrap.cc:654] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.258208 28241 raft_consensus.cc:2804] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.258884 28241 raft_consensus.cc:493] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.259348 28241 raft_consensus.cc:3060] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.261300 27993 leader_election.cc:290] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:54.263034 27950 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:54.263646 27950 ts_tablet_manager.cc:1403] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.142s	user 0.006s	sys 0.012s
W20260709 13:12:54.268605 27865 leader_election.cc:343] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.269153 27959 raft_consensus.cc:493] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.269655 27959 raft_consensus.cc:515] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.271152 27948 tablet_bootstrap.cc:492] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:54.271425 27959 leader_election.cc:290] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:54.271663 27948 ts_tablet_manager.cc:1403] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.005s
I20260709 13:12:54.270946 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:54.272989 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a146802808647fbbdee0f0788daf5f7" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.274641 27899 raft_consensus.cc:2468] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:54.275988 27794 leader_election.cc:304] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:54.277014 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a146802808647fbbdee0f0788daf5f7" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.277186 28010 consensus_queue.cc:1048] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.277750 27676 raft_consensus.cc:2468] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:54.278107 28181 raft_consensus.cc:493] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.278680 28181 raft_consensus.cc:515] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:54.279268 27718 leader_election.cc:343] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.278589 28010 raft_consensus.cc:2804] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.280212 28010 raft_consensus.cc:493] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.280577 28010 raft_consensus.cc:3060] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.281136 28181 leader_election.cc:290] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:54.284735 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.284960 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.291544 28010 raft_consensus.cc:515] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.295125 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a146802808647fbbdee0f0788daf5f7" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:54.295773 27899 raft_consensus.cc:3060] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.291672 27950 raft_consensus.cc:359] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.297569 27950 raft_consensus.cc:385] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.297968 27950 raft_consensus.cc:740] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.295135 27948 raft_consensus.cc:359] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.301692 27948 raft_consensus.cc:385] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.302121 27948 raft_consensus.cc:740] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.303028 27948 consensus_queue.cc:260] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.315689 27948 ts_tablet_manager.cc:1434] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:12:54.317808 27950 consensus_queue.cc:260] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:54.313735 27866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 151974us
I20260709 13:12:54.329937 27948 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:54.322635 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:54.336093 28010 leader_election.cc:290] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:54.339182 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.339053 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f0ecc1a707d48a3b7862009ff9feded" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.338182 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.343703 27897 raft_consensus.cc:2393] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:54.352190 27949 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:54.352567 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:54.352813 27949 ts_tablet_manager.cc:1403] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.150s	user 0.019s	sys 0.010s
I20260709 13:12:54.356446 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a146802808647fbbdee0f0788daf5f7" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:54.357306 27675 raft_consensus.cc:3060] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.372181 28197 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.373557 28197 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.375603 27949 raft_consensus.cc:359] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.376513 27949 raft_consensus.cc:385] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.376787 27949 raft_consensus.cc:740] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.375777 28164 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.377457 27949 consensus_queue.cc:260] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.377553 28164 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.372685 27950 ts_tablet_manager.cc:1434] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 13:12:54.381131 27949 ts_tablet_manager.cc:1434] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:12:54.379244 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.388446 27993 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.389137 27993 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.390930 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.391607 27993 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:54.375674 28197 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:54.384119 28164 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:12:54.384316 27717 leader_election.cc:343] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.401947 27949 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:54.410792 27950 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
W20260709 13:12:54.382236 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 85929.6us
W20260709 13:12:54.399477 27865 leader_election.cc:343] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.425377 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:54.409404 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.433377 27959 raft_consensus.cc:493] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.433890 27959 raft_consensus.cc:515] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.407649 27645 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
W20260709 13:12:54.448645 27866 leader_election.cc:343] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.449137 27866 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:54.449538 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:54.450258 27866 leader_election.cc:343] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.450254 27897 raft_consensus.cc:2468] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:54.450783 28235 raft_consensus.cc:2749] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:54.452430 27718 leader_election.cc:343] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.432900 27753 raft_consensus.cc:2468] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:54.454710 28241 raft_consensus.cc:515] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.457276 27902 raft_consensus.cc:2393] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 1: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:12:54.458459 28241 leader_election.cc:290] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:54.432525 27899 raft_consensus.cc:2468] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:54.473872 27949 tablet_bootstrap.cc:654] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.473982 27865 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
W20260709 13:12:54.464250 27645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 66741.6us
I20260709 13:12:54.480242 27675 raft_consensus.cc:2468] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:54.481038 27574 catalog_manager.cc:5697] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 1 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.482062 27645 leader_election.cc:304] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:54.489455 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59461d3068941fb9f7e72054188b650" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.489934 27720 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:54.490906 28144 raft_consensus.cc:2804] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.491092 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.491319 28144 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.491511 27947 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:54.491704 28144 raft_consensus.cc:3060] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.492043 27947 ts_tablet_manager.cc:1403] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.435s	user 0.044s	sys 0.007s
I20260709 13:12:54.493113 28245 raft_consensus.cc:3060] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.494954 27947 raft_consensus.cc:359] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.495638 27947 raft_consensus.cc:385] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.495899 27947 raft_consensus.cc:740] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.490131 27902 raft_consensus.cc:2468] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:54.467948 27950 tablet_bootstrap.cc:654] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.496759 27948 tablet_bootstrap.cc:654] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.498116 27947 consensus_queue.cc:260] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.500025 27947 ts_tablet_manager.cc:1434] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:54.505877 27959 leader_election.cc:290] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:54.510970 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59461d3068941fb9f7e72054188b650" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.511739 27675 raft_consensus.cc:2468] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:54.480333 27794 leader_election.cc:304] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:54.512823 27959 raft_consensus.cc:2804] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.513266 27959 raft_consensus.cc:697] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:54.514014 27959 consensus_queue.cc:237] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.515806 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:54.498517 28164 raft_consensus.cc:2804] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.523207 28164 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.523602 28164 raft_consensus.cc:3060] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.529836 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:54.530586 27751 raft_consensus.cc:3060] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:54.505498 27717 leader_election.cc:343] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.557102 27947 tablet_bootstrap.cc:492] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:54.561849 28144 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.563997 28144 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:12:54.565160 27791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 80689.2us
W20260709 13:12:54.568446 27866 leader_election.cc:343] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.567086 27791 leader_election.cc:304] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:54.572149 28244 raft_consensus.cc:2749] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.556069 27717 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
W20260709 13:12:54.573338 27717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 69347.3us
I20260709 13:12:54.573732 28136 raft_consensus.cc:2804] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.574198 28136 raft_consensus.cc:493] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.574574 28136 raft_consensus.cc:3060] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.573361 28144 raft_consensus.cc:2749] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.580346 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:54.581869 27717 leader_election.cc:343] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.582293 28245 raft_consensus.cc:2749] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.585912 28164 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.588290 28164 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:54.588967 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:54.590265 27865 leader_election.cc:343] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.591566 27751 raft_consensus.cc:2468] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:54.600769 28152 consensus_queue.cc:1048] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.604527 27576 catalog_manager.cc:5697] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.624238 27959 raft_consensus.cc:493] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.624990 27959 raft_consensus.cc:515] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.638707 27959 leader_election.cc:290] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:54.642740 27947 tablet_bootstrap.cc:654] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.642516 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.643841 27902 raft_consensus.cc:2393] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:54.646418 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.647233 27949 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:54.647935 27949 ts_tablet_manager.cc:1403] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.250s	user 0.012s	sys 0.015s
I20260709 13:12:54.653179 27791 leader_election.cc:304] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:54.655283 27950 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:54.655733 27950 ts_tablet_manager.cc:1403] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.261s	user 0.015s	sys 0.015s
I20260709 13:12:54.655853 27959 raft_consensus.cc:3060] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.665062 28136 raft_consensus.cc:515] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.669181 28136 leader_election.cc:290] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:54.671420 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59461d3068941fb9f7e72054188b650" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:54.672060 27902 raft_consensus.cc:3060] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.672577 27949 raft_consensus.cc:359] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.673334 27949 raft_consensus.cc:385] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.673655 27949 raft_consensus.cc:740] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.673365 27950 raft_consensus.cc:359] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.674299 27950 raft_consensus.cc:385] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.674624 27950 raft_consensus.cc:740] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.675365 27950 consensus_queue.cc:260] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.676633 27949 consensus_queue.cc:260] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.681085 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59461d3068941fb9f7e72054188b650" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:54.681777 27677 raft_consensus.cc:3060] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.688555 27950 ts_tablet_manager.cc:1434] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:12:54.689810 27950 tablet_bootstrap.cc:492] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
W20260709 13:12:54.654240 27720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 124618us
I20260709 13:12:54.692718 27720 leader_election.cc:304] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:54.693563 28152 raft_consensus.cc:2749] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.693907 27677 raft_consensus.cc:2468] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:54.695709 27902 raft_consensus.cc:2468] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:54.696600 28152 consensus_queue.cc:1048] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:54.700939 27865 leader_election.cc:304] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:54.700219 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:54.701973 28164 raft_consensus.cc:2804] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.702592 27897 raft_consensus.cc:2393] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 1: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:12:54.702564 28164 raft_consensus.cc:697] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:54.703864 27794 leader_election.cc:304] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:54.704017 28164 consensus_queue.cc:237] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.707233 28010 raft_consensus.cc:2804] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.708020 27948 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:54.708668 27948 ts_tablet_manager.cc:1403] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.385s	user 0.027s	sys 0.015s
I20260709 13:12:54.701735 27949 ts_tablet_manager.cc:1434] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.050s	user 0.000s	sys 0.006s
I20260709 13:12:54.711674 27949 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:54.707947 28010 raft_consensus.cc:697] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:54.713505 28010 consensus_queue.cc:237] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.696112 27950 tablet_bootstrap.cc:654] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.716378 27959 raft_consensus.cc:2749] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.720376 27948 raft_consensus.cc:359] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.723856 27948 raft_consensus.cc:385] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.724608 27948 raft_consensus.cc:740] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.726297 27948 consensus_queue.cc:260] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.727777 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:54.728693 28244 consensus_queue.cc:1048] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.730538 27752 raft_consensus.cc:2393] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68036e839a414adf854b602c1ee70066 in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:54.739045 28252 consensus_queue.cc:1048] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.745674 27865 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:54.747000 28241 raft_consensus.cc:2749] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.758607 27948 ts_tablet_manager.cc:1434] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
W20260709 13:12:54.768419 27720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 45019.5us
I20260709 13:12:54.769596 27948 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:54.769737 27720 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:12:54.771751 27574 catalog_manager.cc:5697] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.773572 27993 consensus_queue.cc:1048] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.779475 28244 consensus_queue.cc:1048] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.783466 28244 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.785235 28244 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.774191 28152 consensus_queue.cc:1048] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.788969 28244 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:54.790482 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:54.791193 27899 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:54.791689 27948 tablet_bootstrap.cc:654] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.793673 27645 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:54.772467 28020 raft_consensus.cc:2749] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.772333 28253 consensus_queue.cc:1048] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:54.795137 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:54.801558 27643 leader_election.cc:343] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.812513 28181 raft_consensus.cc:2804] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.813104 28181 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.813580 28181 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.826242 28181 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.835178 27949 tablet_bootstrap.cc:654] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.839124 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:54.839094 27950 tablet_bootstrap.cc:492] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:54.849304 27950 ts_tablet_manager.cc:1403] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.160s	user 0.009s	sys 0.007s
I20260709 13:12:54.867354 27959 raft_consensus.cc:493] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.867987 27959 raft_consensus.cc:515] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.870246 27959 leader_election.cc:290] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:12:54.859817 27643 leader_election.cc:343] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.875661 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.876432 27751 raft_consensus.cc:2468] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:54.877686 27791 leader_election.cc:304] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:54.877774 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:54.878566 27959 raft_consensus.cc:2804] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.878944 27959 raft_consensus.cc:493] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.879251 27959 raft_consensus.cc:3060] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:54.880810 27791 leader_election.cc:343] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.883437 27576 catalog_manager.cc:5697] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.888350 27950 raft_consensus.cc:359] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.889133 27950 raft_consensus.cc:385] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.889498 27950 raft_consensus.cc:740] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.890687 27950 consensus_queue.cc:260] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.882843 28241 raft_consensus.cc:493] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.892035 28241 raft_consensus.cc:515] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.893445 27950 ts_tablet_manager.cc:1434] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 13:12:54.894111 28241 leader_election.cc:290] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:54.894649 27950 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:54.890008 27959 raft_consensus.cc:515] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.900110 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:54.888980 28181 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:54.901379 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:54.900821 27899 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.903048 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8c7f462a245618d096e6e8d01bd6a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:54.905382 27865 leader_election.cc:343] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:54.906715 27791 leader_election.cc:343] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.907344 27947 tablet_bootstrap.cc:492] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
W20260709 13:12:54.887941 27718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 115068us
I20260709 13:12:54.909924 27947 ts_tablet_manager.cc:1403] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.366s	user 0.024s	sys 0.003s
I20260709 13:12:54.922739 27947 raft_consensus.cc:359] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.923543 27947 raft_consensus.cc:385] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.923888 27947 raft_consensus.cc:740] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.924682 27947 consensus_queue.cc:260] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:54.928210 27947 ts_tablet_manager.cc:1434] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:12:54.929214 27947 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:54.933348 27899 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:54.936451 27645 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:54.938030 27959 leader_election.cc:290] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:54.939144 28181 raft_consensus.cc:2804] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.939667 28181 raft_consensus.cc:697] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:12:54.940479 28181 consensus_queue.cc:237] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:54.953281 27575 catalog_manager.cc:5697] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 1 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.957195 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:54.957881 27751 raft_consensus.cc:3060] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.966166 27947 tablet_bootstrap.cc:654] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.976352 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8c7f462a245618d096e6e8d01bd6a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:54.977221 27752 raft_consensus.cc:2468] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:54.979202 27865 leader_election.cc:304] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:54.980446 28241 raft_consensus.cc:2804] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.980854 28241 raft_consensus.cc:493] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.981215 28241 raft_consensus.cc:3060] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.982554 27950 tablet_bootstrap.cc:654] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.987174 27949 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:54.987774 27949 ts_tablet_manager.cc:1403] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.276s	user 0.015s	sys 0.002s
I20260709 13:12:54.989327 28241 raft_consensus.cc:515] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:54.990911 27949 raft_consensus.cc:359] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:54.991845 27949 raft_consensus.cc:385] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.993731 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8c7f462a245618d096e6e8d01bd6a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:54.995114 27948 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:54.995157 28241 leader_election.cc:290] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:54.998878 27950 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
W20260709 13:12:54.998981 27865 leader_election.cc:343] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.999271 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8c7f462a245618d096e6e8d01bd6a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:54.999570 27950 ts_tablet_manager.cc:1403] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.005s
I20260709 13:12:54.999506 28241 raft_consensus.cc:493] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.000432 28241 raft_consensus.cc:515] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.002708 27751 raft_consensus.cc:2468] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:54.999862 27752 raft_consensus.cc:3060] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.002951 27950 raft_consensus.cc:359] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.003795 27950 raft_consensus.cc:385] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.004127 27950 raft_consensus.cc:740] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.004014 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1487f7f5bd2f44a3a7b1ff7dd221f441" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.005312 27950 consensus_queue.cc:260] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:55.006364 27866 leader_election.cc:343] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.007310 27791 leader_election.cc:304] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:55.007706 27950 ts_tablet_manager.cc:1434] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:55.008522 28136 raft_consensus.cc:2804] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.009183 28136 raft_consensus.cc:697] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:55.010352 28136 consensus_queue.cc:237] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.011498 27752 raft_consensus.cc:2468] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:55.012274 28241 leader_election.cc:290] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:55.012840 27950 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:55.013123 27948 ts_tablet_manager.cc:1403] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.244s	user 0.013s	sys 0.000s
I20260709 13:12:55.016139 27948 raft_consensus.cc:359] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.024863 27865 leader_election.cc:304] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
W20260709 13:12:55.018600 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:55.018824 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1487f7f5bd2f44a3a7b1ff7dd221f441" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.026070 28241 raft_consensus.cc:2804] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.022495 28263 raft_consensus.cc:493] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.026881 27950 tablet_bootstrap.cc:654] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.026670 28241 raft_consensus.cc:697] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:55.028471 27947 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:55.029102 27947 ts_tablet_manager.cc:1403] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.001s
I20260709 13:12:55.029229 28241 consensus_queue.cc:237] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.018687 27949 raft_consensus.cc:740] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.025054 27948 raft_consensus.cc:385] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.033869 27948 raft_consensus.cc:740] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.033367 27949 consensus_queue.cc:260] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.034621 27948 consensus_queue.cc:260] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.036434 27949 ts_tablet_manager.cc:1434] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:12:55.036682 27948 ts_tablet_manager.cc:1434] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:12:55.037765 27948 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:55.037964 27949 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:55.042804 28263 raft_consensus.cc:515] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.046808 27751 raft_consensus.cc:2468] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:55.048004 28010 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.047646 27947 raft_consensus.cc:359] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.049161 27947 raft_consensus.cc:385] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.048810 28010 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.049664 27947 raft_consensus.cc:740] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.052804 27947 consensus_queue.cc:260] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.053839 27948 tablet_bootstrap.cc:654] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.058231 27865 leader_election.cc:304] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:55.059163 27575 catalog_manager.cc:5697] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.061936 28241 raft_consensus.cc:2804] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.062410 28241 raft_consensus.cc:493] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.062793 28241 raft_consensus.cc:3060] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.063047 27950 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:55.063587 27950 ts_tablet_manager.cc:1403] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.009s
I20260709 13:12:55.065310 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1487f7f5bd2f44a3a7b1ff7dd221f441" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:55.066045 28010 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:55.067413 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:55.067873 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1487f7f5bd2f44a3a7b1ff7dd221f441" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.069198 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:55.069492 27718 leader_election.cc:343] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.069763 27947 ts_tablet_manager.cc:1434] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:12:55.070093 27899 raft_consensus.cc:2393] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate 1da14a10b312403c91c2ff8aa9d0338a in this term.
I20260709 13:12:55.071048 27947 tablet_bootstrap.cc:492] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:55.072028 27794 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:12:55.067945 28263 leader_election.cc:290] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:55.073536 27959 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.076287 27949 tablet_bootstrap.cc:654] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.083758 27959 raft_consensus.cc:2749] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.090687 27959 consensus_queue.cc:1048] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.087608 28241 raft_consensus.cc:515] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.092836 27900 raft_consensus.cc:2393] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 1: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:12:55.093672 27950 raft_consensus.cc:359] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.094444 27950 raft_consensus.cc:385] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.094734 27950 raft_consensus.cc:740] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.095664 27950 consensus_queue.cc:260] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.101182 27576 catalog_manager.cc:5697] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.102089 28181 raft_consensus.cc:493] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.103704 27720 leader_election.cc:304] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:55.104266 28181 raft_consensus.cc:515] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.102456 27948 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:55.103111 28146 consensus_queue.cc:1048] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.106573 28181 leader_election.cc:290] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:55.106830 27948 ts_tablet_manager.cc:1403] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.006s
I20260709 13:12:55.109760 27948 raft_consensus.cc:359] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.110450 27948 raft_consensus.cc:385] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.110718 27948 raft_consensus.cc:740] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.114598 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1487f7f5bd2f44a3a7b1ff7dd221f441" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:55.115278 27751 raft_consensus.cc:3060] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.111346 27948 consensus_queue.cc:260] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.117741 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.118667 27752 raft_consensus.cc:2393] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:55.122850 28146 consensus_queue.cc:1048] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.123308 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bdab5ff078a49dcbcb94c0229037b27" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.123811 28050 raft_consensus.cc:493] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.124194 27751 raft_consensus.cc:2468] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:55.122066 27948 ts_tablet_manager.cc:1434] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:12:55.124508 28050 raft_consensus.cc:515] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.125845 27948 tablet_bootstrap.cc:492] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:55.126065 27865 leader_election.cc:304] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:55.126935 28164 raft_consensus.cc:2804] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.127485 28164 raft_consensus.cc:697] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:55.124846 28197 raft_consensus.cc:2749] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.128460 28164 consensus_queue.cc:237] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.127648 28050 leader_election.cc:290] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:55.131625 27643 leader_election.cc:304] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:55.133006 28181 raft_consensus.cc:3060] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.134932 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:55.138100 27717 leader_election.cc:343] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.143937 28181 raft_consensus.cc:2749] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.147861 27949 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:55.148480 27949 ts_tablet_manager.cc:1403] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.000s
I20260709 13:12:55.152506 27948 tablet_bootstrap.cc:654] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.152936 28241 leader_election.cc:290] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:55.144999 27947 tablet_bootstrap.cc:654] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.163341 27948 tablet_bootstrap.cc:492] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:55.163952 27948 ts_tablet_manager.cc:1403] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.001s
I20260709 13:12:55.164774 27959 consensus_queue.cc:1048] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.166761 27948 raft_consensus.cc:359] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.167541 27948 raft_consensus.cc:385] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.167857 27948 raft_consensus.cc:740] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.168237 27949 raft_consensus.cc:359] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.169036 27949 raft_consensus.cc:385] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.169394 27949 raft_consensus.cc:740] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.168778 27948 consensus_queue.cc:260] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.170208 27949 consensus_queue.cc:260] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.171906 27948 ts_tablet_manager.cc:1434] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:12:55.173115 27948 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:55.175146 27947 tablet_bootstrap.cc:492] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:55.175721 27947 ts_tablet_manager.cc:1403] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.000s
I20260709 13:12:55.177524 27949 ts_tablet_manager.cc:1434] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:12:55.178622 27949 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:55.179037 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.183328 27948 tablet_bootstrap.cc:654] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.183176 27947 raft_consensus.cc:359] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.183982 27947 raft_consensus.cc:385] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.184338 27947 raft_consensus.cc:740] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.185073 27947 consensus_queue.cc:260] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.187989 27947 ts_tablet_manager.cc:1434] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:55.189143 27947 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
W20260709 13:12:55.193004 27718 leader_election.cc:343] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.193542 27718 leader_election.cc:304] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:55.194716 28263 raft_consensus.cc:2749] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.195585 27947 tablet_bootstrap.cc:654] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.200861 27950 ts_tablet_manager.cc:1434] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.000s
I20260709 13:12:55.202457 27950 tablet_bootstrap.cc:492] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:55.208948 27950 tablet_bootstrap.cc:654] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.222172 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1487f7f5bd2f44a3a7b1ff7dd221f441" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:55.246806 28241 consensus_queue.cc:1048] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.283346 28010 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.284183 28010 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.294734 28010 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:55.296361 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.296818 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:55.302912 27752 raft_consensus.cc:2468] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
W20260709 13:12:55.304033 27791 leader_election.cc:343] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.305120 27791 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:55.312376 28010 raft_consensus.cc:2804] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.321707 28010 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.324126 28010 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.333740 28146 raft_consensus.cc:493] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.334779 28146 raft_consensus.cc:515] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.339707 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.340068 28146 leader_election.cc:290] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
W20260709 13:12:55.362534 27794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 91648.6us
W20260709 13:12:55.366034 27866 leader_election.cc:343] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.379057 27949 tablet_bootstrap.cc:654] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.388737 28197 raft_consensus.cc:493] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.389521 28197 raft_consensus.cc:515] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.394840 28197 leader_election.cc:290] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:55.396411 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e70233e82420d90243b593b58b06b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:55.398521 27717 leader_election.cc:343] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.401539 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e70233e82420d90243b593b58b06b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:55.403659 27720 leader_election.cc:343] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.404352 27720 leader_election.cc:304] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:12:55.405926 28197 raft_consensus.cc:2749] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.421659 27825 raft_consensus.cc:3060] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.425686 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b550130fa7644a86adb90f6194db6006" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:55.436690 28005 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.437453 28005 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.444200 28005 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:55.449059 27794 leader_election.cc:304] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:55.457804 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.464332 28005 raft_consensus.cc:493] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.464895 28005 raft_consensus.cc:515] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.466583 27948 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:55.467031 28005 leader_election.cc:290] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:55.467092 27948 ts_tablet_manager.cc:1403] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.294s	user 0.039s	sys 0.069s
I20260709 13:12:55.467439 28010 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.468379 27576 catalog_manager.cc:5697] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.470345 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:55.470144 27948 raft_consensus.cc:359] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.470883 27948 raft_consensus.cc:385] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.471155 27948 raft_consensus.cc:740] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.471932 27948 consensus_queue.cc:260] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.473490 27948 ts_tablet_manager.cc:1434] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:55.474457 27948 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:55.481338 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.482189 27948 tablet_bootstrap.cc:654] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:55.482666 27865 leader_election.cc:343] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:55.484764 27865 leader_election.cc:343] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:55.485507 27865 consensus_peers.cc:597] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.487710 27866 leader_election.cc:343] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.488276 27866 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:55.490473 27959 raft_consensus.cc:2749] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.492744 27949 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:55.493309 27949 ts_tablet_manager.cc:1403] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.000s
I20260709 13:12:55.495102 28005 consensus_queue.cc:1048] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:55.505796 27948 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:55.506080 27950 tablet_bootstrap.cc:492] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:55.506536 27950 ts_tablet_manager.cc:1403] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.304s	user 0.062s	sys 0.091s
I20260709 13:12:55.508090 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.509785 27950 raft_consensus.cc:359] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
W20260709 13:12:55.512199 27866 leader_election.cc:343] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.512678 27947 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:55.512804 28010 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:55.513280 27947 ts_tablet_manager.cc:1403] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.324s	user 0.061s	sys 0.139s
I20260709 13:12:55.503996 27949 raft_consensus.cc:359] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.510568 27950 raft_consensus.cc:385] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.514489 27950 raft_consensus.cc:740] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.514003 28005 consensus_queue.cc:1048] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.515400 27950 consensus_queue.cc:260] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.516225 27947 raft_consensus.cc:359] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.497239 28241 raft_consensus.cc:2749] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.516927 27947 raft_consensus.cc:385] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.517247 27947 raft_consensus.cc:740] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.518065 27950 ts_tablet_manager.cc:1434] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:55.517843 27947 consensus_queue.cc:260] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.519160 27950 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:55.506536 27948 ts_tablet_manager.cc:1403] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.010s
I20260709 13:12:55.512709 27866 leader_election.cc:304] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:55.523530 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:55.523711 27948 raft_consensus.cc:359] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.524137 27752 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.524443 27948 raft_consensus.cc:385] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.524767 27948 raft_consensus.cc:740] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.525337 28241 raft_consensus.cc:2749] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.525480 27948 consensus_queue.cc:260] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.529944 27947 ts_tablet_manager.cc:1434] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:55.530766 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:55.513991 27949 raft_consensus.cc:385] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.531817 27947 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:55.532074 27949 raft_consensus.cc:740] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.532843 27949 consensus_queue.cc:260] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:55.534669 27791 leader_election.cc:343] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.539474 28181 consensus_queue.cc:1048] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:55.546726 28245 raft_consensus.cc:493] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:55.551395 27866 consensus_peers.cc:597] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.551255 28245 raft_consensus.cc:515] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.552156 28181 consensus_queue.cc:1048] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.553807 28245 leader_election.cc:290] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:55.554656 27948 ts_tablet_manager.cc:1434] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:12:55.543373 28291 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.555503 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8c7f462a245618d096e6e8d01bd6a" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.556286 27948 tablet_bootstrap.cc:492] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:55.556187 28291 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.544354 27949 ts_tablet_manager.cc:1434] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:12:55.558228 27949 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:55.558830 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8c7f462a245618d096e6e8d01bd6a" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:55.560084 27950 tablet_bootstrap.cc:654] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.564695 27645 leader_election.cc:304] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:55.568382 28245 raft_consensus.cc:2749] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.569372 27947 tablet_bootstrap.cc:654] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.548658 27752 raft_consensus.cc:2468] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:55.575188 27791 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:55.574266 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:55.585805 27899 raft_consensus.cc:2468] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:55.587749 27794 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:55.577761 28241 raft_consensus.cc:493] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.588951 28241 raft_consensus.cc:515] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.590468 27959 raft_consensus.cc:2804] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.590863 27959 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.591158 27959 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.591650 28241 leader_election.cc:290] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:55.574062 28291 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:55.605659 27959 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.607642 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e70233e82420d90243b593b58b06b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.608349 27752 raft_consensus.cc:2468] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:55.575923 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:55.610110 27791 leader_election.cc:343] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.594439 28010 raft_consensus.cc:2804] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.611631 27865 leader_election.cc:304] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:55.613360 27949 tablet_bootstrap.cc:654] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.614496 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e70233e82420d90243b593b58b06b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:55.620313 28164 raft_consensus.cc:2804] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.620795 28164 raft_consensus.cc:493] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.621114 28164 raft_consensus.cc:3060] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.624845 28010 raft_consensus.cc:697] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:55.625801 28010 consensus_queue.cc:237] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:55.630093 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:55.630517 27959 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:55.630712 27900 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:55.638437 27865 leader_election.cc:343] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.663376 28181 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.665602 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:55.655937 28291 consensus_queue.cc:1048] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:12:55.707679 28241 consensus_queue.cc:1048] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.711395 27900 raft_consensus.cc:2468] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:55.712811 27794 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:55.713610 28010 raft_consensus.cc:2804] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.714291 28010 raft_consensus.cc:697] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:55.715149 28010 consensus_queue.cc:237] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.666193 28181 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.723052 27948 tablet_bootstrap.cc:654] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.726985 28181 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:55.716073 28164 raft_consensus.cc:515] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:55.729907 27791 leader_election.cc:343] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.735872 27947 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:55.736732 27947 ts_tablet_manager.cc:1403] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.205s	user 0.035s	sys 0.032s
I20260709 13:12:55.781914 28020 raft_consensus.cc:493] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.788437 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:55.788550 28020 raft_consensus.cc:515] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:55.789458 27754 raft_consensus.cc:2393] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:12:55.781364 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:55.800707 27643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 86275.4us
I20260709 13:12:55.819420 27900 raft_consensus.cc:2393] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:12:55.824611 28164 leader_election.cc:290] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:55.826069 27947 raft_consensus.cc:359] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.827018 27947 raft_consensus.cc:385] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.827284 27947 raft_consensus.cc:740] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.830925 27950 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:55.831565 27950 ts_tablet_manager.cc:1403] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.313s	user 0.025s	sys 0.017s
I20260709 13:12:55.832953 28020 leader_election.cc:290] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:55.840864 27645 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:55.828025 27947 consensus_queue.cc:260] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:55.868754 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a699d843fce043cea91638fe4622003f" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:55.873472 27720 leader_election.cc:343] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.860592 28301 raft_consensus.cc:3060] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.885730 28146 consensus_queue.cc:1048] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.895334 27950 raft_consensus.cc:359] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.909641 27947 ts_tablet_manager.cc:1434] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.172s	user 0.008s	sys 0.000s
W20260709 13:12:55.910041 27717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 68039us
I20260709 13:12:55.911530 27950 raft_consensus.cc:385] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.912003 27950 raft_consensus.cc:740] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.913115 27950 consensus_queue.cc:260] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:55.917318 27575 catalog_manager.cc:5697] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.922465 27950 ts_tablet_manager.cc:1434] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 13:12:55.945972 27947 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:55.942303 27575 catalog_manager.cc:5697] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.952477 27950 tablet_bootstrap.cc:492] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:55.946838 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e70233e82420d90243b593b58b06b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:55.960088 27751 raft_consensus.cc:3060] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.964461 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a699d843fce043cea91638fe4622003f" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:55.957553 28010 raft_consensus.cc:493] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.001061 27948 tablet_bootstrap.cc:492] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:56.001665 27948 ts_tablet_manager.cc:1403] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.446s	user 0.021s	sys 0.015s
W20260709 13:12:56.002022 27718 leader_election.cc:343] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.003324 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8e70233e82420d90243b593b58b06b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:56.003508 27718 leader_election.cc:304] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:55.987214 28010 raft_consensus.cc:515] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.009449 28263 raft_consensus.cc:2749] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.010263 28010 leader_election.cc:290] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:12:56.016535 27717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 55190.4us
W20260709 13:12:56.020458 27720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 59027.1us
I20260709 13:12:56.026839 27949 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:56.027374 27949 ts_tablet_manager.cc:1403] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.469s	user 0.018s	sys 0.019s
I20260709 13:12:56.033620 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.034327 27750 raft_consensus.cc:2468] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:56.041040 27791 leader_election.cc:304] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:56.041942 28291 raft_consensus.cc:2804] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.042325 28291 raft_consensus.cc:493] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.042654 28291 raft_consensus.cc:3060] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.043987 27751 raft_consensus.cc:2468] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
W20260709 13:12:56.047737 27865 leader_election.cc:343] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.057147 27950 tablet_bootstrap.cc:654] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.059849 27949 raft_consensus.cc:359] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.060719 27949 raft_consensus.cc:385] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.061071 27949 raft_consensus.cc:740] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.061700 27949 consensus_queue.cc:260] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.026575 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.056025 28291 raft_consensus.cc:515] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.066715 27949 ts_tablet_manager.cc:1434] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:12:56.067070 28291 leader_election.cc:290] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.067770 27949 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:56.072947 28050 raft_consensus.cc:493] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.073496 28050 raft_consensus.cc:515] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.075558 28050 leader_election.cc:290] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:56.077061 27865 leader_election.cc:304] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:56.077481 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba13104713a49c6afab7d69cec33275" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:56.078128 28241 raft_consensus.cc:2804] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.078800 28241 raft_consensus.cc:697] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
W20260709 13:12:56.079214 27720 leader_election.cc:343] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:56.080360 27791 leader_election.cc:343] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.079664 28241 consensus_queue.cc:237] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.084976 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:56.083222 27948 raft_consensus.cc:359] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.086488 27948 raft_consensus.cc:385] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.086872 27948 raft_consensus.cc:740] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.090535 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba13104713a49c6afab7d69cec33275" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.092049 27678 raft_consensus.cc:3060] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.093606 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:56.088918 27751 raft_consensus.cc:3060] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.096194 28291 consensus_queue.cc:1048] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.030149 28301 raft_consensus.cc:2749] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:56.103318 27791 leader_election.cc:343] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.100941 27948 consensus_queue.cc:260] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
W20260709 13:12:56.104295 27717 leader_election.cc:343] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.104723 27717 leader_election.cc:304] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:12:56.109968 28144 raft_consensus.cc:2749] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.119699 27948 ts_tablet_manager.cc:1434] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:12:56.122623 27947 tablet_bootstrap.cc:654] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.126571 27828 raft_consensus.cc:3060] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.143049 27751 raft_consensus.cc:2468] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:56.145444 27791 leader_election.cc:304] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:56.151276 27950 tablet_bootstrap.cc:492] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:56.151818 27950 ts_tablet_manager.cc:1403] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.200s	user 0.017s	sys 0.013s
I20260709 13:12:56.153496 27948 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:56.154590 27950 raft_consensus.cc:359] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.155313 27950 raft_consensus.cc:385] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.155601 27950 raft_consensus.cc:740] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.158352 27950 consensus_queue.cc:260] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.157784 28306 raft_consensus.cc:2804] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.166663 28306 raft_consensus.cc:697] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:56.166770 27950 ts_tablet_manager.cc:1434] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:12:56.167943 27950 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:56.170662 28301 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.171162 28301 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.167511 28306 consensus_queue.cc:237] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:12:56.177065 27791 consensus_peers.cc:597] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.177073 28301 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:56.177060 27950 tablet_bootstrap.cc:654] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.180770 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:56.181563 27900 raft_consensus.cc:2393] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:56.182101 27949 tablet_bootstrap.cc:654] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.183441 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.190423 28010 consensus_queue.cc:1048] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:56.209342 27643 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:56.216154 28181 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.229250 27947 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:56.230142 27947 ts_tablet_manager.cc:1403] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.288s	user 0.013s	sys 0.013s
I20260709 13:12:56.249626 27948 tablet_bootstrap.cc:654] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.237099 27947 raft_consensus.cc:359] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.253450 27947 raft_consensus.cc:385] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.253847 27947 raft_consensus.cc:740] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
W20260709 13:12:56.262620 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:56.263375 28320 raft_consensus.cc:493] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.263967 28320 raft_consensus.cc:515] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.267573 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995243704b794d67a15048bce788b7fe" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.273264 27947 consensus_queue.cc:260] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.277038 27947 ts_tablet_manager.cc:1434] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:12:56.278585 27947 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
W20260709 13:12:56.284675 27866 leader_election.cc:343] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.267783 28181 raft_consensus.cc:2749] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.298738 28320 leader_election.cc:290] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:56.300526 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995243704b794d67a15048bce788b7fe" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.301899 27947 tablet_bootstrap.cc:654] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.304097 27865 leader_election.cc:343] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.304692 27865 leader_election.cc:304] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:56.306232 28164 raft_consensus.cc:2749] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.275257 27573 catalog_manager.cc:5697] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.309919 27959 consensus_queue.cc:1048] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.326586 27949 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:56.327280 27949 ts_tablet_manager.cc:1403] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.260s	user 0.017s	sys 0.011s
I20260709 13:12:56.332149 27949 raft_consensus.cc:359] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.332849 27949 raft_consensus.cc:385] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.334685 27950 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:56.335188 27950 ts_tablet_manager.cc:1403] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.033s
I20260709 13:12:56.333119 27949 raft_consensus.cc:740] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.337847 27949 consensus_queue.cc:260] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.343819 27576 catalog_manager.cc:5697] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.344594 28197 raft_consensus.cc:493] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.345103 28197 raft_consensus.cc:515] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.347222 28197 leader_election.cc:290] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:56.348781 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.348985 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:56.349654 27900 raft_consensus.cc:2468] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:56.349397 27950 raft_consensus.cc:359] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.350266 27950 raft_consensus.cc:385] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:56.350351 27718 leader_election.cc:343] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.350558 27950 raft_consensus.cc:740] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.350878 27720 leader_election.cc:304] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:56.351400 27950 consensus_queue.cc:260] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.352535 28144 raft_consensus.cc:2804] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.353063 28144 raft_consensus.cc:493] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.353513 28144 raft_consensus.cc:3060] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.354091 27950 ts_tablet_manager.cc:1434] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:56.355346 27950 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:56.360466 27949 ts_tablet_manager.cc:1434] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:12:56.361769 27949 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:56.374382 27949 tablet_bootstrap.cc:654] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.382951 27950 tablet_bootstrap.cc:654] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.386626 27947 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:56.387274 27947 ts_tablet_manager.cc:1403] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.010s
I20260709 13:12:56.390051 27947 raft_consensus.cc:359] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.392999 27947 raft_consensus.cc:385] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.393316 27947 raft_consensus.cc:740] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.393930 27947 consensus_queue.cc:260] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.395835 27948 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:56.396366 27948 ts_tablet_manager.cc:1403] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.249s	user 0.025s	sys 0.014s
I20260709 13:12:56.396726 28144 raft_consensus.cc:515] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.399005 27948 raft_consensus.cc:359] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.399705 27948 raft_consensus.cc:385] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.399988 27948 raft_consensus.cc:740] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.401428 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:56.404189 27899 raft_consensus.cc:3060] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.401698 27948 consensus_queue.cc:260] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.405818 27947 ts_tablet_manager.cc:1434] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:12:56.411706 27948 ts_tablet_manager.cc:1434] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:56.401476 28144 leader_election.cc:290] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:56.413215 27948 tablet_bootstrap.cc:492] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:56.415951 27947 tablet_bootstrap.cc:492] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:56.415853 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
W20260709 13:12:56.418092 27718 leader_election.cc:343] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.420325 27948 tablet_bootstrap.cc:654] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.420037 27899 raft_consensus.cc:2468] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:12:56.421742 27720 leader_election.cc:304] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:56.422680 28144 raft_consensus.cc:2804] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.423161 28144 raft_consensus.cc:697] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:12:56.424183 27947 tablet_bootstrap.cc:654] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.424185 28144 consensus_queue.cc:237] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.424154 27950 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:56.428886 27950 ts_tablet_manager.cc:1403] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.016s
I20260709 13:12:56.423173 27949 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:56.429531 27949 ts_tablet_manager.cc:1403] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.002s
I20260709 13:12:56.433413 27949 raft_consensus.cc:359] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.434053 27949 raft_consensus.cc:385] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.434386 27949 raft_consensus.cc:740] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.435405 27949 consensus_queue.cc:260] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.441586 27949 ts_tablet_manager.cc:1434] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:12:56.442589 27949 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:56.432626 27950 raft_consensus.cc:359] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.466352 27950 raft_consensus.cc:385] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.466748 27950 raft_consensus.cc:740] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.473665 28164 consensus_queue.cc:1048] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.478814 28164 raft_consensus.cc:493] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.479305 28164 raft_consensus.cc:515] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.488291 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba13104713a49c6afab7d69cec33275" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:56.489893 27865 leader_election.cc:343] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.493152 28181 raft_consensus.cc:493] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.493631 28164 leader_election.cc:290] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.484216 27950 consensus_queue.cc:260] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.493685 28181 raft_consensus.cc:515] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.495925 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba13104713a49c6afab7d69cec33275" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.496610 27751 raft_consensus.cc:2468] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:56.497399 28181 leader_election.cc:290] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:56.500541 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.501403 27754 raft_consensus.cc:2393] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:56.501684 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.508752 27643 leader_election.cc:304] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:56.509974 28301 raft_consensus.cc:3060] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.506305 27576 catalog_manager.cc:5697] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.517252 28301 raft_consensus.cc:2749] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.529567 27865 leader_election.cc:304] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:56.534415 27949 tablet_bootstrap.cc:654] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.536873 27947 tablet_bootstrap.cc:492] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:56.537410 27947 ts_tablet_manager.cc:1403] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.122s	user 0.042s	sys 0.061s
I20260709 13:12:56.538350 27948 tablet_bootstrap.cc:492] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:56.538846 27948 ts_tablet_manager.cc:1403] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.000s
I20260709 13:12:56.540419 28164 raft_consensus.cc:2804] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.543514 28164 raft_consensus.cc:493] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.544540 28164 raft_consensus.cc:3060] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.545286 28301 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.545843 28301 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.543144 27950 ts_tablet_manager.cc:1434] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:12:56.548023 28301 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:56.542050 27948 raft_consensus.cc:359] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.549345 27950 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:56.549495 27948 raft_consensus.cc:385] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.550035 27948 raft_consensus.cc:740] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.550889 27948 consensus_queue.cc:260] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.553395 27948 ts_tablet_manager.cc:1434] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:12:56.541213 27947 raft_consensus.cc:359] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.553790 27947 raft_consensus.cc:385] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.554143 27947 raft_consensus.cc:740] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.561389 27948 tablet_bootstrap.cc:492] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:56.563768 27950 tablet_bootstrap.cc:654] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.565624 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.554937 27947 consensus_queue.cc:260] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.568198 27947 ts_tablet_manager.cc:1434] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:12:56.570305 27947 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:56.573745 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.575449 27642 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:56.576632 28301 raft_consensus.cc:2749] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.577229 27947 tablet_bootstrap.cc:654] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.577796 27949 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:56.578311 27949 ts_tablet_manager.cc:1403] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.000s
I20260709 13:12:56.581156 27949 raft_consensus.cc:359] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.581840 27949 raft_consensus.cc:385] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.582134 27949 raft_consensus.cc:740] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.588599 27949 consensus_queue.cc:260] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.593921 27949 ts_tablet_manager.cc:1434] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:56.595021 27949 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:56.602710 27949 tablet_bootstrap.cc:654] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.605259 27947 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:56.605816 27947 ts_tablet_manager.cc:1403] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.015s
I20260709 13:12:56.616657 27948 tablet_bootstrap.cc:654] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.617611 27950 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:56.618122 27950 ts_tablet_manager.cc:1403] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.005s
I20260709 13:12:56.621286 27950 raft_consensus.cc:359] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.624764 27950 raft_consensus.cc:385] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.625121 27950 raft_consensus.cc:740] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.626205 28304 consensus_queue.cc:1048] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:56.626611 27950 consensus_queue.cc:260] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.638027 27676 raft_consensus.cc:3060] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.638417 27947 raft_consensus.cc:359] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.639190 27947 raft_consensus.cc:385] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.639447 27947 raft_consensus.cc:740] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.641237 27950 ts_tablet_manager.cc:1434] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:12:56.640262 27947 consensus_queue.cc:260] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.646229 27947 ts_tablet_manager.cc:1434] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:12:56.649703 27950 tablet_bootstrap.cc:492] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:56.654306 27947 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:56.654421 27949 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:56.660861 27949 ts_tablet_manager.cc:1403] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.005s
I20260709 13:12:56.663754 27949 raft_consensus.cc:359] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.664458 27949 raft_consensus.cc:385] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.664740 27949 raft_consensus.cc:740] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.665387 27949 consensus_queue.cc:260] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.669490 27949 ts_tablet_manager.cc:1434] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:12:56.675338 27950 tablet_bootstrap.cc:654] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.677731 27949 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:56.675619 28164 raft_consensus.cc:515] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.680106 28164 leader_election.cc:290] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.682530 27947 tablet_bootstrap.cc:654] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.682260 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba13104713a49c6afab7d69cec33275" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:56.684383 27949 tablet_bootstrap.cc:654] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.688396 27865 leader_election.cc:343] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.689976 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba13104713a49c6afab7d69cec33275" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:56.690161 28320 consensus_queue.cc:1048] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:56.696861 28304 consensus_queue.cc:1048] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.691829 27751 raft_consensus.cc:3060] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.729513 27947 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:56.730021 27947 ts_tablet_manager.cc:1403] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.000s
I20260709 13:12:56.731941 28315 raft_consensus.cc:493] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.734144 28315 raft_consensus.cc:515] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.734866 27948 tablet_bootstrap.cc:492] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:56.735375 27948 ts_tablet_manager.cc:1403] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.174s	user 0.019s	sys 0.001s
I20260709 13:12:56.742362 28315 leader_election.cc:290] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:56.745352 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:56.746861 27717 leader_election.cc:343] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.747813 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:56.749351 27718 leader_election.cc:343] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.749727 27718 leader_election.cc:304] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:56.750526 27950 tablet_bootstrap.cc:492] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:56.750931 27950 ts_tablet_manager.cc:1403] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.013s
I20260709 13:12:56.751797 28314 raft_consensus.cc:2749] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.755780 27751 raft_consensus.cc:2468] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:56.756109 27675 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.757138 27865 leader_election.cc:304] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:56.757774 27947 raft_consensus.cc:359] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.758184 28164 raft_consensus.cc:2804] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.758508 27947 raft_consensus.cc:385] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.758694 28164 raft_consensus.cc:697] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:56.759672 28164 consensus_queue.cc:237] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.760289 27948 raft_consensus.cc:359] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.761099 27948 raft_consensus.cc:385] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.761418 27948 raft_consensus.cc:740] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.762147 27948 consensus_queue.cc:260] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.771642 27948 ts_tablet_manager.cc:1434] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:12:56.773084 28320 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.773703 28320 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.775902 28320 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:56.777542 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.777901 27950 raft_consensus.cc:359] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.778713 27950 raft_consensus.cc:385] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.779011 27950 raft_consensus.cc:740] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.779574 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.779820 27950 consensus_queue.cc:260] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.758803 27947 raft_consensus.cc:740] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
W20260709 13:12:56.781072 27865 leader_election.cc:343] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:56.781934 27866 leader_election.cc:343] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.781623 27947 consensus_queue.cc:260] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.782363 27866 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:56.784413 27949 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:56.784945 27949 ts_tablet_manager.cc:1403] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.004s
I20260709 13:12:56.786630 27950 ts_tablet_manager.cc:1434] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:12:56.787622 27949 raft_consensus.cc:359] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.788726 27949 raft_consensus.cc:385] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.789095 27949 raft_consensus.cc:740] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.789916 27947 ts_tablet_manager.cc:1434] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.003s
I20260709 13:12:56.791011 27947 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:56.791647 27949 consensus_queue.cc:260] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:56.793560 27949 ts_tablet_manager.cc:1434] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:56.794533 27949 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:56.797107 28291 raft_consensus.cc:493] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.797602 28291 raft_consensus.cc:515] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.799858 28291 leader_election.cc:290] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:56.802412 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995243704b794d67a15048bce788b7fe" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:56.803184 27899 raft_consensus.cc:2468] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:56.805038 27794 leader_election.cc:304] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:56.808670 28291 raft_consensus.cc:2804] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.787827 27950 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:56.788403 27948 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:56.804479 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995243704b794d67a15048bce788b7fe" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.816090 27676 raft_consensus.cc:2468] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:56.809067 28291 raft_consensus.cc:493] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.817927 28291 raft_consensus.cc:3060] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.823302 27828 raft_consensus.cc:3060] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.823632 27577 catalog_manager.cc:5697] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.787832 28320 raft_consensus.cc:2749] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.831925 27950 tablet_bootstrap.cc:654] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.835175 28320 raft_consensus.cc:493] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.835889 28320 raft_consensus.cc:515] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.840802 28164 raft_consensus.cc:493] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.840859 28315 raft_consensus.cc:493] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.841501 28320 leader_election.cc:290] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.841388 28164 raft_consensus.cc:515] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.841594 28315 raft_consensus.cc:515] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.843060 27675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d135ee8d4e4b30a625e909937c9a2d" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.843806 28315 leader_election.cc:290] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:56.844668 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d135ee8d4e4b30a625e909937c9a2d" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.844920 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.845258 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a699d843fce043cea91638fe4622003f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.845953 27751 raft_consensus.cc:2468] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:56.844930 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:12:56.847892 27720 leader_election.cc:343] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:56.848037 27865 leader_election.cc:343] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.848699 27865 leader_election.cc:304] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
W20260709 13:12:56.848812 27718 leader_election.cc:343] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.849224 27718 leader_election.cc:304] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:12:56.850376 28315 raft_consensus.cc:2749] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.845321 27752 raft_consensus.cc:2468] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:56.851923 27948 tablet_bootstrap.cc:654] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.853438 27865 leader_election.cc:304] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:56.859810 28315 consensus_queue.cc:1048] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.849442 28005 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.860641 28005 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.861336 28241 raft_consensus.cc:2804] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.861739 28241 raft_consensus.cc:493] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.862090 28241 raft_consensus.cc:3060] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.862728 28005 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.858978 28291 raft_consensus.cc:515] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.859812 28164 leader_election.cc:290] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:56.853967 28320 raft_consensus.cc:2804] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.864933 28320 raft_consensus.cc:493] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.865293 28320 raft_consensus.cc:3060] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.865835 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a699d843fce043cea91638fe4622003f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:56.866482 27828 raft_consensus.cc:2468] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:56.866586 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:56.867205 27752 raft_consensus.cc:2468] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:56.869408 27865 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:56.870177 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995243704b794d67a15048bce788b7fe" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:56.872092 27899 raft_consensus.cc:3060] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.879937 28320 raft_consensus.cc:515] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:56.871346 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:56.881843 27676 raft_consensus.cc:2468] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:56.883208 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a699d843fce043cea91638fe4622003f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:56.884120 27826 raft_consensus.cc:3060] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.889451 27949 tablet_bootstrap.cc:654] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.889197 27899 raft_consensus.cc:2468] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:56.891657 27794 leader_election.cc:304] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:56.892479 27959 raft_consensus.cc:2804] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.893023 27959 raft_consensus.cc:697] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:56.892050 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a699d843fce043cea91638fe4622003f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:56.895385 27751 raft_consensus.cc:3060] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.893710 27959 consensus_queue.cc:237] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:56.900629 28241 raft_consensus.cc:515] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.890125 28164 raft_consensus.cc:2804] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:56.902714 28164 raft_consensus.cc:493] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.903098 28164 raft_consensus.cc:3060] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.903287 28241 leader_election.cc:290] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.906553 27751 raft_consensus.cc:2468] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:56.909989 28164 raft_consensus.cc:515] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:56.910959 27826 raft_consensus.cc:2468] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:56.912305 27866 leader_election.cc:304] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:56.889134 28320 leader_election.cc:290] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:56.912109 27674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d135ee8d4e4b30a625e909937c9a2d" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:56.902668 27947 tablet_bootstrap.cc:654] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.919214 28005 raft_consensus.cc:2804] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.929229 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "995243704b794d67a15048bce788b7fe" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:56.929901 27677 raft_consensus.cc:3060] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.927071 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d135ee8d4e4b30a625e909937c9a2d" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:56.927042 28144 consensus_queue.cc:1048] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:56.933241 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:56.935189 27678 raft_consensus.cc:3060] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.912111 28164 leader_election.cc:290] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:56.936393 27751 raft_consensus.cc:3060] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.967669 27573 catalog_manager.cc:5697] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.928669 28291 leader_election.cc:290] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:56.934741 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91f6da6c29164c54a83cb71cb4069456" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:56.982059 27948 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:56.982818 27948 ts_tablet_manager.cc:1403] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.210s	user 0.014s	sys 0.012s
W20260709 13:12:56.971846 27865 leader_election.cc:343] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.973750 27678 raft_consensus.cc:2468] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:12:56.986088 27752 raft_consensus.cc:3060] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.985791 28311 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.002214 27950 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:57.003858 27950 ts_tablet_manager.cc:1403] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.216s	user 0.017s	sys 0.021s
I20260709 13:12:57.000141 28311 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.015275 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:57.016148 27950 raft_consensus.cc:359] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:57.016840 27717 leader_election.cc:343] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.018013 27948 raft_consensus.cc:359] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.018748 27948 raft_consensus.cc:385] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.019009 27948 raft_consensus.cc:740] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.011809 27751 raft_consensus.cc:2468] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:57.019682 27948 consensus_queue.cc:260] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.025424 28311 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:57.026772 27950 raft_consensus.cc:385] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.028425 27950 raft_consensus.cc:740] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.004652 27865 leader_election.cc:304] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:56.995251 27677 raft_consensus.cc:2468] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:57.033664 27865 leader_election.cc:304] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:57.029192 27950 consensus_queue.cc:260] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.035351 27948 ts_tablet_manager.cc:1434] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:12:57.034801 28241 raft_consensus.cc:2804] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.051079 27948 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:57.053000 27950 ts_tablet_manager.cc:1434] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:12:57.041111 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:57.040927 28005 raft_consensus.cc:697] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:57.065662 27950 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d: Bootstrap starting.
I20260709 13:12:57.066488 27752 raft_consensus.cc:2468] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:12:57.064769 28164 raft_consensus.cc:2804] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.080407 28164 raft_consensus.cc:697] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:57.081423 28164 consensus_queue.cc:237] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:57.084877 27718 leader_election.cc:343] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.085378 27718 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:57.086082 28197 raft_consensus.cc:2749] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.093786 27947 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:57.094355 27947 ts_tablet_manager.cc:1403] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.304s	user 0.013s	sys 0.010s
W20260709 13:12:57.102203 28358 log.cc:927] Time spent T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:57.105397 27947 raft_consensus.cc:359] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.106974 27947 raft_consensus.cc:385] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.107273 27947 raft_consensus.cc:740] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.094647 28241 raft_consensus.cc:697] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:57.107990 27947 consensus_queue.cc:260] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.117372 28320 raft_consensus.cc:493] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.132859 27947 ts_tablet_manager.cc:1434] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:12:57.135679 27949 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:57.136238 27949 ts_tablet_manager.cc:1403] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.342s	user 0.034s	sys 0.024s
I20260709 13:12:57.144503 27947 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:57.147729 27948 tablet_bootstrap.cc:654] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.124970 28005 consensus_queue.cc:237] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:57.155673 27949 raft_consensus.cc:359] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.157688 27949 raft_consensus.cc:385] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.158061 27949 raft_consensus.cc:740] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.160408 27949 consensus_queue.cc:260] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.135387 28320 raft_consensus.cc:515] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.169359 27947 tablet_bootstrap.cc:654] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.179884 27950 tablet_bootstrap.cc:654] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.182660 28320 leader_election.cc:290] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:57.185055 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ec45e6ca9c4c98bd3a36fa21d7ee67" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
W20260709 13:12:57.194732 27865 leader_election.cc:343] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.153956 28241 consensus_queue.cc:237] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.190346 27677 raft_consensus.cc:3060] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.199072 27949 ts_tablet_manager.cc:1434] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.001s
I20260709 13:12:57.200610 27949 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:57.203066 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ec45e6ca9c4c98bd3a36fa21d7ee67" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:57.205924 28361 consensus_queue.cc:1048] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:57.205102 27866 leader_election.cc:343] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.212857 27866 leader_election.cc:304] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:57.214416 28356 raft_consensus.cc:2749] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.230645 27948 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:57.233700 27947 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:57.234609 27947 ts_tablet_manager.cc:1403] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.004s
I20260709 13:12:57.236380 27948 ts_tablet_manager.cc:1403] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.004s
I20260709 13:12:57.242991 27948 raft_consensus.cc:359] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.243660 27948 raft_consensus.cc:385] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.243921 27948 raft_consensus.cc:740] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.244638 27948 consensus_queue.cc:260] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.246819 27948 ts_tablet_manager.cc:1434] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:12:57.249262 28181 raft_consensus.cc:493] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.249498 28005 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.249809 28181 raft_consensus.cc:515] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.250074 28005 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.247638 28356 consensus_queue.cc:1048] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:57.253203 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:57.254470 27866 leader_election.cc:343] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.255204 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:57.255594 28005 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:57.257282 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:57.259429 27947 raft_consensus.cc:359] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.260138 27947 raft_consensus.cc:385] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.260450 27947 raft_consensus.cc:740] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.264228 27950 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d: No bootstrap required, opened a new log
I20260709 13:12:57.255900 27752 raft_consensus.cc:2468] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:57.264775 27950 ts_tablet_manager.cc:1403] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.000s
W20260709 13:12:57.259455 27865 leader_election.cc:343] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.265547 27865 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:57.265833 27642 leader_election.cc:304] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:57.267163 28320 raft_consensus.cc:2749] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.267549 27950 raft_consensus.cc:359] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.268337 27950 raft_consensus.cc:385] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.268616 27950 raft_consensus.cc:740] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.269276 27950 consensus_queue.cc:260] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.269832 28181 leader_election.cc:290] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:57.270744 28181 raft_consensus.cc:2804] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.271139 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:57.272620 27828 raft_consensus.cc:2468] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:57.273352 28181 raft_consensus.cc:493] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.273821 28181 raft_consensus.cc:3060] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.275015 27577 catalog_manager.cc:5697] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.276626 27948 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:57.281944 27949 tablet_bootstrap.cc:654] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.283221 27948 tablet_bootstrap.cc:654] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.271440 27950 ts_tablet_manager.cc:1434] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:57.261071 27947 consensus_queue.cc:260] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.289651 27947 ts_tablet_manager.cc:1434] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:12:57.292721 28181 raft_consensus.cc:515] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.294922 28181 leader_election.cc:290] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:57.295996 27947 tablet_bootstrap.cc:492] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066: Bootstrap starting.
I20260709 13:12:57.304591 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:57.305286 27828 raft_consensus.cc:3060] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:57.306208 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:57.321810 27577 catalog_manager.cc:5697] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:57.324213 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 58479.2us
I20260709 13:12:57.322762 27947 tablet_bootstrap.cc:654] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.329001 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:57.333084 27751 raft_consensus.cc:3060] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.323899 27577 catalog_manager.cc:5697] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 2, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.327149 28364 raft_consensus.cc:493] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.337507 28364 raft_consensus.cc:515] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.342257 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70470ccb3c14f3eb3ea2c9ad9232f40" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:57.342962 27900 raft_consensus.cc:2468] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 0.
I20260709 13:12:57.343528 27751 raft_consensus.cc:2468] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:57.344332 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70470ccb3c14f3eb3ea2c9ad9232f40" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:57.346645 27720 leader_election.cc:304] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:57.348253 28315 raft_consensus.cc:2804] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.348697 28315 raft_consensus.cc:493] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.349053 28315 raft_consensus.cc:3060] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:57.359035 27717 leader_election.cc:343] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.361801 27642 leader_election.cc:304] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:57.362859 28372 raft_consensus.cc:2804] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.363328 28372 raft_consensus.cc:697] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:12:57.364115 28372 consensus_queue.cc:237] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.365429 28291 consensus_queue.cc:1048] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.339866 28364 leader_election.cc:290] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:57.382488 27948 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:57.382966 27948 ts_tablet_manager.cc:1403] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.009s
I20260709 13:12:57.327454 27828 raft_consensus.cc:2468] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:57.394034 28315 raft_consensus.cc:515] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.401942 27949 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:57.406051 27949 ts_tablet_manager.cc:1403] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.206s	user 0.014s	sys 0.004s
I20260709 13:12:57.388569 27948 raft_consensus.cc:359] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.406872 27948 raft_consensus.cc:385] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.407284 27948 raft_consensus.cc:740] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.408689 27948 consensus_queue.cc:260] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.413018 28363 raft_consensus.cc:493] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.413594 28363 raft_consensus.cc:515] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.415901 28363 leader_election.cc:290] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:57.416847 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70470ccb3c14f3eb3ea2c9ad9232f40" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:57.417568 27900 raft_consensus.cc:3060] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.426529 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:57.428196 27900 raft_consensus.cc:2468] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
W20260709 13:12:57.428676 27717 leader_election.cc:343] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.429557 28291 consensus_queue.cc:1048] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:57.432663 27720 leader_election.cc:304] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:57.435606 28364 raft_consensus.cc:2804] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.435740 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:57.436471 28364 raft_consensus.cc:697] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
W20260709 13:12:57.437251 27718 leader_election.cc:343] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.437363 28364 consensus_queue.cc:237] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.437842 27718 leader_election.cc:304] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:57.439008 28311 raft_consensus.cc:2749] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.440536 28315 leader_election.cc:290] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:57.441865 27678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70470ccb3c14f3eb3ea2c9ad9232f40" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:57.443761 27717 leader_election.cc:343] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.454089 27948 ts_tablet_manager.cc:1434] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:12:57.465102 27577 catalog_manager.cc:5697] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 1 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.474165 28304 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.474994 28304 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.481042 28304 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:57.481638 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:57.482295 27899 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:57.488435 27794 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:57.489166 27959 raft_consensus.cc:2804] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.489524 27959 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.489815 27959 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.469548 27949 raft_consensus.cc:359] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.492630 27949 raft_consensus.cc:385] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.492676 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:57.492990 27949 raft_consensus.cc:740] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.494022 27949 consensus_queue.cc:260] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.495996 27676 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:57.497339 27948 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:57.498514 28320 consensus_queue.cc:1048] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.509346 27959 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.512869 27899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:57.513746 27899 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.514541 27949 ts_tablet_manager.cc:1434] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:12:57.518893 27959 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:57.533394 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:57.534137 27677 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.541188 27899 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:57.542580 27794 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:57.547729 27949 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:57.554571 27677 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:57.563560 27947 tablet_bootstrap.cc:492] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066: No bootstrap required, opened a new log
I20260709 13:12:57.568002 27947 ts_tablet_manager.cc:1403] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066: Time spent bootstrapping tablet: real 0.272s	user 0.032s	sys 0.035s
I20260709 13:12:57.549847 28146 raft_consensus.cc:2804] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.579986 27577 catalog_manager.cc:5697] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 0 to 1, leader changed from <none> to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 1 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.584470 28146 raft_consensus.cc:697] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:57.585532 28146 consensus_queue.cc:237] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.628275 27947 raft_consensus.cc:359] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:57.629460 27947 raft_consensus.cc:385] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.629853 27947 raft_consensus.cc:740] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68036e839a414adf854b602c1ee70066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.634374 27947 consensus_queue.cc:260] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:57.658591 27947 ts_tablet_manager.cc:1434] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 13:12:57.660126 27949 tablet_bootstrap.cc:654] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.667429 28005 consensus_queue.cc:1048] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:57.689297 27948 tablet_bootstrap.cc:654] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:57.701393 27865 consensus_peers.cc:597] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.711935 27573 catalog_manager.cc:5697] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.742803 28320 raft_consensus.cc:493] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.744674 28320 raft_consensus.cc:515] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:57.747821 28320 leader_election.cc:290] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:57.757416 28381 raft_consensus.cc:493] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.762667 28381 raft_consensus.cc:515] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:57.767922 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:57.768687 27753 raft_consensus.cc:2468] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 0.
I20260709 13:12:57.760345 27751 raft_consensus.cc:1275] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:57.773636 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ec45e6ca9c4c98bd3a36fa21d7ee67" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:57.775409 27677 raft_consensus.cc:1275] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:57.776249 28381 leader_election.cc:290] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:12:57.775552 27791 leader_election.cc:343] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.784018 27865 leader_election.cc:304] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
W20260709 13:12:57.784585 28382 log.cc:927] Time spent T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:57.789268 28005 consensus_queue.cc:1048] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.789906 28241 raft_consensus.cc:2804] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.792954 28241 raft_consensus.cc:493] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.793754 28241 raft_consensus.cc:3060] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.809015 28005 consensus_queue.cc:1048] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:57.829629 27794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 149888us
I20260709 13:12:57.843822 27948 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:57.844362 27948 ts_tablet_manager.cc:1403] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.347s	user 0.040s	sys 0.078s
I20260709 13:12:57.846419 27948 raft_consensus.cc:359] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.846938 27948 raft_consensus.cc:385] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.847155 27948 raft_consensus.cc:740] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.847702 27948 consensus_queue.cc:260] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:57.852231 27948 ts_tablet_manager.cc:1434] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:57.858896 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ec45e6ca9c4c98bd3a36fa21d7ee67" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:57.859566 27902 raft_consensus.cc:2468] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:57.871107 27794 leader_election.cc:304] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:57.873291 28381 raft_consensus.cc:2804] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.876394 28381 raft_consensus.cc:493] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.877849 28381 raft_consensus.cc:3060] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.907718 27948 tablet_bootstrap.cc:492] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:57.916745 27948 tablet_bootstrap.cc:654] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.917922 27949 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:57.918471 27949 ts_tablet_manager.cc:1403] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.378s	user 0.030s	sys 0.005s
I20260709 13:12:57.918614 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:57.925302 28372 consensus_queue.cc:1048] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.937458 27949 raft_consensus.cc:359] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:57.939273 28181 consensus_queue.cc:1048] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.938226 27949 raft_consensus.cc:385] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.944334 27949 raft_consensus.cc:740] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.961027 28241 raft_consensus.cc:515] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:57.968672 28241 leader_election.cc:290] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:57.954074 27949 consensus_queue.cc:260] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
W20260709 13:12:57.976468 27865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 102450us
I20260709 13:12:57.980135 27949 ts_tablet_manager.cc:1434] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:12:57.981326 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:57.982159 27751 raft_consensus.cc:3060] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.998703 27751 raft_consensus.cc:2468] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:12:57.962924 28381 raft_consensus.cc:515] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:58.002261 27865 leader_election.cc:304] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:12:58.029585 27949 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
W20260709 13:12:58.031661 27866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 153280us
W20260709 13:12:58.048713 27717 consensus_peers.cc:597] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.052551 27948 tablet_bootstrap.cc:492] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:58.053361 27948 ts_tablet_manager.cc:1403] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.040s
I20260709 13:12:58.086395 28381 leader_election.cc:290] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:12:58.100054 27866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 61653us
W20260709 13:12:58.100871 27866 leader_election.cc:343] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.102319 28401 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.102902 28401 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.105082 28401 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:58.074615 28005 raft_consensus.cc:2804] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.059427 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:58.118124 28389 consensus_queue.cc:1048] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.107574 28372 raft_consensus.cc:493] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.120440 28372 raft_consensus.cc:515] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:58.122814 28372 leader_election.cc:290] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:58.128476 27949 tablet_bootstrap.cc:654] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.130698 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:58.131145 28005 raft_consensus.cc:697] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:12:58.131682 27751 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:58.132141 28005 consensus_queue.cc:237] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:58.133005 27948 raft_consensus.cc:359] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:58.133769 27948 raft_consensus.cc:385] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.134037 27948 raft_consensus.cc:740] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.134657 27948 consensus_queue.cc:260] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:58.139815 28263 consensus_queue.cc:1048] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:58.144711 27866 leader_election.cc:343] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.185233 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ec45e6ca9c4c98bd3a36fa21d7ee67" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:58.185453 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ec45e6ca9c4c98bd3a36fa21d7ee67" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:58.185887 27897 raft_consensus.cc:3060] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.199137 27948 ts_tablet_manager.cc:1434] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.145s	user 0.005s	sys 0.002s
I20260709 13:12:58.114109 28401 consensus_queue.cc:1048] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.092s
I20260709 13:12:58.208555 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:58.198969 27791 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
W20260709 13:12:58.247988 27791 leader_election.cc:343] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:58.248746 27791 leader_election.cc:343] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.249028 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d135ee8d4e4b30a625e909937c9a2d" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:58.253347 27948 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:58.253533 27949 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:58.253988 27949 ts_tablet_manager.cc:1403] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.234s	user 0.022s	sys 0.008s
I20260709 13:12:58.257965 27959 consensus_queue.cc:1048] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.260524 27897 raft_consensus.cc:2468] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:58.215444 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d135ee8d4e4b30a625e909937c9a2d" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:58.276475 27794 leader_election.cc:304] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:58.277621 27959 raft_consensus.cc:2804] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.278299 27959 raft_consensus.cc:697] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:58.222193 28380 raft_consensus.cc:2804] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.282089 27949 raft_consensus.cc:359] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.283252 27949 raft_consensus.cc:385] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.283810 27949 raft_consensus.cc:740] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.284765 27949 consensus_queue.cc:260] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.288843 27959 consensus_queue.cc:237] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:12:58.275343 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 133712us
I20260709 13:12:58.281744 28380 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.315745 27573 catalog_manager.cc:5697] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 1 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.325336 28380 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.381624 27718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 79267.4us
I20260709 13:12:58.395923 27949 ts_tablet_manager.cc:1434] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.017s
W20260709 13:12:58.404520 27645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 142332us
I20260709 13:12:58.413158 27948 tablet_bootstrap.cc:654] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:58.388145 27642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 55715.4us
I20260709 13:12:58.445592 27949 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:58.457770 28380 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.467056 27753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:58.467331 27645 leader_election.cc:304] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:58.467849 27753 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.460031 28380 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:58.478276 28425 raft_consensus.cc:2749] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.484077 27949 tablet_bootstrap.cc:654] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.496848 27677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:12:58.497854 27677 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.503340 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:58.507428 27948 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:58.507964 27948 ts_tablet_manager.cc:1403] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.255s	user 0.015s	sys 0.007s
I20260709 13:12:58.531087 27948 raft_consensus.cc:359] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.532054 27948 raft_consensus.cc:385] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.533036 27948 raft_consensus.cc:740] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.533759 27948 consensus_queue.cc:260] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.551016 27959 raft_consensus.cc:493] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.552786 27959 raft_consensus.cc:515] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:12:58.555446 27677 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:58.564244 27959 leader_election.cc:290] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:58.583734 27676 raft_consensus.cc:3060] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.600481 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:58.615520 27753 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:58.634827 27948 ts_tablet_manager.cc:1434] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.009s
I20260709 13:12:58.645485 27824 raft_consensus.cc:3060] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.660581 27791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 105431us
I20260709 13:12:58.661587 27791 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
W20260709 13:12:58.661795 28430 log.cc:927] Time spent T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:12:58.662602 28304 raft_consensus.cc:2804] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.663118 28304 raft_consensus.cc:697] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:58.663959 28304 consensus_queue.cc:237] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.670961 27948 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: Bootstrap starting.
I20260709 13:12:58.622789 28389 consensus_queue.cc:1048] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:12:58.685232 27752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0954ebc4144a79b312f1d47bb6d167" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:58.686115 27752 raft_consensus.cc:2393] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 1: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:12:58.686805 27949 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:58.687497 27949 ts_tablet_manager.cc:1403] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.024s
I20260709 13:12:58.691406 28403 consensus_queue.cc:1048] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:58.716760 27949 raft_consensus.cc:359] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:58.717561 27949 raft_consensus.cc:385] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.717850 27949 raft_consensus.cc:740] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.718469 27949 consensus_queue.cc:260] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:58.728094 27949 ts_tablet_manager.cc:1434] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:12:58.730607 27949 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:58.742399 27791 leader_election.cc:304] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:58.743312 28438 raft_consensus.cc:2749] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.749043 28429 raft_consensus.cc:493] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.749626 28429 raft_consensus.cc:515] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:12:58.753671 28429 leader_election.cc:290] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:58.765949 27949 tablet_bootstrap.cc:654] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.781600 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70470ccb3c14f3eb3ea2c9ad9232f40" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:58.786101 28402 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.786628 28402 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:58.789654 28402 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:12:58.790480 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70470ccb3c14f3eb3ea2c9ad9232f40" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:58.791465 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:12:58.793243 27866 leader_election.cc:343] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.793427 27645 leader_election.cc:304] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:58.794414 28429 raft_consensus.cc:2749] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.794344 27676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:58.799980 28304 consensus_queue.cc:1048] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.808298 27948 tablet_bootstrap.cc:654] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.827312 27577 catalog_manager.cc:5697] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.829581 28304 raft_consensus.cc:493] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.830139 28304 raft_consensus.cc:515] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.831274 27577 catalog_manager.cc:5697] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.832492 28304 leader_election.cc:290] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:58.833132 27949 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:58.833431 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:12:58.833621 27949 ts_tablet_manager.cc:1403] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.000s
W20260709 13:12:58.834784 27791 leader_election.cc:343] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.837451 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:58.838165 27754 raft_consensus.cc:2468] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 0.
I20260709 13:12:58.838814 27949 raft_consensus.cc:359] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:58.844211 27791 leader_election.cc:304] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
W20260709 13:12:58.844791 27865 leader_election.cc:343] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.846035 28381 raft_consensus.cc:2804] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.846531 28381 raft_consensus.cc:493] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.846890 28381 raft_consensus.cc:3060] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.839898 27949 raft_consensus.cc:385] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.848201 27949 raft_consensus.cc:740] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.845333 27865 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:12:58.850409 28241 raft_consensus.cc:2749] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.851540 27949 consensus_queue.cc:260] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:58.854494 27949 ts_tablet_manager.cc:1434] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:58.871476 28381 raft_consensus.cc:515] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.875236 27949 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:58.883751 27676 raft_consensus.cc:3060] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.889531 27679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
W20260709 13:12:58.891759 27791 leader_election.cc:343] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.892117 28381 leader_election.cc:290] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:12:58.889154 27949 tablet_bootstrap.cc:654] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.903949 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:12:58.904639 27754 raft_consensus.cc:3060] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.926764 27754 raft_consensus.cc:2468] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:12:58.928864 27791 leader_election.cc:304] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:12:58.932150 28419 raft_consensus.cc:2804] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.933463 28419 raft_consensus.cc:697] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:12:58.934458 28419 consensus_queue.cc:237] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.942591 27948 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: No bootstrap required, opened a new log
I20260709 13:12:58.943221 27948 ts_tablet_manager.cc:1403] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: Time spent bootstrapping tablet: real 0.272s	user 0.012s	sys 0.008s
I20260709 13:12:58.946384 27948 raft_consensus.cc:359] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:58.947764 27948 raft_consensus.cc:385] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.948103 27948 raft_consensus.cc:740] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.948937 27948 consensus_queue.cc:260] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:58.953692 27949 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:58.954257 27949 ts_tablet_manager.cc:1403] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.008s
I20260709 13:12:58.954666 27948 ts_tablet_manager.cc:1434] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:12:58.957460 27949 raft_consensus.cc:359] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.957877 28304 consensus_queue.cc:1048] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.958207 27949 raft_consensus.cc:385] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.960466 27949 raft_consensus.cc:740] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.962802 27949 consensus_queue.cc:260] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:58.964854 27949 ts_tablet_manager.cc:1434] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:12:58.965939 27949 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:12:58.971642 27949 tablet_bootstrap.cc:654] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.000335 27577 catalog_manager.cc:5697] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.010370 27949 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: No bootstrap required, opened a new log
I20260709 13:12:59.012064 27949 ts_tablet_manager.cc:1403] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.015s
I20260709 13:12:59.014932 27949 raft_consensus.cc:359] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:59.015684 27949 raft_consensus.cc:385] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.016000 27949 raft_consensus.cc:740] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.016748 27949 consensus_queue.cc:260] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:59.019011 27949 ts_tablet_manager.cc:1434] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:59.039812 27676 raft_consensus.cc:3060] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.045224 28429 raft_consensus.cc:493] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.045794 28429 raft_consensus.cc:515] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:12:59.047574 28429 leader_election.cc:290] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:12:59.052122 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:59.058094 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2aca4291bad45cc9d8413a65298e541" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:12:59.058813 27751 raft_consensus.cc:2393] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1da14a10b312403c91c2ff8aa9d0338a in current term 1: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:12:59.068339 27642 leader_election.cc:304] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:12:59.069162 28425 raft_consensus.cc:3060] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.085807 28425 raft_consensus.cc:2749] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.090186 28425 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.090680 28425 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:59.092906 28425 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:59.094264 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:12:59.095021 27900 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:59.096372 27645 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:12:59.097481 28423 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.097863 28423 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.098145 28423 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.104367 28423 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:59.108378 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:12:59.110118 27824 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 0.
I20260709 13:12:59.112767 28423 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:12:59.112993 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:12:59.113678 27823 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.114436 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:12:59.115068 27900 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.123603 27823 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:59.124850 27643 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:12:59.125814 28423 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.125969 27900 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 1.
I20260709 13:12:59.126593 28423 raft_consensus.cc:697] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:12:59.128017 28423 consensus_queue.cc:237] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:12:59.147102 27577 catalog_manager.cc:5697] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 1 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.230484 28419 consensus_queue.cc:1048] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.245559 28434 consensus_queue.cc:1048] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.357745 28419 consensus_queue.cc:1048] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.373323 28419 consensus_queue.cc:1048] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.542847 28425 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.592664 28425 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.193289 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
W20260709 13:13:00.196511 27717 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:13:00.207540 27717 consensus_peers.cc:597] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.222924 27791 consensus_peers.cc:597] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.228868 27791 consensus_peers.cc:597] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.241585 27865 consensus_peers.cc:597] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.242331 27865 consensus_peers.cc:597] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.251103 27717 consensus_peers.cc:597] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.260327 27717 consensus_peers.cc:597] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.277266 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:00.280133 18095 tablet_replica.cc:333] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.281522 18095 raft_consensus.cc:2243] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.282105 18095 raft_consensus.cc:2272] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.282894 27717 consensus_peers.cc:597] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.284868 18095 tablet_replica.cc:333] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
W20260709 13:13:00.285272 27717 consensus_peers.cc:597] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.285869 18095 raft_consensus.cc:2243] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.286480 18095 raft_consensus.cc:2272] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.289124 18095 tablet_replica.cc:333] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.290012 18095 raft_consensus.cc:2243] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.290539 18095 raft_consensus.cc:2272] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.293260 18095 tablet_replica.cc:333] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.294278 18095 raft_consensus.cc:2243] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:00.295313 18095 raft_consensus.cc:2272] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.297875 18095 tablet_replica.cc:333] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.298797 18095 raft_consensus.cc:2243] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.299321 18095 raft_consensus.cc:2272] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.301831 18095 tablet_replica.cc:333] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.302678 18095 raft_consensus.cc:2243] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.303195 18095 raft_consensus.cc:2272] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.305693 18095 tablet_replica.cc:333] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
W20260709 13:13:00.306073 27791 consensus_peers.cc:597] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.306541 18095 raft_consensus.cc:2243] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.307180 18095 raft_consensus.cc:2272] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.309834 18095 tablet_replica.cc:333] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.310665 18095 raft_consensus.cc:2243] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:00.311663 18095 raft_consensus.cc:2272] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.314241 18095 tablet_replica.cc:333] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.315138 18095 raft_consensus.cc:2243] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:00.315724 27791 consensus_peers.cc:597] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.316258 18095 raft_consensus.cc:2272] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.319255 18095 tablet_replica.cc:333] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
W20260709 13:13:00.319866 27791 consensus_peers.cc:597] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.320135 18095 raft_consensus.cc:2243] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.320850 18095 raft_consensus.cc:2272] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.323657 18095 tablet_replica.cc:333] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.324596 18095 raft_consensus.cc:2243] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.325184 18095 raft_consensus.cc:2272] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.327893 18095 tablet_replica.cc:333] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.328810 18095 raft_consensus.cc:2243] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.329356 18095 raft_consensus.cc:2272] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.332135 18095 tablet_replica.cc:333] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.333031 18095 raft_consensus.cc:2243] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.333567 18095 raft_consensus.cc:2272] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.336068 18095 tablet_replica.cc:333] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.336973 18095 raft_consensus.cc:2243] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.337489 18095 raft_consensus.cc:2272] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.339960 18095 tablet_replica.cc:333] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.340801 18095 raft_consensus.cc:2243] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.341303 18095 raft_consensus.cc:2272] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.343812 18095 tablet_replica.cc:333] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.344683 18095 raft_consensus.cc:2243] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.345196 18095 raft_consensus.cc:2272] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.347697 18095 tablet_replica.cc:333] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.348598 18095 raft_consensus.cc:2243] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.349118 18095 raft_consensus.cc:2272] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.351913 18095 tablet_replica.cc:333] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.352767 18095 raft_consensus.cc:2243] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.353289 18095 raft_consensus.cc:2272] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.355836 18095 tablet_replica.cc:333] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.356706 18095 raft_consensus.cc:2243] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.357236 18095 raft_consensus.cc:2272] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.359640 18095 tablet_replica.cc:333] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.360538 18095 raft_consensus.cc:2243] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:00.361629 18095 raft_consensus.cc:2272] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.364209 18095 tablet_replica.cc:333] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.365141 18095 raft_consensus.cc:2243] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.365702 18095 raft_consensus.cc:2272] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.368368 18095 tablet_replica.cc:333] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.369182 18095 raft_consensus.cc:2243] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.369683 18095 raft_consensus.cc:2272] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.372373 18095 tablet_replica.cc:333] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.373178 18095 raft_consensus.cc:2243] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.373700 18095 raft_consensus.cc:2272] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.376207 18095 tablet_replica.cc:333] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.377002 18095 raft_consensus.cc:2243] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.377542 18095 raft_consensus.cc:2272] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.380100 18095 tablet_replica.cc:333] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.380919 18095 raft_consensus.cc:2243] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.381453 18095 raft_consensus.cc:2272] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.384302 18095 tablet_replica.cc:333] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.385052 18095 raft_consensus.cc:2243] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.385547 18095 raft_consensus.cc:2272] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.387336 27717 consensus_peers.cc:597] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.389021 18095 tablet_replica.cc:333] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.389961 18095 raft_consensus.cc:2243] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:00.390998 18095 raft_consensus.cc:2272] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.393944 18095 tablet_replica.cc:333] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.394876 18095 raft_consensus.cc:2243] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.395428 18095 raft_consensus.cc:2272] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.397962 18095 tablet_replica.cc:333] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.398753 18095 raft_consensus.cc:2243] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.399322 18095 raft_consensus.cc:2272] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.401852 18095 tablet_replica.cc:333] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.402714 18095 raft_consensus.cc:2243] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:00.403203 27791 consensus_peers.cc:597] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.403226 18095 raft_consensus.cc:2272] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.406268 18095 tablet_replica.cc:333] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.407107 18095 raft_consensus.cc:2243] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.407625 18095 raft_consensus.cc:2272] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.410358 18095 tablet_replica.cc:333] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.411197 18095 raft_consensus.cc:2243] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.411743 18095 raft_consensus.cc:2272] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.414619 18095 tablet_replica.cc:333] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.415469 18095 raft_consensus.cc:2243] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.416035 18095 raft_consensus.cc:2272] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.419759 18095 tablet_replica.cc:333] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.420670 18095 raft_consensus.cc:2243] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.421278 18095 raft_consensus.cc:2272] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.424316 18095 tablet_replica.cc:333] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.425168 18095 raft_consensus.cc:2243] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.425701 18095 raft_consensus.cc:2272] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.427995 27717 consensus_peers.cc:597] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.428251 18095 tablet_replica.cc:333] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.429179 18095 raft_consensus.cc:2243] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.429739 18095 raft_consensus.cc:2272] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.429893 27717 consensus_peers.cc:597] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.432346 18095 tablet_replica.cc:333] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.433185 18095 raft_consensus.cc:2243] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.433691 18095 raft_consensus.cc:2272] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.436374 18095 tablet_replica.cc:333] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
W20260709 13:13:00.436671 27717 consensus_peers.cc:597] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.437192 18095 raft_consensus.cc:2243] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.437830 18095 raft_consensus.cc:2272] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.439867 27865 consensus_peers.cc:597] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.440490 18095 tablet_replica.cc:333] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.441391 18095 raft_consensus.cc:2243] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.441955 18095 raft_consensus.cc:2272] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.444835 18095 tablet_replica.cc:333] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
W20260709 13:13:00.445327 27791 consensus_peers.cc:597] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.445649 18095 raft_consensus.cc:2243] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.446273 18095 raft_consensus.cc:2272] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.446345 27791 consensus_peers.cc:597] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.448961 18095 tablet_replica.cc:333] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.449779 18095 raft_consensus.cc:2243] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.450309 18095 raft_consensus.cc:2272] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.450479 27791 consensus_peers.cc:597] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.452952 18095 tablet_replica.cc:333] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.453804 18095 raft_consensus.cc:2243] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.454356 18095 raft_consensus.cc:2272] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.457403 18095 tablet_replica.cc:333] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.458151 18095 raft_consensus.cc:2243] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.458660 18095 raft_consensus.cc:2272] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:00.461320 18095 tablet_replica.cc:333] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.462037 18095 raft_consensus.cc:2243] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:00.463063 18095 raft_consensus.cc:2272] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.464214 27791 consensus_peers.cc:597] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.465766 18095 tablet_replica.cc:333] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: stopping tablet replica
I20260709 13:13:00.466531 18095 raft_consensus.cc:2243] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:00.467070 18095 raft_consensus.cc:2272] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:00.468120 27717 consensus_peers.cc:597] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.478910 27717 consensus_peers.cc:597] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.507174 27791 consensus_peers.cc:597] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.509171 27791 consensus_peers.cc:597] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.509730 27791 consensus_peers.cc:597] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.534329 27717 consensus_peers.cc:597] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.535244 27791 consensus_peers.cc:597] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.558966 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
W20260709 13:13:00.610963 27791 consensus_peers.cc:597] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.611644 27791 consensus_peers.cc:597] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.652441 27791 consensus_peers.cc:597] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.652948 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:00.653082 27791 consensus_peers.cc:597] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.671061 27791 consensus_peers.cc:597] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.671949 28474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:00.766729 27865 consensus_peers.cc:597] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.767342 27865 consensus_peers.cc:597] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.769825 28475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:00.778492 27865 consensus_peers.cc:597] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.778991 27865 consensus_peers.cc:597] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.788594 27791 consensus_peers.cc:597] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.841756 28479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:00.853669 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:00.861584 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:00.861931 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:00.862181 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602780862163 us; error 0 us; skew 500 ppm
I20260709 13:13:00.862990 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:00.883740 18095 webserver.cc:533] Webserver started at http://127.17.171.193:45749/ using document root <none> and password file <none>
I20260709 13:13:00.884570 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:00.884838 18095 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:00.890384 18095 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:13:00.902550 28488 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:00.903554 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:13:00.903947 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "1da14a10b312403c91c2ff8aa9d0338a"
format_stamp: "Formatted at 2026-07-09 13:12:47 on dist-test-slave-jhlz"
I20260709 13:13:00.904484 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:00.917088 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:00.918473 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:00.920565 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:00.938313 28495 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:13:01.327208 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:13:01.327620 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.397s	user 0.005s	sys 0.010s
I20260709 13:13:01.328004 18095 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:13:01.336575 28495 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:01.355741 28495 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.356752 28495 tablet_bootstrap.cc:492] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:01.357450 28495 ts_tablet_manager.cc:1403] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:13:01.360209 28495 raft_consensus.cc:359] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.360960 28495 raft_consensus.cc:740] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.361863 28495 consensus_queue.cc:260] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.377923 28495 ts_tablet_manager.cc:1434] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.012s
I20260709 13:13:01.378845 28495 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:01.393894 28495 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.394822 28495 tablet_bootstrap.cc:492] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:01.395439 28495 ts_tablet_manager.cc:1403] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:13:01.397601 28495 raft_consensus.cc:359] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.398278 28495 raft_consensus.cc:740] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.399112 28495 consensus_queue.cc:260] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.425928 28495 ts_tablet_manager.cc:1434] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:13:01.426813 28495 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:01.430436 28469 raft_consensus.cc:493] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.431279 28469 raft_consensus.cc:515] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.432986 28381 raft_consensus.cc:493] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.433655 28381 raft_consensus.cc:515] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.437322 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:13:01.449168 27791 leader_election.cc:336] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.449636 27791 leader_election.cc:304] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:01.435993 28381 leader_election.cc:290] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:01.453569 28419 raft_consensus.cc:2749] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.459445 28469 leader_election.cc:290] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:01.461298 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
W20260709 13:13:01.463896 27717 leader_election.cc:336] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.467672 27718 leader_election.cc:304] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:01.468997 28469 raft_consensus.cc:2749] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.475572 28495 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.476696 28495 tablet_bootstrap.cc:492] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:01.477396 28495 ts_tablet_manager.cc:1403] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.001s
I20260709 13:13:01.517791 28483 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.519901 28483 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.522078 28495 raft_consensus.cc:359] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.527789 28478 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.529114 28473 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.523528 28495 raft_consensus.cc:740] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.530326 28473 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.532603 28495 consensus_queue.cc:260] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.530687 28478 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.538229 28478 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.562553 28304 raft_consensus.cc:493] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
W20260709 13:13:01.572322 27865 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.576498 28473 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.578327 28462 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.558444 28483 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
W20260709 13:13:01.589658 27717 leader_election.cc:336] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.588377 28495 ts_tablet_manager.cc:1434] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.111s	user 0.005s	sys 0.010s
I20260709 13:13:01.579636 28462 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.583377 28304 raft_consensus.cc:515] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.619258 28304 leader_election.cc:290] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:01.613652 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:01.619831 28495 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:01.620512 27901 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:13:01.623906 28462 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:01.637936 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:01.639075 27824 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:13:01.639063 28473 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.642946 28473 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.644527 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:01.645438 27751 raft_consensus.cc:2468] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:13:01.645613 28473 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:13:01.646449 27717 leader_election.cc:336] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:01.646658 27791 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.656931 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:01.657927 27825 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:13:01.660919 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:01.661839 27827 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:13:01.664894 28473 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.665855 28473 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.668912 28473 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.670356 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:01.671206 27754 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:13:01.671783 27718 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.673699 28462 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.674103 28462 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.674505 28462 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.674528 28478 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.675442 28478 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.681226 28478 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.678212 27791 leader_election.cc:304] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:01.702826 28304 raft_consensus.cc:2804] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.703249 28304 raft_consensus.cc:493] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.703790 28304 raft_consensus.cc:3060] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:01.703302 27865 leader_election.cc:336] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.704523 27794 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.705828 28473 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.706278 28473 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.706668 28473 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:01.709584 27791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 50205.7us
W20260709 13:13:01.711014 27791 leader_election.cc:336] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.721499 28473 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.732882 27791 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:01.736337 28506 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.732913 27718 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.736788 28506 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.734748 28473 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.737329 28506 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.738354 28505 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.738890 28505 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.739302 28505 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:01.741801 27791 leader_election.cc:336] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.743161 28462 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.758044 27866 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.760407 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:01.778965 27897 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:13:01.734622 28304 raft_consensus.cc:515] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.781433 28304 leader_election.cc:290] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:01.781605 28478 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.782150 28478 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.782541 28478 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.769591 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:01.786367 27823 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 1.
I20260709 13:13:01.769994 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:01.755435 28505 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.789361 28505 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:01.747315 28506 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.791805 27866 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.792012 28506 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:01.793498 28403 raft_consensus.cc:2804] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.793946 28403 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.794353 28403 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.791714 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:01.800709 27824 raft_consensus.cc:2393] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 2: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:13:01.814054 27794 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:01.821331 28506 raft_consensus.cc:2804] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.821794 28506 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.822172 28506 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.825522 28462 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:01.862401 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:01.863300 27823 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.881968 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:01.883461 27754 raft_consensus.cc:2393] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 2: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
W20260709 13:13:01.887687 27791 leader_election.cc:336] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.830052 28478 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.830101 28506 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.838502 28403 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:01.840420 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ff1f63fbf04422b661a09729f3285f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:01.897508 28506 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.898118 27750 raft_consensus.cc:3060] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.897750 28403 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.850611 28505 raft_consensus.cc:493] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.900458 28505 raft_consensus.cc:515] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.902987 28505 leader_election.cc:290] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:01.903072 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
W20260709 13:13:01.903622 27865 leader_election.cc:336] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.904049 27897 raft_consensus.cc:2393] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 2: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:13:01.905306 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:01.906571 27827 raft_consensus.cc:2393] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 68036e839a414adf854b602c1ee70066 in current term 2: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:13:01.908639 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:01.909407 27824 raft_consensus.cc:2468] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:13:01.910276 27866 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:01.911145 28403 raft_consensus.cc:2749] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.911937 27718 leader_election.cc:304] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:01.918510 27901 raft_consensus.cc:2393] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 2: Already voted for candidate 68036e839a414adf854b602c1ee70066 in this term.
I20260709 13:13:01.919543 28501 raft_consensus.cc:2804] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.920297 28501 raft_consensus.cc:493] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:01.920871 28501 raft_consensus.cc:3060] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.933928 27824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
W20260709 13:13:01.934877 27865 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.934903 27824 raft_consensus.cc:2393] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 68036e839a414adf854b602c1ee70066 in current term 2: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:13:01.935990 28478 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:01.939262 27866 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:01.940841 28403 raft_consensus.cc:2749] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.944702 27823 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:13:01.950177 27750 raft_consensus.cc:2468] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
I20260709 13:13:01.952972 27718 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:01.954005 28503 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.957068 28503 raft_consensus.cc:697] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:01.958391 28503 consensus_queue.cc:237] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.945298 28495 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.962760 28495 tablet_bootstrap.cc:492] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:01.963508 28495 ts_tablet_manager.cc:1403] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.344s	user 0.099s	sys 0.079s
I20260709 13:13:01.966413 28495 raft_consensus.cc:359] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:01.967115 28495 raft_consensus.cc:740] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
W20260709 13:13:01.968503 27717 leader_election.cc:336] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.969035 27717 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:01.969754 28505 raft_consensus.cc:2749] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:01.970475 27791 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.970917 27791 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:13:01.971678 28506 raft_consensus.cc:2749] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:01.972839 27791 leader_election.cc:336] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:01.973318 27791 leader_election.cc:336] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.973675 27791 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:01.975685 28506 raft_consensus.cc:2749] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:01.970001 27717 leader_election.cc:336] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.949980 28501 raft_consensus.cc:515] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:01.978832 28501 leader_election.cc:290] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
W20260709 13:13:01.980259 27717 leader_election.cc:336] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.980605 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189c1d4fe48745baac57eb71662d27b1" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:01.981221 27823 raft_consensus.cc:3060] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:01.987876 27717 leader_election.cc:336] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:01.988718 28495 consensus_queue.cc:260] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:01.990933 27823 raft_consensus.cc:2468] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:13:01.992321 27718 leader_election.cc:304] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.993525 28501 raft_consensus.cc:2804] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.996832 27791 leader_election.cc:304] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:01.997972 28495 ts_tablet_manager.cc:1434] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:13:01.999087 28495 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.004739 28381 raft_consensus.cc:2804] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.005385 28381 raft_consensus.cc:697] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:02.006387 28381 consensus_queue.cc:237] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.006701 27576 catalog_manager.cc:5697] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 1 to 2, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 2 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.006913 28501 raft_consensus.cc:697] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:02.011781 28501 consensus_queue.cc:237] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:13:02.051479 27791 leader_election.cc:336] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:02.056730 27791 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:13:02.059003 28381 raft_consensus.cc:2749] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.066203 27574 catalog_manager.cc:5697] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 1 to 2, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.133049 28495 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.134038 28495 tablet_bootstrap.cc:492] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.134732 28495 ts_tablet_manager.cc:1403] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.004s
I20260709 13:13:02.137517 28495 raft_consensus.cc:359] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.138234 28495 raft_consensus.cc:740] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.138985 28495 consensus_queue.cc:260] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.144718 27574 catalog_manager.cc:5697] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 1 to 2, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 2 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.145906 28495 ts_tablet_manager.cc:1434] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:13:02.147008 28495 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.178092 28495 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.179118 28495 tablet_bootstrap.cc:492] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.179792 28495 ts_tablet_manager.cc:1403] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.000s
I20260709 13:13:02.182435 28495 raft_consensus.cc:359] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.183164 28495 raft_consensus.cc:740] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.185083 28495 consensus_queue.cc:260] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.186936 28495 ts_tablet_manager.cc:1434] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:13:02.187887 28495 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.199636 18095 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:13:02.200088 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.872s	user 0.313s	sys 0.011s
I20260709 13:13:02.210855 28495 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.211998 28495 tablet_bootstrap.cc:492] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.212741 28495 ts_tablet_manager.cc:1403] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.015s
I20260709 13:13:02.215430 28495 raft_consensus.cc:359] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.216078 28495 raft_consensus.cc:740] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.216728 28495 consensus_queue.cc:260] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.218783 28495 ts_tablet_manager.cc:1434] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:02.219735 28495 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.261155 28495 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.262315 28495 tablet_bootstrap.cc:492] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.263473 28495 ts_tablet_manager.cc:1403] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.006s
I20260709 13:13:02.267109 28495 raft_consensus.cc:359] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.268288 28495 raft_consensus.cc:740] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.269236 28495 consensus_queue.cc:260] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.272588 28495 ts_tablet_manager.cc:1434] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:02.273762 28495 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.333034 28495 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.334065 28495 tablet_bootstrap.cc:492] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.334738 28495 ts_tablet_manager.cc:1403] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.013s
I20260709 13:13:02.337388 28495 raft_consensus.cc:359] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.338096 28495 raft_consensus.cc:740] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.339686 28495 consensus_queue.cc:260] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.341988 28495 ts_tablet_manager.cc:1434] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:02.342813 28495 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.397835 28495 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.398891 28495 tablet_bootstrap.cc:492] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.399603 28495 ts_tablet_manager.cc:1403] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.019s
I20260709 13:13:02.402537 28495 raft_consensus.cc:359] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.403301 28495 raft_consensus.cc:740] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.404100 28495 consensus_queue.cc:260] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.406965 28495 ts_tablet_manager.cc:1434] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.010s	sys 0.000s
I20260709 13:13:02.408035 28495 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
W20260709 13:13:02.440651 27717 consensus_peers.cc:597] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.441069 28495 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.442198 28495 tablet_bootstrap.cc:492] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.442948 28495 ts_tablet_manager.cc:1403] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.016s
I20260709 13:13:02.446194 28495 raft_consensus.cc:359] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.446950 28495 raft_consensus.cc:740] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.447707 28495 consensus_queue.cc:260] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.450126 28495 ts_tablet_manager.cc:1434] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:02.451059 28495 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
W20260709 13:13:02.452448 27791 consensus_peers.cc:597] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.484758 28495 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.485867 28495 tablet_bootstrap.cc:492] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.486555 28495 ts_tablet_manager.cc:1403] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.008s
I20260709 13:13:02.489661 28495 raft_consensus.cc:359] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.490396 28495 raft_consensus.cc:740] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.491226 28495 consensus_queue.cc:260] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.493607 28495 ts_tablet_manager.cc:1434] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:13:02.494556 28495 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.518953 28495 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.519989 28495 tablet_bootstrap.cc:492] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.520706 28495 ts_tablet_manager.cc:1403] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 13:13:02.523512 28495 raft_consensus.cc:359] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.524370 28495 raft_consensus.cc:740] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.525306 28495 consensus_queue.cc:260] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.527712 28495 ts_tablet_manager.cc:1434] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:13:02.528676 28495 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
W20260709 13:13:02.522656 27791 consensus_peers.cc:597] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.539240 27824 raft_consensus.cc:1275] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.540814 28503 consensus_queue.cc:1048] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.552040 28495 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.553205 28495 tablet_bootstrap.cc:492] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.553871 28495 ts_tablet_manager.cc:1403] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:13:02.556777 28495 raft_consensus.cc:359] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.557500 28495 raft_consensus.cc:740] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.558419 28495 consensus_queue.cc:260] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.562407 28495 ts_tablet_manager.cc:1434] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:02.563335 28495 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.583406 27823 raft_consensus.cc:1275] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.585139 28503 consensus_queue.cc:1048] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.586339 28495 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.587564 28495 tablet_bootstrap.cc:492] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.588279 28495 ts_tablet_manager.cc:1403] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:13:02.602063 28495 raft_consensus.cc:359] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.602854 28495 raft_consensus.cc:740] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.606693 28495 consensus_queue.cc:260] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.609997 28495 ts_tablet_manager.cc:1434] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:13:02.610917 28495 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.630205 28495 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.631240 28495 tablet_bootstrap.cc:492] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.631923 28495 ts_tablet_manager.cc:1403] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:13:02.635178 28495 raft_consensus.cc:359] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.635984 28495 raft_consensus.cc:740] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.636880 28495 consensus_queue.cc:260] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.639367 28495 ts_tablet_manager.cc:1434] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:02.640275 28495 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
W20260709 13:13:02.645011 27717 consensus_peers.cc:597] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.647789 27750 raft_consensus.cc:1275] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.665499 28498 raft_consensus.cc:493] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.666191 28498 raft_consensus.cc:515] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.676530 28495 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.676187 28498 leader_election.cc:290] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:02.678503 28495 tablet_bootstrap.cc:492] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.679519 28495 ts_tablet_manager.cc:1403] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.003s
I20260709 13:13:02.685497 28495 raft_consensus.cc:359] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.686435 28495 raft_consensus.cc:740] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.687265 28495 consensus_queue.cc:260] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:02.702570 28498 raft_consensus.cc:493] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.717167 28498 raft_consensus.cc:515] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:02.721949 28498 leader_election.cc:290] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
W20260709 13:13:02.714291 27865 consensus_peers.cc:597] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.758206 27791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.194:38543, user_credentials={real_user=slave}} blocked reactor thread for 59876.3us
I20260709 13:13:02.770591 28495 ts_tablet_manager.cc:1434] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.091s	user 0.010s	sys 0.002s
W20260709 13:13:02.772392 27717 consensus_peers.cc:597] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.772058 28495 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.777161 28473 consensus_queue.cc:1048] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:02.775566 27717 consensus_peers.cc:597] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.784005 27865 consensus_peers.cc:597] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.812147 27791 consensus_peers.cc:597] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.817926 27791 consensus_peers.cc:597] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.819382 27791 consensus_peers.cc:597] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.820511 27791 consensus_peers.cc:597] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.821573 27791 consensus_peers.cc:597] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.845655 27717 consensus_peers.cc:597] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.851871 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1db39393c244cabaa23bd30f42faf0" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
W20260709 13:13:02.899629 27717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 53145.3us
I20260709 13:13:02.900596 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:13:02.920161 27865 consensus_peers.cc:597] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.920359 27717 consensus_peers.cc:597] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:02.921701 27717 consensus_peers.cc:597] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.941641 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0194dc3b668440ceaa960a9b2ffbf646" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:02.942755 28495 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.943337 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1db39393c244cabaa23bd30f42faf0" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:02.943830 28495 tablet_bootstrap.cc:492] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:02.944605 28495 ts_tablet_manager.cc:1403] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.173s	user 0.026s	sys 0.009s
I20260709 13:13:02.945677 28490 leader_election.cc:304] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:02.947537 28495 raft_consensus.cc:359] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.948344 28495 raft_consensus.cc:740] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.948576 28490 leader_election.cc:304] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a; no voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066
I20260709 13:13:02.949854 28597 raft_consensus.cc:2749] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.950541 28597 raft_consensus.cc:2749] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.954730 27791 consensus_peers.cc:597] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.955312 28495 consensus_queue.cc:260] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:02.959735 28495 ts_tablet_manager.cc:1434] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:02.960645 28495 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:02.967991 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:35225
I20260709 13:13:02.968151 28611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:35225 every 8 connection(s)
W20260709 13:13:02.969286 27717 consensus_peers.cc:597] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.010125 28495 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.011122 28495 tablet_bootstrap.cc:492] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.029772 28495 ts_tablet_manager.cc:1403] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.008s
W20260709 13:13:03.032518 27717 consensus_peers.cc:597] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.033272 27717 consensus_peers.cc:597] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.044970 27791 consensus_peers.cc:597] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.046563 27791 consensus_peers.cc:597] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.047200 27791 consensus_peers.cc:597] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:03.049803 27791 consensus_peers.cc:597] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.052487 28495 raft_consensus.cc:359] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.053258 28495 raft_consensus.cc:740] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
W20260709 13:13:03.057777 27791 consensus_peers.cc:597] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.060781 28495 consensus_queue.cc:260] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.063067 28495 ts_tablet_manager.cc:1434] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:13:03.063889 28495 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.089723 28495 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.090732 28495 tablet_bootstrap.cc:492] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.091828 28495 ts_tablet_manager.cc:1403] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.005s
I20260709 13:13:03.092504 28612 heartbeater.cc:344] Connected to a master server at 127.17.171.254:33607
I20260709 13:13:03.092994 28612 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:03.093981 28612 heartbeater.cc:507] Master 127.17.171.254:33607 requested a full tablet report, sending...
I20260709 13:13:03.096872 28495 raft_consensus.cc:359] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.097818 28495 raft_consensus.cc:740] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.098621 28495 consensus_queue.cc:260] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.103595 28495 ts_tablet_manager.cc:1434] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:03.106567 28495 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.125407 28495 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.126688 28495 tablet_bootstrap.cc:492] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.127368 28495 ts_tablet_manager.cc:1403] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:13:03.128809 27574 ts_manager.cc:194] Re-registered known tserver with Master: 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:03.129886 28495 raft_consensus.cc:359] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.130977 28495 raft_consensus.cc:740] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.131619 28495 consensus_queue.cc:260] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.133493 28495 ts_tablet_manager.cc:1434] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:03.134161 28495 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.154716 28495 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.155782 28495 tablet_bootstrap.cc:492] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.156529 28495 ts_tablet_manager.cc:1403] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:13:03.163218 28495 raft_consensus.cc:359] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.165902 28495 raft_consensus.cc:740] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.166729 28495 consensus_queue.cc:260] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:13:03.167125 27791 consensus_peers.cc:597] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.169382 28495 ts_tablet_manager.cc:1434] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:13:03.170421 28495 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.177114 27574 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50212
I20260709 13:13:03.182665 28612 heartbeater.cc:499] Master 127.17.171.254:33607 was elected leader, sending a full tablet report...
I20260709 13:13:03.189105 28495 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.190184 28495 tablet_bootstrap.cc:492] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.191073 28495 ts_tablet_manager.cc:1403] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:13:03.193787 28495 raft_consensus.cc:359] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.194526 28495 raft_consensus.cc:740] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.195286 28495 consensus_queue.cc:260] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.197868 28495 ts_tablet_manager.cc:1434] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:03.198774 28495 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.216125 28495 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.217173 28495 tablet_bootstrap.cc:492] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.217830 28495 ts_tablet_manager.cc:1403] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:13:03.220645 28495 raft_consensus.cc:359] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.221349 28495 raft_consensus.cc:740] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.222036 28495 consensus_queue.cc:260] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.224299 28495 ts_tablet_manager.cc:1434] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:13:03.225132 28495 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.242395 28495 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.243362 28495 tablet_bootstrap.cc:492] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.244076 28495 ts_tablet_manager.cc:1403] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 13:13:03.246752 28495 raft_consensus.cc:359] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.247457 28495 raft_consensus.cc:740] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.248147 28495 consensus_queue.cc:260] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.250406 28495 ts_tablet_manager.cc:1434] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:03.251222 28495 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.267976 28495 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.269467 28495 tablet_bootstrap.cc:492] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.270489 28495 ts_tablet_manager.cc:1403] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:13:03.273164 28495 raft_consensus.cc:359] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.273874 28495 raft_consensus.cc:740] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.274564 28495 consensus_queue.cc:260] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.274951 28554 raft_consensus.cc:3060] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.276754 28495 ts_tablet_manager.cc:1434] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:03.277691 28495 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.303508 28495 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.304699 28495 tablet_bootstrap.cc:492] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.305516 28495 ts_tablet_manager.cc:1403] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.012s
W20260709 13:13:03.307735 27717 consensus_peers.cc:597] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.308468 28495 raft_consensus.cc:359] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.309209 28495 raft_consensus.cc:740] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.310276 28495 consensus_queue.cc:260] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.312475 28495 ts_tablet_manager.cc:1434] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:03.313301 28495 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.355317 28495 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.356362 28495 tablet_bootstrap.cc:492] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.357014 28495 ts_tablet_manager.cc:1403] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.008s
I20260709 13:13:03.359587 28495 raft_consensus.cc:359] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.360309 28495 raft_consensus.cc:740] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.361035 28495 consensus_queue.cc:260] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.363498 28495 ts_tablet_manager.cc:1434] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:03.364954 28495 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.424984 28495 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.429790 28495 tablet_bootstrap.cc:492] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.430599 28495 ts_tablet_manager.cc:1403] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.020s
I20260709 13:13:03.433519 28495 raft_consensus.cc:359] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:03.434813 28495 raft_consensus.cc:740] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.435599 28495 consensus_queue.cc:260] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:03.442622 28495 ts_tablet_manager.cc:1434] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:03.443490 28495 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.465327 28495 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.466348 28495 tablet_bootstrap.cc:492] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.467072 28495 ts_tablet_manager.cc:1403] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:13:03.472054 28495 raft_consensus.cc:359] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.473851 28495 raft_consensus.cc:740] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.474658 28495 consensus_queue.cc:260] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.477206 28495 ts_tablet_manager.cc:1434] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:03.478689 28495 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
W20260709 13:13:03.498565 27791 consensus_peers.cc:597] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.498806 28495 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.499856 28495 tablet_bootstrap.cc:492] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.500593 28495 ts_tablet_manager.cc:1403] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:13:03.503343 28495 raft_consensus.cc:359] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.504143 28495 raft_consensus.cc:740] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.505064 28495 consensus_queue.cc:260] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.507678 28495 ts_tablet_manager.cc:1434] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:13:03.508819 28495 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.521183 28607 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.521718 28607 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.524603 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:03.525005 28553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:13:03.525275 27897 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
W20260709 13:13:03.526638 27791 leader_election.cc:343] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.527186 28607 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:03.529894 27794 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:03.530697 28607 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.531059 28607 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.531368 28607 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.537693 28495 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.538628 28495 tablet_bootstrap.cc:492] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.538625 28607 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.539476 28495 ts_tablet_manager.cc:1403] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 13:13:03.540838 28591 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.540880 28607 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:03.541618 28607 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.541493 28591 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.542057 28607 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.542403 28495 raft_consensus.cc:359] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.543107 28495 raft_consensus.cc:740] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.544358 28607 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:03.544694 28495 consensus_queue.cc:260] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:03.545281 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:03.545959 27750 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
I20260709 13:13:03.548796 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:03.549379 27901 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.549882 27791 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:03.550251 28554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:13:03.551542 28552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:13:03.551867 28495 ts_tablet_manager.cc:1434] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:03.551983 28607 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.552232 28552 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:13:03.552533 28607 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.552816 28495 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.552913 28607 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.555943 28553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:13:03.556600 28553 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 1.
I20260709 13:13:03.558492 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:03.563501 27901 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 3.
W20260709 13:13:03.571134 27791 leader_election.cc:343] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.572604 27717 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:03.573434 28501 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.573837 28501 raft_consensus.cc:493] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.574159 28501 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.586040 27794 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:03.543900 28591 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:03.585911 28501 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.589501 28506 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.590049 28506 raft_consensus.cc:697] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:03.590932 28506 consensus_queue.cc:237] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.592290 28607 raft_consensus.cc:515] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.594563 27825 raft_consensus.cc:2393] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 3: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:13:03.596779 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:03.593538 28553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:13:03.602587 28553 raft_consensus.cc:3060] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.605780 28495 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.606894 28495 tablet_bootstrap.cc:492] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.607571 28495 ts_tablet_manager.cc:1403] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.019s
I20260709 13:13:03.616393 28606 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.616931 28606 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.617131 28495 raft_consensus.cc:359] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.618006 28495 raft_consensus.cc:740] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.618963 28606 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:03.618738 28495 consensus_queue.cc:260] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.620718 28495 ts_tablet_manager.cc:1434] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:13:03.620626 28554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a" is_pre_election: true
I20260709 13:13:03.621460 28554 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 1.
I20260709 13:13:03.621744 28495 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.622854 27791 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:13:03.629483 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:03.630179 27901 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
I20260709 13:13:03.634774 28592 raft_consensus.cc:2804] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:03.635167 28592 raft_consensus.cc:493] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.635609 28592 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.643558 28495 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.644677 28495 tablet_bootstrap.cc:492] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.643389 28592 raft_consensus.cc:515] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.597615 27827 raft_consensus.cc:2393] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dabb1961ed804fee806c7e46eedef86d in current term 3: Already voted for candidate 591cc7bfde9f4ddfbf2460174879d675 in this term.
I20260709 13:13:03.599267 28607 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:03.601169 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:03.650202 27750 raft_consensus.cc:2393] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 591cc7bfde9f4ddfbf2460174879d675 in current term 3: Already voted for candidate dabb1961ed804fee806c7e46eedef86d in this term.
I20260709 13:13:03.601172 28552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f2dcad5345411ba79433efc6545618" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:13:03.645398 28495 ts_tablet_manager.cc:1403] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:13:03.655004 28495 raft_consensus.cc:359] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.655704 28495 raft_consensus.cc:740] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.656513 28495 consensus_queue.cc:260] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.660713 27574 catalog_manager.cc:5697] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 1 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.593720 28501 leader_election.cc:290] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:03.668005 28592 leader_election.cc:290] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:03.671115 28495 ts_tablet_manager.cc:1434] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:13:03.671491 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:03.677292 27897 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.677642 28495 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.674422 27791 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:03.675575 28552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5017019a2944f28b6055421fe3a6e4f" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
I20260709 13:13:03.680846 28552 raft_consensus.cc:3060] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.688464 28552 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 3.
I20260709 13:13:03.689559 28592 raft_consensus.cc:2749] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:13:03.691944 28553 raft_consensus.cc:2468] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
W20260709 13:13:03.693650 27718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 56783.2us
I20260709 13:13:03.694927 27717 leader_election.cc:304] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:03.698096 28637 raft_consensus.cc:2804] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.698627 28637 raft_consensus.cc:697] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:03.699501 28637 consensus_queue.cc:237] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.715997 27791 leader_election.cc:304] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:13:03.723625 28506 raft_consensus.cc:2804] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:03.730289 28506 raft_consensus.cc:697] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:03.731335 28506 consensus_queue.cc:237] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.749702 27577 catalog_manager.cc:5697] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 1 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 3 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.756138 27897 raft_consensus.cc:2468] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 3.
I20260709 13:13:03.768024 28495 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.769081 28495 tablet_bootstrap.cc:492] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.769738 28495 ts_tablet_manager.cc:1403] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.020s
I20260709 13:13:03.772961 28495 raft_consensus.cc:359] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.773633 28495 raft_consensus.cc:740] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.774474 28495 consensus_queue.cc:260] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.782294 28495 ts_tablet_manager.cc:1434] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:03.783178 28495 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.828887 27576 catalog_manager.cc:5697] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 1 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.830520 28495 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.831525 28495 tablet_bootstrap.cc:492] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.832398 28495 ts_tablet_manager.cc:1403] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.020s
I20260709 13:13:03.834975 28495 raft_consensus.cc:359] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.835639 28495 raft_consensus.cc:740] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.838100 28495 consensus_queue.cc:260] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.840615 28495 ts_tablet_manager.cc:1434] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:03.841396 28495 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.873009 28495 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.873984 28495 tablet_bootstrap.cc:492] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.875039 28495 ts_tablet_manager.cc:1403] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.006s
I20260709 13:13:03.877578 28495 raft_consensus.cc:359] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.878254 28495 raft_consensus.cc:740] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.878921 28495 consensus_queue.cc:260] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:03.880596 28495 ts_tablet_manager.cc:1434] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:03.881318 28495 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.913313 28495 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.914296 28495 tablet_bootstrap.cc:492] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.914999 28495 ts_tablet_manager.cc:1403] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.034s	user 0.027s	sys 0.003s
I20260709 13:13:03.917646 28495 raft_consensus.cc:359] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.918392 28495 raft_consensus.cc:740] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.919083 28495 consensus_queue.cc:260] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.920652 28495 ts_tablet_manager.cc:1434] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:03.921446 28495 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.952466 28495 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.953933 28495 tablet_bootstrap.cc:492] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:03.954604 28495 ts_tablet_manager.cc:1403] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.004s
I20260709 13:13:03.957376 28495 raft_consensus.cc:359] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.958029 28495 raft_consensus.cc:740] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.958788 28495 consensus_queue.cc:260] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:03.960822 28495 ts_tablet_manager.cc:1434] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:03.962204 28495 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:03.999379 28495 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.000366 28495 tablet_bootstrap.cc:492] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:04.001039 28495 ts_tablet_manager.cc:1403] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.011s
I20260709 13:13:04.003639 28495 raft_consensus.cc:359] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:04.004326 28495 raft_consensus.cc:740] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.005004 28495 consensus_queue.cc:260] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:04.007165 28495 ts_tablet_manager.cc:1434] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:04.016484 28495 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:04.027961 28552 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.042338 28495 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.044395 28495 tablet_bootstrap.cc:492] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:04.045045 28495 ts_tablet_manager.cc:1403] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:13:04.047561 28495 raft_consensus.cc:359] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:04.048266 28495 raft_consensus.cc:740] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.048887 28495 consensus_queue.cc:260] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:04.051028 28495 ts_tablet_manager.cc:1434] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:13:04.051811 28495 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:04.056648 28552 raft_consensus.cc:1275] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.061507 27897 raft_consensus.cc:1275] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.063269 28506 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.066614 28506 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.076498 28495 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.077622 28495 tablet_bootstrap.cc:492] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:04.078439 28495 ts_tablet_manager.cc:1403] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.007s
I20260709 13:13:04.081065 28495 raft_consensus.cc:359] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:04.081724 28495 raft_consensus.cc:740] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.082386 28495 consensus_queue.cc:260] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:04.084599 28495 ts_tablet_manager.cc:1434] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:04.085351 28495 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:04.089075 27827 raft_consensus.cc:1275] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.093957 28641 consensus_queue.cc:1048] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.133181 28495 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.134312 28495 tablet_bootstrap.cc:492] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:04.135020 28495 ts_tablet_manager.cc:1403] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.010s
I20260709 13:13:04.152237 28554 raft_consensus.cc:1275] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.154984 28495 raft_consensus.cc:359] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:04.158056 28495 raft_consensus.cc:740] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.158949 28495 consensus_queue.cc:260] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:04.161073 28495 ts_tablet_manager.cc:1434] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:13:04.162230 28495 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:04.163538 28554 raft_consensus.cc:1275] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.165433 28641 consensus_queue.cc:1048] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.175874 28606 consensus_queue.cc:1048] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.197206 27897 raft_consensus.cc:1275] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:04.198729 28506 consensus_queue.cc:1048] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.199433 28495 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.200484 28495 tablet_bootstrap.cc:492] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:04.201249 28495 ts_tablet_manager.cc:1403] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.010s
I20260709 13:13:04.203984 28495 raft_consensus.cc:359] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:04.205129 28495 raft_consensus.cc:740] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.205910 28495 consensus_queue.cc:260] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:04.207641 28495 ts_tablet_manager.cc:1434] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:04.208484 28495 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap starting.
I20260709 13:13:04.232949 28495 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:04.235042 28495 tablet_bootstrap.cc:492] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Bootstrap complete.
I20260709 13:13:04.235967 28495 ts_tablet_manager.cc:1403] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 13:13:04.239586 28495 raft_consensus.cc:359] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:04.246354 28495 raft_consensus.cc:740] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.247124 28495 consensus_queue.cc:260] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:04.249835 28495 ts_tablet_manager.cc:1434] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.004s
I20260709 13:13:04.248402 28552 raft_consensus.cc:3060] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.401419 28550 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.055426 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.108532 27825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28693539a08d46a585b795a22f78252c"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:13.109385 27825 raft_consensus.cc:606] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:13.123799 27750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "68036e839a414adf854b602c1ee70066"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:13.124303 27750 raft_consensus.cc:606] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Received request to transfer leadership to TS 68036e839a414adf854b602c1ee70066
I20260709 13:13:13.127269 27825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:13.127949 27825 raft_consensus.cc:606] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:13.130836 27827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:13.131304 27827 raft_consensus.cc:606] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:13.133723 27827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:13.134200 27827 raft_consensus.cc:606] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:13.136523 27827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:13.137133 27827 raft_consensus.cc:606] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:13.138480 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:13.140355 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:13.192690 28689 raft_consensus.cc:993] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.194571 28699 raft_consensus.cc:1081] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.197018 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:13.197693 28550 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.198109 28550 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.207485 28550 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.210955 28550 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:13.211766 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:13.212615 27901 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.213024 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:13.213615 27825 raft_consensus.cc:3055] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.213869 27825 raft_consensus.cc:740] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:13.214669 27825 consensus_queue.cc:260] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.216040 27825 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.219815 28700 raft_consensus.cc:993] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.220435 28689 raft_consensus.cc:1081] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.222113 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28693539a08d46a585b795a22f78252c"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:13.222720 28550 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.223081 28550 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.225394 27825 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.227002 28490 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:13:13.229125 28702 raft_consensus.cc:2804] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.237052 28702 raft_consensus.cc:697] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:13.238421 27901 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.238989 28702 consensus_queue.cc:237] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.237926 28550 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.243175 28550 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 4 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:13.243875 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:13.244563 27825 raft_consensus.cc:3055] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:13.244890 27825 raft_consensus.cc:740] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:13.245154 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:13.246202 27901 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.246217 27825 consensus_queue.cc:260] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.247763 28700 raft_consensus.cc:993] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.248052 27825 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:13.248312 28700 raft_consensus.cc:1081] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.259470 27901 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 4.
I20260709 13:13:13.261054 28492 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:13.263464 27825 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 4.
I20260709 13:13:13.264546 28704 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:13.267287 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:13.267889 28550 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.268280 28550 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.275103 28550 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:13.275924 28704 raft_consensus.cc:697] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 4 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:13.277393 28550 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:13.277174 28704 consensus_queue.cc:237] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.278152 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:13.278766 27750 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.278982 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:13.279564 27825 raft_consensus.cc:3055] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.279882 27825 raft_consensus.cc:740] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:13.280687 27825 consensus_queue.cc:260] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:13.282198 27825 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.283100 27573 catalog_manager.cc:5697] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.286326 27750 raft_consensus.cc:2468] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.289762 28489 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:13.290748 28704 raft_consensus.cc:2804] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.291237 28704 raft_consensus.cc:697] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:13.292135 28704 consensus_queue.cc:237] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:13.304658 27825 raft_consensus.cc:2468] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.320080 28695 raft_consensus.cc:993] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 68036e839a414adf854b602c1ee70066 to start an election
I20260709 13:13:13.320802 28693 raft_consensus.cc:1081] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Signalling peer 68036e839a414adf854b602c1ee70066 to start an election
I20260709 13:13:13.326300 27901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874"
dest_uuid: "68036e839a414adf854b602c1ee70066"
 from {username='slave'} at 127.0.0.1:46520
I20260709 13:13:13.326808 27901 raft_consensus.cc:493] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.327116 27901 raft_consensus.cc:3060] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.332504 27901 raft_consensus.cc:515] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:13.335480 27901 leader_election.cc:290] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:13.337940 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:13.338061 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65d3519d610d4f459ce05058f1eea874" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:13.337499 27573 catalog_manager.cc:5697] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 3 to 4, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 4 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.338516 27750 raft_consensus.cc:3055] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.338701 27825 raft_consensus.cc:3060] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.338862 27750 raft_consensus.cc:740] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:13.339181 27573 catalog_manager.cc:5697] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.339779 27750 consensus_queue.cc:260] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:13.341231 27750 raft_consensus.cc:3060] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.343575 28700 raft_consensus.cc:993] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.344071 28700 raft_consensus.cc:1081] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.347293 28552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:13.348035 28552 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.348497 28552 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.349061 27750 raft_consensus.cc:2468] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:13.350327 27865 leader_election.cc:304] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:13.350917 27825 raft_consensus.cc:2468] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:13.351094 28701 raft_consensus.cc:2804] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.351696 28701 raft_consensus.cc:697] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:13.352814 28701 consensus_queue.cc:237] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:13.357622 28552 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:13.360699 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:13.360968 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:13.361626 27825 raft_consensus.cc:3055] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.362002 27825 raft_consensus.cc:740] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:13.362746 27825 consensus_queue.cc:260] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:13.363835 27825 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.361225 27750 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.368729 28552 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:13.369035 27573 catalog_manager.cc:5697] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 1 to 2, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.370564 27825 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.371687 28490 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:13:13.372686 28704 raft_consensus.cc:2804] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.373153 28704 raft_consensus.cc:697] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:13.373400 27750 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.374053 28704 consensus_queue.cc:237] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:13.388042 27576 catalog_manager.cc:5697] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.589658 28699 raft_consensus.cc:993] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.590121 28699 raft_consensus.cc:1081] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:13.591497 28552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:13.591938 28552 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.592259 28552 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.597831 28552 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.599200 28552 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:13.600091 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:13.600315 27901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:13.600716 27825 raft_consensus.cc:3055] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.600849 27901 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.601027 27825 raft_consensus.cc:740] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:13.601866 27825 consensus_queue.cc:260] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.602782 27825 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.605937 27901 raft_consensus.cc:2468] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.607314 28492 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:13.608136 28704 raft_consensus.cc:2804] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.608654 28704 raft_consensus.cc:697] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:13.609618 28704 consensus_queue.cc:237] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:13.608466 27825 raft_consensus.cc:2468] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:13.632464 27576 catalog_manager.cc:5697] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.661633 27827 raft_consensus.cc:1275] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:13.662755 28704 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.670382 27901 raft_consensus.cc:1275] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.672254 28704 consensus_queue.cc:1048] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.675716 27901 raft_consensus.cc:1275] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:13.681070 28706 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.714879 27825 raft_consensus.cc:1275] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.716285 28704 consensus_queue.cc:1048] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:13.760434 27720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.196:38641, user_credentials={real_user=slave}} blocked reactor thread for 67284.9us
I20260709 13:13:13.761435 27750 raft_consensus.cc:1275] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.768356 28702 consensus_queue.cc:1048] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.775110 27825 raft_consensus.cc:1275] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.778425 28724 consensus_queue.cc:1048] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.799489 27827 raft_consensus.cc:1275] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.801003 28724 consensus_queue.cc:1048] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.819789 27750 raft_consensus.cc:1275] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.821525 28724 consensus_queue.cc:1048] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.916216 27825 raft_consensus.cc:1275] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.917687 28701 consensus_queue.cc:1048] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.926887 27750 raft_consensus.cc:1275] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.930246 28703 consensus_queue.cc:1048] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.142315 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:14.142865 27825 raft_consensus.cc:1275] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.144271 28724 consensus_queue.cc:1048] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.153824 27901 raft_consensus.cc:1275] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.155370 28704 consensus_queue.cc:1048] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.242587 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:14.285043 27825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:14.285588 27825 raft_consensus.cc:606] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:14.287875 27825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:14.288399 27825 raft_consensus.cc:606] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:14.290494 27825 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:14.290932 27825 raft_consensus.cc:606] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:14.293398 27823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "68036e839a414adf854b602c1ee70066"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:14.294327 27823 raft_consensus.cc:606] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 68036e839a414adf854b602c1ee70066
I20260709 13:13:14.296819 27823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c748896fe9414667aaa260600a04970e"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:14.297446 27823 raft_consensus.cc:606] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:14.300191 27751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7e8866752254eff89e9da91504747ba"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "68036e839a414adf854b602c1ee70066"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:14.300765 27751 raft_consensus.cc:606] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Received request to transfer leadership to TS 68036e839a414adf854b602c1ee70066
I20260709 13:13:14.301992 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:14.303426 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:14.324939 28700 raft_consensus.cc:993] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.325469 28700 raft_consensus.cc:1081] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.326828 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:14.327201 28550 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.327425 28550 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.331836 28550 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:14.333511 28550 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:14.334229 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:14.334509 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:14.334846 27751 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.335040 27825 raft_consensus.cc:3055] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.335356 27825 raft_consensus.cc:740] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:14.336124 27825 consensus_queue.cc:260] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:14.337497 27825 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.342190 27751 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.343482 28489 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:14.344416 28704 raft_consensus.cc:2804] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.344416 27825 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.345187 28704 raft_consensus.cc:697] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:14.346132 28704 consensus_queue.cc:237] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:14.354188 28699 raft_consensus.cc:993] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.354655 28699 raft_consensus.cc:1081] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.356657 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:14.356082 27577 catalog_manager.cc:5697] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.357219 28550 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.357607 28550 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.365849 28550 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:14.368999 28550 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:14.369082 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:14.369815 27751 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.374504 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:14.376260 27825 raft_consensus.cc:3055] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.376678 27751 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.376727 27825 raft_consensus.cc:740] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:14.381345 27825 consensus_queue.cc:260] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:14.382376 27825 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.385790 28489 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:14.386732 28727 raft_consensus.cc:2804] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.387218 28727 raft_consensus.cc:697] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:14.388123 28727 consensus_queue.cc:237] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:14.391664 27825 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.402124 27577 catalog_manager.cc:5697] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.431900 28695 raft_consensus.cc:993] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 68036e839a414adf854b602c1ee70066 to start an election
I20260709 13:13:14.432471 28693 raft_consensus.cc:1081] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Signalling peer 68036e839a414adf854b602c1ee70066 to start an election
I20260709 13:13:14.434255 27897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7e8866752254eff89e9da91504747ba"
dest_uuid: "68036e839a414adf854b602c1ee70066"
 from {username='slave'} at 127.0.0.1:46520
I20260709 13:13:14.434733 27897 raft_consensus.cc:493] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.435060 27897 raft_consensus.cc:3060] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.442162 27897 raft_consensus.cc:515] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:14.443538 27897 leader_election.cc:290] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:14.444335 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e8866752254eff89e9da91504747ba" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:14.444494 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7e8866752254eff89e9da91504747ba" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:14.444939 27751 raft_consensus.cc:3055] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.445103 27825 raft_consensus.cc:3060] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.445253 27751 raft_consensus.cc:740] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:14.446101 27751 consensus_queue.cc:260] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:14.447393 27751 raft_consensus.cc:3060] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.450099 27825 raft_consensus.cc:2468] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:14.451288 27866 leader_election.cc:304] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:14.451997 28703 raft_consensus.cc:2804] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.452450 28703 raft_consensus.cc:697] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:14.452754 27751 raft_consensus.cc:2468] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:14.453368 28703 consensus_queue.cc:237] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:14.467583 27577 catalog_manager.cc:5697] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 1 to 2, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.648608 28699 raft_consensus.cc:993] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.649268 28742 raft_consensus.cc:1081] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.650702 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:14.651263 28550 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.651659 28550 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.657967 28550 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:14.659413 28550 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:14.660151 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:14.660369 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:14.660804 27825 raft_consensus.cc:3055] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.661054 27897 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.661237 27825 raft_consensus.cc:740] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:14.662153 27825 consensus_queue.cc:260] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:14.663264 27825 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.667192 27897 raft_consensus.cc:2468] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.668764 28492 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:14.669530 27825 raft_consensus.cc:2468] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.669700 28706 raft_consensus.cc:2804] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.670432 28706 raft_consensus.cc:697] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:14.671200 28706 consensus_queue.cc:237] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:14.681560 27577 catalog_manager.cc:5697] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.682860 28699 raft_consensus.cc:993] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.683457 28742 raft_consensus.cc:1081] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:14.684886 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c748896fe9414667aaa260600a04970e"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:14.685379 28550 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.685738 28550 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.701197 28550 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:14.702821 28550 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:14.703851 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:14.704701 27897 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.704862 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:14.705783 27825 raft_consensus.cc:3055] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.706105 27825 raft_consensus.cc:740] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:14.706975 27825 consensus_queue.cc:260] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:14.708263 27825 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.714933 27825 raft_consensus.cc:2468] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.716331 27897 raft_consensus.cc:2468] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:14.717505 28490 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:13:14.718340 28706 raft_consensus.cc:2804] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.718746 28706 raft_consensus.cc:697] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:14.719576 28706 consensus_queue.cc:237] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:14.731130 27577 catalog_manager.cc:5697] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.761554 27825 raft_consensus.cc:1275] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.762607 28706 consensus_queue.cc:1048] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.776865 27750 raft_consensus.cc:1275] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.776906 27751 raft_consensus.cc:1275] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.781659 28727 consensus_queue.cc:1048] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.783011 28704 consensus_queue.cc:1048] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.811537 27823 raft_consensus.cc:1275] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.813104 28704 consensus_queue.cc:1048] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.871389 28742 raft_consensus.cc:993] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 68036e839a414adf854b602c1ee70066 to start an election
I20260709 13:13:14.871889 28700 raft_consensus.cc:1081] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 68036e839a414adf854b602c1ee70066 to start an election
I20260709 13:13:14.873253 27897 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b"
dest_uuid: "68036e839a414adf854b602c1ee70066"
 from {username='slave'} at 127.0.0.1:46528
I20260709 13:13:14.873708 27897 raft_consensus.cc:493] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.874009 27897 raft_consensus.cc:3060] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.879230 27897 raft_consensus.cc:515] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:14.881172 27897 leader_election.cc:290] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:14.882298 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:14.882994 27750 raft_consensus.cc:3060] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.883610 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fb03199ba945afb863bc4d9e97011b" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:14.884968 27823 raft_consensus.cc:3055] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.885313 27823 raft_consensus.cc:740] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:14.886108 27823 consensus_queue.cc:260] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:14.887420 27823 raft_consensus.cc:3060] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.889639 27750 raft_consensus.cc:2468] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:14.890920 27865 leader_election.cc:304] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:14.891837 28703 raft_consensus.cc:2804] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.892963 28703 raft_consensus.cc:697] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:14.894241 28703 consensus_queue.cc:237] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:14.895555 27823 raft_consensus.cc:2468] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:14.905016 27576 catalog_manager.cc:5697] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 2 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.926237 27823 raft_consensus.cc:1275] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.927640 28703 consensus_queue.cc:1048] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.937000 27750 raft_consensus.cc:1275] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.940357 28703 consensus_queue.cc:1048] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.165047 27825 raft_consensus.cc:1275] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.166733 28753 consensus_queue.cc:1048] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.177651 27897 raft_consensus.cc:1275] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.179045 28706 consensus_queue.cc:1048] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.255113 27827 raft_consensus.cc:1275] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.256464 28753 consensus_queue.cc:1048] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.265594 27900 raft_consensus.cc:1275] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.267025 28704 consensus_queue.cc:1048] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.304360 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:15.341974 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:15.351657 27750 raft_consensus.cc:1275] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.353442 28703 consensus_queue.cc:1048] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.354950 27827 raft_consensus.cc:1275] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.356791 28703 consensus_queue.cc:1048] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.411255 27750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:15.412218 27750 raft_consensus.cc:606] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:15.415505 27750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:15.416252 27750 raft_consensus.cc:606] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:15.419109 27750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:15.419627 27750 raft_consensus.cc:606] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:15.422258 27750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:15.422825 27750 raft_consensus.cc:606] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:15.426090 27750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2"
dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
mode: GRACEFUL
new_leader_uuid: "591cc7bfde9f4ddfbf2460174879d675"
 from {username='slave'} at 127.0.0.1:59422
I20260709 13:13:15.426703 27750 raft_consensus.cc:606] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Received request to transfer leadership to TS 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:15.428234 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:15.430132 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:15.534736 28693 raft_consensus.cc:993] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.535413 28695 raft_consensus.cc:1081] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.537423 28552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:13:15.538018 28552 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.538470 28552 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.543620 28552 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:15.545202 28552 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 3 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:15.545998 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:15.546176 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:15.546819 27750 raft_consensus.cc:3055] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:15.546862 27827 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.547349 27750 raft_consensus.cc:740] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:15.548295 27750 consensus_queue.cc:260] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:15.549278 27750 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.553826 27827 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 3.
I20260709 13:13:15.556011 28490 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675; no voters: 
I20260709 13:13:15.556409 27750 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 3.
I20260709 13:13:15.556918 28753 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:15.557462 28753 raft_consensus.cc:697] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 3 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:15.558492 28753 consensus_queue.cc:237] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:15.568228 27577 catalog_manager.cc:5697] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 2 to 3, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 3 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.577924 28695 raft_consensus.cc:993] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.578418 28695 raft_consensus.cc:1081] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.579914 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:13:15.580502 28550 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.580847 28550 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.588083 28550 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:15.590083 28550 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:15.590868 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:15.590991 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:15.591696 27897 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.591773 27750 raft_consensus.cc:3055] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.592242 27750 raft_consensus.cc:740] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:15.593003 27750 consensus_queue.cc:260] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:15.594154 27750 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.598464 27897 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:15.599397 27750 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:15.599678 28492 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:15.600690 28753 raft_consensus.cc:2804] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.601190 28753 raft_consensus.cc:697] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:15.602023 28753 consensus_queue.cc:237] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:15.610857 27577 catalog_manager.cc:5697] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.638775 28693 raft_consensus.cc:993] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.639369 28695 raft_consensus.cc:1081] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.640787 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:13:15.641189 28550 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.641423 28550 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.646916 28550 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:15.648483 28550 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:15.649260 27897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:15.649605 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:15.649880 27897 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.650246 27750 raft_consensus.cc:3055] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.650555 27750 raft_consensus.cc:740] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:15.651232 27750 consensus_queue.cc:260] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:15.652128 27750 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.654963 27897 raft_consensus.cc:2468] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:15.656021 28492 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:15.656827 28753 raft_consensus.cc:2804] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.657267 28753 raft_consensus.cc:697] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:15.657277 27750 raft_consensus.cc:2468] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:15.658197 28753 consensus_queue.cc:237] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:15.668443 27577 catalog_manager.cc:5697] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.898676 28693 raft_consensus.cc:993] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 591cc7bfde9f4ddfbf2460174879d675 to start an election
I20260709 13:13:15.899158 28695 raft_consensus.cc:1081] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Signalling peer 591cc7bfde9f4ddfbf2460174879d675 to start an election
I20260709 13:13:15.900739 27823 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
 from {username='slave'} at 127.0.0.1:38208
I20260709 13:13:15.901338 27823 raft_consensus.cc:493] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.901629 27823 raft_consensus.cc:3060] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.906981 27823 raft_consensus.cc:515] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:15.909227 28693 raft_consensus.cc:993] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.909715 28695 raft_consensus.cc:1081] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:15.909914 27823 leader_election.cc:290] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:15.909962 27750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:15.911921 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64a4cec1f6f4dc2a7457fe97b3b2cb2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:15.913659 27750 raft_consensus.cc:3055] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.913829 27900 raft_consensus.cc:3060] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.914064 27750 raft_consensus.cc:740] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:15.915014 27750 consensus_queue.cc:260] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:15.917377 27750 raft_consensus.cc:3060] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.925460 27750 raft_consensus.cc:2468] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
I20260709 13:13:15.926163 28550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45072
I20260709 13:13:15.926812 28550 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.927214 28550 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.927294 27791 leader_election.cc:304] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:15.928066 28699 raft_consensus.cc:2804] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.928639 28699 raft_consensus.cc:697] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:15.929687 27900 raft_consensus.cc:2468] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
I20260709 13:13:15.929563 28699 consensus_queue.cc:237] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } }
I20260709 13:13:15.935761 28550 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:15.938381 28550 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 3 election: Requested vote from peers dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:15.938620 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:15.939208 27754 raft_consensus.cc:3055] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:15.939496 27754 raft_consensus.cc:740] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:15.940537 27754 consensus_queue.cc:260] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:15.942019 27754 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.959467 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:15.960127 27823 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:15.963639 27754 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 3.
I20260709 13:13:15.964762 28489 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:15.965675 28706 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:15.966151 28706 raft_consensus.cc:697] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:15.966238 27577 catalog_manager.cc:5697] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 1 to 2, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.967031 28706 consensus_queue.cc:237] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:15.967615 27823 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 3.
I20260709 13:13:15.980912 27577 catalog_manager.cc:5697] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 2 to 3, leader changed from dabb1961ed804fee806c7e46eedef86d (127.17.171.194) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 3 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.077657 27827 raft_consensus.cc:1275] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:16.080744 28706 consensus_queue.cc:1048] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:16.091185 27750 raft_consensus.cc:1275] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:16.092718 28706 consensus_queue.cc:1048] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:16.134120 27900 raft_consensus.cc:1275] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.135742 28704 consensus_queue.cc:1048] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.147883 27754 raft_consensus.cc:1275] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.149799 27897 raft_consensus.cc:1275] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.150688 28753 consensus_queue.cc:1048] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.152400 28753 consensus_queue.cc:1048] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.156644 27750 raft_consensus.cc:1275] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.158725 28704 consensus_queue.cc:1048] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:16.400759 27750 raft_consensus.cc:1275] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:16.402480 28706 consensus_queue.cc:1048] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.413815 27823 raft_consensus.cc:1275] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer 1da14a10b312403c91c2ff8aa9d0338a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:16.419209 28706 consensus_queue.cc:1048] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.431044 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.452927 27750 raft_consensus.cc:1275] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.454321 28776 consensus_queue.cc:1048] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.475664 27897 raft_consensus.cc:1275] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.477345 28776 consensus_queue.cc:1048] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.502812 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.546651 27823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6"
dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
mode: GRACEFUL
new_leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:50512
I20260709 13:13:16.547278 27823 raft_consensus.cc:606] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Received request to transfer leadership to TS 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:16.548810 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:16.550669 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:17.500528 28796 raft_consensus.cc:993] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: : Instructing follower 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:17.508633 28796 raft_consensus.cc:1081] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Signalling peer 1da14a10b312403c91c2ff8aa9d0338a to start an election
I20260709 13:13:17.519752 28552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6"
dest_uuid: "1da14a10b312403c91c2ff8aa9d0338a"
 from {username='slave'} at 127.0.0.1:45084
I20260709 13:13:17.520354 28552 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.520712 28552 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.537182 28552 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:17.539325 28552 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641)
I20260709 13:13:17.540222 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:17.540910 27896 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.545032 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "1da14a10b312403c91c2ff8aa9d0338a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:17.545706 27823 raft_consensus.cc:3055] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:17.545969 27823 raft_consensus.cc:740] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:17.546566 27823 consensus_queue.cc:260] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:17.547447 27823 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.547789 27896 raft_consensus.cc:2468] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:17.548931 28492 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:17.549695 28815 raft_consensus.cc:2804] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:17.550398 28815 raft_consensus.cc:697] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Becoming Leader. State: Replica: 1da14a10b312403c91c2ff8aa9d0338a, State: Running, Role: LEADER
I20260709 13:13:17.551096 28815 consensus_queue.cc:237] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:17.552435 27823 raft_consensus.cc:2468] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da14a10b312403c91c2ff8aa9d0338a in term 2.
I20260709 13:13:17.562022 27577 catalog_manager.cc:5697] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a reported cstate change: term changed from 1 to 2, leader changed from 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195) to 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193). New cstate: current_term: 2 leader_uuid: "1da14a10b312403c91c2ff8aa9d0338a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.688301 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:17.721877 18095 tablet_server.cc:179] TabletServer@127.17.171.193:35225 shutting down...
W20260709 13:13:17.763397 27791 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 238 similar messages]
I20260709 13:13:17.765221 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.766332 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.767324 18095 raft_consensus.cc:2243] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.767819 18095 raft_consensus.cc:2272] T 017321988c03432fa294e969af945a82 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.770038 27791 consensus_peers.cc:597] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.771003 18095 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.771047 27791 consensus_peers.cc:597] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.771852 27791 consensus_peers.cc:597] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.772027 18095 raft_consensus.cc:2243] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:17.772572 27791 consensus_peers.cc:597] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.773123 18095 raft_consensus.cc:2272] T 82ca1906db13410aac9f2a4d0d6969ed P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.776217 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.776813 18095 raft_consensus.cc:2243] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.777338 18095 raft_consensus.cc:2272] T 189c1d4fe48745baac57eb71662d27b1 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.780133 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.780710 18095 raft_consensus.cc:2243] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.781389 18095 raft_consensus.cc:2272] T 8fc1089a2ae7406393d4586c2eae87b2 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.783584 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.784358 18095 raft_consensus.cc:2243] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.785425 18095 raft_consensus.cc:2272] T f3132e52c1c645a1883133f963c50b24 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.787073 27717 consensus_peers.cc:597] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.788321 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.789422 18095 raft_consensus.cc:2243] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.790270 18095 raft_consensus.cc:2272] T b767b8bc36f64a1a88db4639a82afa4d P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.793201 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.794034 18095 raft_consensus.cc:2243] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.794575 18095 raft_consensus.cc:2272] T c01d0b46b4fd44288bc03adbf43521de P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.797246 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.798003 18095 raft_consensus.cc:2243] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.798414 18095 raft_consensus.cc:2272] T 6a146802808647fbbdee0f0788daf5f7 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.801327 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.802066 18095 raft_consensus.cc:2243] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:17.802130 27791 consensus_peers.cc:597] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.802814 18095 pending_rounds.cc:70] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Trying to abort 1 pending ops.
I20260709 13:13:17.803015 18095 pending_rounds.cc:77] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637058776809472 op_type: NO_OP noop_request { }
I20260709 13:13:17.803264 18095 raft_consensus.cc:2889] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:17.803498 18095 raft_consensus.cc:2272] T 0caeff718eac4a82bb75e0f96911c2a6 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.806051 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.806602 18095 raft_consensus.cc:2243] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.807032 18095 raft_consensus.cc:2272] T f7d135ee8d4e4b30a625e909937c9a2d P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.809634 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.810519 18095 raft_consensus.cc:2243] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.811048 18095 raft_consensus.cc:2272] T cfa72a1976674cb2b73ab182d717bc93 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.814136 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.814954 18095 raft_consensus.cc:2243] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.815493 18095 raft_consensus.cc:2272] T 0194dc3b668440ceaa960a9b2ffbf646 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.817610 27717 consensus_peers.cc:597] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.818665 18095 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.819098 27791 consensus_peers.cc:597] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.819787 18095 raft_consensus.cc:2243] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.820322 18095 raft_consensus.cc:2272] T e59461d3068941fb9f7e72054188b650 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.823257 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.823838 18095 raft_consensus.cc:2243] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.824342 18095 raft_consensus.cc:2272] T db71274402644eb0801ecfeda9b1ae53 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.827164 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.828016 18095 raft_consensus.cc:2243] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.828609 18095 raft_consensus.cc:2272] T 71f2dcad5345411ba79433efc6545618 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.831202 27865 consensus_peers.cc:597] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.831380 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.832422 18095 raft_consensus.cc:2243] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.832980 18095 raft_consensus.cc:2272] T 4bdab5ff078a49dcbcb94c0229037b27 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.833539 27865 consensus_peers.cc:597] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.835847 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.836864 18095 raft_consensus.cc:2243] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.837265 18095 raft_consensus.cc:2272] T 0c73c86edb0f46ce9fd0547671f4ff22 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.839568 27865 consensus_peers.cc:597] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.839848 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.840571 18095 raft_consensus.cc:2243] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.841292 18095 raft_consensus.cc:2272] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.843701 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.844403 18095 raft_consensus.cc:2243] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.844872 18095 raft_consensus.cc:2272] T aba13104713a49c6afab7d69cec33275 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.847592 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.848418 18095 raft_consensus.cc:2243] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.848937 18095 raft_consensus.cc:2272] T 064de8ca801f46a093830449c4b59008 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.851750 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.852583 18095 raft_consensus.cc:2243] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.853500 18095 raft_consensus.cc:2272] T 28693539a08d46a585b795a22f78252c P 1da14a10b312403c91c2ff8aa9d0338a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.856262 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.857115 18095 raft_consensus.cc:2243] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:17.857362 27717 consensus_peers.cc:597] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.857556 18095 raft_consensus.cc:2272] T 91f6da6c29164c54a83cb71cb4069456 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.860339 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.860937 18095 raft_consensus.cc:2243] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.861383 18095 raft_consensus.cc:2272] T 16fbe94a3d414e7aa7c648a08e086a32 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.861792 27717 consensus_peers.cc:597] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.864288 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.865442 18095 raft_consensus.cc:2243] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.865895 18095 raft_consensus.cc:2272] T 7f0ecc1a707d48a3b7862009ff9feded P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.868743 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.869571 18095 raft_consensus.cc:2243] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.870126 18095 raft_consensus.cc:2272] T b5017019a2944f28b6055421fe3a6e4f P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.872895 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.873615 18095 raft_consensus.cc:2243] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.874065 18095 raft_consensus.cc:2272] T 995243704b794d67a15048bce788b7fe P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.876684 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.877384 18095 raft_consensus.cc:2243] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.877900 18095 raft_consensus.cc:2272] T ce354a66175a49b48f20aba6ef8d8f16 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.880631 18095 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.880717 27717 consensus_peers.cc:597] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.881325 18095 raft_consensus.cc:2243] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.881855 18095 raft_consensus.cc:2272] T b227f398fd164b8b8d69bd00c1ead78c P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.883919 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.884507 18095 raft_consensus.cc:2243] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.885200 18095 raft_consensus.cc:2272] T b7605f0caec04cc29194d200cb76dc6c P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.887076 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.887544 18095 raft_consensus.cc:2243] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.887894 18095 raft_consensus.cc:2272] T bb8e70233e82420d90243b593b58b06b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.889940 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.890425 18095 raft_consensus.cc:2243] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.891091 18095 raft_consensus.cc:2272] T f33c97dcdaeb465b8c80a8eb0fb78390 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.893208 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.893757 18095 raft_consensus.cc:2243] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.894192 18095 raft_consensus.cc:2272] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.896229 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.896795 18095 raft_consensus.cc:2243] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.897563 18095 raft_consensus.cc:2272] T 630a85e09f9445509a4ef98bcd31013a P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.900324 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.901260 18095 raft_consensus.cc:2243] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.902299 18095 raft_consensus.cc:2272] T 0a7b585542d94b0880f652f4ef59c27b P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.905553 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.906594 18095 raft_consensus.cc:2243] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.907637 18095 raft_consensus.cc:2272] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.910720 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.911531 18095 raft_consensus.cc:2243] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.912103 18095 raft_consensus.cc:2272] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.912742 27865 consensus_peers.cc:597] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.915161 18095 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.915709 27791 consensus_peers.cc:597] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.916090 18095 raft_consensus.cc:2243] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.916779 18095 raft_consensus.cc:2272] T 8e1db39393c244cabaa23bd30f42faf0 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.919318 27791 consensus_peers.cc:597] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.920251 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.921023 18095 raft_consensus.cc:2243] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.921519 18095 raft_consensus.cc:2272] T dd13b4c8384d40b4a3d039b69415bce3 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.924204 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.924999 18095 raft_consensus.cc:2243] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.925534 18095 raft_consensus.cc:2272] T ecb8c7f462a245618d096e6e8d01bd6a P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.927883 27791 consensus_peers.cc:597] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.928133 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.928787 18095 raft_consensus.cc:2243] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.929539 18095 raft_consensus.cc:2272] T c748896fe9414667aaa260600a04970e P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.931519 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.932024 18095 raft_consensus.cc:2243] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.932503 18095 raft_consensus.cc:2272] T 51ff1f63fbf04422b661a09729f3285f P 1da14a10b312403c91c2ff8aa9d0338a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.935154 18095 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.935564 27717 consensus_peers.cc:597] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.935739 18095 raft_consensus.cc:2243] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.936386 18095 raft_consensus.cc:2272] T 0a06c2def27d4ed89f8469619a9c3c8b P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.939025 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.939761 18095 raft_consensus.cc:2243] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:17.940125 27717 consensus_peers.cc:597] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.940308 18095 raft_consensus.cc:2272] T f2aca4291bad45cc9d8413a65298e541 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.942770 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.943301 18095 raft_consensus.cc:2243] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.943718 18095 raft_consensus.cc:2272] T 62682940e2d74241925b8bfb53838357 P 1da14a10b312403c91c2ff8aa9d0338a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.946302 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.946930 18095 raft_consensus.cc:2243] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.947788 18095 raft_consensus.cc:2272] T 6450cda50a0047b79eed2a54d82b1f72 P 1da14a10b312403c91c2ff8aa9d0338a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.957548 27865 consensus_peers.cc:597] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.958841 27717 consensus_peers.cc:597] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.959533 27717 consensus_peers.cc:597] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.979288 27791 consensus_peers.cc:597] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.998698 27717 consensus_peers.cc:597] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.002720 27717 consensus_peers.cc:597] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.162809 27791 consensus_peers.cc:597] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.173749 27791 consensus_peers.cc:597] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.177271 27865 consensus_peers.cc:597] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.189989 28608 debug-util.cc:398] Leaking SignalData structure 0x7b080020ef00 after lost signal to thread 18098
W20260709 13:13:18.191059 28608 debug-util.cc:398] Leaking SignalData structure 0x7b0800084660 after lost signal to thread 27611
W20260709 13:13:18.192145 28608 debug-util.cc:398] Leaking SignalData structure 0x7b08002d53e0 after lost signal to thread 27778
W20260709 13:13:18.193279 28608 debug-util.cc:398] Leaking SignalData structure 0x7b08003ebc60 after lost signal to thread 27852
W20260709 13:13:18.194396 28608 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d60 after lost signal to thread 27926
W20260709 13:13:18.228751 27865 consensus_peers.cc:597] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.233840 27791 consensus_peers.cc:597] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.945048 28827 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:18.945585 28827 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:18.947275 28827 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:18.947813 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:18.950982 28796 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
W20260709 13:13:18.951201 27865 leader_election.cc:336] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:18.951757 27865 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:18.951537 28796 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:18.952437 28827 raft_consensus.cc:2749] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.953234 28810 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:18.953748 28810 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:18.954298 28796 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:18.955802 28810 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:18.956064 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:18.958881 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
W20260709 13:13:18.961817 27791 leader_election.cc:336] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:18.962312 27791 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:18.962982 28810 raft_consensus.cc:2749] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:18.963104 27791 leader_election.cc:336] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:18.963685 27791 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:18.964296 28810 raft_consensus.cc:2749] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.973575 28800 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:18.976276 28800 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:18.989802 28813 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:18.987589 28801 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:18.984520 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:18.990965 28801 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:18.982676 28800 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:18.990975 28813 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:18.992429 28810 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:18.993052 28810 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:18.994670 28813 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:18.995239 28810 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:18.995595 28801 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
W20260709 13:13:18.989751 27717 leader_election.cc:336] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:18.996519 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:18.998562 27718 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:18.998932 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:19.000381 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.002280 28801 raft_consensus.cc:2749] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.001005 27825 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
W20260709 13:13:19.008412 27791 leader_election.cc:336] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.009055 27791 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:19.009137 27718 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:19.010720 28801 raft_consensus.cc:2804] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.011085 28801 raft_consensus.cc:493] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.011467 28801 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.011711 28810 raft_consensus.cc:2749] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.015584 28810 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.016479 28796 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.016636 28814 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.017156 28796 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.017297 28814 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.019549 28796 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.019734 28814 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.016263 28810 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.022562 28810 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:13:19.023913 27717 leader_election.cc:336] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.026338 27717 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:13:19.027308 28800 raft_consensus.cc:2749] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:19.027609 27717 leader_election.cc:336] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.025398 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.028432 27900 raft_consensus.cc:2468] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
W20260709 13:13:19.028870 18095 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28608)
I20260709 13:13:19.026381 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.024055 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.029857 27794 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.031342 28810 raft_consensus.cc:2804] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.031714 28810 raft_consensus.cc:493] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.024808 28801 raft_consensus.cc:515] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.032085 28810 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.033754 28801 leader_election.cc:290] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
W20260709 13:13:19.037123 27791 leader_election.cc:336] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.037990 27791 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:13:19.039122 28814 raft_consensus.cc:2749] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:19.040386 27791 leader_election.cc:336] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.040902 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3124bdaf6fc1485fb3c6dfe99582b4fd" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.041576 27825 raft_consensus.cc:3060] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.044373 28810 raft_consensus.cc:515] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:13:19.045570 27791 leader_election.cc:336] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.046142 27791 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:13:19.047492 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fc1089a2ae7406393d4586c2eae87b2" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:19.047698 28814 raft_consensus.cc:2749] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.048256 27896 raft_consensus.cc:3060] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.049774 27717 leader_election.cc:336] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.058960 27825 raft_consensus.cc:2468] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
I20260709 13:13:19.059265 28827 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.059877 28827 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.062676 27718 leader_election.cc:304] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.063985 28801 raft_consensus.cc:2804] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.064581 28801 raft_consensus.cc:697] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:19.065461 28801 consensus_queue.cc:237] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.070168 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.063706 28827 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.075783 28827 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.076427 28827 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.078624 28827 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:19.079458 28810 leader_election.cc:290] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.083554 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:19.089897 27751 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:19.084343 28814 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.092398 28814 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.095084 28814 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:13:19.086181 27865 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.089057 27896 raft_consensus.cc:2468] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 3.
I20260709 13:13:19.096450 27865 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 591cc7bfde9f4ddfbf2460174879d675
I20260709 13:13:19.097349 28827 raft_consensus.cc:2749] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:19.102658 27794 leader_election.cc:304] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.103446 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:19.105094 28810 raft_consensus.cc:2804] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.105603 27865 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
W20260709 13:13:19.106508 27865 leader_election.cc:336] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.106630 28827 raft_consensus.cc:2804] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.107177 28827 raft_consensus.cc:493] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.107638 28827 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.107991 27791 leader_election.cc:336] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.108508 28810 raft_consensus.cc:697] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:19.111428 28810 consensus_queue.cc:237] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.114732 28828 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.115320 28828 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.117547 28828 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
W20260709 13:13:19.121297 27791 leader_election.cc:336] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.121824 27791 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:19.122628 28814 raft_consensus.cc:2749] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.123241 27576 catalog_manager.cc:5697] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 3 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.124408 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:19.124763 28814 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.126209 28814 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.128623 28814 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.134115 28828 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
W20260709 13:13:19.134433 27791 leader_election.cc:336] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.134963 28828 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.139622 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.139822 28828 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.140275 27825 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:19.140897 28789 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.141726 27866 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.141508 28789 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:13:19.142246 27865 leader_election.cc:336] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.142746 27865 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:19.143868 28789 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.144852 28789 raft_consensus.cc:2749] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.143339 28828 raft_consensus.cc:2804] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.145179 28827 raft_consensus.cc:515] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.145661 28828 raft_consensus.cc:493] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.146358 28828 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.147580 28827 leader_election.cc:290] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:19.146870 27573 catalog_manager.cc:5697] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.147850 28813 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.148464 28813 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.149469 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.150166 27825 raft_consensus.cc:2468] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:19.150718 28813 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.152122 27866 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.152882 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.157829 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.158212 27825 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:13:19.162314 27794 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, 68036e839a414adf854b602c1ee70066
I20260709 13:13:19.164336 28814 raft_consensus.cc:2749] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.163923 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f33c97dcdaeb465b8c80a8eb0fb78390" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:19.166538 27751 raft_consensus.cc:3060] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.169878 28828 raft_consensus.cc:515] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.172698 28828 leader_election.cc:290] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.173554 28810 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:19.156683 27717 leader_election.cc:336] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.174173 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ca1906db13410aac9f2a4d0d6969ed" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.174129 28810 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.174888 27825 raft_consensus.cc:3060] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.175037 27718 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.176364 28813 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
W20260709 13:13:19.176994 27865 leader_election.cc:336] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.176870 28813 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.177958 28800 raft_consensus.cc:2804] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.178421 28800 raft_consensus.cc:493] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.178891 28800 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.181023 27865 leader_election.cc:336] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:19.181823 27865 leader_election.cc:336] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.185693 28810 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
W20260709 13:13:19.188302 27791 leader_election.cc:336] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:19.190194 27865 leader_election.cc:336] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.190361 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.191092 27902 raft_consensus.cc:2468] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 2.
I20260709 13:13:19.191363 28813 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.193117 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.193807 27823 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
I20260709 13:13:19.196754 27794 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.197606 28796 raft_consensus.cc:2804] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.198104 28796 raft_consensus.cc:493] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.198467 28796 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.198107 27718 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:19.199893 28813 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.200322 28813 raft_consensus.cc:493] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.200716 28813 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.207350 28796 raft_consensus.cc:515] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.197395 27751 raft_consensus.cc:2468] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 3.
W20260709 13:13:19.214708 27717 leader_election.cc:336] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.173379 28828 raft_consensus.cc:2804] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.216210 28828 raft_consensus.cc:493] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.217048 28828 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.218205 28796 leader_election.cc:290] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.212002 28800 raft_consensus.cc:515] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.210034 27825 raft_consensus.cc:2468] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 3.
I20260709 13:13:19.220906 27866 leader_election.cc:304] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.222333 28800 leader_election.cc:290] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.223397 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fbeba4a6dff4488b1e0e1c3768235c4" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.224247 27825 raft_consensus.cc:3060] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.224745 27791 leader_election.cc:336] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.228452 28827 raft_consensus.cc:2804] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.229017 28827 raft_consensus.cc:697] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:19.229918 28827 consensus_queue.cc:237] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:13:19.232697 27717 leader_election.cc:336] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.245591 27825 raft_consensus.cc:2468] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
I20260709 13:13:19.248950 27718 leader_election.cc:304] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.249914 28801 raft_consensus.cc:2804] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.235921 28813 raft_consensus.cc:515] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.253530 28801 raft_consensus.cc:697] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:19.254308 28813 leader_election.cc:290] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.254844 28801 consensus_queue.cc:237] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.258132 28796 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.258796 28796 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.261143 28796 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:19.262502 28828 raft_consensus.cc:515] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.264689 28828 leader_election.cc:290] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.264842 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:19.266294 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7b585542d94b0880f652f4ef59c27b" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.266968 27825 raft_consensus.cc:3060] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:19.269550 27717 leader_election.cc:336] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.271142 27826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3132e52c1c645a1883133f963c50b24" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.271908 27826 raft_consensus.cc:3060] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.277801 27791 leader_election.cc:336] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.278815 27791 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675; no voters: 1da14a10b312403c91c2ff8aa9d0338a, dabb1961ed804fee806c7e46eedef86d
I20260709 13:13:19.279858 28796 raft_consensus.cc:2749] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:19.285096 27826 raft_consensus.cc:2468] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 3.
I20260709 13:13:19.290813 28796 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.291400 28796 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.294178 28796 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.294962 27825 raft_consensus.cc:2468] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 4.
I20260709 13:13:19.296298 27718 leader_election.cc:304] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.297080 28800 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.297634 28800 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.299551 28813 raft_consensus.cc:2804] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.303748 28813 raft_consensus.cc:697] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 4 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:19.304812 28813 consensus_queue.cc:237] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.307955 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caeff718eac4a82bb75e0f96911c2a6" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:19.308673 27902 raft_consensus.cc:3060] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.309993 27717 leader_election.cc:336] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.300019 28800 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.312470 27866 leader_election.cc:304] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.315114 28828 raft_consensus.cc:2804] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.315623 28828 raft_consensus.cc:697] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:19.316639 28828 consensus_queue.cc:237] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.318214 27902 raft_consensus.cc:2468] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 3.
I20260709 13:13:19.325314 27576 catalog_manager.cc:5697] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 3 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.326783 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.327620 27825 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:13:19.331571 28800 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.332216 28800 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.335860 28800 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.338371 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.339129 27896 raft_consensus.cc:2468] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
W20260709 13:13:19.341287 27791 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.343528 27720 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:19.344997 28842 raft_consensus.cc:2804] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.345413 28842 raft_consensus.cc:493] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.345777 28842 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.355264 27900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066" is_pre_election: true
I20260709 13:13:19.355988 27900 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 4.
I20260709 13:13:19.362599 28814 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
W20260709 13:13:19.363409 27717 leader_election.cc:336] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.363243 28814 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.365483 28814 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:19.370211 27865 leader_election.cc:304] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.372444 28836 raft_consensus.cc:2804] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.372978 28836 raft_consensus.cc:697] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:19.373921 28836 consensus_queue.cc:237] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.380780 27573 catalog_manager.cc:5697] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 3 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:19.384334 27718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:42137, user_credentials={real_user=slave}} blocked reactor thread for 51604.2us
I20260709 13:13:19.390084 27718 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.393940 28801 raft_consensus.cc:2804] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.394466 28801 raft_consensus.cc:493] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.394886 28801 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.409106 28813 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.409905 28813 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.412220 28813 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.414431 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.415099 27825 raft_consensus.cc:2468] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 2.
I20260709 13:13:19.418324 27794 leader_election.cc:304] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.419471 28796 raft_consensus.cc:2804] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.419994 27718 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:19.420370 28796 raft_consensus.cc:697] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
W20260709 13:13:19.421878 27717 leader_election.cc:336] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.422220 28800 raft_consensus.cc:2804] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.422716 28800 raft_consensus.cc:493] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.418529 28801 raft_consensus.cc:515] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.423316 28800 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.423852 27751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d" is_pre_election: true
I20260709 13:13:19.426187 27751 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 3.
I20260709 13:13:19.422708 28796 consensus_queue.cc:237] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.393105 28842 raft_consensus.cc:515] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.414866 27573 catalog_manager.cc:5697] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 3 to 4, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 4 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.430539 28842 leader_election.cc:290] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.434372 27902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630a85e09f9445509a4ef98bcd31013a" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:19.437428 27794 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.440282 28801 leader_election.cc:290] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.440620 28814 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:19.441097 28814 raft_consensus.cc:493] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.441534 28814 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:19.441967 27717 leader_election.cc:336] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:19.442512 27717 leader_election.cc:336] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.442080 28800 raft_consensus.cc:515] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.444954 28800 leader_election.cc:290] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137)
I20260709 13:13:19.446338 27827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7605f0caec04cc29194d200cb76dc6c" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.446944 27827 raft_consensus.cc:3060] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.448873 27828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b767b8bc36f64a1a88db4639a82afa4d" candidate_uuid: "dabb1961ed804fee806c7e46eedef86d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.450805 27828 raft_consensus.cc:3060] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.451956 27717 leader_election.cc:336] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.457485 27827 raft_consensus.cc:2468] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
I20260709 13:13:19.461221 27718 leader_election.cc:304] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.462296 28800 raft_consensus.cc:2804] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.462888 28800 raft_consensus.cc:697] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:19.463692 28814 raft_consensus.cc:515] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.463898 28800 consensus_queue.cc:237] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.466912 28814 leader_election.cc:290] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 5 election: Requested vote from peers 68036e839a414adf854b602c1ee70066 (127.17.171.196:38641), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.469044 27828 raft_consensus.cc:2468] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
I20260709 13:13:19.470158 27902 raft_consensus.cc:3060] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.470357 27718 leader_election.cc:304] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.478298 28800 raft_consensus.cc:2804] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.478824 28800 raft_consensus.cc:697] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:19.479671 28800 consensus_queue.cc:237] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:13:19.482816 27791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:35225, user_credentials={real_user=slave}} blocked reactor thread for 44204.2us
I20260709 13:13:19.492509 27902 raft_consensus.cc:2468] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabb1961ed804fee806c7e46eedef86d in term 3.
I20260709 13:13:19.495805 28827 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.496428 28827 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.496889 27720 leader_election.cc:304] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68036e839a414adf854b602c1ee70066, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.500073 27823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675" is_pre_election: true
I20260709 13:13:19.500483 28827 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.500799 27823 raft_consensus.cc:2468] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 2.
I20260709 13:13:19.503314 28842 raft_consensus.cc:2804] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.503850 28842 raft_consensus.cc:697] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Becoming Leader. State: Replica: dabb1961ed804fee806c7e46eedef86d, State: Running, Role: LEADER
I20260709 13:13:19.504665 28842 consensus_queue.cc:237] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } }
I20260709 13:13:19.505733 27896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28693539a08d46a585b795a22f78252c" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "68036e839a414adf854b602c1ee70066"
I20260709 13:13:19.506403 27896 raft_consensus.cc:3060] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:19.511277 27791 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 
I20260709 13:13:19.513487 27823 raft_consensus.cc:1275] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.514348 27866 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.515637 28828 raft_consensus.cc:2804] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:19.516134 28828 raft_consensus.cc:493] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
I20260709 13:13:19.512146 27576 catalog_manager.cc:5697] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.516678 28828 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.516007 28801 consensus_queue.cc:1048] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.531951 27896 raft_consensus.cc:2468] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 5.
I20260709 13:13:19.538267 28796 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:19.538694 28796 raft_consensus.cc:493] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1da14a10b312403c91c2ff8aa9d0338a)
W20260709 13:13:19.538856 27865 leader_election.cc:336] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.539239 28796 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:19.533902 27573 catalog_manager.cc:5697] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 3 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.545939 27573 catalog_manager.cc:5697] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 3 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:19.551555 27791 leader_election.cc:336] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:19.561954 27717 consensus_peers.cc:597] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.548454 28828 raft_consensus.cc:515] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.564918 28796 raft_consensus.cc:515] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
W20260709 13:13:19.566565 27791 leader_election.cc:336] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.567034 28796 leader_election.cc:290] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 election: Requested vote from peers 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225), dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543)
I20260709 13:13:19.570735 28828 leader_election.cc:290] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Requested vote from peers 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137), 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225)
I20260709 13:13:19.576136 27825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c748896fe9414667aaa260600a04970e" candidate_uuid: "68036e839a414adf854b602c1ee70066" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "591cc7bfde9f4ddfbf2460174879d675"
I20260709 13:13:19.576814 27825 raft_consensus.cc:3060] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.605854 27791 leader_election.cc:336] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.598737 27576 catalog_manager.cc:5697] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 3 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.624199 27576 catalog_manager.cc:5697] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 3 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.600394 27754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6450cda50a0047b79eed2a54d82b1f72" candidate_uuid: "591cc7bfde9f4ddfbf2460174879d675" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dabb1961ed804fee806c7e46eedef86d"
I20260709 13:13:19.626781 27754 raft_consensus.cc:3060] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:19.613169 27865 leader_election.cc:336] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
I20260709 13:13:19.598634 27825 raft_consensus.cc:2468] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68036e839a414adf854b602c1ee70066 in term 3.
I20260709 13:13:19.594424 27794 leader_election.cc:304] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.591584 27573 catalog_manager.cc:5697] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to dabb1961ed804fee806c7e46eedef86d (127.17.171.194). New cstate: current_term: 3 leader_uuid: "dabb1961ed804fee806c7e46eedef86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.632838 27866 leader_election.cc:304] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, 68036e839a414adf854b602c1ee70066; no voters: 
I20260709 13:13:19.633637 28833 raft_consensus.cc:2804] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.634117 28833 raft_consensus.cc:697] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Becoming Leader. State: Replica: 68036e839a414adf854b602c1ee70066, State: Running, Role: LEADER
I20260709 13:13:19.634897 28833 consensus_queue.cc:237] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
I20260709 13:13:19.636371 28814 raft_consensus.cc:2804] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:19.636914 28814 raft_consensus.cc:697] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 5 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:19.637696 28814 consensus_queue.cc:237] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } }
W20260709 13:13:19.659569 27865 leader_election.cc:336] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111)
W20260709 13:13:19.664341 27717 consensus_peers.cc:597] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.665848 27754 raft_consensus.cc:2468] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 591cc7bfde9f4ddfbf2460174879d675 in term 4.
I20260709 13:13:19.669394 27901 raft_consensus.cc:1275] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.682116 27791 leader_election.cc:304] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 591cc7bfde9f4ddfbf2460174879d675, dabb1961ed804fee806c7e46eedef86d; no voters: 1da14a10b312403c91c2ff8aa9d0338a
I20260709 13:13:19.681641 27573 catalog_manager.cc:5697] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 4 to 5, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 5 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.683075 28814 raft_consensus.cc:2804] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:19.683660 28814 raft_consensus.cc:697] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 4 LEADER]: Becoming Leader. State: Replica: 591cc7bfde9f4ddfbf2460174879d675, State: Running, Role: LEADER
I20260709 13:13:19.684521 28814 consensus_queue.cc:237] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } }
I20260709 13:13:19.690832 28796 consensus_queue.cc:1048] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.695593 27576 catalog_manager.cc:5697] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 reported cstate change: term changed from 2 to 3, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 68036e839a414adf854b602c1ee70066 (127.17.171.196). New cstate: current_term: 3 leader_uuid: "68036e839a414adf854b602c1ee70066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.703619 27825 raft_consensus.cc:1275] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.706413 28836 consensus_queue.cc:1048] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.719563 27825 raft_consensus.cc:1275] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.729770 27825 raft_consensus.cc:1275] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.732913 28842 consensus_queue.cc:1048] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:19.741194 28836 consensus_queue.cc:1048] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.742617 27576 catalog_manager.cc:5697] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 reported cstate change: term changed from 3 to 4, leader changed from 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193) to 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195). New cstate: current_term: 4 leader_uuid: "591cc7bfde9f4ddfbf2460174879d675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da14a10b312403c91c2ff8aa9d0338a" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 35225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:19.753362 27791 consensus_peers.cc:597] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:19.767903 27865 consensus_peers.cc:597] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.812987 27827 raft_consensus.cc:1275] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:19.815071 28847 consensus_queue.cc:1048] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:19.819255 27865 consensus_peers.cc:597] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:19.854403 27791 consensus_peers.cc:597] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.863041 27827 raft_consensus.cc:1275] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.866103 28813 consensus_queue.cc:1048] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.870440 27825 raft_consensus.cc:1275] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:13:19.873543 27717 consensus_peers.cc:597] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.874828 28813 consensus_queue.cc:1048] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:19.890352 27751 raft_consensus.cc:1275] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.892058 28836 consensus_queue.cc:1048] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:19.900708 27717 consensus_peers.cc:597] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:19.948211 27865 consensus_peers.cc:597] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:19.972023 27717 consensus_peers.cc:597] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:19.972924 27717 consensus_peers.cc:597] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.993930 27896 raft_consensus.cc:1275] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:19.995370 28796 consensus_queue.cc:1048] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.010443 27896 raft_consensus.cc:1275] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Refusing update from remote peer dabb1961ed804fee806c7e46eedef86d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:20.013298 28842 consensus_queue.cc:1048] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:20.029647 18095 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28608)
W20260709 13:13:20.042526 27865 consensus_peers.cc:597] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.076859 27751 raft_consensus.cc:1275] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:20.078656 28810 consensus_queue.cc:1048] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabb1961ed804fee806c7e46eedef86d" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 38543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:20.079541 27791 consensus_peers.cc:597] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.082249 27865 consensus_peers.cc:597] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.115835 27717 consensus_peers.cc:597] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:20.126214 27823 raft_consensus.cc:1275] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Refusing update from remote peer 68036e839a414adf854b602c1ee70066: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:20.127573 28836 consensus_queue.cc:1048] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "591cc7bfde9f4ddfbf2460174879d675" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:20.149173 27896 raft_consensus.cc:1275] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 5 FOLLOWER]: Refusing update from remote peer 591cc7bfde9f4ddfbf2460174879d675: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:13:20.150372 27791 consensus_peers.cc:597] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:20.151198 28814 consensus_queue.cc:1048] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68036e839a414adf854b602c1ee70066" member_type: VOTER last_known_addr { host: "127.17.171.196" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:20.166874 27717 consensus_peers.cc:597] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.174443 27717 consensus_peers.cc:597] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.183138 27791 consensus_peers.cc:597] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.216408 27791 consensus_peers.cc:597] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.289425 27717 consensus_peers.cc:597] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.292608 27791 consensus_peers.cc:597] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.300467 27717 consensus_peers.cc:597] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.311209 27717 consensus_peers.cc:597] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.316157 27791 consensus_peers.cc:597] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.360515 27717 consensus_peers.cc:597] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.363864 27865 consensus_peers.cc:597] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.365934 27717 consensus_peers.cc:597] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.422159 27791 consensus_peers.cc:597] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.440902 27791 consensus_peers.cc:597] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.470640 27717 consensus_peers.cc:597] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.472131 27791 consensus_peers.cc:597] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.509722 27791 consensus_peers.cc:597] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.514343 27717 consensus_peers.cc:597] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.540531 27717 consensus_peers.cc:597] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.557641 27791 consensus_peers.cc:597] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.560636 27791 consensus_peers.cc:597] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.563490 27865 consensus_peers.cc:597] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.596396 27865 consensus_peers.cc:597] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.602995 27865 consensus_peers.cc:597] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.617666 27865 consensus_peers.cc:597] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.650369 27791 consensus_peers.cc:597] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.652454 27865 consensus_peers.cc:597] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.676718 27791 consensus_peers.cc:597] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.741775 27791 consensus_peers.cc:597] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:21.030177 18095 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 28608)
W20260709 13:13:22.019097 27717 consensus_peers.cc:597] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.030826 18095 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 28608)
W20260709 13:13:22.175089 27865 consensus_peers.cc:597] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.275024 27717 consensus_peers.cc:597] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.310217 27717 consensus_peers.cc:597] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.310899 27865 consensus_peers.cc:597] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.323243 27865 consensus_peers.cc:597] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.335901 27791 consensus_peers.cc:597] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.362468 27791 consensus_peers.cc:597] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.364931 27717 consensus_peers.cc:597] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.370553 27717 consensus_peers.cc:597] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.425837 27791 consensus_peers.cc:597] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.452913 27791 consensus_peers.cc:597] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.478648 27791 consensus_peers.cc:597] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.497146 27865 consensus_peers.cc:597] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.519937 27717 consensus_peers.cc:597] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.522346 27717 consensus_peers.cc:597] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.541582 27865 consensus_peers.cc:597] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.605135 27717 consensus_peers.cc:597] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.656582 18095 tablet_server.cc:196] TabletServer@127.17.171.193:35225 shutdown complete.
W20260709 13:13:22.662171 27717 consensus_peers.cc:597] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.699582 27717 consensus_peers.cc:597] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.748890 27791 consensus_peers.cc:597] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.766016 27717 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111) [suppressed 440 similar messages]
W20260709 13:13:22.784869 27791 consensus_peers.cc:597] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.785616 27717 consensus_peers.cc:597] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.796025 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
W20260709 13:13:22.802780 27865 consensus_peers.cc:597] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.805603 27865 consensus_peers.cc:597] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.808365 27791 consensus_peers.cc:597] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.816427 27865 consensus_peers.cc:597] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.827888 27865 consensus_peers.cc:597] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.829102 27791 consensus_peers.cc:597] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.835433 27717 consensus_peers.cc:597] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.836068 27717 consensus_peers.cc:597] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.850406 27791 consensus_peers.cc:597] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.852357 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:22.853448 18095 tablet_replica.cc:333] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.854596 18095 raft_consensus.cc:2243] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.855386 18095 raft_consensus.cc:2272] T f2aca4291bad45cc9d8413a65298e541 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.858093 18095 tablet_replica.cc:333] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.858860 18095 raft_consensus.cc:2243] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.859700 27791 consensus_peers.cc:597] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.859990 18095 raft_consensus.cc:2272] T b70470ccb3c14f3eb3ea2c9ad9232f40 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.862609 18095 tablet_replica.cc:333] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.863322 18095 raft_consensus.cc:2243] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:22.863425 27791 consensus_peers.cc:597] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.863920 18095 raft_consensus.cc:2272] T bf0954ebc4144a79b312f1d47bb6d167 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.866086 18095 tablet_replica.cc:333] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.866699 18095 raft_consensus.cc:2243] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.867146 18095 raft_consensus.cc:2272] T f7d135ee8d4e4b30a625e909937c9a2d P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.869778 18095 tablet_replica.cc:333] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.870486 18095 raft_consensus.cc:2243] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.871287 18095 raft_consensus.cc:2272] T 189c1d4fe48745baac57eb71662d27b1 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.873822 18095 tablet_replica.cc:333] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.874616 18095 raft_consensus.cc:2243] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.875118 18095 raft_consensus.cc:2272] T aba13104713a49c6afab7d69cec33275 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.877167 18095 tablet_replica.cc:333] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.877727 18095 raft_consensus.cc:2243] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.878188 18095 raft_consensus.cc:2272] T bb8e70233e82420d90243b593b58b06b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.880461 18095 tablet_replica.cc:333] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.881165 18095 raft_consensus.cc:2243] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.881750 18095 raft_consensus.cc:2272] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.884143 18095 tablet_replica.cc:333] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.884718 18095 raft_consensus.cc:2243] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.885185 18095 raft_consensus.cc:2272] T ecb8c7f462a245618d096e6e8d01bd6a P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.888012 18095 tablet_replica.cc:333] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.889488 18095 raft_consensus.cc:2243] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.890703 18095 raft_consensus.cc:2272] T 7f0ecc1a707d48a3b7862009ff9feded P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.893796 18095 tablet_replica.cc:333] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.895136 18095 raft_consensus.cc:2243] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.895975 27865 consensus_peers.cc:597] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.896250 18095 raft_consensus.cc:2272] T 290bd7625b0a4ccab3894dc7aacf43b8 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.898911 18095 tablet_replica.cc:333] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.899709 18095 raft_consensus.cc:2243] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.900410 18095 raft_consensus.cc:2272] T 65d3519d610d4f459ce05058f1eea874 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.903004 27865 consensus_peers.cc:597] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.904543 18095 tablet_replica.cc:333] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.905292 18095 raft_consensus.cc:2243] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.905838 18095 raft_consensus.cc:2272] T 51ff1f63fbf04422b661a09729f3285f P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.908286 18095 tablet_replica.cc:333] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.908891 18095 raft_consensus.cc:2243] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.909878 18095 raft_consensus.cc:2272] T 8fbeba4a6dff4488b1e0e1c3768235c4 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.912098 18095 tablet_replica.cc:333] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.912719 18095 raft_consensus.cc:2243] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.913655 18095 raft_consensus.cc:2272] T 0a7b585542d94b0880f652f4ef59c27b P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.916441 18095 tablet_replica.cc:333] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.917255 18095 raft_consensus.cc:2243] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.917804 18095 raft_consensus.cc:2272] T b550130fa7644a86adb90f6194db6006 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.920992 18095 tablet_replica.cc:333] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.921574 18095 raft_consensus.cc:2243] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.922504 18095 raft_consensus.cc:2272] T 603fce887130421f8625960b354f5220 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.924926 18095 tablet_replica.cc:333] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.925616 18095 raft_consensus.cc:2243] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.926151 18095 raft_consensus.cc:2272] T 6450cda50a0047b79eed2a54d82b1f72 P dabb1961ed804fee806c7e46eedef86d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.928330 18095 tablet_replica.cc:333] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.928898 18095 raft_consensus.cc:2243] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.929343 18095 raft_consensus.cc:2272] T 62682940e2d74241925b8bfb53838357 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.931428 18095 tablet_replica.cc:333] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.932060 18095 raft_consensus.cc:2243] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.932570 18095 raft_consensus.cc:2272] T 0194dc3b668440ceaa960a9b2ffbf646 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.934828 18095 tablet_replica.cc:333] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.935405 18095 raft_consensus.cc:2243] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.936354 18095 raft_consensus.cc:2272] T cfa72a1976674cb2b73ab182d717bc93 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.938563 18095 tablet_replica.cc:333] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.939213 18095 raft_consensus.cc:2243] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.940294 18095 raft_consensus.cc:2272] T db71274402644eb0801ecfeda9b1ae53 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.943094 18095 tablet_replica.cc:333] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.943817 18095 raft_consensus.cc:2243] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.944958 18095 raft_consensus.cc:2272] T e1baec7715c34422b3103684a51711f1 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.948065 18095 tablet_replica.cc:333] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.948800 18095 raft_consensus.cc:2243] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.949788 18095 raft_consensus.cc:2272] T 3124bdaf6fc1485fb3c6dfe99582b4fd P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.952601 18095 tablet_replica.cc:333] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.953411 18095 raft_consensus.cc:2243] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.954002 18095 raft_consensus.cc:2272] T 4bdab5ff078a49dcbcb94c0229037b27 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.956650 27865 consensus_peers.cc:597] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.958400 27791 consensus_peers.cc:597] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:22.961217 18095 tablet_replica.cc:333] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.962083 18095 raft_consensus.cc:2243] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.963099 18095 raft_consensus.cc:2272] T 0c73c86edb0f46ce9fd0547671f4ff22 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.966147 18095 tablet_replica.cc:333] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.967718 18095 raft_consensus.cc:2243] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.968339 18095 raft_consensus.cc:2272] T f33c97dcdaeb465b8c80a8eb0fb78390 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.971290 18095 tablet_replica.cc:333] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.972014 18095 raft_consensus.cc:2243] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.971840 27791 consensus_peers.cc:597] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.973274 18095 raft_consensus.cc:2272] T 017321988c03432fa294e969af945a82 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.974666 27865 consensus_peers.cc:597] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.976876 18095 tablet_replica.cc:333] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.977984 18095 raft_consensus.cc:2243] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.978524 27865 consensus_peers.cc:597] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.979139 18095 raft_consensus.cc:2272] T 16fbe94a3d414e7aa7c648a08e086a32 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.982139 18095 tablet_replica.cc:333] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.983044 18095 raft_consensus.cc:2243] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.983645 18095 raft_consensus.cc:2272] T a2fb03199ba945afb863bc4d9e97011b P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.985867 18095 tablet_replica.cc:333] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.986474 18095 raft_consensus.cc:2243] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.987390 18095 raft_consensus.cc:2272] T a0d816cb7fb741e4a64bc9a6b69d4d26 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.990609 18095 tablet_replica.cc:333] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.991310 18095 raft_consensus.cc:2243] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.992017 27865 consensus_peers.cc:597] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.992455 18095 raft_consensus.cc:2272] T 630a85e09f9445509a4ef98bcd31013a P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.994560 18095 tablet_replica.cc:333] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.995103 18095 raft_consensus.cc:2243] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.995529 18095 raft_consensus.cc:2272] T c7e8866752254eff89e9da91504747ba P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.997714 18095 tablet_replica.cc:333] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:22.998229 18095 raft_consensus.cc:2243] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.998628 18095 raft_consensus.cc:2272] T 91d25e8c307f46b7aa029d102bdc0b0b P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.001473 18095 tablet_replica.cc:333] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.002275 18095 raft_consensus.cc:2243] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.003360 18095 raft_consensus.cc:2272] T b767b8bc36f64a1a88db4639a82afa4d P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.005221 27791 consensus_peers.cc:597] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:23.006253 18095 tablet_replica.cc:333] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.007030 18095 raft_consensus.cc:2243] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.008059 18095 raft_consensus.cc:2272] T c01d0b46b4fd44288bc03adbf43521de P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.011093 18095 tablet_replica.cc:333] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
W20260709 13:13:23.011314 27865 consensus_peers.cc:597] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.011838 18095 raft_consensus.cc:2243] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.012842 18095 raft_consensus.cc:2272] T b7605f0caec04cc29194d200cb76dc6c P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.014819 18095 tablet_replica.cc:333] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.015379 18095 raft_consensus.cc:2243] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.015766 18095 raft_consensus.cc:2272] T 26d5a3b562d24f8ba2e682e4964efc43 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.017808 18095 tablet_replica.cc:333] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.018247 18095 raft_consensus.cc:2243] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.018985 18095 raft_consensus.cc:2272] T ce354a66175a49b48f20aba6ef8d8f16 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.021139 18095 tablet_replica.cc:333] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.021878 18095 raft_consensus.cc:2243] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.022432 18095 raft_consensus.cc:2272] T a699d843fce043cea91638fe4622003f P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.023871 27791 consensus_peers.cc:597] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.025106 18095 tablet_replica.cc:333] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.025693 18095 raft_consensus.cc:2243] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.026084 18095 raft_consensus.cc:2272] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.027972 18095 tablet_replica.cc:333] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.028476 18095 raft_consensus.cc:2243] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.029309 18095 raft_consensus.cc:2272] T 71f2dcad5345411ba79433efc6545618 P dabb1961ed804fee806c7e46eedef86d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.031320 18095 tablet_replica.cc:333] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.031819 18095 raft_consensus.cc:2243] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.032311 18095 raft_consensus.cc:2272] T 91f6da6c29164c54a83cb71cb4069456 P dabb1961ed804fee806c7e46eedef86d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.034304 18095 tablet_replica.cc:333] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d: stopping tablet replica
I20260709 13:13:23.034714 18095 raft_consensus.cc:2243] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.035082 18095 raft_consensus.cc:2272] T 064de8ca801f46a093830449c4b59008 P dabb1961ed804fee806c7e46eedef86d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.057542 27791 consensus_peers.cc:597] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.063287 27791 consensus_peers.cc:597] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.069128 27865 consensus_peers.cc:597] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.074239 27865 consensus_peers.cc:597] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.110090 27791 consensus_peers.cc:597] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:23.111181 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
W20260709 13:13:23.127769 27791 consensus_peers.cc:597] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.128055 27865 consensus_peers.cc:597] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.133618 27791 consensus_peers.cc:597] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.138173 27865 consensus_peers.cc:597] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.146818 27791 consensus_peers.cc:597] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.150123 27865 consensus_peers.cc:597] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.167711 27865 consensus_peers.cc:597] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.175012 27865 consensus_peers.cc:597] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.195370 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
W20260709 13:13:23.214504 27866 consensus_peers.cc:597] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.216475 27791 consensus_peers.cc:597] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.236783 27866 consensus_peers.cc:597] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.242435 27791 consensus_peers.cc:597] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.249979 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:23.250952 18095 tablet_replica.cc:333] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.251736 18095 raft_consensus.cc:2243] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.252702 18095 raft_consensus.cc:2272] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.254794 18095 tablet_replica.cc:333] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.255390 18095 raft_consensus.cc:2243] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.255841 18095 raft_consensus.cc:2272] T 189c1d4fe48745baac57eb71662d27b1 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.257840 18095 tablet_replica.cc:333] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.258431 18095 raft_consensus.cc:2243] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.259207 18095 raft_consensus.cc:2272] T 995243704b794d67a15048bce788b7fe P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.261831 18095 tablet_replica.cc:333] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.262606 18095 raft_consensus.cc:2243] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.263667 18095 raft_consensus.cc:2272] T b5017019a2944f28b6055421fe3a6e4f P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.266330 18095 tablet_replica.cc:333] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.267175 18095 raft_consensus.cc:2243] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.267714 18095 raft_consensus.cc:2272] T 3124bdaf6fc1485fb3c6dfe99582b4fd P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.270207 18095 tablet_replica.cc:333] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.270682 18095 raft_consensus.cc:2243] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.271442 18095 raft_consensus.cc:2272] T 4bdab5ff078a49dcbcb94c0229037b27 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.273556 18095 tablet_replica.cc:333] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.274158 18095 raft_consensus.cc:2243] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.274595 18095 raft_consensus.cc:2272] T bf0954ebc4144a79b312f1d47bb6d167 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.276623 18095 tablet_replica.cc:333] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.277107 18095 raft_consensus.cc:2243] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.277843 18095 raft_consensus.cc:2272] T 6a146802808647fbbdee0f0788daf5f7 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.279677 18095 tablet_replica.cc:333] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.280210 18095 raft_consensus.cc:2243] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.280646 18095 raft_consensus.cc:2272] T 65d3519d610d4f459ce05058f1eea874 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.282437 18095 tablet_replica.cc:333] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.282914 18095 raft_consensus.cc:2243] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.283584 18095 raft_consensus.cc:2272] T 51ff1f63fbf04422b661a09729f3285f P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.285531 18095 tablet_replica.cc:333] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.286073 18095 raft_consensus.cc:2243] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.286424 18095 raft_consensus.cc:2272] T 290bd7625b0a4ccab3894dc7aacf43b8 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.288291 18095 tablet_replica.cc:333] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.288827 18095 raft_consensus.cc:2243] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.289774 18095 raft_consensus.cc:2272] T 6450cda50a0047b79eed2a54d82b1f72 P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.291990 27866 consensus_peers.cc:597] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.292834 18095 tablet_replica.cc:333] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.293685 18095 raft_consensus.cc:2243] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.295248 18095 raft_consensus.cc:2272] T 62682940e2d74241925b8bfb53838357 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.298110 27865 consensus_peers.cc:597] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.298126 18095 tablet_replica.cc:333] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.299078 18095 raft_consensus.cc:2243] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.299708 18095 raft_consensus.cc:2272] T 82ca1906db13410aac9f2a4d0d6969ed P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.302892 18095 tablet_replica.cc:333] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.303766 18095 raft_consensus.cc:2243] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.304368 18095 raft_consensus.cc:2272] T b550130fa7644a86adb90f6194db6006 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.306962 18095 tablet_replica.cc:333] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.307700 18095 raft_consensus.cc:2243] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.308244 18095 raft_consensus.cc:2272] T 603fce887130421f8625960b354f5220 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.309882 27791 consensus_peers.cc:597] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 -> Peer dabb1961ed804fee806c7e46eedef86d (127.17.171.194:38543): Couldn't send request to peer dabb1961ed804fee806c7e46eedef86d. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:38543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.310891 18095 tablet_replica.cc:333] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.311551 18095 raft_consensus.cc:2243] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.312000 18095 raft_consensus.cc:2272] T 8fbeba4a6dff4488b1e0e1c3768235c4 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.314015 18095 tablet_replica.cc:333] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.314610 18095 raft_consensus.cc:2243] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.315058 18095 raft_consensus.cc:2272] T 0a7b585542d94b0880f652f4ef59c27b P 591cc7bfde9f4ddfbf2460174879d675 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.317735 18095 tablet_replica.cc:333] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.318559 18095 raft_consensus.cc:2243] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.319065 18095 raft_consensus.cc:2272] T f3132e52c1c645a1883133f963c50b24 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.319420 27866 consensus_peers.cc:597] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.321187 18095 tablet_replica.cc:333] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.321841 18095 raft_consensus.cc:2243] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.322283 18095 raft_consensus.cc:2272] T e1baec7715c34422b3103684a51711f1 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.324343 18095 tablet_replica.cc:333] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.324877 18095 raft_consensus.cc:2243] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.325380 18095 raft_consensus.cc:2272] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.327353 18095 tablet_replica.cc:333] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.327880 18095 raft_consensus.cc:2243] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.328395 18095 raft_consensus.cc:2272] T c7e8866752254eff89e9da91504747ba P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.330484 18095 tablet_replica.cc:333] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.331267 18095 raft_consensus.cc:2243] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 5 LEADER]: Raft consensus shutting down.
W20260709 13:13:23.331899 27866 consensus_peers.cc:597] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.332437 18095 raft_consensus.cc:2272] T 28693539a08d46a585b795a22f78252c P 591cc7bfde9f4ddfbf2460174879d675 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.335171 18095 tablet_replica.cc:333] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.336056 18095 raft_consensus.cc:2243] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.337136 18095 raft_consensus.cc:2272] T 064de8ca801f46a093830449c4b59008 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.339947 18095 tablet_replica.cc:333] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.340550 18095 raft_consensus.cc:2243] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.341128 18095 raft_consensus.cc:2272] T b7605f0caec04cc29194d200cb76dc6c P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.343122 18095 tablet_replica.cc:333] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.343673 18095 raft_consensus.cc:2243] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.344506 18095 raft_consensus.cc:2272] T b227f398fd164b8b8d69bd00c1ead78c P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.346460 18095 tablet_replica.cc:333] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.347013 18095 raft_consensus.cc:2243] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.347719 18095 raft_consensus.cc:2272] T 26d5a3b562d24f8ba2e682e4964efc43 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.349850 18095 tablet_replica.cc:333] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.350369 18095 raft_consensus.cc:2243] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.350766 18095 raft_consensus.cc:2272] T 91d25e8c307f46b7aa029d102bdc0b0b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.353011 18095 tablet_replica.cc:333] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.353816 18095 raft_consensus.cc:2243] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.354439 18095 raft_consensus.cc:2272] T b767b8bc36f64a1a88db4639a82afa4d P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.357053 18095 tablet_replica.cc:333] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.357650 18095 raft_consensus.cc:2243] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.358506 18095 raft_consensus.cc:2272] T dd13b4c8384d40b4a3d039b69415bce3 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.360968 18095 tablet_replica.cc:333] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.361531 18095 raft_consensus.cc:2243] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.361958 18095 raft_consensus.cc:2272] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.364645 18095 tablet_replica.cc:333] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.365175 18095 raft_consensus.cc:2243] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.365989 18095 raft_consensus.cc:2272] T 8fc1089a2ae7406393d4586c2eae87b2 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.368074 18095 tablet_replica.cc:333] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.368717 18095 raft_consensus.cc:2243] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.369511 18095 raft_consensus.cc:2272] T 0caeff718eac4a82bb75e0f96911c2a6 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.371810 18095 tablet_replica.cc:333] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.372575 18095 raft_consensus.cc:2243] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.373039 18095 raft_consensus.cc:2272] T a2fb03199ba945afb863bc4d9e97011b P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.375550 18095 tablet_replica.cc:333] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.376082 18095 raft_consensus.cc:2243] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.376636 18095 raft_consensus.cc:2272] T c748896fe9414667aaa260600a04970e P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.378014 27866 consensus_peers.cc:597] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.378535 18095 tablet_replica.cc:333] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.379127 18095 raft_consensus.cc:2243] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.379562 18095 raft_consensus.cc:2272] T 8e1db39393c244cabaa23bd30f42faf0 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.381636 18095 tablet_replica.cc:333] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.382161 18095 raft_consensus.cc:2243] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.383013 18095 raft_consensus.cc:2272] T f2aca4291bad45cc9d8413a65298e541 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.384996 18095 tablet_replica.cc:333] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.385520 18095 raft_consensus.cc:2243] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.386004 18095 raft_consensus.cc:2272] T 0a06c2def27d4ed89f8469619a9c3c8b P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.387828 18095 tablet_replica.cc:333] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.388511 18095 raft_consensus.cc:2243] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.389402 18095 raft_consensus.cc:2272] T 0194dc3b668440ceaa960a9b2ffbf646 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.392123 18095 tablet_replica.cc:333] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.392732 18095 raft_consensus.cc:2243] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.393450 18095 raft_consensus.cc:2272] T e59461d3068941fb9f7e72054188b650 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.395233 18095 tablet_replica.cc:333] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.395665 18095 raft_consensus.cc:2243] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.396001 18095 raft_consensus.cc:2272] T cfa72a1976674cb2b73ab182d717bc93 P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.397789 18095 tablet_replica.cc:333] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.398203 18095 raft_consensus.cc:2243] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.398568 18095 raft_consensus.cc:2272] T a699d843fce043cea91638fe4622003f P 591cc7bfde9f4ddfbf2460174879d675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.401317 18095 tablet_replica.cc:333] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.402032 18095 raft_consensus.cc:2243] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.403151 18095 raft_consensus.cc:2272] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 591cc7bfde9f4ddfbf2460174879d675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.405715 18095 tablet_replica.cc:333] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675: stopping tablet replica
I20260709 13:13:23.406373 18095 raft_consensus.cc:2243] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.406854 18095 raft_consensus.cc:2272] T 71f2dcad5345411ba79433efc6545618 P 591cc7bfde9f4ddfbf2460174879d675 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.409689 27866 consensus_peers.cc:597] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.437740 27866 consensus_peers.cc:597] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.464495 27865 consensus_peers.cc:597] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 -> Peer 1da14a10b312403c91c2ff8aa9d0338a (127.17.171.193:35225): Couldn't send request to peer 1da14a10b312403c91c2ff8aa9d0338a. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:35225: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:23.467490 27866 consensus_peers.cc:597] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.506255 27866 consensus_peers.cc:597] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:42137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.525831 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
W20260709 13:13:23.536664 27866 consensus_peers.cc:597] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:42137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.606297 27866 consensus_peers.cc:597] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:42137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.617564 18095 tablet_server.cc:179] TabletServer@127.17.171.196:0 shutting down...
W20260709 13:13:23.630751 27866 consensus_peers.cc:597] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 -> Peer 591cc7bfde9f4ddfbf2460174879d675 (127.17.171.195:42137): Couldn't send request to peer 591cc7bfde9f4ddfbf2460174879d675. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.195:42137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.665247 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:23.666074 18095 tablet_replica.cc:333] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.666759 18095 raft_consensus.cc:2243] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.667604 18095 raft_consensus.cc:2272] T f7d135ee8d4e4b30a625e909937c9a2d P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.669890 18095 tablet_replica.cc:333] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.670495 18095 raft_consensus.cc:2243] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.671303 18095 raft_consensus.cc:2272] T aba13104713a49c6afab7d69cec33275 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.673508 18095 tablet_replica.cc:333] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.674109 18095 raft_consensus.cc:2243] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.674912 18095 raft_consensus.cc:2272] T bb8e70233e82420d90243b593b58b06b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.676927 18095 tablet_replica.cc:333] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.677503 18095 raft_consensus.cc:2243] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.678252 18095 raft_consensus.cc:2272] T 65d3519d610d4f459ce05058f1eea874 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.680369 18095 tablet_replica.cc:333] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.680985 18095 raft_consensus.cc:2243] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.681567 18095 raft_consensus.cc:2272] T 28693539a08d46a585b795a22f78252c P 68036e839a414adf854b602c1ee70066 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.683643 18095 tablet_replica.cc:333] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.684255 18095 raft_consensus.cc:2243] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.685156 18095 raft_consensus.cc:2272] T 91f6da6c29164c54a83cb71cb4069456 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.687093 18095 tablet_replica.cc:333] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.687633 18095 raft_consensus.cc:2243] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.688061 18095 raft_consensus.cc:2272] T 995243704b794d67a15048bce788b7fe P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.689970 18095 tablet_replica.cc:333] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.690500 18095 raft_consensus.cc:2243] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.690939 18095 raft_consensus.cc:2272] T b5017019a2944f28b6055421fe3a6e4f P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.692837 18095 tablet_replica.cc:333] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.693588 18095 raft_consensus.cc:2243] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.694510 18095 raft_consensus.cc:2272] T a699d843fce043cea91638fe4622003f P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.697131 18095 tablet_replica.cc:333] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.697881 18095 raft_consensus.cc:2243] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.698266 18095 raft_consensus.cc:2272] T f64a4cec1f6f4dc2a7457fe97b3b2cb2 P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.700143 18095 tablet_replica.cc:333] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.700687 18095 raft_consensus.cc:2243] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.701043 18095 raft_consensus.cc:2272] T 7f0ecc1a707d48a3b7862009ff9feded P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.702934 18095 tablet_replica.cc:333] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.703388 18095 raft_consensus.cc:2243] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.703873 18095 raft_consensus.cc:2272] T 290bd7625b0a4ccab3894dc7aacf43b8 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.706305 18095 tablet_replica.cc:333] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.706884 18095 raft_consensus.cc:2243] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.707659 18095 raft_consensus.cc:2272] T 82ca1906db13410aac9f2a4d0d6969ed P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.709583 18095 tablet_replica.cc:333] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.710062 18095 raft_consensus.cc:2243] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.710762 18095 raft_consensus.cc:2272] T b550130fa7644a86adb90f6194db6006 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.712589 18095 tablet_replica.cc:333] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.713043 18095 raft_consensus.cc:2243] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.713388 18095 raft_consensus.cc:2272] T 603fce887130421f8625960b354f5220 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.715219 18095 tablet_replica.cc:333] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.715783 18095 raft_consensus.cc:2243] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.716636 18095 raft_consensus.cc:2272] T f3132e52c1c645a1883133f963c50b24 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.718456 18095 tablet_replica.cc:333] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.718976 18095 raft_consensus.cc:2243] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.719482 18095 raft_consensus.cc:2272] T e1baec7715c34422b3103684a51711f1 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.721537 18095 tablet_replica.cc:333] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.722046 18095 raft_consensus.cc:2243] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.722455 18095 raft_consensus.cc:2272] T e59461d3068941fb9f7e72054188b650 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.724293 18095 tablet_replica.cc:333] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.724845 18095 raft_consensus.cc:2243] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.725260 18095 raft_consensus.cc:2272] T db71274402644eb0801ecfeda9b1ae53 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.727022 18095 tablet_replica.cc:333] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.727532 18095 raft_consensus.cc:2243] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.727989 18095 raft_consensus.cc:2272] T b8ec45e6ca9c4c98bd3a36fa21d7ee67 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.729785 18095 tablet_replica.cc:333] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.730309 18095 raft_consensus.cc:2243] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.731099 18095 raft_consensus.cc:2272] T f33c97dcdaeb465b8c80a8eb0fb78390 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.733805 18095 tablet_replica.cc:333] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.734562 18095 raft_consensus.cc:2243] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.735569 18095 raft_consensus.cc:2272] T ecb8c7f462a245618d096e6e8d01bd6a P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.737455 18095 tablet_replica.cc:333] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.737926 18095 raft_consensus.cc:2243] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.738421 18095 raft_consensus.cc:2272] T dd13b4c8384d40b4a3d039b69415bce3 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.740543 18095 tablet_replica.cc:333] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.741019 18095 raft_consensus.cc:2243] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.741681 18095 raft_consensus.cc:2272] T bf0954ebc4144a79b312f1d47bb6d167 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.743468 18095 tablet_replica.cc:333] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.743933 18095 raft_consensus.cc:2243] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.744411 18095 raft_consensus.cc:2272] T 6a146802808647fbbdee0f0788daf5f7 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.746232 18095 tablet_replica.cc:333] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.746687 18095 raft_consensus.cc:2243] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.747437 18095 raft_consensus.cc:2272] T c748896fe9414667aaa260600a04970e P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.749285 18095 tablet_replica.cc:333] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.749744 18095 raft_consensus.cc:2243] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.750191 18095 raft_consensus.cc:2272] T b70470ccb3c14f3eb3ea2c9ad9232f40 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.751884 18095 tablet_replica.cc:333] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.752425 18095 raft_consensus.cc:2243] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.753163 18095 raft_consensus.cc:2272] T 8e1db39393c244cabaa23bd30f42faf0 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.755125 18095 tablet_replica.cc:333] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.755632 18095 raft_consensus.cc:2243] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.756069 18095 raft_consensus.cc:2272] T 0c73c86edb0f46ce9fd0547671f4ff22 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.757970 18095 tablet_replica.cc:333] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.758525 18095 raft_consensus.cc:2243] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.759334 18095 raft_consensus.cc:2272] T 0a06c2def27d4ed89f8469619a9c3c8b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.761288 18095 tablet_replica.cc:333] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.761752 18095 raft_consensus.cc:2243] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.762526 18095 raft_consensus.cc:2272] T c7e8866752254eff89e9da91504747ba P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.764559 18095 tablet_replica.cc:333] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.765105 18095 raft_consensus.cc:2243] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.765528 18095 raft_consensus.cc:2272] T a0d816cb7fb741e4a64bc9a6b69d4d26 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.767422 18095 tablet_replica.cc:333] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.767948 18095 raft_consensus.cc:2243] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.768400 18095 raft_consensus.cc:2272] T 630a85e09f9445509a4ef98bcd31013a P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.770406 18095 tablet_replica.cc:333] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.770949 18095 raft_consensus.cc:2243] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.771382 18095 raft_consensus.cc:2272] T 26d5a3b562d24f8ba2e682e4964efc43 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.773308 18095 tablet_replica.cc:333] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.773833 18095 raft_consensus.cc:2243] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.774221 18095 raft_consensus.cc:2272] T b227f398fd164b8b8d69bd00c1ead78c P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.776844 18095 tablet_replica.cc:333] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.777402 18095 raft_consensus.cc:2243] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.777945 18095 raft_consensus.cc:2272] T ce354a66175a49b48f20aba6ef8d8f16 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.779824 18095 tablet_replica.cc:333] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.780362 18095 raft_consensus.cc:2243] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.780717 18095 raft_consensus.cc:2272] T 017321988c03432fa294e969af945a82 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.782541 18095 tablet_replica.cc:333] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.782990 18095 raft_consensus.cc:2243] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.783337 18095 raft_consensus.cc:2272] T 16fbe94a3d414e7aa7c648a08e086a32 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.785540 18095 tablet_replica.cc:333] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.786101 18095 raft_consensus.cc:2243] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.786479 18095 raft_consensus.cc:2272] T 0caeff718eac4a82bb75e0f96911c2a6 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.788380 18095 tablet_replica.cc:333] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.788851 18095 raft_consensus.cc:2243] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.789587 18095 raft_consensus.cc:2272] T a2fb03199ba945afb863bc4d9e97011b P 68036e839a414adf854b602c1ee70066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.791432 18095 tablet_replica.cc:333] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.791883 18095 raft_consensus.cc:2243] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.792714 18095 raft_consensus.cc:2272] T 1487f7f5bd2f44a3a7b1ff7dd221f441 P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.794672 18095 tablet_replica.cc:333] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.795141 18095 raft_consensus.cc:2243] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.795548 18095 raft_consensus.cc:2272] T 8fc1089a2ae7406393d4586c2eae87b2 P 68036e839a414adf854b602c1ee70066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.797603 18095 tablet_replica.cc:333] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.798072 18095 raft_consensus.cc:2243] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.798877 18095 raft_consensus.cc:2272] T 91d25e8c307f46b7aa029d102bdc0b0b P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.800966 18095 tablet_replica.cc:333] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066: stopping tablet replica
I20260709 13:13:23.801397 18095 raft_consensus.cc:2243] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.801802 18095 raft_consensus.cc:2272] T c01d0b46b4fd44288bc03adbf43521de P 68036e839a414adf854b602c1ee70066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.874778 18095 tablet_server.cc:196] TabletServer@127.17.171.196:0 shutdown complete.
I20260709 13:13:23.939107 18095 master.cc:562] Master@127.17.171.254:33607 shutting down...
W20260709 13:13:23.964682 27625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:13:23.965732 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.966310 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.966596 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P d265e9c49c694535930056cd56280bd3: stopping tablet replica
I20260709 13:13:23.989073 18095 master.cc:584] Master@127.17.171.254:33607 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37265 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:24.087248 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:44367
I20260709 13:13:24.088476 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.093953 28886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.094298 28887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.095419 28889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.096855 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:24.098096 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:24.098325 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:24.098618 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602804098592 us; error 0 us; skew 500 ppm
I20260709 13:13:24.099260 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:24.102141 18095 webserver.cc:533] Webserver started at http://127.17.171.254:38251/ using document root <none> and password file <none>
I20260709 13:13:24.102674 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:24.102872 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:24.103150 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:24.104364 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "abfefba423904dbab665a72d8d372b29"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.109094 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:13:24.112546 28894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.113315 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:24.113626 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "abfefba423904dbab665a72d8d372b29"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.113973 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:24.139689 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:24.141001 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:24.179335 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:44367
I20260709 13:13:24.179515 28945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:44367 every 8 connection(s)
I20260709 13:13:24.183210 28946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.193835 28946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29: Bootstrap starting.
I20260709 13:13:24.198544 28946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.202641 28946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29: No bootstrap required, opened a new log
I20260709 13:13:24.204800 28946 raft_consensus.cc:359] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfefba423904dbab665a72d8d372b29" member_type: VOTER }
I20260709 13:13:24.205211 28946 raft_consensus.cc:385] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.205386 28946 raft_consensus.cc:740] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfefba423904dbab665a72d8d372b29, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.206027 28946 consensus_queue.cc:260] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfefba423904dbab665a72d8d372b29" member_type: VOTER }
I20260709 13:13:24.206449 28946 raft_consensus.cc:399] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:24.206637 28946 raft_consensus.cc:493] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:24.206861 28946 raft_consensus.cc:3060] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.211388 28946 raft_consensus.cc:515] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfefba423904dbab665a72d8d372b29" member_type: VOTER }
I20260709 13:13:24.211908 28946 leader_election.cc:304] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abfefba423904dbab665a72d8d372b29; no voters: 
I20260709 13:13:24.213016 28946 leader_election.cc:290] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:24.213364 28949 raft_consensus.cc:2804] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.214819 28949 raft_consensus.cc:697] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 1 LEADER]: Becoming Leader. State: Replica: abfefba423904dbab665a72d8d372b29, State: Running, Role: LEADER
I20260709 13:13:24.215520 28949 consensus_queue.cc:237] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfefba423904dbab665a72d8d372b29" member_type: VOTER }
I20260709 13:13:24.216244 28946 sys_catalog.cc:565] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:24.220273 28950 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abfefba423904dbab665a72d8d372b29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfefba423904dbab665a72d8d372b29" member_type: VOTER } }
I20260709 13:13:24.221128 28950 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:24.220799 28951 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abfefba423904dbab665a72d8d372b29. Latest consensus state: current_term: 1 leader_uuid: "abfefba423904dbab665a72d8d372b29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfefba423904dbab665a72d8d372b29" member_type: VOTER } }
I20260709 13:13:24.221746 28951 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:24.228891 28956 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:24.233726 28956 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:24.234802 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:24.242553 28956 catalog_manager.cc:1383] Generated new cluster ID: 8df8931c4741450fa6f030d88ad4d5c3
I20260709 13:13:24.242823 28956 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:24.275489 28956 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:24.276803 28956 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:24.295054 28956 catalog_manager.cc:6070] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29: Generated new TSK 0
I20260709 13:13:24.295688 28956 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:24.301045 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.307596 28967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.308446 28968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.315863 18095 server_base.cc:1061] running on GCE node
W20260709 13:13:24.315733 28970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.317189 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:24.317400 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:24.317641 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602804317621 us; error 0 us; skew 500 ppm
I20260709 13:13:24.318229 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:24.320542 18095 webserver.cc:533] Webserver started at http://127.17.171.193:43431/ using document root <none> and password file <none>
I20260709 13:13:24.321019 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:24.321168 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:24.321380 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:24.322631 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "76efb6ed03474988a248e8ba602494ca"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.327147 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:24.330602 28975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.331353 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:24.331704 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "76efb6ed03474988a248e8ba602494ca"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.332015 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:24.363003 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:24.364369 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:24.365944 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:24.368417 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:24.368650 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.368906 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:24.369109 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.410370 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:45629
I20260709 13:13:24.410480 29037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:45629 every 8 connection(s)
I20260709 13:13:24.415553 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.423010 29042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.424047 29043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.427798 29045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.427994 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:24.429062 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:24.429267 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:24.429391 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602804429380 us; error 0 us; skew 500 ppm
I20260709 13:13:24.429838 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:24.432096 18095 webserver.cc:533] Webserver started at http://127.17.171.194:34609/ using document root <none> and password file <none>
I20260709 13:13:24.432629 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:24.432782 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:24.432986 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:24.434196 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "c2e63f26e63946ddb432b1f45f185726"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.437621 29038 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44367
I20260709 13:13:24.438055 29038 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:24.439041 29038 heartbeater.cc:507] Master 127.17.171.254:44367 requested a full tablet report, sending...
I20260709 13:13:24.439529 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:24.441253 28911 ts_manager.cc:194] Registered new tserver with Master: 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629)
I20260709 13:13:24.443357 29050 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.443536 28911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39006
I20260709 13:13:24.444401 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:24.444764 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "c2e63f26e63946ddb432b1f45f185726"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.445139 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:24.466022 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:24.467326 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:24.468945 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:24.471176 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:24.471405 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.471678 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:24.471866 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.512755 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:32793
I20260709 13:13:24.512859 29112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:32793 every 8 connection(s)
I20260709 13:13:24.517839 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.525434 29116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.526651 29117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.532972 29113 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44367
I20260709 13:13:24.533416 29113 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:24.533452 29119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.533645 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:24.534349 29113 heartbeater.cc:507] Master 127.17.171.254:44367 requested a full tablet report, sending...
I20260709 13:13:24.534797 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:24.535066 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:24.535259 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602804535242 us; error 0 us; skew 500 ppm
I20260709 13:13:24.536051 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:24.536741 28911 ts_manager.cc:194] Registered new tserver with Master: c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:24.538539 28911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39020
I20260709 13:13:24.538715 18095 webserver.cc:533] Webserver started at http://127.17.171.195:42203/ using document root <none> and password file <none>
I20260709 13:13:24.539378 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:24.539611 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:24.539932 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:24.541158 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "62a851868343413e9be6f4b949d511ba"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.545614 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:24.549137 29124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.549945 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:24.550249 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "62a851868343413e9be6f4b949d511ba"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:24.550555 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:24.570865 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:24.572103 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:24.573586 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:24.575783 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:24.576025 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.576294 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:24.576479 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.618427 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:35839
I20260709 13:13:24.618531 29186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:35839 every 8 connection(s)
I20260709 13:13:24.633024 29187 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44367
I20260709 13:13:24.633423 29187 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:24.634362 29187 heartbeater.cc:507] Master 127.17.171.254:44367 requested a full tablet report, sending...
I20260709 13:13:24.636546 28911 ts_manager.cc:194] Registered new tserver with Master: 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:24.637462 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015798605s
I20260709 13:13:24.637916 28911 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39034
I20260709 13:13:24.663879 28911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39038:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:24.666966 28911 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:24.743182 29003 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd6f848e2b14bf687575084e168c3fa (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:24.744709 29003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd6f848e2b14bf687575084e168c3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.749265 29001 tablet_service.cc:1511] Processing CreateTablet for tablet 2091eca5b2ee410ea8b46f812d545abb (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:24.750767 29001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2091eca5b2ee410ea8b46f812d545abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.750419 29000 tablet_service.cc:1511] Processing CreateTablet for tablet fa92b60a211948d5a79d0bb8b6193b87 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:24.751821 29000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa92b60a211948d5a79d0bb8b6193b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.752990 29152 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd6f848e2b14bf687575084e168c3fa (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:24.754405 29152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd6f848e2b14bf687575084e168c3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.757342 29150 tablet_service.cc:1511] Processing CreateTablet for tablet 2091eca5b2ee410ea8b46f812d545abb (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:24.759032 28999 tablet_service.cc:1511] Processing CreateTablet for tablet 5a812142e18044199d2c083d92861a94 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:24.760468 28999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a812142e18044199d2c083d92861a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.761749 29075 tablet_service.cc:1511] Processing CreateTablet for tablet fa92b60a211948d5a79d0bb8b6193b87 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:24.763154 29075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa92b60a211948d5a79d0bb8b6193b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.763708 29074 tablet_service.cc:1511] Processing CreateTablet for tablet 5a812142e18044199d2c083d92861a94 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:24.764508 29151 tablet_service.cc:1511] Processing CreateTablet for tablet cb2ef2223e08485ca47508039af7fe71 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:24.765105 29074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a812142e18044199d2c083d92861a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.766808 29148 tablet_service.cc:1511] Processing CreateTablet for tablet 5a812142e18044199d2c083d92861a94 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:24.759730 29149 tablet_service.cc:1511] Processing CreateTablet for tablet fa92b60a211948d5a79d0bb8b6193b87 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:24.744330 29002 tablet_service.cc:1511] Processing CreateTablet for tablet cb2ef2223e08485ca47508039af7fe71 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:24.768919 28998 tablet_service.cc:1511] Processing CreateTablet for tablet 69a998a870214438acaa1339c9fc2663 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:24.769546 29002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2ef2223e08485ca47508039af7fe71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.769352 29076 tablet_service.cc:1511] Processing CreateTablet for tablet 2091eca5b2ee410ea8b46f812d545abb (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:24.770275 28998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a998a870214438acaa1339c9fc2663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.770756 29076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2091eca5b2ee410ea8b46f812d545abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.770927 29150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2091eca5b2ee410ea8b46f812d545abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.773108 29147 tablet_service.cc:1511] Processing CreateTablet for tablet 69a998a870214438acaa1339c9fc2663 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:24.773350 29077 tablet_service.cc:1511] Processing CreateTablet for tablet cb2ef2223e08485ca47508039af7fe71 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:24.774746 29077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2ef2223e08485ca47508039af7fe71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.775115 29073 tablet_service.cc:1511] Processing CreateTablet for tablet 69a998a870214438acaa1339c9fc2663 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:24.776507 29151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2ef2223e08485ca47508039af7fe71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.777334 29078 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd6f848e2b14bf687575084e168c3fa (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:24.780742 29072 tablet_service.cc:1511] Processing CreateTablet for tablet 695b8e2d195e445cbf0e847bf76c8f23 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:24.779124 28997 tablet_service.cc:1511] Processing CreateTablet for tablet 695b8e2d195e445cbf0e847bf76c8f23 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:24.782740 28997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695b8e2d195e445cbf0e847bf76c8f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.783118 29146 tablet_service.cc:1511] Processing CreateTablet for tablet 695b8e2d195e445cbf0e847bf76c8f23 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:24.784513 29146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695b8e2d195e445cbf0e847bf76c8f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.785161 29149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa92b60a211948d5a79d0bb8b6193b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.787393 28996 tablet_service.cc:1511] Processing CreateTablet for tablet c4cbe563dc1e4784aec53d250b87d13b (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:24.788766 28996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbe563dc1e4784aec53d250b87d13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.787120 29071 tablet_service.cc:1511] Processing CreateTablet for tablet c4cbe563dc1e4784aec53d250b87d13b (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:24.793661 29147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a998a870214438acaa1339c9fc2663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.793372 29145 tablet_service.cc:1511] Processing CreateTablet for tablet c4cbe563dc1e4784aec53d250b87d13b (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:24.776494 29073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a998a870214438acaa1339c9fc2663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.796478 29070 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee301c956394f7c960ec3bafed83589 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:24.796803 28995 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee301c956394f7c960ec3bafed83589 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:24.797858 29070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee301c956394f7c960ec3bafed83589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.798020 28995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee301c956394f7c960ec3bafed83589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.794761 29145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbe563dc1e4784aec53d250b87d13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.804540 29144 tablet_service.cc:1511] Processing CreateTablet for tablet 3ee301c956394f7c960ec3bafed83589 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:24.805938 29144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ee301c956394f7c960ec3bafed83589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.808529 29071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4cbe563dc1e4784aec53d250b87d13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.812536 29072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695b8e2d195e445cbf0e847bf76c8f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.816569 29148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a812142e18044199d2c083d92861a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.816071 29078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd6f848e2b14bf687575084e168c3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.821295 29069 tablet_service.cc:1511] Processing CreateTablet for tablet 7cefdcdb640a4a589022c88d7c46ac22 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:24.823123 29069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cefdcdb640a4a589022c88d7c46ac22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.824997 28994 tablet_service.cc:1511] Processing CreateTablet for tablet 7cefdcdb640a4a589022c88d7c46ac22 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:24.826732 28994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cefdcdb640a4a589022c88d7c46ac22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.828321 29143 tablet_service.cc:1511] Processing CreateTablet for tablet 7cefdcdb640a4a589022c88d7c46ac22 (DEFAULT_TABLE table=test-workload [id=0a43ee2217e84d07add3e0a0dee90da8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:24.830022 29143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cefdcdb640a4a589022c88d7c46ac22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.858412 29203 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:24.868602 29203 tablet_bootstrap.cc:654] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.964430 29202 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:24.970024 29205 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:24.971231 29203 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:24.971767 29203 ts_tablet_manager.cc:1403] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.048s
I20260709 13:13:24.979888 29203 raft_consensus.cc:359] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:24.981781 29202 tablet_bootstrap.cc:654] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.983228 29205 tablet_bootstrap.cc:654] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.980715 29203 raft_consensus.cc:385] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.998682 29203 raft_consensus.cc:740] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.999533 29203 consensus_queue.cc:260] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.020067 29038 heartbeater.cc:499] Master 127.17.171.254:44367 was elected leader, sending a full tablet report...
I20260709 13:13:25.020998 29202 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.021581 29202 ts_tablet_manager.cc:1403] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.008s
I20260709 13:13:25.022884 29203 ts_tablet_manager.cc:1434] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.004s
I20260709 13:13:25.023948 29203 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.024870 29202 raft_consensus.cc:359] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.025657 29202 raft_consensus.cc:385] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.025985 29202 raft_consensus.cc:740] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.026940 29202 consensus_queue.cc:260] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.034005 29202 ts_tablet_manager.cc:1434] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:13:25.034760 29113 heartbeater.cc:499] Master 127.17.171.254:44367 was elected leader, sending a full tablet report...
I20260709 13:13:25.035553 29203 tablet_bootstrap.cc:654] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.040283 29202 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.041114 29205 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.041661 29205 ts_tablet_manager.cc:1403] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.072s	user 0.000s	sys 0.014s
I20260709 13:13:25.044723 29205 raft_consensus.cc:359] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.045454 29205 raft_consensus.cc:385] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.045744 29205 raft_consensus.cc:740] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.046701 29203 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.046448 29205 consensus_queue.cc:260] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.047375 29203 ts_tablet_manager.cc:1403] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.003s
I20260709 13:13:25.047845 29202 tablet_bootstrap.cc:654] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.051484 29203 raft_consensus.cc:359] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.052618 29203 raft_consensus.cc:385] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.053082 29203 raft_consensus.cc:740] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.054141 29203 consensus_queue.cc:260] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.056556 29203 ts_tablet_manager.cc:1434] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:13:25.057622 29203 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.058379 29205 ts_tablet_manager.cc:1434] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.013s
I20260709 13:13:25.059175 29187 heartbeater.cc:499] Master 127.17.171.254:44367 was elected leader, sending a full tablet report...
I20260709 13:13:25.063860 29205 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.064440 29203 tablet_bootstrap.cc:654] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.072263 29205 tablet_bootstrap.cc:654] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.079768 29203 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.080499 29203 ts_tablet_manager.cc:1403] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.019s
I20260709 13:13:25.084484 29203 raft_consensus.cc:359] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.085457 29203 raft_consensus.cc:385] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.085844 29203 raft_consensus.cc:740] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.086954 29203 consensus_queue.cc:260] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.090273 29203 ts_tablet_manager.cc:1434] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:25.091670 29203 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.100347 29203 tablet_bootstrap.cc:654] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.118984 29202 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.119554 29202 ts_tablet_manager.cc:1403] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.052s
I20260709 13:13:25.122560 29202 raft_consensus.cc:359] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
W20260709 13:13:25.122742 29188 tablet.cc:2406] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:25.123312 29202 raft_consensus.cc:385] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.123667 29202 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.124397 29202 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.125437 29209 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.125988 29209 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.138463 29207 raft_consensus.cc:493] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.139240 29207 raft_consensus.cc:515] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.145550 29207 leader_election.cc:290] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.157398 29209 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.180393 29207 raft_consensus.cc:493] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.181193 29207 raft_consensus.cc:515] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.183913 29207 leader_election.cc:290] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.191375 29205 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.192238 29205 ts_tablet_manager.cc:1403] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.129s	user 0.057s	sys 0.063s
I20260709 13:13:25.197142 29205 raft_consensus.cc:359] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.198552 29205 raft_consensus.cc:385] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.198941 29205 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.199832 29205 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.202049 29205 ts_tablet_manager.cc:1434] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:13:25.203055 29205 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.209079 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.209506 29202 ts_tablet_manager.cc:1434] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.090s	user 0.031s	sys 0.047s
I20260709 13:13:25.209882 29162 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.210268 29205 tablet_bootstrap.cc:654] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.212404 29203 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.214217 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.214417 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.215124 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee301c956394f7c960ec3bafed83589" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.216778 29052 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 
W20260709 13:13:25.217844 29051 leader_election.cc:343] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.213105 29203 ts_tablet_manager.cc:1403] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.122s	user 0.031s	sys 0.028s
I20260709 13:13:25.216785 29202 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.219049 29216 raft_consensus.cc:2804] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.221146 29216 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.221562 29216 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.227339 29202 tablet_bootstrap.cc:654] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:25.227996 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:25.228758 29207 raft_consensus.cc:493] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.229269 29207 raft_consensus.cc:515] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.230697 29207 leader_election.cc:290] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
W20260709 13:13:25.227401 28977 leader_election.cc:343] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:25.233837 28977 leader_election.cc:343] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.235026 29205 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.235599 29205 ts_tablet_manager.cc:1403] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 13:13:25.235527 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee301c956394f7c960ec3bafed83589" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.236413 29203 raft_consensus.cc:359] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.237476 29203 raft_consensus.cc:385] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.237890 29203 raft_consensus.cc:740] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.238062 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.238756 29088 raft_consensus.cc:2468] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76efb6ed03474988a248e8ba602494ca in term 0.
I20260709 13:13:25.239014 29205 raft_consensus.cc:359] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.239071 29203 consensus_queue.cc:260] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.240041 29205 raft_consensus.cc:385] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.240447 29205 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
W20260709 13:13:25.241492 28977 leader_election.cc:343] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.242491 28977 leader_election.cc:304] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca; no voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.242172 29202 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.240723 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.244140 29202 ts_tablet_manager.cc:1403] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.005s
I20260709 13:13:25.241351 29205 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.243322 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.244544 28977 leader_election.cc:304] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba
I20260709 13:13:25.246402 29205 ts_tablet_manager.cc:1434] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:25.246742 29207 raft_consensus.cc:2749] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.231706 29216 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.247423 29205 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.247480 29207 raft_consensus.cc:2804] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.247435 29202 raft_consensus.cc:359] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.249245 29202 raft_consensus.cc:385] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.248896 29207 raft_consensus.cc:493] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.249567 29202 raft_consensus.cc:740] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.249722 29207 raft_consensus.cc:3060] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.250404 29202 consensus_queue.cc:260] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.252969 29202 ts_tablet_manager.cc:1434] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:13:25.253639 29216 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.254078 29202 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.254799 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
W20260709 13:13:25.256407 29051 leader_election.cc:343] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.258069 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.259028 29162 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.261663 29205 tablet_bootstrap.cc:654] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.264568 29202 tablet_bootstrap.cc:654] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.270571 29162 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.272468 29052 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:25.274098 29205 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.274175 29216 raft_consensus.cc:2804] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.274708 29205 ts_tablet_manager.cc:1403] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.013s
I20260709 13:13:25.275044 29216 raft_consensus.cc:697] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:25.276247 29216 consensus_queue.cc:237] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.277881 29202 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.278460 29202 ts_tablet_manager.cc:1403] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:13:25.278633 29207 raft_consensus.cc:515] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.280830 29207 leader_election.cc:290] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Requested vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.281623 29202 raft_consensus.cc:359] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.282430 29202 raft_consensus.cc:385] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.282442 29203 ts_tablet_manager.cc:1434] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:13:25.282858 29202 raft_consensus.cc:740] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.285619 29203 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.286001 29205 raft_consensus.cc:359] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.286742 29205 raft_consensus.cc:385] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.287041 29205 raft_consensus.cc:740] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.283645 29202 consensus_queue.cc:260] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.290337 29202 ts_tablet_manager.cc:1434] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:25.291445 29202 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.287773 29205 consensus_queue.cc:260] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
W20260709 13:13:25.297724 28977 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.194:32793, user_credentials={real_user=slave}} blocked reactor thread for 53253.4us
I20260709 13:13:25.298254 29203 tablet_bootstrap.cc:654] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.297719 29202 tablet_bootstrap.cc:654] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.300040 29205 ts_tablet_manager.cc:1434] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:13:25.300552 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
W20260709 13:13:25.300979 28977 leader_election.cc:343] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.301131 29205 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.301226 29088 raft_consensus.cc:3060] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:25.301753 28977 leader_election.cc:343] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.302163 28977 leader_election.cc:304] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca; no voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.303385 29224 raft_consensus.cc:2749] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.308511 29211 raft_consensus.cc:493] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.309237 29211 raft_consensus.cc:515] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.309804 29205 tablet_bootstrap.cc:654] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.300595 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
W20260709 13:13:25.317772 28977 leader_election.cc:343] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.324265 29211 leader_election.cc:290] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:25.324543 29233 raft_consensus.cc:493] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.325877 29233 raft_consensus.cc:515] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.298210 28910 catalog_manager.cc:5697] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.334980 29216 raft_consensus.cc:493] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.337880 29088 raft_consensus.cc:2468] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76efb6ed03474988a248e8ba602494ca in term 1.
I20260709 13:13:25.340276 29233 leader_election.cc:290] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:25.341955 28977 leader_election.cc:304] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba
I20260709 13:13:25.335734 29216 raft_consensus.cc:515] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.343132 29224 raft_consensus.cc:2804] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.343926 29224 raft_consensus.cc:697] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: Becoming Leader. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Running, Role: LEADER
I20260709 13:13:25.345155 29224 consensus_queue.cc:237] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.349478 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.349766 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.350368 29162 raft_consensus.cc:2468] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
W20260709 13:13:25.351006 29051 leader_election.cc:343] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.351698 29052 leader_election.cc:304] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:25.352836 29209 raft_consensus.cc:2804] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.353277 29209 raft_consensus.cc:493] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.353708 29209 raft_consensus.cc:3060] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.363082 29209 raft_consensus.cc:515] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.365219 29216 leader_election.cc:290] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.366333 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
W20260709 13:13:25.367839 29125 leader_election.cc:343] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.367671 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.368646 29209 leader_election.cc:290] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.373163 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.374209 29162 raft_consensus.cc:3060] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.374519 29207 raft_consensus.cc:493] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.375174 29207 raft_consensus.cc:515] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.377759 29207 leader_election.cc:290] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.369387 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:25.380847 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
W20260709 13:13:25.382831 28977 leader_election.cc:343] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.387423 29202 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.388288 29202 ts_tablet_manager.cc:1403] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.031s
I20260709 13:13:25.388898 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
W20260709 13:13:25.390154 29051 leader_election.cc:343] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:25.385830 29125 leader_election.cc:343] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.392673 29202 raft_consensus.cc:359] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.393872 29202 raft_consensus.cc:385] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.394318 29202 raft_consensus.cc:740] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.395368 29202 consensus_queue.cc:260] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.396757 29088 raft_consensus.cc:2468] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76efb6ed03474988a248e8ba602494ca in term 0.
I20260709 13:13:25.401499 28977 leader_election.cc:304] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba
I20260709 13:13:25.402642 29202 ts_tablet_manager.cc:1434] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:25.403223 29224 raft_consensus.cc:2804] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.403812 29224 raft_consensus.cc:493] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.404112 29202 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.404306 29224 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.412058 29162 raft_consensus.cc:2468] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.413774 29202 tablet_bootstrap.cc:654] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.423931 29205 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.430197 29205 ts_tablet_manager.cc:1403] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.129s	user 0.034s	sys 0.071s
I20260709 13:13:25.430326 29052 leader_election.cc:304] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:25.430112 28908 catalog_manager.cc:5697] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76efb6ed03474988a248e8ba602494ca (127.17.171.193). New cstate: current_term: 1 leader_uuid: "76efb6ed03474988a248e8ba602494ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.431865 29209 raft_consensus.cc:2804] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.426189 29224 raft_consensus.cc:515] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.432500 29209 raft_consensus.cc:697] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:25.427963 29087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.433943 29205 raft_consensus.cc:359] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.426908 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.435142 29088 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 0.
I20260709 13:13:25.434394 29224 leader_election.cc:290] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Requested vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.435757 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.436406 29205 raft_consensus.cc:385] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.436811 29205 raft_consensus.cc:740] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.437453 29126 leader_election.cc:304] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:25.437882 29205 consensus_queue.cc:260] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.438881 29233 raft_consensus.cc:2804] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.439271 29233 raft_consensus.cc:493] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.439740 29233 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.440786 29205 ts_tablet_manager.cc:1434] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:13:25.441927 29205 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.445065 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:25.445255 29202 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.445814 29088 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.446090 29202 ts_tablet_manager.cc:1403] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.000s
W20260709 13:13:25.445119 28977 leader_election.cc:343] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.449790 29202 raft_consensus.cc:359] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.450511 29202 raft_consensus.cc:385] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.450150 29233 raft_consensus.cc:515] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.450803 29202 raft_consensus.cc:740] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.451560 29202 consensus_queue.cc:260] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.433957 29209 consensus_queue.cc:237] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.454172 29088 raft_consensus.cc:2468] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76efb6ed03474988a248e8ba602494ca in term 1.
I20260709 13:13:25.454515 29202 ts_tablet_manager.cc:1434] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:25.455732 29202 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.455668 28977 leader_election.cc:304] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba
I20260709 13:13:25.457022 29224 raft_consensus.cc:2804] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.457492 29224 raft_consensus.cc:697] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: Becoming Leader. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Running, Role: LEADER
I20260709 13:13:25.429045 29203 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.458704 29203 ts_tablet_manager.cc:1403] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.173s	user 0.008s	sys 0.035s
I20260709 13:13:25.458298 29224 consensus_queue.cc:237] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.459270 29205 tablet_bootstrap.cc:654] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.462286 29203 raft_consensus.cc:359] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.471360 29205 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.472103 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:25.473551 29233 leader_election.cc:290] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:25.474982 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:25.476847 29088 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.477325 29205 ts_tablet_manager.cc:1403] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.016s
I20260709 13:13:25.478135 29126 leader_election.cc:304] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62a851868343413e9be6f4b949d511ba; no voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.478991 29211 raft_consensus.cc:2749] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.471941 29202 tablet_bootstrap.cc:654] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.480489 29205 raft_consensus.cc:359] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.481326 29205 raft_consensus.cc:385] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.481606 29205 raft_consensus.cc:740] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.482332 29205 consensus_queue.cc:260] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.484561 29205 ts_tablet_manager.cc:1434] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:25.485376 29088 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 1.
I20260709 13:13:25.486420 29203 raft_consensus.cc:385] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.486840 29203 raft_consensus.cc:740] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.486522 29126 leader_election.cc:304] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.487905 29211 raft_consensus.cc:2804] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.488445 29211 raft_consensus.cc:697] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:25.489291 29211 consensus_queue.cc:237] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.486497 28908 catalog_manager.cc:5697] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76efb6ed03474988a248e8ba602494ca (127.17.171.193). New cstate: current_term: 1 leader_uuid: "76efb6ed03474988a248e8ba602494ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.487892 29203 consensus_queue.cc:260] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.495021 29012 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.498919 29205 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.501737 29209 raft_consensus.cc:493] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.502286 29209 raft_consensus.cc:515] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.505529 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.506220 29013 raft_consensus.cc:2468] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.507644 29051 leader_election.cc:304] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.508575 29216 raft_consensus.cc:2804] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.508975 29216 raft_consensus.cc:493] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.509907 29216 raft_consensus.cc:3060] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.512365 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.513005 29233 raft_consensus.cc:493] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.513039 29162 raft_consensus.cc:2468] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.513839 29233 raft_consensus.cc:515] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.513146 29209 leader_election.cc:290] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.517372 29216 raft_consensus.cc:515] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.518112 29012 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 1.
I20260709 13:13:25.508829 29205 tablet_bootstrap.cc:654] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.522938 29203 ts_tablet_manager.cc:1434] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.003s
I20260709 13:13:25.523000 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:25.524520 29012 raft_consensus.cc:3060] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.526402 29216 leader_election.cc:290] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.527889 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.528847 29162 raft_consensus.cc:3060] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.529510 28910 catalog_manager.cc:5697] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.543445 29203 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.551820 29203 tablet_bootstrap.cc:654] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.554474 29233 leader_election.cc:290] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:25.554620 29012 raft_consensus.cc:2468] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.551157 28911 catalog_manager.cc:5697] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 1 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.557180 29013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.557840 29162 raft_consensus.cc:2468] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.557984 29051 leader_election.cc:304] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.558869 29216 raft_consensus.cc:2804] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.559340 29216 raft_consensus.cc:697] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
W20260709 13:13:25.559752 29125 leader_election.cc:343] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.555641 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.559978 29216 consensus_queue.cc:237] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.556422 29202 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.560119 29205 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.561196 29202 ts_tablet_manager.cc:1403] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.106s	user 0.040s	sys 0.032s
I20260709 13:13:25.561281 29205 ts_tablet_manager.cc:1403] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.015s
W20260709 13:13:25.563797 29126 leader_election.cc:343] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.564317 29126 leader_election.cc:304] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62a851868343413e9be6f4b949d511ba; no voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.564419 29202 raft_consensus.cc:359] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.565157 29202 raft_consensus.cc:385] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.565493 29202 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.565440 29233 raft_consensus.cc:2749] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.566165 29205 raft_consensus.cc:359] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.566938 29205 raft_consensus.cc:385] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.566383 29202 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.567247 29205 raft_consensus.cc:740] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.568032 29205 consensus_queue.cc:260] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.569408 29202 ts_tablet_manager.cc:1434] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:13:25.570252 29205 ts_tablet_manager.cc:1434] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:13:25.570492 29202 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.571281 29205 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.572321 29203 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.573915 29203 ts_tablet_manager.cc:1403] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.004s
I20260709 13:13:25.577986 29203 raft_consensus.cc:359] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.578837 29202 tablet_bootstrap.cc:654] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.580849 29205 tablet_bootstrap.cc:654] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.582769 29203 raft_consensus.cc:385] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.583161 29203 raft_consensus.cc:740] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.584096 29203 consensus_queue.cc:260] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.584718 29202 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.585232 29202 ts_tablet_manager.cc:1403] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:13:25.586799 29203 ts_tablet_manager.cc:1434] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:25.587891 29203 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.587807 29202 raft_consensus.cc:359] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.588963 29202 raft_consensus.cc:385] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.589318 29202 raft_consensus.cc:740] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.588434 28909 catalog_manager.cc:5697] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.590013 29202 consensus_queue.cc:260] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.592237 29202 ts_tablet_manager.cc:1434] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:25.593230 29202 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.595178 29203 tablet_bootstrap.cc:654] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.598922 29202 tablet_bootstrap.cc:654] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.604554 29233 raft_consensus.cc:493] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.605222 29233 raft_consensus.cc:515] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.609149 29233 leader_election.cc:290] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:25.609261 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.609364 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.611191 29224 raft_consensus.cc:493] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:25.611701 29125 leader_election.cc:343] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.611706 29224 raft_consensus.cc:515] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.612764 29202 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
I20260709 13:13:25.613224 29202 ts_tablet_manager.cc:1403] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:13:25.614292 29224 leader_election.cc:290] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
W20260709 13:13:25.616068 29126 leader_election.cc:343] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.616027 29202 raft_consensus.cc:359] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.616835 29202 raft_consensus.cc:385] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.617113 29202 raft_consensus.cc:740] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.617973 29202 consensus_queue.cc:260] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.619422 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.620097 29202 ts_tablet_manager.cc:1434] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:25.621263 29202 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726: Bootstrap starting.
I20260709 13:13:25.618556 29126 leader_election.cc:304] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62a851868343413e9be6f4b949d511ba; no voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726
W20260709 13:13:25.621165 28977 leader_election.cc:343] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.622500 29233 raft_consensus.cc:2749] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.624284 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.624946 29162 raft_consensus.cc:2468] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76efb6ed03474988a248e8ba602494ca in term 0.
I20260709 13:13:25.626252 28977 leader_election.cc:304] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.627472 29224 raft_consensus.cc:2804] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.627883 29224 raft_consensus.cc:493] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.628300 29224 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.630439 29202 tablet_bootstrap.cc:654] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.636956 29224 raft_consensus.cc:515] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.640535 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:25.641644 29202 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726: No bootstrap required, opened a new log
W20260709 13:13:25.642032 28977 leader_election.cc:343] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.642215 29202 ts_tablet_manager.cc:1403] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:13:25.643060 29216 raft_consensus.cc:493] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.643558 29216 raft_consensus.cc:515] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.645291 29202 raft_consensus.cc:359] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.645764 29216 leader_election.cc:290] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.646047 29202 raft_consensus.cc:385] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.646257 29205 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.646332 29202 raft_consensus.cc:740] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.647413 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.647749 29205 ts_tablet_manager.cc:1403] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.039s
I20260709 13:13:25.647522 29202 consensus_queue.cc:260] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
W20260709 13:13:25.648979 29051 leader_election.cc:343] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.649659 29202 ts_tablet_manager.cc:1434] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:25.649647 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.650446 29162 raft_consensus.cc:2468] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.650609 29205 raft_consensus.cc:359] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.651161 29205 raft_consensus.cc:385] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.651407 29205 raft_consensus.cc:740] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.651757 29052 leader_election.cc:304] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:25.652100 29205 consensus_queue.cc:260] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.652714 29209 raft_consensus.cc:2804] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.653105 29209 raft_consensus.cc:493] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.653440 29209 raft_consensus.cc:3060] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.654191 29205 ts_tablet_manager.cc:1434] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:25.655139 29205 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.657809 29203 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.658393 29203 ts_tablet_manager.cc:1403] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.034s
I20260709 13:13:25.661373 29203 raft_consensus.cc:359] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.662103 29203 raft_consensus.cc:385] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.662412 29203 raft_consensus.cc:740] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.662276 29209 raft_consensus.cc:515] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.663623 29203 consensus_queue.cc:260] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.663617 29224 leader_election.cc:290] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Requested vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.664856 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.665467 29162 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.666066 29203 ts_tablet_manager.cc:1434] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:25.666571 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:25.667133 29012 raft_consensus.cc:3060] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.671833 29205 tablet_bootstrap.cc:654] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.667156 29203 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.674662 29012 raft_consensus.cc:2468] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.678570 29209 leader_election.cc:290] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.678820 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.679486 29161 raft_consensus.cc:3060] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.680064 29203 tablet_bootstrap.cc:654] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.679994 29051 leader_election.cc:304] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.681074 29209 raft_consensus.cc:2804] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.681962 29209 raft_consensus.cc:697] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:25.682843 29209 consensus_queue.cc:237] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:25.685027 29162 raft_consensus.cc:2468] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76efb6ed03474988a248e8ba602494ca in term 1.
I20260709 13:13:25.686162 28977 leader_election.cc:304] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.686988 29224 raft_consensus.cc:2804] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.687484 29224 raft_consensus.cc:697] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: Becoming Leader. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Running, Role: LEADER
I20260709 13:13:25.688292 29224 consensus_queue.cc:237] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.690090 29205 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.690548 29205 ts_tablet_manager.cc:1403] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:13:25.692904 29205 raft_consensus.cc:359] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.693682 29205 raft_consensus.cc:385] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.693992 29205 raft_consensus.cc:740] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.694399 29203 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.694912 29205 consensus_queue.cc:260] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.695425 29161 raft_consensus.cc:2468] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.697002 29205 ts_tablet_manager.cc:1434] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:25.694939 29203 ts_tablet_manager.cc:1403] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.011s
I20260709 13:13:25.698276 28907 catalog_manager.cc:5697] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 76efb6ed03474988a248e8ba602494ca (127.17.171.193). New cstate: current_term: 1 leader_uuid: "76efb6ed03474988a248e8ba602494ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.700093 29203 raft_consensus.cc:359] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.700855 29203 raft_consensus.cc:385] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.701159 29203 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.701992 29203 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.701797 28911 catalog_manager.cc:5697] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.704310 29203 ts_tablet_manager.cc:1434] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:25.705116 29203 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.707465 29205 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba: Bootstrap starting.
I20260709 13:13:25.711050 29203 tablet_bootstrap.cc:654] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.715225 29209 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.717177 29205 tablet_bootstrap.cc:654] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.731438 29205 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba: No bootstrap required, opened a new log
I20260709 13:13:25.731513 29203 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.732050 29205 ts_tablet_manager.cc:1403] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.002s
I20260709 13:13:25.732198 29203 ts_tablet_manager.cc:1403] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 13:13:25.734370 29205 raft_consensus.cc:359] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.734885 29205 raft_consensus.cc:385] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.735110 29205 raft_consensus.cc:740] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.735051 29203 raft_consensus.cc:359] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.735783 29203 raft_consensus.cc:385] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.736047 29203 raft_consensus.cc:740] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.736253 29205 consensus_queue.cc:260] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.736991 29203 consensus_queue.cc:260] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.738569 29205 ts_tablet_manager.cc:1434] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:25.745653 29203 ts_tablet_manager.cc:1434] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:25.740801 29209 raft_consensus.cc:493] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.749014 29203 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:25.748685 29209 raft_consensus.cc:515] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.752697 29209 leader_election.cc:290] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.753203 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee301c956394f7c960ec3bafed83589" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.753962 29012 raft_consensus.cc:2468] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.755369 29051 leader_election.cc:304] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.757248 29162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee301c956394f7c960ec3bafed83589" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.757851 29162 raft_consensus.cc:2468] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.758577 29209 raft_consensus.cc:2804] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.759063 29209 raft_consensus.cc:493] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.759442 29209 raft_consensus.cc:3060] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.766463 29203 tablet_bootstrap.cc:654] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:25.781665 29051 consensus_peers.cc:597] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.796466 29209 raft_consensus.cc:515] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.799134 29209 leader_election.cc:290] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.799767 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee301c956394f7c960ec3bafed83589" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:25.800458 29012 raft_consensus.cc:3060] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.801322 29203 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: No bootstrap required, opened a new log
I20260709 13:13:25.801874 29203 ts_tablet_manager.cc:1403] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.026s
I20260709 13:13:25.802867 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ee301c956394f7c960ec3bafed83589" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.803504 29161 raft_consensus.cc:3060] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.804666 29203 raft_consensus.cc:359] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.805416 29203 raft_consensus.cc:385] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.805728 29203 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.806454 29203 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.808439 29203 ts_tablet_manager.cc:1434] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:25.809051 29012 raft_consensus.cc:2468] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.810396 29051 leader_election.cc:304] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.811352 29209 raft_consensus.cc:2804] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.811815 29209 raft_consensus.cc:697] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:25.812712 29209 consensus_queue.cc:237] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.813719 29161 raft_consensus.cc:2468] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.819929 29233 raft_consensus.cc:493] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.820529 29233 raft_consensus.cc:515] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.822659 29233 leader_election.cc:290] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:25.823392 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.824627 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.825444 29088 raft_consensus.cc:2393] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 62a851868343413e9be6f4b949d511ba in current term 1: Already voted for candidate 76efb6ed03474988a248e8ba602494ca in this term.
I20260709 13:13:25.825315 29161 raft_consensus.cc:3060] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.824901 28907 catalog_manager.cc:5697] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.826581 29126 leader_election.cc:304] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62a851868343413e9be6f4b949d511ba; no voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.834334 29224 consensus_queue.cc:1048] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.834846 29233 raft_consensus.cc:2749] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.835825 29224 consensus_queue.cc:1048] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.856089 29209 raft_consensus.cc:493] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.856144 29224 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.856643 29209 raft_consensus.cc:515] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.857151 29224 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.858943 29209 leader_election.cc:290] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.859620 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca" is_pre_election: true
I20260709 13:13:25.861964 29012 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.862937 29224 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.864776 29051 leader_election.cc:304] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.866029 29209 raft_consensus.cc:2804] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.866084 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:25.866887 29209 raft_consensus.cc:493] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.867265 29209 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.864809 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.874470 29161 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 0.
I20260709 13:13:25.879767 29209 raft_consensus.cc:515] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.882972 29012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:25.883384 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:25.883633 29012 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.884285 29161 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.886426 29209 leader_election.cc:290] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:25.890739 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "76efb6ed03474988a248e8ba602494ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:25.892308 29012 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.892704 28977 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca; no voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:25.893671 29051 leader_election.cc:304] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:25.894225 29161 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 1.
I20260709 13:13:25.894694 29209 raft_consensus.cc:2804] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.895303 29209 raft_consensus.cc:697] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:25.896199 29209 consensus_queue.cc:237] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:25.896737 29271 raft_consensus.cc:2749] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.901489 29263 consensus_queue.cc:1048] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.905210 29271 consensus_queue.cc:1048] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.918799 29012 raft_consensus.cc:3060] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.916144 28911 catalog_manager.cc:5697] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.935921 29161 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.945092 29209 consensus_queue.cc:1048] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.945999 29271 consensus_queue.cc:1048] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.996129 29233 consensus_queue.cc:1048] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.009044 29278 consensus_queue.cc:1048] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:26.018653 18095 ts_manager.cc:295] Set tserver state for 76efb6ed03474988a248e8ba602494ca to MAINTENANCE_MODE
I20260709 13:13:26.019544 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:13:26.048961 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:26.049800 18095 tablet_replica.cc:333] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.050398 18095 raft_consensus.cc:2243] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.050865 18095 raft_consensus.cc:2272] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.053570 18095 tablet_replica.cc:333] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.054167 18095 raft_consensus.cc:2243] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.054543 18095 raft_consensus.cc:2272] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.056432 18095 tablet_replica.cc:333] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.056994 18095 raft_consensus.cc:2243] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.057368 18095 raft_consensus.cc:2272] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.059217 18095 tablet_replica.cc:333] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.059747 18095 raft_consensus.cc:2243] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.060487 18095 pending_rounds.cc:70] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Trying to abort 1 pending ops.
I20260709 13:13:26.060694 18095 pending_rounds.cc:77] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637092111904768 op_type: NO_OP noop_request { }
I20260709 13:13:26.061013 18095 raft_consensus.cc:2889] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:26.061234 18095 raft_consensus.cc:2272] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.063267 18095 tablet_replica.cc:333] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.063764 18095 raft_consensus.cc:2243] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.064075 18095 raft_consensus.cc:2272] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.065788 18095 tablet_replica.cc:333] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.066236 18095 raft_consensus.cc:2243] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.066571 18095 raft_consensus.cc:2272] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.068658 18095 tablet_replica.cc:333] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.069131 18095 raft_consensus.cc:2243] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.069437 18095 raft_consensus.cc:2272] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.071318 18095 tablet_replica.cc:333] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.071761 18095 raft_consensus.cc:2243] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.072567 18095 raft_consensus.cc:2272] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.074553 18095 tablet_replica.cc:333] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.075110 18095 raft_consensus.cc:2243] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.075488 18095 raft_consensus.cc:2272] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.077091 18095 tablet_replica.cc:333] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: stopping tablet replica
I20260709 13:13:26.077490 18095 raft_consensus.cc:2243] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.078150 18095 raft_consensus.cc:2272] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.091534 29209 raft_consensus.cc:493] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.092245 29209 raft_consensus.cc:515] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:26.095552 29209 leader_election.cc:290] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:26.096657 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
I20260709 13:13:26.097757 29161 raft_consensus.cc:2393] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c2e63f26e63946ddb432b1f45f185726 in current term 1: Already voted for candidate 76efb6ed03474988a248e8ba602494ca in this term.
I20260709 13:13:26.101163 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
W20260709 13:13:26.101895 29051 leader_election.cc:336] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:26.102355 29051 leader_election.cc:304] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:26.102968 29209 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:26.109982 29209 raft_consensus.cc:2749] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:26.113651 29051 consensus_peers.cc:597] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.162539 29209 consensus_queue.cc:1048] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:26.164716 29051 consensus_peers.cc:597] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.229113 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:26.267066 29216 consensus_queue.cc:1048] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:26.298771 29051 consensus_peers.cc:597] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.421901 29216 consensus_queue.cc:1048] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:26.431775 29264 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:26.436947 29051 consensus_peers.cc:597] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.454312 29051 consensus_peers.cc:597] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.500404 29125 consensus_peers.cc:597] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.209504 29278 raft_consensus.cc:493] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.209951 29278 raft_consensus.cc:515] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.211714 29278 leader_election.cc:290] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:27.212937 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:27.213665 29088 raft_consensus.cc:2468] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 1.
I20260709 13:13:27.214813 29126 leader_election.cc:304] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 
W20260709 13:13:27.215476 29125 leader_election.cc:336] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.215476 29278 raft_consensus.cc:2804] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.216111 29278 raft_consensus.cc:493] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.216502 29278 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.221505 29278 raft_consensus.cc:515] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.223145 29278 leader_election.cc:290] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:27.224422 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:27.225083 29088 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.226804 29125 leader_election.cc:336] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
W20260709 13:13:27.229981 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:27.230641 29088 raft_consensus.cc:2468] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:27.231645 29126 leader_election.cc:304] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:27.232378 29278 raft_consensus.cc:2804] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.232805 29278 raft_consensus.cc:697] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:27.233573 29278 consensus_queue.cc:237] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.240957 28909 catalog_manager.cc:5697] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from 76efb6ed03474988a248e8ba602494ca (127.17.171.193) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.348753 29263 raft_consensus.cc:493] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76efb6ed03474988a248e8ba602494ca)
I20260709 13:13:27.349334 29263 raft_consensus.cc:515] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.351020 29263 leader_election.cc:290] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:27.352279 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
W20260709 13:13:27.354478 29051 leader_election.cc:336] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.354832 29051 leader_election.cc:304] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:27.355394 29263 raft_consensus.cc:2749] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.368561 29278 raft_consensus.cc:493] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76efb6ed03474988a248e8ba602494ca)
I20260709 13:13:27.369261 29278 raft_consensus.cc:515] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.371124 29278 leader_election.cc:290] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:27.372339 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:27.373064 29088 raft_consensus.cc:2468] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 1.
I20260709 13:13:27.374140 29126 leader_election.cc:304] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:27.374837 29278 raft_consensus.cc:2804] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.375272 29278 raft_consensus.cc:493] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 76efb6ed03474988a248e8ba602494ca)
W20260709 13:13:27.375490 29125 leader_election.cc:336] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.375727 29278 raft_consensus.cc:3060] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.381194 29278 raft_consensus.cc:515] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.383078 29278 leader_election.cc:290] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:27.384358 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa92b60a211948d5a79d0bb8b6193b87" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:27.385042 29088 raft_consensus.cc:3060] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.387352 29125 leader_election.cc:336] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.391435 29088 raft_consensus.cc:2468] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:27.392518 29126 leader_election.cc:304] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:27.393168 29278 raft_consensus.cc:2804] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.393565 29278 raft_consensus.cc:697] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:27.394331 29278 consensus_queue.cc:237] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.401399 28909 catalog_manager.cc:5697] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from 76efb6ed03474988a248e8ba602494ca (127.17.171.193) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.430528 29263 raft_consensus.cc:493] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76efb6ed03474988a248e8ba602494ca)
I20260709 13:13:27.431187 29263 raft_consensus.cc:515] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.433146 29263 leader_election.cc:290] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:27.434381 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "62a851868343413e9be6f4b949d511ba" is_pre_election: true
W20260709 13:13:27.436909 29051 leader_election.cc:336] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.437309 29051 leader_election.cc:304] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2e63f26e63946ddb432b1f45f185726; no voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:27.437911 29263 raft_consensus.cc:2749] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.450846 29278 raft_consensus.cc:493] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 76efb6ed03474988a248e8ba602494ca)
I20260709 13:13:27.451412 29278 raft_consensus.cc:515] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.453351 29278 leader_election.cc:290] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:27.454612 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726" is_pre_election: true
I20260709 13:13:27.455358 29088 raft_consensus.cc:2468] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 1.
I20260709 13:13:27.456293 29126 leader_election.cc:304] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:27.457082 29278 raft_consensus.cc:2804] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.457432 29278 raft_consensus.cc:493] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 76efb6ed03474988a248e8ba602494ca)
W20260709 13:13:27.457485 29125 leader_election.cc:336] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.457886 29278 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.462895 29278 raft_consensus.cc:515] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.464740 29278 leader_election.cc:290] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:27.465925 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:27.466504 29088 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.468302 29125 leader_election.cc:336] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111)
I20260709 13:13:27.471719 29088 raft_consensus.cc:2468] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:27.472864 29126 leader_election.cc:304] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, c2e63f26e63946ddb432b1f45f185726; no voters: 76efb6ed03474988a248e8ba602494ca
I20260709 13:13:27.473546 29278 raft_consensus.cc:2804] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.474007 29278 raft_consensus.cc:697] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:27.474767 29278 consensus_queue.cc:237] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:27.482175 28909 catalog_manager.cc:5697] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from 76efb6ed03474988a248e8ba602494ca (127.17.171.193) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:27.622763 29125 consensus_peers.cc:597] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.771183 29051 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111) [suppressed 137 similar messages]
I20260709 13:13:27.774475 29088 raft_consensus.cc:1275] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.775586 29278 consensus_queue.cc:1048] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.780239 29087 raft_consensus.cc:1275] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:27.782673 29278 consensus_queue.cc:1048] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:27.794906 29125 consensus_peers.cc:597] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.944895 29125 consensus_peers.cc:597] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.086588 29088 raft_consensus.cc:1275] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.087791 29299 consensus_queue.cc:1048] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:28.143255 29051 consensus_peers.cc:597] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.230952 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:28.496809 29051 consensus_peers.cc:597] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.569149 29051 consensus_peers.cc:597] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.797257 29051 consensus_peers.cc:597] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.824450 29051 consensus_peers.cc:597] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:29.084154 29125 consensus_peers.cc:597] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:29.117417 29051 consensus_peers.cc:597] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:29.232424 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:30.031841 29125 consensus_peers.cc:597] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:30.105559 29125 consensus_peers.cc:597] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:30.233440 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:30.658686 29125 consensus_peers.cc:597] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:30.931033 29051 consensus_peers.cc:597] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Error code: TABLET_NOT_RUNNING (12). Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:30.933202 29051 consensus_peers.cc:597] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.122125 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.129850 29305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.130751 29306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.137792 18095 server_base.cc:1061] running on GCE node
W20260709 13:13:31.138410 29308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.139902 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.140110 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.140318 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602811140304 us; error 0 us; skew 500 ppm
I20260709 13:13:31.140790 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.143083 18095 webserver.cc:533] Webserver started at http://127.17.171.193:43431/ using document root <none> and password file <none>
I20260709 13:13:31.143520 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.143671 18095 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:31.147153 18095 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:31.150831 29313 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.151723 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:31.152036 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "76efb6ed03474988a248e8ba602494ca"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-jhlz"
I20260709 13:13:31.152400 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:13:31.156419 29051 consensus_peers.cc:597] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.168947 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.170531 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.172389 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.175674 29320 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:13:31.200191 29051 consensus_peers.cc:597] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.224911 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:31.225282 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:13:31.225526 18095 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:31.230023 29320 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
W20260709 13:13:31.234520 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:31.234829 29051 consensus_peers.cc:597] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.243132 29320 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:31.244138 29320 tablet_bootstrap.cc:492] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.244786 29320 ts_tablet_manager.cc:1403] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:13:31.247069 29320 raft_consensus.cc:359] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.247834 29320 raft_consensus.cc:740] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.248553 29320 consensus_queue.cc:260] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.251407 29320 ts_tablet_manager.cc:1434] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:13:31.252434 29320 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.265439 18095 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:31.265741 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.039s	sys 0.000s
I20260709 13:13:31.265861 29320 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.266747 29320 tablet_bootstrap.cc:492] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.267356 29320 ts_tablet_manager.cc:1403] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:13:31.269398 29320 raft_consensus.cc:359] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.269958 29320 raft_consensus.cc:740] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.270562 29320 consensus_queue.cc:260] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.272492 29320 ts_tablet_manager.cc:1434] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:13:31.273417 29320 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.284535 29320 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.285434 29320 tablet_bootstrap.cc:492] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.286248 29320 ts_tablet_manager.cc:1403] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:13:31.288388 29320 raft_consensus.cc:359] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.288997 29320 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.289656 29320 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.291862 29320 ts_tablet_manager.cc:1434] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:31.292658 29320 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.302950 29320 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.303702 29320 tablet_bootstrap.cc:492] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.304422 29320 ts_tablet_manager.cc:1403] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:13:31.306151 29320 raft_consensus.cc:359] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:31.306670 29320 raft_consensus.cc:740] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.307287 29320 consensus_queue.cc:260] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:31.308805 29320 ts_tablet_manager.cc:1434] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:31.309432 29320 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.319830 29320 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.320582 29320 tablet_bootstrap.cc:492] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.321132 29320 ts_tablet_manager.cc:1403] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:13:31.321998 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:45629
I20260709 13:13:31.322124 29382 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:45629 every 8 connection(s)
I20260709 13:13:31.323108 29320 raft_consensus.cc:359] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.323683 29320 raft_consensus.cc:385] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.323925 29320 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.324512 29320 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.326023 29320 ts_tablet_manager.cc:1434] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:31.326656 29320 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.336100 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.348030 29320 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.349097 29320 tablet_bootstrap.cc:492] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.349792 29320 ts_tablet_manager.cc:1403] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 13:13:31.353018 29320 raft_consensus.cc:359] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.353852 29320 raft_consensus.cc:740] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.354668 29320 consensus_queue.cc:260] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.356765 29320 ts_tablet_manager.cc:1434] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:31.357574 29320 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.361446 29383 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44367
I20260709 13:13:31.362286 29383 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:31.363245 29383 heartbeater.cc:507] Master 127.17.171.254:44367 requested a full tablet report, sending...
I20260709 13:13:31.364503 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:31.365276 29088 raft_consensus.cc:606] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:31.367841 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:31.368431 29088 raft_consensus.cc:606] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:31.369642 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:31.370220 28909 ts_manager.cc:194] Re-registered known tserver with Master: 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629)
I20260709 13:13:31.370385 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:31.371271 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.374260 29320 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.375262 29320 tablet_bootstrap.cc:492] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.375903 29320 ts_tablet_manager.cc:1403] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:13:31.378376 29320 raft_consensus.cc:359] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.379225 29320 raft_consensus.cc:740] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.379451 28909 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35092
I20260709 13:13:31.379894 29320 consensus_queue.cc:260] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.382192 29320 ts_tablet_manager.cc:1434] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:31.383013 29320 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.383917 29383 heartbeater.cc:499] Master 127.17.171.254:44367 was elected leader, sending a full tablet report...
I20260709 13:13:31.395001 29356 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.398000 29320 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.399123 29320 tablet_bootstrap.cc:492] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.399809 29320 ts_tablet_manager.cc:1403] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:13:31.402110 29320 raft_consensus.cc:359] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.402637 29320 raft_consensus.cc:740] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.403285 29320 consensus_queue.cc:260] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.404891 29320 ts_tablet_manager.cc:1434] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:31.405721 29320 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.420221 29320 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.421145 29320 tablet_bootstrap.cc:492] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.421860 29320 ts_tablet_manager.cc:1403] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:13:31.424048 29320 raft_consensus.cc:359] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.424574 29320 raft_consensus.cc:740] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.425035 29320 consensus_queue.cc:260] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.426682 29320 ts_tablet_manager.cc:1434] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:31.427579 29320 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Bootstrap starting.
I20260709 13:13:31.438961 29320 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.439532 29320 tablet_bootstrap.cc:492] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Bootstrap complete.
I20260709 13:13:31.440006 29320 ts_tablet_manager.cc:1403] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:13:31.441766 29320 raft_consensus.cc:359] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.442274 29320 raft_consensus.cc:740] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76efb6ed03474988a248e8ba602494ca, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.442734 29320 consensus_queue.cc:260] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.444123 29320 ts_tablet_manager.cc:1434] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.000s
I20260709 13:13:31.485386 29304 raft_consensus.cc:993] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:31.485867 29399 raft_consensus.cc:1081] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:31.487423 29160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:31.487994 29160 raft_consensus.cc:493] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.488332 29160 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.494966 29160 raft_consensus.cc:515] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.497092 29160 leader_election.cc:290] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:31.498245 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:31.498917 29088 raft_consensus.cc:3055] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.499205 29088 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:31.499876 29088 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.500689 29356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:31.501101 29088 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.501292 29356 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.508157 29088 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:31.508157 29356 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:31.509765 29125 leader_election.cc:304] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:31.510521 29299 raft_consensus.cc:2804] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.511713 29299 raft_consensus.cc:697] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:31.512542 29299 consensus_queue.cc:237] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.519300 28909 catalog_manager.cc:5697] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.526633 29356 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.549526 29356 raft_consensus.cc:3060] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.806540 29355 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.815667 29355 pending_rounds.cc:85] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Aborting all ops after (but not including) 0
I20260709 13:13:31.815903 29355 pending_rounds.cc:107] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:31.816133 29355 raft_consensus.cc:2889] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:31.896124 29399 raft_consensus.cc:993] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:31.896740 29304 raft_consensus.cc:1081] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:31.898367 29160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:31.898993 29160 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.899335 29160 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.910719 29160 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.913298 29160 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:31.914623 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:31.914681 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:31.915360 29355 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.915462 29088 raft_consensus.cc:3055] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.915956 29088 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:31.916865 29088 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.918291 29088 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.922384 29355 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:31.923774 29125 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:31.924794 29299 raft_consensus.cc:2804] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.925243 29299 raft_consensus.cc:697] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:31.926168 29088 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:31.926391 29299 consensus_queue.cc:237] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:31.934726 28909 catalog_manager.cc:5697] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.080873 29088 raft_consensus.cc:1275] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.082070 29414 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.093179 29355 raft_consensus.cc:1275] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.094934 29414 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:32.235777 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:32.383919 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.392544 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:32.393082 29088 raft_consensus.cc:606] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:32.406071 29160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
mode: GRACEFUL
new_leader_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:53300
I20260709 13:13:32.406574 29160 raft_consensus.cc:606] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Received request to transfer leadership to TS c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:32.409581 29160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69a998a870214438acaa1339c9fc2663"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
mode: GRACEFUL
new_leader_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:53300
I20260709 13:13:32.410051 29160 raft_consensus.cc:606] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Received request to transfer leadership to TS c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:32.411139 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:32.411576 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:32.412370 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.471129 29355 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.472635 29414 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.482328 29088 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:32.483826 29414 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.494006 29400 raft_consensus.cc:993] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: : Instructing follower c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:32.494486 29414 raft_consensus.cc:1081] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Signalling peer c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:32.495949 29088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69a998a870214438acaa1339c9fc2663"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:39152
I20260709 13:13:32.496408 29088 raft_consensus.cc:493] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.496691 29088 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.502329 29088 raft_consensus.cc:515] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:32.504299 29088 leader_election.cc:290] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:32.505160 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:32.505450 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a998a870214438acaa1339c9fc2663" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:32.505827 29355 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.506034 29160 raft_consensus.cc:3055] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.506384 29160 raft_consensus.cc:740] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:32.507323 29160 consensus_queue.cc:260] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:32.508900 29160 raft_consensus.cc:3060] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.513827 29355 raft_consensus.cc:2468] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:32.515282 29051 leader_election.cc:304] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:32.516245 29412 raft_consensus.cc:2804] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:32.516722 29412 raft_consensus.cc:697] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:32.516795 29160 raft_consensus.cc:2468] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:32.517959 29412 consensus_queue.cc:237] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:32.525385 28907 catalog_manager.cc:5697] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 2 to 3, leader changed from 62a851868343413e9be6f4b949d511ba (127.17.171.195) to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.575838 29400 raft_consensus.cc:993] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: : Instructing follower c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:32.576412 29414 raft_consensus.cc:1081] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Signalling peer c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:32.577893 29088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:39152
I20260709 13:13:32.578438 29088 raft_consensus.cc:493] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.578787 29088 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.584079 29088 raft_consensus.cc:515] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:32.585660 29088 leader_election.cc:290] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:32.586578 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:32.586678 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:32.587273 29355 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.587404 29160 raft_consensus.cc:3055] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.587817 29160 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:32.588670 29160 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:32.589686 29160 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.592578 29355 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:32.593637 29051 leader_election.cc:304] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:32.594305 29412 raft_consensus.cc:2804] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:32.594784 29412 raft_consensus.cc:697] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:32.595407 29160 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:32.595752 29412 consensus_queue.cc:237] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:32.602149 28907 catalog_manager.cc:5697] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 2 to 3, leader changed from 62a851868343413e9be6f4b949d511ba (127.17.171.195) to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.716871 29399 raft_consensus.cc:993] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:32.717317 29412 raft_consensus.cc:1081] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:32.718815 29160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:32.719338 29160 raft_consensus.cc:493] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.719714 29160 raft_consensus.cc:3060] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.725378 29160 raft_consensus.cc:515] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:32.727201 29160 leader_election.cc:290] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:32.728060 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:32.728392 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd6f848e2b14bf687575084e168c3fa" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:32.728883 29355 raft_consensus.cc:3060] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.729014 29088 raft_consensus.cc:3055] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.729454 29088 raft_consensus.cc:740] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:32.730259 29088 consensus_queue.cc:260] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:32.731349 29088 raft_consensus.cc:3060] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.734130 29355 raft_consensus.cc:2468] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:32.735143 29125 leader_election.cc:304] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:32.735937 29414 raft_consensus.cc:2804] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:32.736250 29088 raft_consensus.cc:2468] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:32.736493 29414 raft_consensus.cc:697] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:32.737825 29414 consensus_queue.cc:237] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } }
I20260709 13:13:32.745229 28907 catalog_manager.cc:5697] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.047199 29160 raft_consensus.cc:1275] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.048681 29412 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.060132 29355 raft_consensus.cc:1275] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.062208 29412 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.072016 29160 raft_consensus.cc:1275] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.073701 29412 consensus_queue.cc:1048] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.086218 29355 raft_consensus.cc:1275] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.087765 29435 consensus_queue.cc:1048] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.201803 29088 raft_consensus.cc:1275] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.202919 29414 consensus_queue.cc:1048] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.212998 29355 raft_consensus.cc:1275] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.215415 29414 consensus_queue.cc:1048] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:33.236768 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:33.419045 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.427219 29160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
mode: GRACEFUL
new_leader_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:53300
I20260709 13:13:33.427875 29160 raft_consensus.cc:606] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Received request to transfer leadership to TS c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:33.430944 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:33.431383 29088 raft_consensus.cc:606] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:33.433677 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:33.434073 29088 raft_consensus.cc:606] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:33.435005 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:33.435523 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:33.436143 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.471101 29435 raft_consensus.cc:993] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:33.471722 29430 raft_consensus.cc:1081] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:33.473254 29160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:33.473721 29160 raft_consensus.cc:493] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.474028 29160 raft_consensus.cc:3060] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.478955 29160 raft_consensus.cc:515] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.480564 29160 leader_election.cc:290] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:33.481693 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:33.481618 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cefdcdb640a4a589022c88d7c46ac22" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:33.482551 29355 raft_consensus.cc:3060] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.482637 29088 raft_consensus.cc:3055] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.483188 29088 raft_consensus.cc:740] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:33.484045 29088 consensus_queue.cc:260] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.485134 29088 raft_consensus.cc:3060] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.488950 29355 raft_consensus.cc:2468] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:33.489481 29088 raft_consensus.cc:2468] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:33.489946 29356 raft_consensus.cc:1240] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Rejecting Update request from peer c2e63f26e63946ddb432b1f45f185726 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.490409 29125 leader_election.cc:304] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:33.491626 29414 raft_consensus.cc:2804] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.492542 29414 raft_consensus.cc:697] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:33.493935 29435 raft_consensus.cc:993] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:33.493732 29414 consensus_queue.cc:237] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.494513 29430 raft_consensus.cc:1081] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:33.496363 29160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:33.496922 29160 raft_consensus.cc:493] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.497272 29160 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.502636 28907 catalog_manager.cc:5697] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.503567 29160 raft_consensus.cc:515] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.505836 29160 leader_election.cc:290] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 4 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:33.506330 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:33.506330 29356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b8e2d195e445cbf0e847bf76c8f23" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:33.507164 29088 raft_consensus.cc:3055] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:33.507292 29356 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.507532 29088 raft_consensus.cc:740] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:33.508338 29088 consensus_queue.cc:260] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.509585 29088 raft_consensus.cc:3060] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.516098 29356 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 4.
I20260709 13:13:33.517153 29088 raft_consensus.cc:2468] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 4.
I20260709 13:13:33.517494 29125 leader_election.cc:304] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:33.518465 29414 raft_consensus.cc:2804] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:33.518937 29414 raft_consensus.cc:697] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:33.519685 29414 consensus_queue.cc:237] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.525890 28907 catalog_manager.cc:5697] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 3 to 4, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 4 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.878796 29355 raft_consensus.cc:1275] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.880115 29414 consensus_queue.cc:1048] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.892094 29088 raft_consensus.cc:1275] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.893884 29443 consensus_queue.cc:1048] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.906656 29414 raft_consensus.cc:993] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: : Instructing follower c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:33.907173 29443 raft_consensus.cc:1081] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Signalling peer c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:33.908601 29088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:39152
I20260709 13:13:33.909171 29088 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.909498 29088 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.914286 29088 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.915823 29088 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:33.916554 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:33.916826 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:33.917191 29355 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.917394 29160 raft_consensus.cc:3055] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.917788 29160 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:33.918396 29160 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.919256 29160 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.922583 29355 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:33.923731 29051 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:33.923748 29160 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:33.924441 29430 raft_consensus.cc:2804] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.924979 29430 raft_consensus.cc:697] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:33.925724 29430 consensus_queue.cc:237] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:33.932935 28909 catalog_manager.cc:5697] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 2 to 3, leader changed from 62a851868343413e9be6f4b949d511ba (127.17.171.195) to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.962001 29355 raft_consensus.cc:1275] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:33.963409 29414 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:33.964356 29088 raft_consensus.cc:1275] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:33.965618 29414 consensus_queue.cc:1048] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:34.237771 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:34.415745 29160 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:34.416970 29430 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:34.427671 29355 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:34.429173 29453 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:34.443858 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.451519 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:34.452100 29088 raft_consensus.cc:606] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:34.454840 29160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a812142e18044199d2c083d92861a94"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
mode: GRACEFUL
new_leader_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:53300
I20260709 13:13:34.455353 29160 raft_consensus.cc:606] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 LEADER]: Received request to transfer leadership to TS c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:34.457653 29160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
mode: GRACEFUL
new_leader_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:53300
I20260709 13:13:34.458104 29160 raft_consensus.cc:606] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Received request to transfer leadership to TS c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:34.459151 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:34.459676 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:34.460368 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.709489 29443 raft_consensus.cc:993] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: : Instructing follower c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:34.710041 29444 raft_consensus.cc:1081] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 LEADER]: Signalling peer c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:34.711511 29088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a812142e18044199d2c083d92861a94"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:39152
I20260709 13:13:34.712013 29088 raft_consensus.cc:493] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.712321 29088 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.717170 29088 raft_consensus.cc:515] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.718832 29088 leader_election.cc:290] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:34.719633 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:34.719830 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:34.720422 29355 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.720477 29160 raft_consensus.cc:3055] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.720876 29160 raft_consensus.cc:740] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:34.721550 29160 consensus_queue.cc:260] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.722536 29160 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.725929 29355 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 2.
I20260709 13:13:34.727159 29160 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 2.
I20260709 13:13:34.727290 29051 leader_election.cc:304] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:34.728199 29453 raft_consensus.cc:2804] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:34.728677 29453 raft_consensus.cc:697] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:34.729532 29453 consensus_queue.cc:237] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.737329 28911 catalog_manager.cc:5697] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 1 to 2, leader changed from 62a851868343413e9be6f4b949d511ba (127.17.171.195) to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.853952 29443 raft_consensus.cc:993] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: : Instructing follower c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:34.854425 29444 raft_consensus.cc:1081] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Signalling peer c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:34.855881 29088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:39152
I20260709 13:13:34.856400 29088 raft_consensus.cc:493] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.856657 29088 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.861128 29088 raft_consensus.cc:515] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.862473 29088 leader_election.cc:290] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:34.863332 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:34.863493 29160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4cbe563dc1e4784aec53d250b87d13b" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:34.864010 29355 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.864097 29160 raft_consensus.cc:3055] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.864607 29160 raft_consensus.cc:740] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:34.865411 29160 consensus_queue.cc:260] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.866416 29160 raft_consensus.cc:3060] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.869793 29355 raft_consensus.cc:2468] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:34.870801 29051 leader_election.cc:304] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:34.871445 29160 raft_consensus.cc:2468] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 3.
I20260709 13:13:34.871563 29453 raft_consensus.cc:2804] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.872126 29453 raft_consensus.cc:697] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:34.873057 29453 consensus_queue.cc:237] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.880288 28911 catalog_manager.cc:5697] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 2 to 3, leader changed from 62a851868343413e9be6f4b949d511ba (127.17.171.195) to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 3 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.888880 29430 raft_consensus.cc:993] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:34.889412 29453 raft_consensus.cc:1081] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:34.890828 29160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:34.891360 29160 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.891669 29160 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.897583 29160 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.899130 29160 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 4 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:34.899756 29355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:34.900051 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:34.900466 29355 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.900617 29088 raft_consensus.cc:3055] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:34.901026 29088 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:34.901782 29088 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.902899 29088 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.907104 29355 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 4.
I20260709 13:13:34.908277 29125 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:34.909020 29444 raft_consensus.cc:2804] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:34.909111 29088 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 4.
I20260709 13:13:34.909608 29444 raft_consensus.cc:697] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:34.910459 29444 consensus_queue.cc:237] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:34.917410 28911 catalog_manager.cc:5697] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 3 to 4, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 4 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.186492 29355 raft_consensus.cc:1275] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.187812 29430 consensus_queue.cc:1048] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.200287 29160 raft_consensus.cc:1275] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.201730 29453 consensus_queue.cc:1048] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:35.238876 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:35.323190 29356 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:35.324502 29443 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:35.333062 29088 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:35.334477 29466 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:35.366763 29161 raft_consensus.cc:1275] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:35.368196 29453 consensus_queue.cc:1048] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.377429 29356 raft_consensus.cc:1275] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:35.379026 29430 consensus_queue.cc:1048] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.467272 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.474452 29161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
mode: GRACEFUL
new_leader_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:53300
I20260709 13:13:35.475041 29161 raft_consensus.cc:606] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Received request to transfer leadership to TS c2e63f26e63946ddb432b1f45f185726
I20260709 13:13:35.477612 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a812142e18044199d2c083d92861a94"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:35.478127 29088 raft_consensus.cc:606] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:35.480479 29088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
mode: GRACEFUL
new_leader_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:13:35.480916 29088 raft_consensus.cc:606] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Received request to transfer leadership to TS 62a851868343413e9be6f4b949d511ba
I20260709 13:13:35.481907 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:35.482390 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:35.482892 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.582793 29430 raft_consensus.cc:993] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:35.583348 29453 raft_consensus.cc:1081] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:35.585028 29161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:35.585601 29161 raft_consensus.cc:493] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.585918 29161 raft_consensus.cc:3060] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.591734 29161 raft_consensus.cc:515] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.593832 29161 leader_election.cc:290] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:35.594676 29356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:35.594740 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2ef2223e08485ca47508039af7fe71" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:35.595528 29356 raft_consensus.cc:3060] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.595582 29088 raft_consensus.cc:3055] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.595995 29088 raft_consensus.cc:740] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:35.596853 29088 consensus_queue.cc:260] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.598194 29088 raft_consensus.cc:3060] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.603379 29356 raft_consensus.cc:2468] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:35.604918 29125 leader_election.cc:304] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:35.605201 29088 raft_consensus.cc:2468] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 2.
I20260709 13:13:35.605841 29467 raft_consensus.cc:2804] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.606438 29467 raft_consensus.cc:697] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:35.607259 29467 consensus_queue.cc:237] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.614953 28909 catalog_manager.cc:5697] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 1 to 2, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 2 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.745402 29466 raft_consensus.cc:993] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: : Instructing follower c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:35.745960 29467 raft_consensus.cc:1081] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Signalling peer c2e63f26e63946ddb432b1f45f185726 to start an election
I20260709 13:13:35.747560 29088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb"
dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
 from {username='slave'} at 127.0.0.1:39152
I20260709 13:13:35.748023 29088 raft_consensus.cc:493] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.748363 29088 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.753036 29088 raft_consensus.cc:515] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.754594 29088 leader_election.cc:290] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 5 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), 62a851868343413e9be6f4b949d511ba (127.17.171.195:35839)
I20260709 13:13:35.755450 29356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:35.755517 29161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2091eca5b2ee410ea8b46f812d545abb" candidate_uuid: "c2e63f26e63946ddb432b1f45f185726" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "62a851868343413e9be6f4b949d511ba"
I20260709 13:13:35.756377 29356 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.756544 29161 raft_consensus.cc:3055] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:35.756940 29161 raft_consensus.cc:740] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:35.757752 29161 consensus_queue.cc:260] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.759006 29161 raft_consensus.cc:3060] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.763656 29356 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 5.
I20260709 13:13:35.764900 29051 leader_election.cc:304] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76efb6ed03474988a248e8ba602494ca, c2e63f26e63946ddb432b1f45f185726; no voters: 
I20260709 13:13:35.765566 29453 raft_consensus.cc:2804] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:35.765756 29161 raft_consensus.cc:2468] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2e63f26e63946ddb432b1f45f185726 in term 5.
I20260709 13:13:35.765995 29453 raft_consensus.cc:697] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 5 LEADER]: Becoming Leader. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:35.766889 29453 consensus_queue.cc:237] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.773543 28909 catalog_manager.cc:5697] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 reported cstate change: term changed from 4 to 5, leader changed from 62a851868343413e9be6f4b949d511ba (127.17.171.195) to c2e63f26e63946ddb432b1f45f185726 (127.17.171.194). New cstate: current_term: 5 leader_uuid: "c2e63f26e63946ddb432b1f45f185726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.803067 29435 raft_consensus.cc:993] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: : Instructing follower 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:35.803575 29453 raft_consensus.cc:1081] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 LEADER]: Signalling peer 62a851868343413e9be6f4b949d511ba to start an election
I20260709 13:13:35.805078 29161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a812142e18044199d2c083d92861a94"
dest_uuid: "62a851868343413e9be6f4b949d511ba"
 from {username='slave'} at 127.0.0.1:51374
I20260709 13:13:35.805613 29161 raft_consensus.cc:493] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.806011 29161 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.810798 29161 raft_consensus.cc:515] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.812434 29161 leader_election.cc:290] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 3 election: Requested vote from peers 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629), c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793)
I20260709 13:13:35.813267 29356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76efb6ed03474988a248e8ba602494ca"
I20260709 13:13:35.813400 29088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a812142e18044199d2c083d92861a94" candidate_uuid: "62a851868343413e9be6f4b949d511ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c2e63f26e63946ddb432b1f45f185726"
I20260709 13:13:35.814023 29088 raft_consensus.cc:3055] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:35.814287 29088 raft_consensus.cc:740] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c2e63f26e63946ddb432b1f45f185726, State: Running, Role: LEADER
I20260709 13:13:35.814507 29356 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.815151 29088 consensus_queue.cc:260] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.816541 29088 raft_consensus.cc:3060] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.820489 29356 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 3.
I20260709 13:13:35.821393 29088 raft_consensus.cc:2468] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a851868343413e9be6f4b949d511ba in term 3.
I20260709 13:13:35.821616 29125 leader_election.cc:304] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a851868343413e9be6f4b949d511ba, 76efb6ed03474988a248e8ba602494ca; no voters: 
I20260709 13:13:35.822422 29467 raft_consensus.cc:2804] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:35.822880 29467 raft_consensus.cc:697] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 3 LEADER]: Becoming Leader. State: Replica: 62a851868343413e9be6f4b949d511ba, State: Running, Role: LEADER
I20260709 13:13:35.823493 29467 consensus_queue.cc:237] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } }
I20260709 13:13:35.829715 28909 catalog_manager.cc:5697] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba reported cstate change: term changed from 2 to 3, leader changed from c2e63f26e63946ddb432b1f45f185726 (127.17.171.194) to 62a851868343413e9be6f4b949d511ba (127.17.171.195). New cstate: current_term: 3 leader_uuid: "62a851868343413e9be6f4b949d511ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.050947 29356 raft_consensus.cc:1275] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.052202 29467 consensus_queue.cc:1048] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.062944 29088 raft_consensus.cc:1275] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:36.064183 29444 consensus_queue.cc:1048] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:36.239804 28959 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:36.259699 29356 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 5 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:36.261209 29453 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:36.270438 29161 raft_consensus.cc:1275] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 5 FOLLOWER]: Refusing update from remote peer c2e63f26e63946ddb432b1f45f185726: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:36.271991 29453 consensus_queue.cc:1048] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a851868343413e9be6f4b949d511ba" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:36.342026 29088 raft_consensus.cc:1275] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.343219 29444 consensus_queue.cc:1048] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2e63f26e63946ddb432b1f45f185726" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:36.351208 29355 raft_consensus.cc:1275] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Refusing update from remote peer 62a851868343413e9be6f4b949d511ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.352661 29467 consensus_queue.cc:1048] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "76efb6ed03474988a248e8ba602494ca" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:36.488873 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:36.518606 18095 tablet_server.cc:179] TabletServer@127.17.171.193:45629 shutting down...
I20260709 13:13:36.547806 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.548659 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.549355 18095 raft_consensus.cc:2243] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.549844 18095 raft_consensus.cc:2272] T 7cefdcdb640a4a589022c88d7c46ac22 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.553186 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.554414 18095 raft_consensus.cc:2243] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.555107 18095 raft_consensus.cc:2272] T cb2ef2223e08485ca47508039af7fe71 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.558970 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.559582 18095 raft_consensus.cc:2243] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.560091 18095 raft_consensus.cc:2272] T 5a812142e18044199d2c083d92861a94 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.563407 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.564389 18095 raft_consensus.cc:2243] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.565048 18095 raft_consensus.cc:2272] T 3ee301c956394f7c960ec3bafed83589 P 76efb6ed03474988a248e8ba602494ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.567548 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.568099 18095 raft_consensus.cc:2243] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.568609 18095 raft_consensus.cc:2272] T 69a998a870214438acaa1339c9fc2663 P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.570817 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.571359 18095 raft_consensus.cc:2243] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.571808 18095 raft_consensus.cc:2272] T 2091eca5b2ee410ea8b46f812d545abb P 76efb6ed03474988a248e8ba602494ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.574348 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.574916 18095 raft_consensus.cc:2243] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.575347 18095 raft_consensus.cc:2272] T c4cbe563dc1e4784aec53d250b87d13b P 76efb6ed03474988a248e8ba602494ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.577525 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.578015 18095 raft_consensus.cc:2243] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.578435 18095 raft_consensus.cc:2272] T 4cd6f848e2b14bf687575084e168c3fa P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.580505 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.580986 18095 raft_consensus.cc:2243] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.581429 18095 raft_consensus.cc:2272] T 695b8e2d195e445cbf0e847bf76c8f23 P 76efb6ed03474988a248e8ba602494ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.583629 18095 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.584247 18095 raft_consensus.cc:2243] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.584829 18095 raft_consensus.cc:2272] T fa92b60a211948d5a79d0bb8b6193b87 P 76efb6ed03474988a248e8ba602494ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.585388 29125 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 71 similar messages]
W20260709 13:13:36.588748 29125 consensus_peers.cc:597] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:36.591976 29125 consensus_peers.cc:597] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:36.611374 29051 consensus_peers.cc:597] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.618669 18095 tablet_server.cc:196] TabletServer@127.17.171.193:45629 shutdown complete.
I20260709 13:13:36.645612 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
W20260709 13:13:36.660480 29126 consensus_peers.cc:597] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba -> Peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Couldn't send request to peer c2e63f26e63946ddb432b1f45f185726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.671523 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.672385 18095 tablet_replica.cc:333] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.673132 18095 raft_consensus.cc:2243] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.673938 18095 raft_consensus.cc:2272] T c4cbe563dc1e4784aec53d250b87d13b P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.676352 18095 tablet_replica.cc:333] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.676965 18095 raft_consensus.cc:2243] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.677400 18095 raft_consensus.cc:2272] T 4cd6f848e2b14bf687575084e168c3fa P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.679409 18095 tablet_replica.cc:333] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.679955 18095 raft_consensus.cc:2243] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.680414 18095 raft_consensus.cc:2272] T 695b8e2d195e445cbf0e847bf76c8f23 P c2e63f26e63946ddb432b1f45f185726 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.682462 18095 tablet_replica.cc:333] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.682971 18095 raft_consensus.cc:2243] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.683382 18095 raft_consensus.cc:2272] T 7cefdcdb640a4a589022c88d7c46ac22 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.685348 18095 tablet_replica.cc:333] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.685876 18095 raft_consensus.cc:2243] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.686672 18095 raft_consensus.cc:2272] T 2091eca5b2ee410ea8b46f812d545abb P c2e63f26e63946ddb432b1f45f185726 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.689757 18095 tablet_replica.cc:333] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.690428 18095 raft_consensus.cc:2243] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.691362 18095 raft_consensus.cc:2272] T 69a998a870214438acaa1339c9fc2663 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.692304 29126 consensus_peers.cc:597] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba -> Peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Couldn't send request to peer c2e63f26e63946ddb432b1f45f185726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.694103 18095 tablet_replica.cc:333] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.694908 18095 raft_consensus.cc:2243] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.695686 18095 raft_consensus.cc:2272] T 3ee301c956394f7c960ec3bafed83589 P c2e63f26e63946ddb432b1f45f185726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.697862 18095 tablet_replica.cc:333] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.698366 18095 raft_consensus.cc:2243] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.698786 18095 raft_consensus.cc:2272] T 5a812142e18044199d2c083d92861a94 P c2e63f26e63946ddb432b1f45f185726 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.701406 18095 tablet_replica.cc:333] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.701951 18095 raft_consensus.cc:2243] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.702374 18095 raft_consensus.cc:2272] T cb2ef2223e08485ca47508039af7fe71 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.704887 18095 tablet_replica.cc:333] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726: stopping tablet replica
I20260709 13:13:36.705404 18095 raft_consensus.cc:2243] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.705861 18095 raft_consensus.cc:2272] T fa92b60a211948d5a79d0bb8b6193b87 P c2e63f26e63946ddb432b1f45f185726 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.718834 29126 consensus_peers.cc:597] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba -> Peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Couldn't send request to peer c2e63f26e63946ddb432b1f45f185726. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:36.730151 29126 consensus_peers.cc:597] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba -> Peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Couldn't send request to peer c2e63f26e63946ddb432b1f45f185726. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:32793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.739832 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
W20260709 13:13:36.741194 29125 consensus_peers.cc:597] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba -> Peer 76efb6ed03474988a248e8ba602494ca (127.17.171.193:45629): Couldn't send request to peer 76efb6ed03474988a248e8ba602494ca. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:36.745615 29126 consensus_peers.cc:597] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba -> Peer c2e63f26e63946ddb432b1f45f185726 (127.17.171.194:32793): Couldn't send request to peer c2e63f26e63946ddb432b1f45f185726. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:32793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.767697 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
I20260709 13:13:36.796072 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.796918 18095 tablet_replica.cc:333] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.798076 18095 raft_consensus.cc:2243] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.799175 18095 raft_consensus.cc:2272] T fa92b60a211948d5a79d0bb8b6193b87 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.801506 18095 tablet_replica.cc:333] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.802021 18095 raft_consensus.cc:2243] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.802469 18095 raft_consensus.cc:2272] T c4cbe563dc1e4784aec53d250b87d13b P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.804514 18095 tablet_replica.cc:333] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.805088 18095 raft_consensus.cc:2243] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.805795 18095 raft_consensus.cc:2272] T 4cd6f848e2b14bf687575084e168c3fa P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.807822 18095 tablet_replica.cc:333] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.808413 18095 raft_consensus.cc:2243] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.809110 18095 raft_consensus.cc:2272] T 695b8e2d195e445cbf0e847bf76c8f23 P 62a851868343413e9be6f4b949d511ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.811044 18095 tablet_replica.cc:333] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.811520 18095 raft_consensus.cc:2243] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.812271 18095 raft_consensus.cc:2272] T 7cefdcdb640a4a589022c88d7c46ac22 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.814205 18095 tablet_replica.cc:333] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.814678 18095 raft_consensus.cc:2243] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.815026 18095 raft_consensus.cc:2272] T 69a998a870214438acaa1339c9fc2663 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.817018 18095 tablet_replica.cc:333] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.817540 18095 raft_consensus.cc:2243] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.817987 18095 raft_consensus.cc:2272] T 2091eca5b2ee410ea8b46f812d545abb P 62a851868343413e9be6f4b949d511ba [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.820604 18095 tablet_replica.cc:333] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.821157 18095 raft_consensus.cc:2243] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.822074 18095 raft_consensus.cc:2272] T cb2ef2223e08485ca47508039af7fe71 P 62a851868343413e9be6f4b949d511ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.824517 18095 tablet_replica.cc:333] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.825047 18095 raft_consensus.cc:2243] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.825465 18095 raft_consensus.cc:2272] T 3ee301c956394f7c960ec3bafed83589 P 62a851868343413e9be6f4b949d511ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.827850 18095 tablet_replica.cc:333] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba: stopping tablet replica
I20260709 13:13:36.828423 18095 raft_consensus.cc:2243] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.829218 18095 raft_consensus.cc:2272] T 5a812142e18044199d2c083d92861a94 P 62a851868343413e9be6f4b949d511ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.860015 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
I20260709 13:13:36.885720 18095 master.cc:562] Master@127.17.171.254:44367 shutting down...
I20260709 13:13:36.908068 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.908733 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.909098 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P abfefba423904dbab665a72d8d372b29: stopping tablet replica
I20260709 13:13:36.929332 18095 master.cc:584] Master@127.17.171.254:44367 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12886 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:36.973655 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:41347
I20260709 13:13:36.975263 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:36.983606 29489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.984120 29490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.985483 29492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.985661 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:36.986778 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:36.986953 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:36.987138 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602816987124 us; error 0 us; skew 500 ppm
I20260709 13:13:36.987756 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:36.990161 18095 webserver.cc:533] Webserver started at http://127.17.171.254:45763/ using document root <none> and password file <none>
I20260709 13:13:36.990684 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:36.990875 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:36.991155 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:36.992339 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "edb79ab69db54321ae8a0bf98d995438"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-jhlz"
I20260709 13:13:36.996802 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:37.000342 29497 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.001129 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:37.001462 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "edb79ab69db54321ae8a0bf98d995438"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-jhlz"
I20260709 13:13:37.001719 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.030494 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.031764 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.069500 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:41347
I20260709 13:13:37.069617 29548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:41347 every 8 connection(s)
I20260709 13:13:37.073575 29549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.084831 29549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438: Bootstrap starting.
I20260709 13:13:37.089670 29549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.094101 29549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438: No bootstrap required, opened a new log
I20260709 13:13:37.096306 29549 raft_consensus.cc:359] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb79ab69db54321ae8a0bf98d995438" member_type: VOTER }
I20260709 13:13:37.096692 29549 raft_consensus.cc:385] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.096879 29549 raft_consensus.cc:740] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb79ab69db54321ae8a0bf98d995438, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.097499 29549 consensus_queue.cc:260] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb79ab69db54321ae8a0bf98d995438" member_type: VOTER }
I20260709 13:13:37.097929 29549 raft_consensus.cc:399] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:37.098129 29549 raft_consensus.cc:493] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:37.098335 29549 raft_consensus.cc:3060] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.103425 29549 raft_consensus.cc:515] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb79ab69db54321ae8a0bf98d995438" member_type: VOTER }
I20260709 13:13:37.104055 29549 leader_election.cc:304] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edb79ab69db54321ae8a0bf98d995438; no voters: 
I20260709 13:13:37.105247 29549 leader_election.cc:290] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:37.105621 29552 raft_consensus.cc:2804] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.107091 29552 raft_consensus.cc:697] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 1 LEADER]: Becoming Leader. State: Replica: edb79ab69db54321ae8a0bf98d995438, State: Running, Role: LEADER
I20260709 13:13:37.107771 29552 consensus_queue.cc:237] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb79ab69db54321ae8a0bf98d995438" member_type: VOTER }
I20260709 13:13:37.108443 29549 sys_catalog.cc:565] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:37.112838 29554 sys_catalog.cc:455] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edb79ab69db54321ae8a0bf98d995438. Latest consensus state: current_term: 1 leader_uuid: "edb79ab69db54321ae8a0bf98d995438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb79ab69db54321ae8a0bf98d995438" member_type: VOTER } }
I20260709 13:13:37.113734 29554 sys_catalog.cc:458] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:37.118095 29553 sys_catalog.cc:455] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edb79ab69db54321ae8a0bf98d995438" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edb79ab69db54321ae8a0bf98d995438" member_type: VOTER } }
I20260709 13:13:37.119652 29553 sys_catalog.cc:458] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:37.119850 29558 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:37.126776 29558 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:37.135133 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:37.137356 29558 catalog_manager.cc:1383] Generated new cluster ID: cc8dea44f92b4edb904910e51a9acff7
I20260709 13:13:37.137652 29558 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:37.161667 29558 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:37.162981 29558 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:37.185412 29558 catalog_manager.cc:6070] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438: Generated new TSK 0
I20260709 13:13:37.186048 29558 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:37.201958 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.208299 29570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.209476 29571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.211165 18095 server_base.cc:1061] running on GCE node
W20260709 13:13:37.211933 29573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.212929 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.213167 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.213294 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602817213283 us; error 0 us; skew 500 ppm
I20260709 13:13:37.213755 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.215915 18095 webserver.cc:533] Webserver started at http://127.17.171.193:33475/ using document root <none> and password file <none>
I20260709 13:13:37.216423 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.216588 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.216796 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.217856 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "d8368265f1f74353ad1e6c457670f1d1"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-jhlz"
I20260709 13:13:37.222378 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:37.225807 29578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.226581 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:37.226833 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "d8368265f1f74353ad1e6c457670f1d1"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-jhlz"
I20260709 13:13:37.227072 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.245210 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.246397 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.247787 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.250169 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:37.250345 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.250669 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:37.250845 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.290764 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:33755
I20260709 13:13:37.290879 29640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:33755 every 8 connection(s)
I20260709 13:13:37.296005 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.303046 29645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.304967 29646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.306447 29648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.306892 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:37.308507 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:37.308748 29641 heartbeater.cc:344] Connected to a master server at 127.17.171.254:41347
W20260709 13:13:37.308765 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.309170 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602817309150 us; error 0 us; skew 500 ppm
I20260709 13:13:37.309228 29641 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:37.309890 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.310154 29641 heartbeater.cc:507] Master 127.17.171.254:41347 requested a full tablet report, sending...
I20260709 13:13:37.312620 29514 ts_manager.cc:194] Registered new tserver with Master: d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755)
I20260709 13:13:37.312677 18095 webserver.cc:533] Webserver started at http://127.17.171.194:41813/ using document root <none> and password file <none>
I20260709 13:13:37.313546 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.313776 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.314055 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.314829 29514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50324
I20260709 13:13:37.315323 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "c818a46a2210415c8997d9eed8bf661e"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-jhlz"
I20260709 13:13:37.319715 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:13:37.322954 29653 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.323804 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:37.324103 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "c818a46a2210415c8997d9eed8bf661e"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-jhlz"
I20260709 13:13:37.324453 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.344826 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.346014 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.347426 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.349664 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:37.349884 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.350132 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:37.350353 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.389539 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:34583
I20260709 13:13:37.389638 29715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:34583 every 8 connection(s)
I20260709 13:13:37.394862 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.402247 29719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.402995 29720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.406620 18095 server_base.cc:1061] running on GCE node
W20260709 13:13:37.407269 29723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.408093 29716 heartbeater.cc:344] Connected to a master server at 127.17.171.254:41347
I20260709 13:13:37.408608 29716 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:37.410132 29716 heartbeater.cc:507] Master 127.17.171.254:41347 requested a full tablet report, sending...
I20260709 13:13:37.410559 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.410873 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.411108 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602817411085 us; error 0 us; skew 500 ppm
I20260709 13:13:37.411906 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.412493 29514 ts_manager.cc:194] Registered new tserver with Master: c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583)
I20260709 13:13:37.414139 29514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50330
I20260709 13:13:37.414577 18095 webserver.cc:533] Webserver started at http://127.17.171.195:45637/ using document root <none> and password file <none>
I20260709 13:13:37.415226 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.415462 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.415731 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.417244 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "ea8bab8b5b3b457a97e6085583d4d914"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-jhlz"
I20260709 13:13:37.421768 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:37.425405 29727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.426281 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:37.426587 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "ea8bab8b5b3b457a97e6085583d4d914"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-jhlz"
I20260709 13:13:37.426919 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.439393 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.440641 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.442090 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.444314 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:37.444530 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.444769 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:37.444939 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.484937 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:33775
I20260709 13:13:37.485072 29789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:33775 every 8 connection(s)
I20260709 13:13:37.499547 29790 heartbeater.cc:344] Connected to a master server at 127.17.171.254:41347
I20260709 13:13:37.500047 29790 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:37.500954 29790 heartbeater.cc:507] Master 127.17.171.254:41347 requested a full tablet report, sending...
I20260709 13:13:37.502986 29514 ts_manager.cc:194] Registered new tserver with Master: ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:37.503988 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015810244s
I20260709 13:13:37.504518 29514 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50342
I20260709 13:13:37.530337 29514 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50358:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:37.532537 29514 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:37.586236 29755 tablet_service.cc:1511] Processing CreateTablet for tablet 25fb0c4cb7794ed5ab2d2c1e3f33b54a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=96b85e1bff0543e3878e1bbf8b3302c2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.587708 29755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fb0c4cb7794ed5ab2d2c1e3f33b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.587387 29606 tablet_service.cc:1511] Processing CreateTablet for tablet 25fb0c4cb7794ed5ab2d2c1e3f33b54a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=96b85e1bff0543e3878e1bbf8b3302c2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.587924 29605 tablet_service.cc:1511] Processing CreateTablet for tablet 2b80a78c0bc443bdbb1edde82c469acc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=96b85e1bff0543e3878e1bbf8b3302c2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.588877 29606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fb0c4cb7794ed5ab2d2c1e3f33b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.589573 29605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80a78c0bc443bdbb1edde82c469acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.588503 29754 tablet_service.cc:1511] Processing CreateTablet for tablet 2b80a78c0bc443bdbb1edde82c469acc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=96b85e1bff0543e3878e1bbf8b3302c2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.590579 29754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80a78c0bc443bdbb1edde82c469acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.598796 29681 tablet_service.cc:1511] Processing CreateTablet for tablet 25fb0c4cb7794ed5ab2d2c1e3f33b54a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=96b85e1bff0543e3878e1bbf8b3302c2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.599388 29680 tablet_service.cc:1511] Processing CreateTablet for tablet 2b80a78c0bc443bdbb1edde82c469acc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=96b85e1bff0543e3878e1bbf8b3302c2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.600250 29681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fb0c4cb7794ed5ab2d2c1e3f33b54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.601701 29680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80a78c0bc443bdbb1edde82c469acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.617417 29805 tablet_bootstrap.cc:492] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914: Bootstrap starting.
I20260709 13:13:37.625154 29805 tablet_bootstrap.cc:654] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.625514 29806 tablet_bootstrap.cc:492] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1: Bootstrap starting.
I20260709 13:13:37.626858 29807 tablet_bootstrap.cc:492] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: Bootstrap starting.
I20260709 13:13:37.634645 29806 tablet_bootstrap.cc:654] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.637253 29807 tablet_bootstrap.cc:654] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.637964 29805 tablet_bootstrap.cc:492] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914: No bootstrap required, opened a new log
I20260709 13:13:37.638808 29805 ts_tablet_manager.cc:1403] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:13:37.643132 29805 raft_consensus.cc:359] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.644029 29805 raft_consensus.cc:385] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.644117 29806 tablet_bootstrap.cc:492] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1: No bootstrap required, opened a new log
I20260709 13:13:37.644366 29807 tablet_bootstrap.cc:492] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: No bootstrap required, opened a new log
I20260709 13:13:37.644397 29805 raft_consensus.cc:740] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8bab8b5b3b457a97e6085583d4d914, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.644783 29806 ts_tablet_manager.cc:1403] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:37.645195 29807 ts_tablet_manager.cc:1403] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:13:37.645622 29805 consensus_queue.cc:260] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.647895 29790 heartbeater.cc:499] Master 127.17.171.254:41347 was elected leader, sending a full tablet report...
I20260709 13:13:37.648460 29806 raft_consensus.cc:359] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.648761 29807 raft_consensus.cc:359] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.649416 29806 raft_consensus.cc:385] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.649597 29807 raft_consensus.cc:385] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.649865 29806 raft_consensus.cc:740] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.649989 29807 raft_consensus.cc:740] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.650811 29806 consensus_queue.cc:260] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.650982 29805 ts_tablet_manager.cc:1434] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:13:37.652735 29805 tablet_bootstrap.cc:492] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914: Bootstrap starting.
I20260709 13:13:37.652117 29807 consensus_queue.cc:260] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.658651 29641 heartbeater.cc:499] Master 127.17.171.254:41347 was elected leader, sending a full tablet report...
I20260709 13:13:37.659557 29716 heartbeater.cc:499] Master 127.17.171.254:41347 was elected leader, sending a full tablet report...
I20260709 13:13:37.659741 29806 ts_tablet_manager.cc:1434] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 13:13:37.660260 29807 ts_tablet_manager.cc:1434] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:13:37.661309 29806 tablet_bootstrap.cc:492] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: Bootstrap starting.
I20260709 13:13:37.663196 29807 tablet_bootstrap.cc:492] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e: Bootstrap starting.
I20260709 13:13:37.671635 29806 tablet_bootstrap.cc:654] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.671635 29807 tablet_bootstrap.cc:654] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.681339 29805 tablet_bootstrap.cc:654] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.683305 29806 tablet_bootstrap.cc:492] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: No bootstrap required, opened a new log
I20260709 13:13:37.683951 29806 ts_tablet_manager.cc:1403] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:13:37.684350 29807 tablet_bootstrap.cc:492] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e: No bootstrap required, opened a new log
I20260709 13:13:37.684959 29807 ts_tablet_manager.cc:1403] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:13:37.686632 29805 tablet_bootstrap.cc:492] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914: No bootstrap required, opened a new log
I20260709 13:13:37.687263 29805 ts_tablet_manager.cc:1403] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.007s
I20260709 13:13:37.687374 29806 raft_consensus.cc:359] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.688287 29806 raft_consensus.cc:385] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.688239 29807 raft_consensus.cc:359] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.688808 29806 raft_consensus.cc:740] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.689201 29807 raft_consensus.cc:385] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.689615 29807 raft_consensus.cc:740] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.695583 29806 consensus_queue.cc:260] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.695993 29807 consensus_queue.cc:260] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.697402 29805 raft_consensus.cc:359] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.698168 29805 raft_consensus.cc:385] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.698244 29806 ts_tablet_manager.cc:1434] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:13:37.698496 29805 raft_consensus.cc:740] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8bab8b5b3b457a97e6085583d4d914, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.699373 29805 consensus_queue.cc:260] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.701463 29807 ts_tablet_manager.cc:1434] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:13:37.701848 29805 ts_tablet_manager.cc:1434] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:13:37.826349 29812 raft_consensus.cc:493] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.826926 29812 raft_consensus.cc:515] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.829481 29813 raft_consensus.cc:493] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.830104 29813 raft_consensus.cc:515] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.830523 29812 leader_election.cc:290] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:37.837692 29813 leader_election.cc:290] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775), d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755)
I20260709 13:13:37.846451 29812 raft_consensus.cc:493] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.847039 29812 raft_consensus.cc:515] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.848352 29691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c818a46a2210415c8997d9eed8bf661e" is_pre_election: true
I20260709 13:13:37.849148 29691 raft_consensus.cc:2468] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 0.
I20260709 13:13:37.849398 29812 leader_election.cc:290] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775), c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583)
I20260709 13:13:37.850183 29616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8368265f1f74353ad1e6c457670f1d1" is_pre_election: true
I20260709 13:13:37.850854 29616 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 0.
I20260709 13:13:37.851438 29691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c818a46a2210415c8997d9eed8bf661e" is_pre_election: true
I20260709 13:13:37.850783 29581 leader_election.cc:304] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, d8368265f1f74353ad1e6c457670f1d1; no voters: 
I20260709 13:13:37.852089 29691 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 0.
I20260709 13:13:37.852424 29764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914" is_pre_election: true
I20260709 13:13:37.853173 29764 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 0.
I20260709 13:13:37.853336 29812 raft_consensus.cc:2804] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.853268 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914" is_pre_election: true
I20260709 13:13:37.854526 29812 raft_consensus.cc:493] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.854568 29580 leader_election.cc:304] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8368265f1f74353ad1e6c457670f1d1, ea8bab8b5b3b457a97e6085583d4d914; no voters: 
I20260709 13:13:37.854744 29765 raft_consensus.cc:2468] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 0.
I20260709 13:13:37.856559 29654 leader_election.cc:304] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, d8368265f1f74353ad1e6c457670f1d1; no voters: 
I20260709 13:13:37.855019 29812 raft_consensus.cc:3060] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.857460 29813 raft_consensus.cc:2804] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.857652 29821 raft_consensus.cc:2804] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.857878 29813 raft_consensus.cc:493] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.858150 29821 raft_consensus.cc:493] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.858331 29813 raft_consensus.cc:3060] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.858574 29821 raft_consensus.cc:3060] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.861366 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914" is_pre_election: true
I20260709 13:13:37.862043 29765 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 0.
I20260709 13:13:37.865695 29812 raft_consensus.cc:515] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.865734 29821 raft_consensus.cc:515] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.865942 29813 raft_consensus.cc:515] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.868088 29821 leader_election.cc:290] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 election: Requested vote from peers ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775), c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583)
I20260709 13:13:37.868934 29812 leader_election.cc:290] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 election: Requested vote from peers c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:37.869308 29616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
I20260709 13:13:37.869575 29813 leader_election.cc:290] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 election: Requested vote from peers ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775), d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755)
I20260709 13:13:37.870071 29691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
I20260709 13:13:37.870088 29690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
I20260709 13:13:37.870826 29691 raft_consensus.cc:3060] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.871285 29690 raft_consensus.cc:2393] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8368265f1f74353ad1e6c457670f1d1 in current term 1: Already voted for candidate c818a46a2210415c8997d9eed8bf661e in this term.
I20260709 13:13:37.870473 29764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:37.871702 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:37.870155 29616 raft_consensus.cc:2393] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c818a46a2210415c8997d9eed8bf661e in current term 1: Already voted for candidate d8368265f1f74353ad1e6c457670f1d1 in this term.
I20260709 13:13:37.872100 29764 raft_consensus.cc:3060] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.871304 29765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:37.872329 29763 raft_consensus.cc:3060] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.877074 29691 raft_consensus.cc:2468] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 1.
I20260709 13:13:37.878389 29581 leader_election.cc:304] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, d8368265f1f74353ad1e6c457670f1d1; no voters: 
I20260709 13:13:37.879248 29812 raft_consensus.cc:2804] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.880003 29580 leader_election.cc:304] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8368265f1f74353ad1e6c457670f1d1; no voters: c818a46a2210415c8997d9eed8bf661e, ea8bab8b5b3b457a97e6085583d4d914
I20260709 13:13:37.879724 29812 raft_consensus.cc:697] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Becoming Leader. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Running, Role: LEADER
I20260709 13:13:37.880225 29764 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 1.
I20260709 13:13:37.880003 29763 raft_consensus.cc:2468] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 1.
I20260709 13:13:37.881259 29812 consensus_queue.cc:237] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:37.881950 29821 raft_consensus.cc:2749] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.882498 29655 leader_election.cc:304] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, ea8bab8b5b3b457a97e6085583d4d914; no voters: d8368265f1f74353ad1e6c457670f1d1
I20260709 13:13:37.883369 29813 raft_consensus.cc:2804] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.884804 29813 raft_consensus.cc:697] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Becoming Leader. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Running, Role: LEADER
I20260709 13:13:37.885710 29813 consensus_queue.cc:237] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:37.891505 29513 catalog_manager.cc:5697] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "d8368265f1f74353ad1e6c457670f1d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.894446 29514 catalog_manager.cc:5697] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e reported cstate change: term changed from 0 to 1, leader changed from <none> to c818a46a2210415c8997d9eed8bf661e (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c818a46a2210415c8997d9eed8bf661e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.941805 29514 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50366:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:37.943748 29514 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:37.967962 29606 tablet_service.cc:1511] Processing CreateTablet for tablet a1312620916b4c83bcb4b15f0ecfc44f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f628cdb934c3445f99d10e36fe1cb3f1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.969314 29606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1312620916b4c83bcb4b15f0ecfc44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.969591 29680 tablet_service.cc:1511] Processing CreateTablet for tablet a1312620916b4c83bcb4b15f0ecfc44f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f628cdb934c3445f99d10e36fe1cb3f1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.970906 29680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1312620916b4c83bcb4b15f0ecfc44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.971575 29754 tablet_service.cc:1511] Processing CreateTablet for tablet a1312620916b4c83bcb4b15f0ecfc44f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f628cdb934c3445f99d10e36fe1cb3f1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.972862 29754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1312620916b4c83bcb4b15f0ecfc44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.973879 29605 tablet_service.cc:1511] Processing CreateTablet for tablet 259d261763f6422196de5f4df9de1d25 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f628cdb934c3445f99d10e36fe1cb3f1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.975257 29605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259d261763f6422196de5f4df9de1d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.979013 29681 tablet_service.cc:1511] Processing CreateTablet for tablet 259d261763f6422196de5f4df9de1d25 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f628cdb934c3445f99d10e36fe1cb3f1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.980365 29681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259d261763f6422196de5f4df9de1d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.980382 29755 tablet_service.cc:1511] Processing CreateTablet for tablet 259d261763f6422196de5f4df9de1d25 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f628cdb934c3445f99d10e36fe1cb3f1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.981729 29755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259d261763f6422196de5f4df9de1d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.991535 29806 tablet_bootstrap.cc:492] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: Bootstrap starting.
I20260709 13:13:37.998926 29806 tablet_bootstrap.cc:654] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.005497 29807 tablet_bootstrap.cc:492] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: Bootstrap starting.
I20260709 13:13:38.007221 29805 tablet_bootstrap.cc:492] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: Bootstrap starting.
I20260709 13:13:38.010139 29806 tablet_bootstrap.cc:492] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: No bootstrap required, opened a new log
I20260709 13:13:38.010776 29806 ts_tablet_manager.cc:1403] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:13:38.013623 29807 tablet_bootstrap.cc:654] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.014072 29806 raft_consensus.cc:359] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.014789 29805 tablet_bootstrap.cc:654] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.015007 29806 raft_consensus.cc:385] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.015516 29806 raft_consensus.cc:740] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.016391 29806 consensus_queue.cc:260] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.018777 29806 ts_tablet_manager.cc:1434] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:38.019814 29807 tablet_bootstrap.cc:492] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: No bootstrap required, opened a new log
I20260709 13:13:38.019847 29806 tablet_bootstrap.cc:492] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: Bootstrap starting.
I20260709 13:13:38.020649 29807 ts_tablet_manager.cc:1403] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:13:38.022927 29805 tablet_bootstrap.cc:492] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: No bootstrap required, opened a new log
I20260709 13:13:38.023466 29805 ts_tablet_manager.cc:1403] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:13:38.024531 29807 raft_consensus.cc:359] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.025403 29807 raft_consensus.cc:385] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.025693 29807 raft_consensus.cc:740] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.026506 29807 consensus_queue.cc:260] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.031582 29806 tablet_bootstrap.cc:654] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.031953 29805 raft_consensus.cc:359] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.032786 29805 raft_consensus.cc:385] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.033098 29805 raft_consensus.cc:740] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8bab8b5b3b457a97e6085583d4d914, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.034191 29807 ts_tablet_manager.cc:1434] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:38.035401 29807 tablet_bootstrap.cc:492] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e: Bootstrap starting.
I20260709 13:13:38.035457 29805 consensus_queue.cc:260] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.037994 29805 ts_tablet_manager.cc:1434] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.006s
I20260709 13:13:38.039078 29805 tablet_bootstrap.cc:492] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914: Bootstrap starting.
I20260709 13:13:38.041889 29806 tablet_bootstrap.cc:492] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: No bootstrap required, opened a new log
I20260709 13:13:38.042585 29806 ts_tablet_manager.cc:1403] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.009s
I20260709 13:13:38.045933 29805 tablet_bootstrap.cc:654] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.045866 29806 raft_consensus.cc:359] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.046784 29806 raft_consensus.cc:385] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.047178 29806 raft_consensus.cc:740] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.047991 29806 consensus_queue.cc:260] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.050631 29806 ts_tablet_manager.cc:1434] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:13:38.053130 29807 tablet_bootstrap.cc:654] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.058868 29805 tablet_bootstrap.cc:492] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914: No bootstrap required, opened a new log
I20260709 13:13:38.059324 29805 ts_tablet_manager.cc:1403] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:13:38.061095 29807 tablet_bootstrap.cc:492] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e: No bootstrap required, opened a new log
I20260709 13:13:38.061575 29807 ts_tablet_manager.cc:1403] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 13:13:38.062376 29805 raft_consensus.cc:359] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.063187 29805 raft_consensus.cc:385] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.063443 29805 raft_consensus.cc:740] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8bab8b5b3b457a97e6085583d4d914, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.064105 29807 raft_consensus.cc:359] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.064288 29805 consensus_queue.cc:260] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.064778 29807 raft_consensus.cc:385] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.065109 29807 raft_consensus.cc:740] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.065888 29807 consensus_queue.cc:260] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.066499 29805 ts_tablet_manager.cc:1434] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:38.067900 29807 ts_tablet_manager.cc:1434] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:13:38.123594 29813 raft_consensus.cc:493] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.124066 29813 raft_consensus.cc:515] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.125837 29813 leader_election.cc:290] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:38.126725 29616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259d261763f6422196de5f4df9de1d25" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8368265f1f74353ad1e6c457670f1d1" is_pre_election: true
I20260709 13:13:38.126844 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259d261763f6422196de5f4df9de1d25" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914" is_pre_election: true
I20260709 13:13:38.127389 29616 raft_consensus.cc:2468] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 0.
I20260709 13:13:38.127494 29763 raft_consensus.cc:2468] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 0.
I20260709 13:13:38.128454 29654 leader_election.cc:304] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, d8368265f1f74353ad1e6c457670f1d1; no voters: 
I20260709 13:13:38.129319 29813 raft_consensus.cc:2804] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.129657 29813 raft_consensus.cc:493] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:38.129698 29562 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:38.129997 29813 raft_consensus.cc:3060] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.134935 29813 raft_consensus.cc:515] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.136708 29813 leader_election.cc:290] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 election: Requested vote from peers d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:38.137446 29616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259d261763f6422196de5f4df9de1d25" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
I20260709 13:13:38.137817 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259d261763f6422196de5f4df9de1d25" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:38.138022 29616 raft_consensus.cc:3060] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.138429 29763 raft_consensus.cc:3060] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.143546 29616 raft_consensus.cc:2468] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 1.
I20260709 13:13:38.143731 29763 raft_consensus.cc:2468] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 1.
I20260709 13:13:38.144966 29654 leader_election.cc:304] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, d8368265f1f74353ad1e6c457670f1d1; no voters: 
I20260709 13:13:38.145745 29813 raft_consensus.cc:2804] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.146229 29813 raft_consensus.cc:697] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Becoming Leader. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Running, Role: LEADER
I20260709 13:13:38.147019 29813 consensus_queue.cc:237] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.153868 29514 catalog_manager.cc:5697] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e reported cstate change: term changed from 0 to 1, leader changed from <none> to c818a46a2210415c8997d9eed8bf661e (127.17.171.194). New cstate: current_term: 1 leader_uuid: "c818a46a2210415c8997d9eed8bf661e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.202440 29812 raft_consensus.cc:493] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.202988 29812 raft_consensus.cc:515] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.204869 29812 leader_election.cc:290] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:38.205796 29691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c818a46a2210415c8997d9eed8bf661e" is_pre_election: true
I20260709 13:13:38.205884 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914" is_pre_election: true
I20260709 13:13:38.206655 29691 raft_consensus.cc:2468] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 0.
I20260709 13:13:38.206730 29763 raft_consensus.cc:2468] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 0.
I20260709 13:13:38.207851 29580 leader_election.cc:304] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8368265f1f74353ad1e6c457670f1d1, ea8bab8b5b3b457a97e6085583d4d914; no voters: 
I20260709 13:13:38.208592 29812 raft_consensus.cc:2804] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.208923 29812 raft_consensus.cc:493] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.209204 29812 raft_consensus.cc:3060] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.214291 29812 raft_consensus.cc:515] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.215885 29812 leader_election.cc:290] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 election: Requested vote from peers c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:38.216806 29691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
I20260709 13:13:38.216975 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:38.217463 29691 raft_consensus.cc:3060] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.217535 29763 raft_consensus.cc:3060] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.222831 29763 raft_consensus.cc:2468] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 1.
I20260709 13:13:38.222898 29691 raft_consensus.cc:2468] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 1.
I20260709 13:13:38.224036 29580 leader_election.cc:304] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8368265f1f74353ad1e6c457670f1d1, ea8bab8b5b3b457a97e6085583d4d914; no voters: 
I20260709 13:13:38.224869 29812 raft_consensus.cc:2804] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.225386 29812 raft_consensus.cc:697] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Becoming Leader. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Running, Role: LEADER
I20260709 13:13:38.226217 29812 consensus_queue.cc:237] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.233196 29514 catalog_manager.cc:5697] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "d8368265f1f74353ad1e6c457670f1d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.294127 29813 consensus_queue.cc:1048] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.312260 29812 consensus_queue.cc:1048] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.314180 29691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a"
dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
mode: GRACEFUL
new_leader_uuid: "d8368265f1f74353ad1e6c457670f1d1"
 from {username='slave'} at 127.0.0.1:54792
I20260709 13:13:38.314867 29691 raft_consensus.cc:606] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Received request to transfer leadership to TS d8368265f1f74353ad1e6c457670f1d1
I20260709 13:13:38.316044 29842 consensus_queue.cc:1048] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:38.319684 29822 raft_consensus.cc:993] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: : Instructing follower d8368265f1f74353ad1e6c457670f1d1 to start an election
I20260709 13:13:38.320122 29822 raft_consensus.cc:1081] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Signalling peer d8368265f1f74353ad1e6c457670f1d1 to start an election
I20260709 13:13:38.327922 29812 consensus_queue.cc:1048] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.328755 29616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a"
dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
 from {username='slave'} at 127.0.0.1:42924
I20260709 13:13:38.329910 29616 raft_consensus.cc:493] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.330309 29616 raft_consensus.cc:3060] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.333815 29615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc"
dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
mode: GRACEFUL
new_leader_uuid: "c818a46a2210415c8997d9eed8bf661e"
 from {username='slave'} at 127.0.0.1:42928
I20260709 13:13:38.334540 29615 raft_consensus.cc:606] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Received request to transfer leadership to TS c818a46a2210415c8997d9eed8bf661e
I20260709 13:13:38.339259 29616 raft_consensus.cc:515] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:38.341235 29812 raft_consensus.cc:993] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: : Instructing follower c818a46a2210415c8997d9eed8bf661e to start an election
I20260709 13:13:38.341809 29812 raft_consensus.cc:1081] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Signalling peer c818a46a2210415c8997d9eed8bf661e to start an election
I20260709 13:13:38.342043 29616 leader_election.cc:290] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 2 election: Requested vote from peers ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775), c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583)
I20260709 13:13:38.344936 29689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc"
dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
 from {username='slave'} at 127.0.0.1:54782
I20260709 13:13:38.346506 29691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
I20260709 13:13:38.347213 29691 raft_consensus.cc:3055] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.347543 29691 raft_consensus.cc:740] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Running, Role: LEADER
I20260709 13:13:38.346556 29689 raft_consensus.cc:493] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.348779 29689 raft_consensus.cc:3060] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.349076 29764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fb0c4cb7794ed5ab2d2c1e3f33b54a" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:38.350526 29764 raft_consensus.cc:3060] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.351706 29690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "259d261763f6422196de5f4df9de1d25"
dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
mode: GRACEFUL
new_leader_uuid: "d8368265f1f74353ad1e6c457670f1d1"
 from {username='slave'} at 127.0.0.1:54792
I20260709 13:13:38.352376 29690 raft_consensus.cc:606] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Received request to transfer leadership to TS d8368265f1f74353ad1e6c457670f1d1
I20260709 13:13:38.356515 29691 consensus_queue.cc:260] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:38.358141 29691 raft_consensus.cc:3060] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.358539 29764 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 2.
I20260709 13:13:38.359900 29580 leader_election.cc:304] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8368265f1f74353ad1e6c457670f1d1, ea8bab8b5b3b457a97e6085583d4d914; no voters: 
I20260709 13:13:38.366182 29812 raft_consensus.cc:2804] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.366937 29812 raft_consensus.cc:697] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 2 LEADER]: Becoming Leader. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Running, Role: LEADER
I20260709 13:13:38.368942 29812 consensus_queue.cc:237] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } }
I20260709 13:13:38.369611 29691 raft_consensus.cc:2468] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 2.
I20260709 13:13:38.371024 29689 raft_consensus.cc:515] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.384759 29689 leader_election.cc:290] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 2 election: Requested vote from peers d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:38.384902 29616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
I20260709 13:13:38.385639 29616 raft_consensus.cc:3055] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.386003 29616 raft_consensus.cc:740] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Running, Role: LEADER
I20260709 13:13:38.385872 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80a78c0bc443bdbb1edde82c469acc" candidate_uuid: "c818a46a2210415c8997d9eed8bf661e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:38.386718 29763 raft_consensus.cc:3060] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.387041 29616 consensus_queue.cc:260] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.388276 29616 raft_consensus.cc:3060] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.389938 29513 catalog_manager.cc:5697] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 reported cstate change: term changed from 1 to 2, leader changed from c818a46a2210415c8997d9eed8bf661e (127.17.171.194) to d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "d8368265f1f74353ad1e6c457670f1d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.394381 29763 raft_consensus.cc:2468] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 2.
I20260709 13:13:38.396718 29616 raft_consensus.cc:2468] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c818a46a2210415c8997d9eed8bf661e in term 2.
I20260709 13:13:38.397861 29655 leader_election.cc:304] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, ea8bab8b5b3b457a97e6085583d4d914; no voters: 
I20260709 13:13:38.399082 29813 raft_consensus.cc:2804] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.399562 29813 raft_consensus.cc:697] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 2 LEADER]: Becoming Leader. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Running, Role: LEADER
I20260709 13:13:38.400398 29813 consensus_queue.cc:237] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.409330 29511 catalog_manager.cc:5697] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e reported cstate change: term changed from 1 to 2, leader changed from d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193) to c818a46a2210415c8997d9eed8bf661e (127.17.171.194). New cstate: current_term: 2 leader_uuid: "c818a46a2210415c8997d9eed8bf661e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.540751 29842 consensus_queue.cc:1048] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.547855 29813 raft_consensus.cc:993] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: : Instructing follower d8368265f1f74353ad1e6c457670f1d1 to start an election
I20260709 13:13:38.548413 29822 raft_consensus.cc:1081] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Signalling peer d8368265f1f74353ad1e6c457670f1d1 to start an election
I20260709 13:13:38.550216 29615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "259d261763f6422196de5f4df9de1d25"
dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
 from {username='slave'} at 127.0.0.1:42924
I20260709 13:13:38.553514 29615 raft_consensus.cc:493] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.554009 29615 raft_consensus.cc:3060] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.554466 29842 consensus_queue.cc:1048] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.562251 29615 raft_consensus.cc:515] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.565445 29615 leader_election.cc:290] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 2 election: Requested vote from peers c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583), ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195:33775)
I20260709 13:13:38.565763 29689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259d261763f6422196de5f4df9de1d25" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
I20260709 13:13:38.566041 29763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259d261763f6422196de5f4df9de1d25" candidate_uuid: "d8368265f1f74353ad1e6c457670f1d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
I20260709 13:13:38.566455 29689 raft_consensus.cc:3055] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.566606 29763 raft_consensus.cc:3060] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.566864 29689 raft_consensus.cc:740] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c818a46a2210415c8997d9eed8bf661e, State: Running, Role: LEADER
I20260709 13:13:38.567778 29689 consensus_queue.cc:260] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.569180 29689 raft_consensus.cc:3060] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.575294 29763 raft_consensus.cc:2468] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 2.
I20260709 13:13:38.576385 29689 raft_consensus.cc:2468] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8368265f1f74353ad1e6c457670f1d1 in term 2.
I20260709 13:13:38.577800 29581 leader_election.cc:304] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, d8368265f1f74353ad1e6c457670f1d1; no voters: 
I20260709 13:13:38.578987 29847 raft_consensus.cc:2804] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.579464 29847 raft_consensus.cc:697] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 2 LEADER]: Becoming Leader. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Running, Role: LEADER
I20260709 13:13:38.580446 29847 consensus_queue.cc:237] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.587630 29511 catalog_manager.cc:5697] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 reported cstate change: term changed from 1 to 2, leader changed from c818a46a2210415c8997d9eed8bf661e (127.17.171.194) to d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "d8368265f1f74353ad1e6c457670f1d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.680660 18095 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:38.682323 18095 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:38.682753 18095 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:38.696070 29615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f"
dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
mode: GRACEFUL
new_leader_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
 from {username='slave'} at 127.0.0.1:42940
I20260709 13:13:38.696738 29615 raft_consensus.cc:606] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Received request to transfer leadership to TS ea8bab8b5b3b457a97e6085583d4d914
I20260709 13:13:38.697834 18095 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:38.781329 29847 consensus_queue.cc:1048] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.791615 29615 raft_consensus.cc:1275] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Refusing update from remote peer c818a46a2210415c8997d9eed8bf661e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.794102 29812 consensus_queue.cc:1048] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.794143 29822 consensus_queue.cc:1048] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:13:38.807843 29764 raft_consensus.cc:1275] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Refusing update from remote peer c818a46a2210415c8997d9eed8bf661e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.809751 29812 raft_consensus.cc:993] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: : Instructing follower ea8bab8b5b3b457a97e6085583d4d914 to start an election
I20260709 13:13:38.809491 29842 consensus_queue.cc:1048] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.810263 29812 raft_consensus.cc:1081] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Signalling peer ea8bab8b5b3b457a97e6085583d4d914 to start an election
I20260709 13:13:38.812273 29764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f"
dest_uuid: "ea8bab8b5b3b457a97e6085583d4d914"
 from {username='slave'} at 127.0.0.1:50830
I20260709 13:13:38.812879 29764 raft_consensus.cc:493] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.813261 29764 raft_consensus.cc:3060] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.822005 29764 raft_consensus.cc:515] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.824159 29764 leader_election.cc:290] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [CANDIDATE]: Term 2 election: Requested vote from peers d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193:33755), c818a46a2210415c8997d9eed8bf661e (127.17.171.194:34583)
I20260709 13:13:38.836024 29615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f" candidate_uuid: "ea8bab8b5b3b457a97e6085583d4d914" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8368265f1f74353ad1e6c457670f1d1"
I20260709 13:13:38.836752 29615 raft_consensus.cc:3055] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.837129 29615 raft_consensus.cc:740] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8368265f1f74353ad1e6c457670f1d1, State: Running, Role: LEADER
I20260709 13:13:38.837961 29615 consensus_queue.cc:260] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.838976 29689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1312620916b4c83bcb4b15f0ecfc44f" candidate_uuid: "ea8bab8b5b3b457a97e6085583d4d914" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c818a46a2210415c8997d9eed8bf661e"
I20260709 13:13:38.839152 29615 raft_consensus.cc:3060] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.839671 29689 raft_consensus.cc:3060] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.846652 29689 raft_consensus.cc:2468] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8bab8b5b3b457a97e6085583d4d914 in term 2.
I20260709 13:13:38.846652 29615 raft_consensus.cc:2468] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea8bab8b5b3b457a97e6085583d4d914 in term 2.
I20260709 13:13:38.848147 29730 leader_election.cc:304] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c818a46a2210415c8997d9eed8bf661e, ea8bab8b5b3b457a97e6085583d4d914; no voters: 
I20260709 13:13:38.849115 29854 raft_consensus.cc:2804] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.849668 29854 raft_consensus.cc:697] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 2 LEADER]: Becoming Leader. State: Replica: ea8bab8b5b3b457a97e6085583d4d914, State: Running, Role: LEADER
I20260709 13:13:38.850610 29854 consensus_queue.cc:237] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } }
I20260709 13:13:38.857411 29512 catalog_manager.cc:5697] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 reported cstate change: term changed from 1 to 2, leader changed from d8368265f1f74353ad1e6c457670f1d1 (127.17.171.193) to ea8bab8b5b3b457a97e6085583d4d914 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "ea8bab8b5b3b457a97e6085583d4d914" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8368265f1f74353ad1e6c457670f1d1" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 33755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.927152 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:13:38.935034 29764 raft_consensus.cc:1275] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Refusing update from remote peer d8368265f1f74353ad1e6c457670f1d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.936724 29848 consensus_queue.cc:1048] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8bab8b5b3b457a97e6085583d4d914" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.954697 29689 raft_consensus.cc:1275] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Refusing update from remote peer d8368265f1f74353ad1e6c457670f1d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.956383 29858 consensus_queue.cc:1048] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c818a46a2210415c8997d9eed8bf661e" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.958868 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:38.959646 18095 tablet_replica.cc:333] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1: stopping tablet replica
I20260709 13:13:38.960449 18095 raft_consensus.cc:2243] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:38.960968 18095 raft_consensus.cc:2272] T a1312620916b4c83bcb4b15f0ecfc44f P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:38.963359 18095 tablet_replica.cc:333] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: stopping tablet replica
I20260709 13:13:38.964133 18095 raft_consensus.cc:2243] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:38.964855 18095 pending_rounds.cc:70] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: Trying to abort 1 pending ops.
I20260709 13:13:38.965031 18095 pending_rounds.cc:77] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637144914780160 op_type: NO_OP noop_request { }
I20260709 13:13:38.965361 18095 raft_consensus.cc:2889] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:38.965668 18095 raft_consensus.cc:2272] T 259d261763f6422196de5f4df9de1d25 P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:38.968020 18095 tablet_replica.cc:333] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1: stopping tablet replica
I20260709 13:13:38.968576 18095 raft_consensus.cc:2243] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:38.969009 18095 raft_consensus.cc:2272] T 2b80a78c0bc443bdbb1edde82c469acc P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:38.971266 18095 tablet_replica.cc:333] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1: stopping tablet replica
I20260709 13:13:38.971786 18095 raft_consensus.cc:2243] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:38.972662 18095 raft_consensus.cc:2272] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P d8368265f1f74353ad1e6c457670f1d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.000149 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
I20260709 13:13:39.012794 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
I20260709 13:13:39.032881 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:39.033522 18095 tablet_replica.cc:333] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e: stopping tablet replica
I20260709 13:13:39.034112 18095 raft_consensus.cc:2243] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.034580 18095 raft_consensus.cc:2272] T a1312620916b4c83bcb4b15f0ecfc44f P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.036875 18095 tablet_replica.cc:333] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e: stopping tablet replica
I20260709 13:13:39.037431 18095 raft_consensus.cc:2243] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.037873 18095 raft_consensus.cc:2272] T 259d261763f6422196de5f4df9de1d25 P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.040122 18095 tablet_replica.cc:333] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e: stopping tablet replica
I20260709 13:13:39.040697 18095 raft_consensus.cc:2243] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.041522 18095 raft_consensus.cc:2272] T 2b80a78c0bc443bdbb1edde82c469acc P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.043751 18095 tablet_replica.cc:333] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e: stopping tablet replica
I20260709 13:13:39.044322 18095 raft_consensus.cc:2243] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.044764 18095 raft_consensus.cc:2272] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P c818a46a2210415c8997d9eed8bf661e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.057865 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
I20260709 13:13:39.069669 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
I20260709 13:13:39.088230 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:39.088876 18095 tablet_replica.cc:333] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: stopping tablet replica
I20260709 13:13:39.089444 18095 raft_consensus.cc:2243] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.090082 18095 pending_rounds.cc:70] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: Trying to abort 1 pending ops.
I20260709 13:13:39.090291 18095 pending_rounds.cc:77] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637146020630528 op_type: NO_OP noop_request { }
I20260709 13:13:39.090570 18095 raft_consensus.cc:2889] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:39.090847 18095 raft_consensus.cc:2272] T a1312620916b4c83bcb4b15f0ecfc44f P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.093132 18095 tablet_replica.cc:333] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914: stopping tablet replica
I20260709 13:13:39.093676 18095 raft_consensus.cc:2243] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.094143 18095 raft_consensus.cc:2272] T 259d261763f6422196de5f4df9de1d25 P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.096387 18095 tablet_replica.cc:333] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914: stopping tablet replica
I20260709 13:13:39.096884 18095 raft_consensus.cc:2243] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.097301 18095 raft_consensus.cc:2272] T 2b80a78c0bc443bdbb1edde82c469acc P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.099373 18095 tablet_replica.cc:333] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914: stopping tablet replica
I20260709 13:13:39.099845 18095 raft_consensus.cc:2243] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.100310 18095 raft_consensus.cc:2272] T 25fb0c4cb7794ed5ab2d2c1e3f33b54a P ea8bab8b5b3b457a97e6085583d4d914 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.122007 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
I20260709 13:13:39.134176 18095 master.cc:562] Master@127.17.171.254:41347 shutting down...
I20260709 13:13:39.151278 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.151870 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.152235 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P edb79ab69db54321ae8a0bf98d995438: stopping tablet replica
I20260709 13:13:39.170289 18095 master.cc:584] Master@127.17.171.254:41347 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2224 ms)
[----------] 6 tests from LeaderRebalancerTest (339697 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:39.198210 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:45571
I20260709 13:13:39.199357 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.204593 29859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.204620 29860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.207218 29862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.207319 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:39.208508 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.208705 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.208905 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602819208869 us; error 0 us; skew 500 ppm
I20260709 13:13:39.209429 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.211666 18095 webserver.cc:533] Webserver started at http://127.17.171.254:44821/ using document root <none> and password file <none>
I20260709 13:13:39.212374 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.212574 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.212889 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.214011 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "13dc9e81c07c48ce902d63a833363a93"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.218659 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:39.222223 29867 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.223063 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:39.223405 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "13dc9e81c07c48ce902d63a833363a93"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.223706 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.235973 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.237040 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.272086 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:45571
I20260709 13:13:39.272262 29918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:45571 every 8 connection(s)
I20260709 13:13:39.275997 29919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.287005 29919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93: Bootstrap starting.
I20260709 13:13:39.291500 29919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.295641 29919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93: No bootstrap required, opened a new log
I20260709 13:13:39.297802 29919 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dc9e81c07c48ce902d63a833363a93" member_type: VOTER }
I20260709 13:13:39.298200 29919 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.298374 29919 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13dc9e81c07c48ce902d63a833363a93, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.298892 29919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dc9e81c07c48ce902d63a833363a93" member_type: VOTER }
I20260709 13:13:39.299300 29919 raft_consensus.cc:399] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:39.299487 29919 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:39.299700 29919 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.304454 29919 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dc9e81c07c48ce902d63a833363a93" member_type: VOTER }
I20260709 13:13:39.304970 29919 leader_election.cc:304] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13dc9e81c07c48ce902d63a833363a93; no voters: 
I20260709 13:13:39.306113 29919 leader_election.cc:290] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:39.306452 29922 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.307801 29922 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 1 LEADER]: Becoming Leader. State: Replica: 13dc9e81c07c48ce902d63a833363a93, State: Running, Role: LEADER
I20260709 13:13:39.308476 29922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dc9e81c07c48ce902d63a833363a93" member_type: VOTER }
I20260709 13:13:39.309126 29919 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:39.311237 29923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13dc9e81c07c48ce902d63a833363a93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dc9e81c07c48ce902d63a833363a93" member_type: VOTER } }
I20260709 13:13:39.311242 29924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13dc9e81c07c48ce902d63a833363a93. Latest consensus state: current_term: 1 leader_uuid: "13dc9e81c07c48ce902d63a833363a93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dc9e81c07c48ce902d63a833363a93" member_type: VOTER } }
I20260709 13:13:39.311987 29923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:39.312099 29924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:39.315279 29927 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:39.319914 29927 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:39.324220 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:39.329330 29927 catalog_manager.cc:1383] Generated new cluster ID: 4bbf2974bd97486e8cd6a3c979cc7884
I20260709 13:13:39.329645 29927 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:39.349408 29927 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:39.350762 29927 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:39.369978 29927 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93: Generated new TSK 0
I20260709 13:13:39.370672 29927 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:39.390776 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.397146 29940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.397895 29941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.401939 18095 server_base.cc:1061] running on GCE node
W20260709 13:13:39.401758 29943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.403266 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.403455 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.403601 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602819403583 us; error 0 us; skew 500 ppm
I20260709 13:13:39.404052 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.406646 18095 webserver.cc:533] Webserver started at http://127.17.171.193:38587/ using document root <none> and password file <none>
I20260709 13:13:39.407148 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.407321 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.407560 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.409029 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "415b92c00aa34a7fa42ca43284a17345"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.413857 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:39.417184 29948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.418131 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:39.418447 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "415b92c00aa34a7fa42ca43284a17345"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.418736 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.450944 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.452152 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.453692 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:39.455953 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:39.456177 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.456454 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:39.456633 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.495777 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:36727
I20260709 13:13:39.495915 30010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:36727 every 8 connection(s)
I20260709 13:13:39.500836 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.507841 30015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.510352 30016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.510730 30018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.513479 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:39.514107 30011 heartbeater.cc:344] Connected to a master server at 127.17.171.254:45571
I20260709 13:13:39.514536 30011 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:39.515136 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.515426 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.515257 30011 heartbeater.cc:507] Master 127.17.171.254:45571 requested a full tablet report, sending...
I20260709 13:13:39.515678 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602819515660 us; error 0 us; skew 500 ppm
I20260709 13:13:39.516428 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.517997 29884 ts_manager.cc:194] Registered new tserver with Master: 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727)
I20260709 13:13:39.519393 18095 webserver.cc:533] Webserver started at http://127.17.171.194:36541/ using document root <none> and password file <none>
I20260709 13:13:39.520092 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.520344 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.520500 29884 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53606
I20260709 13:13:39.520665 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.522010 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "3bb1ee647860425cb0e270e6da9657da"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.526485 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:39.529754 30023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.530580 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:39.530874 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "3bb1ee647860425cb0e270e6da9657da"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.531191 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.551618 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.552717 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.554210 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:39.556484 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:39.556711 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.556955 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:39.557134 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.594841 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:36161
I20260709 13:13:39.594954 30085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:36161 every 8 connection(s)
I20260709 13:13:39.599677 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.606290 30089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.607558 30090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.611224 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:39.611917 30086 heartbeater.cc:344] Connected to a master server at 127.17.171.254:45571
W20260709 13:13:39.611917 30092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.612645 30086 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:39.613282 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.613574 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.613504 30086 heartbeater.cc:507] Master 127.17.171.254:45571 requested a full tablet report, sending...
I20260709 13:13:39.614094 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602819614075 us; error 0 us; skew 500 ppm
I20260709 13:13:39.614866 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.616092 29884 ts_manager.cc:194] Registered new tserver with Master: 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:39.617619 18095 webserver.cc:533] Webserver started at http://127.17.171.195:41619/ using document root <none> and password file <none>
I20260709 13:13:39.618065 29884 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53612
I20260709 13:13:39.618402 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.618724 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.619046 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.620810 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "3515c7aa152340c0ba2b1d6d702427d8"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.625833 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:13:39.629240 30097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.630007 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:39.630311 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "3515c7aa152340c0ba2b1d6d702427d8"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-jhlz"
I20260709 13:13:39.630617 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.646490 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.647650 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.649163 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:39.651449 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:39.651684 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.651923 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:39.652108 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.690557 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:33633
I20260709 13:13:39.690690 30159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:33633 every 8 connection(s)
I20260709 13:13:39.704788 30160 heartbeater.cc:344] Connected to a master server at 127.17.171.254:45571
I20260709 13:13:39.705315 30160 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:39.706166 30160 heartbeater.cc:507] Master 127.17.171.254:45571 requested a full tablet report, sending...
I20260709 13:13:39.708072 29884 ts_manager.cc:194] Registered new tserver with Master: 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:39.708449 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01466662s
I20260709 13:13:39.709530 29884 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33692
I20260709 13:13:39.734118 29884 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33706:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:39.736763 29884 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:39.809707 30125 tablet_service.cc:1511] Processing CreateTablet for tablet 7a83eced0ac14bdd9ec73990bd1cf3e1 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:39.810274 29975 tablet_service.cc:1511] Processing CreateTablet for tablet b0532343b23845abb2a77293666e91b9 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:39.810753 29976 tablet_service.cc:1511] Processing CreateTablet for tablet 7a83eced0ac14bdd9ec73990bd1cf3e1 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:39.811091 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83eced0ac14bdd9ec73990bd1cf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.811796 29975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0532343b23845abb2a77293666e91b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.812583 29976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83eced0ac14bdd9ec73990bd1cf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.812913 30124 tablet_service.cc:1511] Processing CreateTablet for tablet b0532343b23845abb2a77293666e91b9 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:39.813227 29974 tablet_service.cc:1511] Processing CreateTablet for tablet 7d62ef4433bf4bf393ea115626eafba5 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:39.814311 30124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0532343b23845abb2a77293666e91b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.814635 29974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62ef4433bf4bf393ea115626eafba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.845093 30123 tablet_service.cc:1511] Processing CreateTablet for tablet 7d62ef4433bf4bf393ea115626eafba5 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:39.845856 29973 tablet_service.cc:1511] Processing CreateTablet for tablet c75e3a0f21834a2f8062848fbb87f7e7 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:39.846665 30123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62ef4433bf4bf393ea115626eafba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.847256 29973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e3a0f21834a2f8062848fbb87f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.848587 30048 tablet_service.cc:1511] Processing CreateTablet for tablet c75e3a0f21834a2f8062848fbb87f7e7 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:39.849247 30051 tablet_service.cc:1511] Processing CreateTablet for tablet 7a83eced0ac14bdd9ec73990bd1cf3e1 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:39.850028 30048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e3a0f21834a2f8062848fbb87f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.851390 30050 tablet_service.cc:1511] Processing CreateTablet for tablet b0532343b23845abb2a77293666e91b9 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:39.852859 30050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0532343b23845abb2a77293666e91b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.847335 30049 tablet_service.cc:1511] Processing CreateTablet for tablet 7d62ef4433bf4bf393ea115626eafba5 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:39.856755 30051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83eced0ac14bdd9ec73990bd1cf3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.857458 30049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62ef4433bf4bf393ea115626eafba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.878105 30047 tablet_service.cc:1511] Processing CreateTablet for tablet 9e61311de6644f69907191a785638cd1 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:39.879642 30047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e61311de6644f69907191a785638cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.880590 30122 tablet_service.cc:1511] Processing CreateTablet for tablet c75e3a0f21834a2f8062848fbb87f7e7 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:39.881270 30046 tablet_service.cc:1511] Processing CreateTablet for tablet ffd7960a8ed9419093aa296492d025b5 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:39.882035 30122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75e3a0f21834a2f8062848fbb87f7e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.882602 30046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd7960a8ed9419093aa296492d025b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.881323 29972 tablet_service.cc:1511] Processing CreateTablet for tablet 9e61311de6644f69907191a785638cd1 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:39.887651 29972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e61311de6644f69907191a785638cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.887138 30045 tablet_service.cc:1511] Processing CreateTablet for tablet a5846273cb9648e1acf047b87cdef4d0 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:39.888979 30045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5846273cb9648e1acf047b87cdef4d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.895569 30043 tablet_service.cc:1511] Processing CreateTablet for tablet 78a8c0da960b413490ebf233eb3f062b (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:39.897555 30043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a8c0da960b413490ebf233eb3f062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.901799 30044 tablet_service.cc:1511] Processing CreateTablet for tablet ae17330de1514df686ef51ff126ecb16 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:39.903808 30044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae17330de1514df686ef51ff126ecb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.906452 30121 tablet_service.cc:1511] Processing CreateTablet for tablet 9e61311de6644f69907191a785638cd1 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:39.907932 30121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e61311de6644f69907191a785638cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.925824 29971 tablet_service.cc:1511] Processing CreateTablet for tablet ffd7960a8ed9419093aa296492d025b5 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:39.927290 29971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd7960a8ed9419093aa296492d025b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.929286 29970 tablet_service.cc:1511] Processing CreateTablet for tablet a5846273cb9648e1acf047b87cdef4d0 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:39.930541 29970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5846273cb9648e1acf047b87cdef4d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.929184 29969 tablet_service.cc:1511] Processing CreateTablet for tablet ae17330de1514df686ef51ff126ecb16 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:39.937795 30123 tablet_service.cc:1511] Processing CreateTablet for tablet a5846273cb9648e1acf047b87cdef4d0 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:39.938313 29969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae17330de1514df686ef51ff126ecb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.939194 30123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5846273cb9648e1acf047b87cdef4d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.934686 29968 tablet_service.cc:1511] Processing CreateTablet for tablet 78a8c0da960b413490ebf233eb3f062b (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:39.945206 30125 tablet_service.cc:1511] Processing CreateTablet for tablet ffd7960a8ed9419093aa296492d025b5 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:39.947809 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd7960a8ed9419093aa296492d025b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.953071 30119 tablet_service.cc:1511] Processing CreateTablet for tablet 78a8c0da960b413490ebf233eb3f062b (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:39.954495 30119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a8c0da960b413490ebf233eb3f062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.957020 30120 tablet_service.cc:1511] Processing CreateTablet for tablet ae17330de1514df686ef51ff126ecb16 (DEFAULT_TABLE table=test-workload [id=f2f661d2415f45168c1d28eb1d4f2723]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:39.958401 30120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae17330de1514df686ef51ff126ecb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.960857 30175 tablet_bootstrap.cc:492] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:39.971542 29968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a8c0da960b413490ebf233eb3f062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.977174 30175 tablet_bootstrap.cc:654] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.023639 30177 tablet_bootstrap.cc:492] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.039192 30175 tablet_bootstrap.cc:492] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.039786 30175 ts_tablet_manager.cc:1403] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.029s
I20260709 13:13:40.043319 30175 raft_consensus.cc:359] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.044054 30175 raft_consensus.cc:385] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.044414 30175 raft_consensus.cc:740] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.045293 30175 consensus_queue.cc:260] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.045954 30177 tablet_bootstrap.cc:654] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.045300 30176 tablet_bootstrap.cc:492] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.057910 30176 tablet_bootstrap.cc:654] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.060760 30177 tablet_bootstrap.cc:492] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.061283 30177 ts_tablet_manager.cc:1403] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:13:40.065280 30160 heartbeater.cc:499] Master 127.17.171.254:45571 was elected leader, sending a full tablet report...
I20260709 13:13:40.064000 30177 raft_consensus.cc:359] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.065793 30177 raft_consensus.cc:385] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.066102 30177 raft_consensus.cc:740] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.066253 30175 ts_tablet_manager.cc:1434] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.019s
I20260709 13:13:40.066995 30177 consensus_queue.cc:260] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.067560 30175 tablet_bootstrap.cc:492] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.069944 30176 tablet_bootstrap.cc:492] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.070495 30176 ts_tablet_manager.cc:1403] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 13:13:40.073640 30175 tablet_bootstrap.cc:654] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.073391 30176 raft_consensus.cc:359] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.074137 30176 raft_consensus.cc:385] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.074442 30176 raft_consensus.cc:740] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.075417 30176 consensus_queue.cc:260] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.076514 30177 ts_tablet_manager.cc:1434] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 13:13:40.077306 30011 heartbeater.cc:499] Master 127.17.171.254:45571 was elected leader, sending a full tablet report...
I20260709 13:13:40.082564 30176 ts_tablet_manager.cc:1434] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:13:40.083575 30086 heartbeater.cc:499] Master 127.17.171.254:45571 was elected leader, sending a full tablet report...
I20260709 13:13:40.091775 30177 tablet_bootstrap.cc:492] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.094456 30176 tablet_bootstrap.cc:492] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.096915 30177 tablet_bootstrap.cc:654] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.103996 30176 tablet_bootstrap.cc:654] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.104255 30175 tablet_bootstrap.cc:492] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.104809 30175 ts_tablet_manager.cc:1403] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.014s
I20260709 13:13:40.108389 30177 tablet_bootstrap.cc:492] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.109119 30177 ts_tablet_manager.cc:1403] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:13:40.108311 30175 raft_consensus.cc:359] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.109591 30175 raft_consensus.cc:385] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.109999 30175 raft_consensus.cc:740] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.111112 30175 consensus_queue.cc:260] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.113745 30175 ts_tablet_manager.cc:1434] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:40.114717 30175 tablet_bootstrap.cc:492] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.115357 30176 tablet_bootstrap.cc:492] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.115921 30176 ts_tablet_manager.cc:1403] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:13:40.116391 30177 raft_consensus.cc:359] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.117189 30177 raft_consensus.cc:385] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.117470 30177 raft_consensus.cc:740] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.118338 30177 consensus_queue.cc:260] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.118947 30176 raft_consensus.cc:359] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.119704 30176 raft_consensus.cc:385] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.119987 30176 raft_consensus.cc:740] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.120788 30177 ts_tablet_manager.cc:1434] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:40.121505 30175 tablet_bootstrap.cc:654] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.121912 30177 tablet_bootstrap.cc:492] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.120873 30176 consensus_queue.cc:260] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.127956 30179 raft_consensus.cc:493] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.128366 30177 tablet_bootstrap.cc:654] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.128693 30179 raft_consensus.cc:515] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.137929 30179 leader_election.cc:290] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.138293 30184 raft_consensus.cc:493] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.128706 30176 ts_tablet_manager.cc:1434] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:40.138918 30184 raft_consensus.cc:515] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.140484 30176 tablet_bootstrap.cc:492] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.148285 30176 tablet_bootstrap.cc:654] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.150341 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
W20260709 13:13:40.152190 30101 leader_election.cc:343] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.154507 30184 leader_election.cc:290] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633), 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727)
I20260709 13:13:40.155009 30177 tablet_bootstrap.cc:492] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.155730 30177 ts_tablet_manager.cc:1403] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.004s
I20260709 13:13:40.159690 30177 raft_consensus.cc:359] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.160692 30177 raft_consensus.cc:385] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.161067 30177 raft_consensus.cc:740] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.161985 30177 consensus_queue.cc:260] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.165264 30177 ts_tablet_manager.cc:1434] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:13:40.167016 30177 tablet_bootstrap.cc:492] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.161867 30175 tablet_bootstrap.cc:492] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.168912 30175 ts_tablet_manager.cc:1403] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.006s
I20260709 13:13:40.170603 30182 raft_consensus.cc:493] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.171154 30182 raft_consensus.cc:515] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.175067 30177 tablet_bootstrap.cc:654] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.171933 30175 raft_consensus.cc:359] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.181016 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.182060 30061 raft_consensus.cc:2468] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:40.183902 30099 leader_election.cc:304] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.184844 30179 raft_consensus.cc:2804] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.185303 30179 raft_consensus.cc:493] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.185714 30179 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.181378 30175 raft_consensus.cc:385] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.196053 30175 raft_consensus.cc:740] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.202315 30179 raft_consensus.cc:515] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.205186 30182 leader_election.cc:290] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.205449 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
W20260709 13:13:40.207175 30101 leader_election.cc:343] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.208181 30175 consensus_queue.cc:260] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.220958 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.221705 30061 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.223366 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.224349 30135 raft_consensus.cc:2393] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bb1ee647860425cb0e270e6da9657da in current term 1: Already voted for candidate 3515c7aa152340c0ba2b1d6d702427d8 in this term.
I20260709 13:13:40.230474 30061 raft_consensus.cc:2468] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.231801 30099 leader_election.cc:304] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.239780 30179 leader_election.cc:290] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.243579 30184 raft_consensus.cc:493] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.246470 30184 raft_consensus.cc:515] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.247102 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.248733 30184 leader_election.cc:290] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
W20260709 13:13:40.249012 29952 leader_election.cc:343] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.250864 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.244091 30198 raft_consensus.cc:2804] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.252471 30198 raft_consensus.cc:697] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
W20260709 13:13:40.252703 30027 leader_election.cc:343] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.253449 30198 consensus_queue.cc:237] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.254834 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
W20260709 13:13:40.256383 29950 leader_election.cc:343] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.256839 29950 leader_election.cc:304] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 415b92c00aa34a7fa42ca43284a17345; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:40.256916 30179 raft_consensus.cc:493] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.257635 30182 raft_consensus.cc:2749] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.257963 30176 tablet_bootstrap.cc:492] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.258580 30179 raft_consensus.cc:515] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.259203 30176 ts_tablet_manager.cc:1403] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.119s	user 0.044s	sys 0.064s
I20260709 13:13:40.259616 30175 ts_tablet_manager.cc:1434] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 13:13:40.261214 30175 tablet_bootstrap.cc:492] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.265359 30176 raft_consensus.cc:359] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.261312 30179 leader_election.cc:290] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.261957 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.266414 30176 raft_consensus.cc:385] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.266873 30176 raft_consensus.cc:740] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.266902 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.267354 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.266760 29986 raft_consensus.cc:2468] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
W20260709 13:13:40.268882 30027 leader_election.cc:343] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.268347 30176 consensus_queue.cc:260] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.269366 30027 leader_election.cc:304] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.269662 30101 leader_election.cc:304] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.262717 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
W20260709 13:13:40.270630 30027 leader_election.cc:343] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.270974 30184 raft_consensus.cc:2749] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.271070 30027 leader_election.cc:304] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.271229 30197 raft_consensus.cc:2804] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.272056 30197 raft_consensus.cc:493] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.272243 30184 raft_consensus.cc:2749] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.272470 30197 raft_consensus.cc:3060] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.274264 30177 tablet_bootstrap.cc:492] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.274804 30177 ts_tablet_manager.cc:1403] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.108s	user 0.033s	sys 0.042s
I20260709 13:13:40.275028 30176 ts_tablet_manager.cc:1434] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:40.270776 30061 raft_consensus.cc:2468] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:40.283924 30176 tablet_bootstrap.cc:492] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.278412 30177 raft_consensus.cc:359] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.292117 30177 raft_consensus.cc:385] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.292488 30177 raft_consensus.cc:740] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.292804 30176 tablet_bootstrap.cc:654] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.293421 30175 tablet_bootstrap.cc:654] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.293272 30177 consensus_queue.cc:260] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.294503 30197 raft_consensus.cc:515] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.300606 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:40.301403 29986 raft_consensus.cc:3060] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.295794 30177 ts_tablet_manager.cc:1434] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:13:40.306900 30176 tablet_bootstrap.cc:492] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.307382 30177 tablet_bootstrap.cc:492] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.307480 30176 ts_tablet_manager.cc:1403] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 13:13:40.310696 30176 raft_consensus.cc:359] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.311447 30176 raft_consensus.cc:385] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.311739 30176 raft_consensus.cc:740] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.312826 30176 consensus_queue.cc:260] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.313735 30184 raft_consensus.cc:493] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.314213 30184 raft_consensus.cc:515] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.315749 30177 tablet_bootstrap.cc:654] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.316252 30184 leader_election.cc:290] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
W20260709 13:13:40.319308 29932 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:40.321003 30175 tablet_bootstrap.cc:492] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.321611 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e61311de6644f69907191a785638cd1" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.321734 30175 ts_tablet_manager.cc:1403] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
W20260709 13:13:40.324221 30027 leader_election.cc:343] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.329058 30175 raft_consensus.cc:359] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.324786 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e61311de6644f69907191a785638cd1" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.330919 29984 raft_consensus.cc:2468] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 0.
I20260709 13:13:40.331291 30197 leader_election.cc:290] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.323776 29986 raft_consensus.cc:2468] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.332275 30177 tablet_bootstrap.cc:492] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.332547 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.333330 30177 ts_tablet_manager.cc:1403] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:13:40.333609 30061 raft_consensus.cc:3060] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.334187 30176 ts_tablet_manager.cc:1434] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 13:13:40.335294 29882 catalog_manager.cc:5697] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.336403 30177 raft_consensus.cc:359] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.337131 30177 raft_consensus.cc:385] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.337359 30176 tablet_bootstrap.cc:492] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.337419 30177 raft_consensus.cc:740] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.338521 30177 consensus_queue.cc:260] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.339102 30101 leader_election.cc:304] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.340370 30027 leader_election.cc:304] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:40.340762 30177 ts_tablet_manager.cc:1434] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:13:40.341849 30177 tablet_bootstrap.cc:492] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.341847 30202 raft_consensus.cc:2804] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.342478 30202 raft_consensus.cc:493] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.342836 30202 raft_consensus.cc:3060] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.344769 30176 tablet_bootstrap.cc:654] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.330010 30175 raft_consensus.cc:385] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.349592 30197 raft_consensus.cc:2804] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.350359 30197 raft_consensus.cc:697] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:40.351261 30197 consensus_queue.cc:237] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.349704 30175 raft_consensus.cc:740] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.355629 30202 raft_consensus.cc:515] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.357365 30175 consensus_queue.cc:260] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.358470 30177 tablet_bootstrap.cc:654] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.356024 30061 raft_consensus.cc:2468] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.361297 30176 tablet_bootstrap.cc:492] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.362316 30176 ts_tablet_manager.cc:1403] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.013s
I20260709 13:13:40.364341 30202 leader_election.cc:290] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.365463 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e61311de6644f69907191a785638cd1" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:40.365929 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e61311de6644f69907191a785638cd1" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:40.366109 30177 tablet_bootstrap.cc:492] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.366200 29986 raft_consensus.cc:3060] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.366735 30177 ts_tablet_manager.cc:1403] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
W20260709 13:13:40.367425 30027 leader_election.cc:343] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.364894 30175 ts_tablet_manager.cc:1434] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:13:40.369030 30175 tablet_bootstrap.cc:492] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.370560 30177 raft_consensus.cc:359] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.371616 30177 raft_consensus.cc:385] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.372017 30177 raft_consensus.cc:740] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.372967 30177 consensus_queue.cc:260] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.376257 30177 ts_tablet_manager.cc:1434] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:13:40.377336 30177 tablet_bootstrap.cc:492] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.377372 29986 raft_consensus.cc:2468] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 1.
I20260709 13:13:40.377904 30175 tablet_bootstrap.cc:654] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.380046 30176 raft_consensus.cc:359] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.382074 30176 raft_consensus.cc:385] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.382395 30176 raft_consensus.cc:740] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.382314 30027 leader_election.cc:304] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:40.383440 30176 consensus_queue.cc:260] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.384552 30184 raft_consensus.cc:2804] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.385789 30176 ts_tablet_manager.cc:1434] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:13:40.386102 30177 tablet_bootstrap.cc:654] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.391165 30184 raft_consensus.cc:697] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:40.392912 30176 tablet_bootstrap.cc:492] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.392829 30184 consensus_queue.cc:237] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.397223 30182 raft_consensus.cc:493] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.398044 30182 raft_consensus.cc:515] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.400372 30182 leader_election.cc:290] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.401762 30176 tablet_bootstrap.cc:654] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.402036 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e3a0f21834a2f8062848fbb87f7e7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.402783 30061 raft_consensus.cc:2468] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:40.403208 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e3a0f21834a2f8062848fbb87f7e7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.404042 29950 leader_election.cc:304] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
W20260709 13:13:40.404683 29952 leader_election.cc:343] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.404969 30182 raft_consensus.cc:2804] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.405376 30182 raft_consensus.cc:493] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.405723 30182 raft_consensus.cc:3060] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.414994 30175 tablet_bootstrap.cc:492] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.415619 30175 ts_tablet_manager.cc:1403] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.000s
I20260709 13:13:40.416688 30177 tablet_bootstrap.cc:492] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.417328 30177 ts_tablet_manager.cc:1403] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.017s
I20260709 13:13:40.418763 30175 raft_consensus.cc:359] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.419976 30175 raft_consensus.cc:385] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.420321 30175 raft_consensus.cc:740] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.421168 30175 consensus_queue.cc:260] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.421679 30177 raft_consensus.cc:359] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.424451 30177 raft_consensus.cc:385] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.424801 30176 tablet_bootstrap.cc:492] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.424826 30177 raft_consensus.cc:740] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.424584 29883 catalog_manager.cc:5697] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 1 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.418843 29882 catalog_manager.cc:5697] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.425961 30177 consensus_queue.cc:260] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.422443 30182 raft_consensus.cc:515] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.423926 30175 ts_tablet_manager.cc:1434] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:13:40.425570 30176 ts_tablet_manager.cc:1403] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.000s
I20260709 13:13:40.428984 30175 tablet_bootstrap.cc:492] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.431206 30176 raft_consensus.cc:359] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.432312 30176 raft_consensus.cc:385] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.432689 30176 raft_consensus.cc:740] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.433614 30176 consensus_queue.cc:260] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.436091 30176 ts_tablet_manager.cc:1434] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:40.437006 30175 tablet_bootstrap.cc:654] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.437327 30176 tablet_bootstrap.cc:492] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.442282 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e3a0f21834a2f8062848fbb87f7e7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.443032 30061 raft_consensus.cc:3060] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.444823 30177 ts_tablet_manager.cc:1434] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.027s	user 0.013s	sys 0.010s
I20260709 13:13:40.445850 30177 tablet_bootstrap.cc:492] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.448498 30176 tablet_bootstrap.cc:654] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.452337 30177 tablet_bootstrap.cc:654] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.454067 30061 raft_consensus.cc:2468] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:40.455727 29950 leader_election.cc:304] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.456869 30215 raft_consensus.cc:2804] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.458293 30182 leader_election.cc:290] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.458535 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e3a0f21834a2f8062848fbb87f7e7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
W20260709 13:13:40.460006 29952 leader_election.cc:343] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.462270 30177 tablet_bootstrap.cc:492] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.462788 30177 ts_tablet_manager.cc:1403] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:13:40.465641 30177 raft_consensus.cc:359] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.466289 30177 raft_consensus.cc:385] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.466539 30177 raft_consensus.cc:740] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.467223 30177 consensus_queue.cc:260] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.469267 30177 ts_tablet_manager.cc:1434] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:40.470260 30177 tablet_bootstrap.cc:492] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:40.473272 30175 tablet_bootstrap.cc:492] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.473987 30175 ts_tablet_manager.cc:1403] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.000s
I20260709 13:13:40.475701 30177 tablet_bootstrap.cc:654] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.476642 30215 raft_consensus.cc:697] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:40.477558 30175 raft_consensus.cc:359] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.477613 30215 consensus_queue.cc:237] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.478559 30175 raft_consensus.cc:385] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.478996 30175 raft_consensus.cc:740] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.479969 30176 tablet_bootstrap.cc:492] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.480571 30176 ts_tablet_manager.cc:1403] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.005s
I20260709 13:13:40.479908 30175 consensus_queue.cc:260] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.482806 30175 ts_tablet_manager.cc:1434] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:13:40.483870 30175 tablet_bootstrap.cc:492] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.490932 30175 tablet_bootstrap.cc:654] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.496969 30177 tablet_bootstrap.cc:492] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:40.497624 30177 ts_tablet_manager.cc:1403] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.017s
I20260709 13:13:40.498896 30176 raft_consensus.cc:359] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.499915 30176 raft_consensus.cc:385] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.500253 30176 raft_consensus.cc:740] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.501001 30175 tablet_bootstrap.cc:492] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.501607 30175 ts_tablet_manager.cc:1403] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.010s
I20260709 13:13:40.501405 30177 raft_consensus.cc:359] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.502379 30177 raft_consensus.cc:385] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.502667 30177 raft_consensus.cc:740] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.501219 30176 consensus_queue.cc:260] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.504998 30175 raft_consensus.cc:359] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.505769 30175 raft_consensus.cc:385] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.506145 30175 raft_consensus.cc:740] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.505818 30177 consensus_queue.cc:260] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.507053 30175 consensus_queue.cc:260] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.508059 30177 ts_tablet_manager.cc:1434] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:40.509851 30175 ts_tablet_manager.cc:1434] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:40.509609 29882 catalog_manager.cc:5697] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.511021 30175 tablet_bootstrap.cc:492] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.518011 30176 ts_tablet_manager.cc:1434] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:13:40.518427 30175 tablet_bootstrap.cc:654] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.524263 30175 tablet_bootstrap.cc:492] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.524761 30175 ts_tablet_manager.cc:1403] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:13:40.527498 30175 raft_consensus.cc:359] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.528240 30175 raft_consensus.cc:385] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.528508 30175 raft_consensus.cc:740] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.528591 30176 tablet_bootstrap.cc:492] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.529320 30175 consensus_queue.cc:260] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.531388 30175 ts_tablet_manager.cc:1434] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:40.532147 30215 raft_consensus.cc:493] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.532559 30175 tablet_bootstrap.cc:492] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:40.532897 30215 raft_consensus.cc:515] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:40.536244 30215 leader_election.cc:290] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.536664 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.537964 30176 tablet_bootstrap.cc:654] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.538161 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.539299 30061 raft_consensus.cc:2393] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 415b92c00aa34a7fa42ca43284a17345 in current term 1: Already voted for candidate 3515c7aa152340c0ba2b1d6d702427d8 in this term.
I20260709 13:13:40.541894 29952 leader_election.cc:304] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 415b92c00aa34a7fa42ca43284a17345; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:40.542891 30175 tablet_bootstrap.cc:654] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.543413 30215 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.543876 30176 tablet_bootstrap.cc:492] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.544422 30176 ts_tablet_manager.cc:1403] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:13:40.547808 30176 raft_consensus.cc:359] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.548705 30176 raft_consensus.cc:385] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.549047 30176 raft_consensus.cc:740] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.549243 30197 raft_consensus.cc:493] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.549860 30197 raft_consensus.cc:515] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.549954 30176 consensus_queue.cc:260] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.552610 30215 raft_consensus.cc:2749] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.552881 30176 ts_tablet_manager.cc:1434] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:40.553874 30175 tablet_bootstrap.cc:492] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:40.553874 30176 tablet_bootstrap.cc:492] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:40.554483 30175 ts_tablet_manager.cc:1403] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:13:40.556412 30197 leader_election.cc:290] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.556303 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e61311de6644f69907191a785638cd1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.556304 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e61311de6644f69907191a785638cd1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.557464 29986 raft_consensus.cc:2393] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3515c7aa152340c0ba2b1d6d702427d8 in current term 1: Already voted for candidate 3bb1ee647860425cb0e270e6da9657da in this term.
I20260709 13:13:40.557309 30175 raft_consensus.cc:359] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.558297 30175 raft_consensus.cc:385] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.558319 30215 raft_consensus.cc:493] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.558701 30175 raft_consensus.cc:740] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.559170 30215 raft_consensus.cc:515] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.559559 30175 consensus_queue.cc:260] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.559839 30176 tablet_bootstrap.cc:654] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.559747 30099 leader_election.cc:304] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8; no voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.561411 30198 raft_consensus.cc:3060] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.562053 30175 ts_tablet_manager.cc:1434] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:40.562815 30215 leader_election.cc:290] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.564369 30179 raft_consensus.cc:493] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.565140 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.564901 30179 raft_consensus.cc:515] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.565809 30135 raft_consensus.cc:2468] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:40.566648 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.567340 30179 leader_election.cc:290] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.568678 30176 tablet_bootstrap.cc:492] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:40.569169 30176 ts_tablet_manager.cc:1403] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:13:40.567128 29952 leader_election.cc:304] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
W20260709 13:13:40.572691 29950 leader_election.cc:343] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.572885 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.573752 29986 raft_consensus.cc:2468] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:40.575217 30101 leader_election.cc:304] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.576108 30197 raft_consensus.cc:2804] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.576548 30197 raft_consensus.cc:493] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.576884 30197 raft_consensus.cc:3060] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.576920 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.577651 30061 raft_consensus.cc:2468] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:40.567934 30179 raft_consensus.cc:493] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.580802 30179 raft_consensus.cc:515] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.583736 30198 raft_consensus.cc:2749] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.576114 30176 raft_consensus.cc:359] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.585395 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.585263 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.585807 30176 raft_consensus.cc:385] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.586236 29986 raft_consensus.cc:2468] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:40.586261 30176 raft_consensus.cc:740] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.586390 30061 raft_consensus.cc:2468] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:40.587548 30101 leader_election.cc:304] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.587273 30176 consensus_queue.cc:260] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.588584 30198 raft_consensus.cc:2804] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.586622 30179 leader_election.cc:290] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.588989 30198 raft_consensus.cc:493] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.589404 30198 raft_consensus.cc:3060] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.584975 30215 raft_consensus.cc:2804] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.589834 30215 raft_consensus.cc:493] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.590168 30215 raft_consensus.cc:3060] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.590425 30176 ts_tablet_manager.cc:1434] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:13:40.596493 30197 raft_consensus.cc:515] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.596488 30215 raft_consensus.cc:515] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.597043 30219 raft_consensus.cc:493] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.597827 30219 raft_consensus.cc:515] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.599177 30197 leader_election.cc:290] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.600354 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.600836 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.601488 30060 raft_consensus.cc:3060] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.602070 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:40.602458 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.602653 29986 raft_consensus.cc:3060] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.603118 30135 raft_consensus.cc:2468] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:40.602737 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.604035 30059 raft_consensus.cc:2468] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:40.604718 29952 leader_election.cc:304] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.600024 30219 leader_election.cc:290] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.605588 30182 raft_consensus.cc:2804] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.606006 30182 raft_consensus.cc:493] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.606321 30182 raft_consensus.cc:3060] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.601032 30061 raft_consensus.cc:3060] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.608359 30198 raft_consensus.cc:515] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.609115 30060 raft_consensus.cc:2468] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.609884 29986 raft_consensus.cc:2468] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.610929 30099 leader_election.cc:304] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:40.611788 30197 raft_consensus.cc:2804] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.612363 30197 raft_consensus.cc:697] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:40.613623 30198 leader_election.cc:290] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.614145 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:40.614818 29986 raft_consensus.cc:3060] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.614771 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.615705 30060 raft_consensus.cc:3060] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.616006 30215 leader_election.cc:290] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.614643 30197 consensus_queue.cc:237] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.617096 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:40.617676 30135 raft_consensus.cc:3060] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.623983 29986 raft_consensus.cc:2468] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.624843 30060 raft_consensus.cc:2468] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:40.625237 30184 raft_consensus.cc:493] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.625353 30101 leader_election.cc:304] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.625926 30184 raft_consensus.cc:515] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.626420 30198 raft_consensus.cc:2804] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.626926 30198 raft_consensus.cc:697] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:40.628115 30184 leader_election.cc:290] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.629705 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.630410 29986 raft_consensus.cc:2468] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 0.
I20260709 13:13:40.630363 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:40.627753 30198 consensus_queue.cc:237] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.631259 30134 raft_consensus.cc:2468] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 0.
I20260709 13:13:40.632498 30027 leader_election.cc:304] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:40.633863 30184 raft_consensus.cc:2804] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.634425 30184 raft_consensus.cc:493] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.634897 30184 raft_consensus.cc:3060] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.635567 30182 raft_consensus.cc:515] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.642654 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.643857 30060 raft_consensus.cc:3060] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.648465 30184 raft_consensus.cc:515] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.652311 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:40.652386 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:40.653205 30134 raft_consensus.cc:3060] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.653316 29986 raft_consensus.cc:3060] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.639132 30061 raft_consensus.cc:2468] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:40.638267 30135 raft_consensus.cc:2468] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:40.661489 29950 leader_election.cc:304] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.663074 30215 raft_consensus.cc:2804] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.663748 30215 raft_consensus.cc:697] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:40.665289 30215 consensus_queue.cc:237] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.663635 30182 leader_election.cc:290] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.672042 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:40.672645 30184 leader_election.cc:290] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.673977 30134 raft_consensus.cc:2468] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:40.673686 29986 raft_consensus.cc:2468] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 1.
I20260709 13:13:40.674949 30135 raft_consensus.cc:3060] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.676000 30027 leader_election.cc:304] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.676324 29952 leader_election.cc:304] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.676919 30184 raft_consensus.cc:2804] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.676319 29882 catalog_manager.cc:5697] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.677433 30184 raft_consensus.cc:697] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:40.679108 30184 consensus_queue.cc:237] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.677434 30215 raft_consensus.cc:2804] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.680598 30215 raft_consensus.cc:697] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:40.681465 30215 consensus_queue.cc:237] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.694264 30060 raft_consensus.cc:2468] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:40.694653 30198 consensus_queue.cc:1048] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:40.687944 30135 raft_consensus.cc:2468] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 1.
I20260709 13:13:40.703241 29883 catalog_manager.cc:5697] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.705120 29882 catalog_manager.cc:5697] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.707252 29881 catalog_manager.cc:5697] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 1 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.718389 30179 consensus_queue.cc:1048] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.725908 29883 catalog_manager.cc:5697] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.761022 30135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:40.761624 30135 raft_consensus.cc:606] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.767109 30135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0532343b23845abb2a77293666e91b9"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:40.767577 30135 raft_consensus.cc:606] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.772475 30135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:40.772967 30135 raft_consensus.cc:606] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.788664 30184 consensus_queue.cc:1048] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.793305 29986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
mode: GRACEFUL
new_leader_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:59558
I20260709 13:13:40.793924 29986 raft_consensus.cc:606] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Received request to transfer leadership to TS 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:40.801162 30135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:40.801802 30135 raft_consensus.cc:606] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:40.805305 30211 consensus_queue.cc:1048] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:40.812670 29984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
mode: GRACEFUL
new_leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:59558
I20260709 13:13:40.813438 29984 raft_consensus.cc:606] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Received request to transfer leadership to TS 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:40.843240 30179 raft_consensus.cc:493] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.843928 30179 raft_consensus.cc:515] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.846382 30179 leader_election.cc:290] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:40.847349 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e3a0f21834a2f8062848fbb87f7e7" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:40.847487 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75e3a0f21834a2f8062848fbb87f7e7" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:40.848594 30061 raft_consensus.cc:2393] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3515c7aa152340c0ba2b1d6d702427d8 in current term 1: Already voted for candidate 415b92c00aa34a7fa42ca43284a17345 in this term.
I20260709 13:13:40.849627 30099 leader_election.cc:304] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8; no voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:40.850365 30179 raft_consensus.cc:3060] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.855719 30179 raft_consensus.cc:2749] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.955003 30179 consensus_queue.cc:1048] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.958745 30198 consensus_queue.cc:1048] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.963366 30197 raft_consensus.cc:993] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:40.963864 30197 raft_consensus.cc:1081] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:40.966058 29986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:59552
I20260709 13:13:40.966701 29986 raft_consensus.cc:493] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.967093 29986 raft_consensus.cc:3060] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.974813 29986 raft_consensus.cc:515] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.975905 29984 raft_consensus.cc:1240] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Rejecting Update request from peer 3515c7aa152340c0ba2b1d6d702427d8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:40.977759 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:40.978753 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62ef4433bf4bf393ea115626eafba5" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:40.977978 29986 leader_election.cc:290] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:40.979635 30134 raft_consensus.cc:3055] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.980031 30134 raft_consensus.cc:740] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:40.980923 30134 consensus_queue.cc:260] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:40.982157 30134 raft_consensus.cc:3060] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:40.984342 30198 consensus_queue.cc:1175] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "415b92c00aa34a7fa42ca43284a17345" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3515c7aa152340c0ba2b1d6d702427d8 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:13:40.985074 30061 raft_consensus.cc:3060] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.992538 30134 raft_consensus.cc:2468] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:40.993075 30061 raft_consensus.cc:2468] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:40.994391 29952 leader_election.cc:304] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:40.995398 30215 raft_consensus.cc:2804] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.995903 30215 raft_consensus.cc:697] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:40.996745 30215 consensus_queue.cc:237] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.003414 29881 catalog_manager.cc:5697] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.005946 30215 consensus_queue.cc:1048] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.021965 30219 consensus_queue.cc:1048] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.024550 30198 consensus_queue.cc:1048] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.025347 30197 consensus_queue.cc:1048] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.041371 30197 raft_consensus.cc:993] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:41.041893 30197 raft_consensus.cc:1081] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:41.043687 30060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:36192
I20260709 13:13:41.044965 30060 raft_consensus.cc:493] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.045394 30060 raft_consensus.cc:3060] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.051546 30060 raft_consensus.cc:515] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.054395 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:41.054956 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5846273cb9648e1acf047b87cdef4d0" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:41.055613 30060 leader_election.cc:290] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:41.055760 30134 raft_consensus.cc:3055] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.055024 29984 raft_consensus.cc:3060] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.056226 30134 raft_consensus.cc:740] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:41.057174 30134 consensus_queue.cc:260] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.058573 30134 raft_consensus.cc:3060] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.063235 29984 raft_consensus.cc:2468] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:41.064620 30027 leader_election.cc:304] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:41.064635 30211 consensus_queue.cc:1048] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.065253 30134 raft_consensus.cc:2468] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:41.065533 30202 raft_consensus.cc:2804] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.066321 30202 raft_consensus.cc:697] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:41.067222 30202 consensus_queue.cc:237] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.075254 30219 consensus_queue.cc:1048] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.077454 30202 consensus_queue.cc:1048] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.081239 29882 catalog_manager.cc:5697] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 2 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.089911 30182 consensus_queue.cc:1048] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.106127 30215 raft_consensus.cc:993] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: : Instructing follower 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:41.106648 30182 raft_consensus.cc:1081] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Signalling peer 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:41.108619 30135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:60732
I20260709 13:13:41.109130 30135 raft_consensus.cc:493] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.109429 30135 raft_consensus.cc:3060] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.114207 30198 consensus_queue.cc:1048] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.115216 30135 raft_consensus.cc:515] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.117468 30135 leader_election.cc:290] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:41.118083 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:41.118566 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a8c0da960b413490ebf233eb3f062b" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:41.118777 29986 raft_consensus.cc:3055] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.119196 30060 raft_consensus.cc:3060] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.119235 29986 raft_consensus.cc:740] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:41.120461 29986 consensus_queue.cc:260] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.122053 29986 raft_consensus.cc:3060] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.126958 30060 raft_consensus.cc:2468] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:41.128243 30099 leader_election.cc:304] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:41.128968 30198 raft_consensus.cc:2804] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.129474 30198 raft_consensus.cc:697] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:41.130292 30198 consensus_queue.cc:237] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.132431 29986 raft_consensus.cc:2468] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:41.137497 30198 raft_consensus.cc:993] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:41.137992 30198 raft_consensus.cc:1081] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:41.137989 29883 catalog_manager.cc:5697] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 1 to 2, leader changed from 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193) to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.141558 29986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0532343b23845abb2a77293666e91b9"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:59552
I20260709 13:13:41.143646 30179 consensus_queue.cc:1048] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.143981 29986 raft_consensus.cc:493] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.144721 29986 raft_consensus.cc:3060] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.153580 29986 raft_consensus.cc:515] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.157141 29986 leader_election.cc:290] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:41.158046 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:41.159721 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0532343b23845abb2a77293666e91b9" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:41.160308 30135 raft_consensus.cc:3055] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.160617 30135 raft_consensus.cc:740] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:41.161360 30135 consensus_queue.cc:260] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.162320 30135 raft_consensus.cc:3060] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.167445 30135 raft_consensus.cc:2468] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:41.168452 29952 leader_election.cc:304] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:41.169152 30182 raft_consensus.cc:2804] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.169508 30182 raft_consensus.cc:697] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:41.170323 30182 consensus_queue.cc:237] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.175971 30182 consensus_queue.cc:1048] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.176301 29882 catalog_manager.cc:5697] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.182808 30215 raft_consensus.cc:993] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: : Instructing follower 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:41.183249 30215 raft_consensus.cc:1081] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Signalling peer 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:41.185544 30061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:36196
I20260709 13:13:41.187687 30061 raft_consensus.cc:493] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.188113 30061 raft_consensus.cc:3060] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.187954 30182 consensus_queue.cc:1048] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.196336 30061 raft_consensus.cc:515] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.199905 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:41.200205 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd7960a8ed9419093aa296492d025b5" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:41.200567 29986 raft_consensus.cc:3055] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.200415 30061 leader_election.cc:290] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:41.201249 30135 raft_consensus.cc:3060] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.201140 29986 raft_consensus.cc:740] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:41.204507 29986 consensus_queue.cc:260] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.205490 29986 raft_consensus.cc:3060] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.207777 30135 raft_consensus.cc:2468] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:41.209041 30027 leader_election.cc:304] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:41.209949 30202 raft_consensus.cc:2804] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.210407 30202 raft_consensus.cc:697] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:41.211170 30202 consensus_queue.cc:237] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:41.212561 29986 raft_consensus.cc:2468] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:41.218400 29883 catalog_manager.cc:5697] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 1 to 2, leader changed from 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193) to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 2 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.341248 30179 raft_consensus.cc:993] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:41.341771 30198 raft_consensus.cc:1081] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:41.343333 29986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:59552
I20260709 13:13:41.343859 29986 raft_consensus.cc:493] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.344251 29986 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.349164 29986 raft_consensus.cc:515] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:41.350880 29986 leader_election.cc:290] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Requested vote from peers 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:41.351708 30135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:41.352017 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:41.352397 30135 raft_consensus.cc:3055] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.352650 30061 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.352746 30135 raft_consensus.cc:740] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:41.353566 30135 consensus_queue.cc:260] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:41.354518 30135 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.357890 30061 raft_consensus.cc:2468] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:41.359104 29950 leader_election.cc:304] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:41.359679 30135 raft_consensus.cc:2468] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:41.359953 30182 raft_consensus.cc:2804] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.360508 30182 raft_consensus.cc:697] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:41.361263 30182 consensus_queue.cc:237] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:41.367573 29883 catalog_manager.cc:5697] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.385499 30061 raft_consensus.cc:1275] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.386833 30182 consensus_queue.cc:1048] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.394917 30135 raft_consensus.cc:1275] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.397212 30182 consensus_queue.cc:1048] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.456476 29986 raft_consensus.cc:1275] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.457959 30211 consensus_queue.cc:1048] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.465915 30135 raft_consensus.cc:1275] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.467548 30202 consensus_queue.cc:1048] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.625896 29986 raft_consensus.cc:1275] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.627185 30198 consensus_queue.cc:1048] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.635001 30061 raft_consensus.cc:1275] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.636417 30179 consensus_queue.cc:1048] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.731359 29986 raft_consensus.cc:1275] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.732946 30202 consensus_queue.cc:1048] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.738037 30061 raft_consensus.cc:3060] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.741356 30135 raft_consensus.cc:1275] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.743778 30184 consensus_queue.cc:1048] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.746775 30061 raft_consensus.cc:1275] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.748723 30182 consensus_queue.cc:1048] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.758056 30135 raft_consensus.cc:1275] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.759430 30219 consensus_queue.cc:1048] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.814167 30135 raft_consensus.cc:1275] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.817822 30215 consensus_queue.cc:1048] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:41.836726 30060 raft_consensus.cc:1275] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.838434 30215 consensus_queue.cc:1048] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.851796 29881 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33708:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:43.854480 29881 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:43.908015 29968 tablet_service.cc:1511] Processing CreateTablet for tablet 103898800044427887c32667ce7e7d06 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:43.911240 30119 tablet_service.cc:1511] Processing CreateTablet for tablet 103898800044427887c32667ce7e7d06 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:43.912195 30043 tablet_service.cc:1511] Processing CreateTablet for tablet 103898800044427887c32667ce7e7d06 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:43.913048 30119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103898800044427887c32667ce7e7d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.912603 29969 tablet_service.cc:1511] Processing CreateTablet for tablet 77e23f42ea624a1d82106059c0220385 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:43.913863 30043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103898800044427887c32667ce7e7d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.914834 30045 tablet_service.cc:1511] Processing CreateTablet for tablet 77e23f42ea624a1d82106059c0220385 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:43.916224 30045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e23f42ea624a1d82106059c0220385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.920132 29968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103898800044427887c32667ce7e7d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.921105 29969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e23f42ea624a1d82106059c0220385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.921562 30125 tablet_service.cc:1511] Processing CreateTablet for tablet 77e23f42ea624a1d82106059c0220385 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:43.923058 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77e23f42ea624a1d82106059c0220385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.930441 29975 tablet_service.cc:1511] Processing CreateTablet for tablet 112dfd3da4d1470da8efb487fd60bbb7 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:43.931537 30050 tablet_service.cc:1511] Processing CreateTablet for tablet 112dfd3da4d1470da8efb487fd60bbb7 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:43.932052 29975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112dfd3da4d1470da8efb487fd60bbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.933051 30050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112dfd3da4d1470da8efb487fd60bbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.943847 30120 tablet_service.cc:1511] Processing CreateTablet for tablet 112dfd3da4d1470da8efb487fd60bbb7 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:43.945432 30120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112dfd3da4d1470da8efb487fd60bbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.945093 29970 tablet_service.cc:1511] Processing CreateTablet for tablet 2c11745a94364377a31cdfe49b87781c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:43.946524 29970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c11745a94364377a31cdfe49b87781c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.950232 30046 tablet_service.cc:1511] Processing CreateTablet for tablet 2c11745a94364377a31cdfe49b87781c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:43.954449 30122 tablet_service.cc:1511] Processing CreateTablet for tablet 2c11745a94364377a31cdfe49b87781c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:43.955919 30122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c11745a94364377a31cdfe49b87781c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.956593 30046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c11745a94364377a31cdfe49b87781c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.973923 29971 tablet_service.cc:1511] Processing CreateTablet for tablet 1cca354fe6de4dec9f690f0263b3801c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:43.975494 29971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cca354fe6de4dec9f690f0263b3801c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.982825 30044 tablet_service.cc:1511] Processing CreateTablet for tablet 1cca354fe6de4dec9f690f0263b3801c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:43.984297 30044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cca354fe6de4dec9f690f0263b3801c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.984088 30121 tablet_service.cc:1511] Processing CreateTablet for tablet 1cca354fe6de4dec9f690f0263b3801c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:43.985478 30121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cca354fe6de4dec9f690f0263b3801c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.986210 29968 tablet_service.cc:1511] Processing CreateTablet for tablet 3840c7ad6aaa47da9f4aa34bb867f902 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:43.988447 29968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3840c7ad6aaa47da9f4aa34bb867f902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:43.992055 30048 tablet_service.cc:1511] Processing CreateTablet for tablet 3840c7ad6aaa47da9f4aa34bb867f902 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:43.994679 30048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3840c7ad6aaa47da9f4aa34bb867f902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.000677 29975 tablet_service.cc:1511] Processing CreateTablet for tablet 7b99ac39d8084ef38142d0f99b6cba94 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.002164 29975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b99ac39d8084ef38142d0f99b6cba94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.010491 30047 tablet_service.cc:1511] Processing CreateTablet for tablet 7b99ac39d8084ef38142d0f99b6cba94 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.012049 30124 tablet_service.cc:1511] Processing CreateTablet for tablet 7b99ac39d8084ef38142d0f99b6cba94 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:43.993142 30125 tablet_service.cc:1511] Processing CreateTablet for tablet 3840c7ad6aaa47da9f4aa34bb867f902 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.013592 30124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b99ac39d8084ef38142d0f99b6cba94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.014442 30125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3840c7ad6aaa47da9f4aa34bb867f902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.012049 30047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b99ac39d8084ef38142d0f99b6cba94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.018198 30275 tablet_bootstrap.cc:492] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.029356 29970 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd915ecaf30495ea123adc4f05e596c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.030846 29970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd915ecaf30495ea123adc4f05e596c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.034642 30275 tablet_bootstrap.cc:654] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.037490 30276 tablet_bootstrap.cc:492] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.058701 30043 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd915ecaf30495ea123adc4f05e596c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.060206 30043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd915ecaf30495ea123adc4f05e596c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.062412 30276 tablet_bootstrap.cc:654] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.064875 30122 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd915ecaf30495ea123adc4f05e596c (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.070147 30274 tablet_bootstrap.cc:492] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.071367 29975 tablet_service.cc:1511] Processing CreateTablet for tablet 29b65cce9db64bee8a5e57f10f903552 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.072760 29975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b65cce9db64bee8a5e57f10f903552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.075153 30122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd915ecaf30495ea123adc4f05e596c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.078670 30274 tablet_bootstrap.cc:654] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.071367 30275 tablet_bootstrap.cc:492] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.084758 30275 ts_tablet_manager.cc:1403] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.067s	user 0.006s	sys 0.007s
I20260709 13:13:44.084959 30124 tablet_service.cc:1511] Processing CreateTablet for tablet 29b65cce9db64bee8a5e57f10f903552 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.086354 30124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b65cce9db64bee8a5e57f10f903552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.083716 30047 tablet_service.cc:1511] Processing CreateTablet for tablet 29b65cce9db64bee8a5e57f10f903552 (DEFAULT_TABLE table=soft_deleted_table [id=e512472fde7b4249a449e73c345db39b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.087723 30047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b65cce9db64bee8a5e57f10f903552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.090945 30275 raft_consensus.cc:359] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.091866 30275 raft_consensus.cc:385] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.092146 30275 raft_consensus.cc:740] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.094851 30276 tablet_bootstrap.cc:492] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.095405 30276 ts_tablet_manager.cc:1403] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.018s
I20260709 13:13:44.095414 30275 consensus_queue.cc:260] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.104964 30275 ts_tablet_manager.cc:1434] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:13:44.106231 30275 tablet_bootstrap.cc:492] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.098678 30276 raft_consensus.cc:359] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.110983 30276 raft_consensus.cc:385] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.111357 30276 raft_consensus.cc:740] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.112134 30276 consensus_queue.cc:260] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.114980 30276 ts_tablet_manager.cc:1434] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:13:44.122666 30275 tablet_bootstrap.cc:654] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.115998 30276 tablet_bootstrap.cc:492] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.132356 30274 tablet_bootstrap.cc:492] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.132726 30275 tablet_bootstrap.cc:492] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.132853 30274 ts_tablet_manager.cc:1403] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.014s
I20260709 13:13:44.133497 30275 ts_tablet_manager.cc:1403] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:13:44.133703 30276 tablet_bootstrap.cc:654] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.135636 30274 raft_consensus.cc:359] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.136358 30274 raft_consensus.cc:385] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.136611 30274 raft_consensus.cc:740] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.137311 30275 raft_consensus.cc:359] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.137946 30275 raft_consensus.cc:385] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.137476 30274 consensus_queue.cc:260] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.138319 30275 raft_consensus.cc:740] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.139555 30276 tablet_bootstrap.cc:492] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.139171 30275 consensus_queue.cc:260] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.140194 30276 ts_tablet_manager.cc:1403] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:13:44.140396 30274 ts_tablet_manager.cc:1434] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:44.141490 30274 tablet_bootstrap.cc:492] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.143409 30276 raft_consensus.cc:359] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.144202 30276 raft_consensus.cc:385] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.144366 30275 ts_tablet_manager.cc:1434] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:44.144551 30276 raft_consensus.cc:740] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.145552 30275 tablet_bootstrap.cc:492] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.145448 30276 consensus_queue.cc:260] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.148229 30276 ts_tablet_manager.cc:1434] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:44.148408 30274 tablet_bootstrap.cc:654] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.153584 30275 tablet_bootstrap.cc:654] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.155833 30274 tablet_bootstrap.cc:492] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.156386 30274 ts_tablet_manager.cc:1403] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.011s
I20260709 13:13:44.159071 30275 tablet_bootstrap.cc:492] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.159718 30275 ts_tablet_manager.cc:1403] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:13:44.160992 30276 tablet_bootstrap.cc:492] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.163106 30275 raft_consensus.cc:359] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.163894 30275 raft_consensus.cc:385] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.164264 30275 raft_consensus.cc:740] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.165067 30275 consensus_queue.cc:260] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.167131 30275 ts_tablet_manager.cc:1434] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:44.167846 30276 tablet_bootstrap.cc:654] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.159545 30274 raft_consensus.cc:359] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.168191 30275 tablet_bootstrap.cc:492] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.168570 30274 raft_consensus.cc:385] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.168893 30274 raft_consensus.cc:740] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.169657 30274 consensus_queue.cc:260] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.172084 30274 ts_tablet_manager.cc:1434] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:13:44.173141 30274 tablet_bootstrap.cc:492] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.175706 30275 tablet_bootstrap.cc:654] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.180761 30274 tablet_bootstrap.cc:654] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.188521 30275 tablet_bootstrap.cc:492] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.189297 30275 ts_tablet_manager.cc:1403] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.006s
I20260709 13:13:44.190162 30179 raft_consensus.cc:493] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.190929 30179 raft_consensus.cc:515] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.192440 30274 tablet_bootstrap.cc:492] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.193018 30274 ts_tablet_manager.cc:1403] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:13:44.192696 30275 raft_consensus.cc:359] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.193436 30275 raft_consensus.cc:385] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.193773 30275 raft_consensus.cc:740] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.194623 30275 consensus_queue.cc:260] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.195514 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e23f42ea624a1d82106059c0220385" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.196527 29986 raft_consensus.cc:2468] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.197046 30275 ts_tablet_manager.cc:1434] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:44.196977 30274 raft_consensus.cc:359] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.198014 30274 raft_consensus.cc:385] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.198328 30275 tablet_bootstrap.cc:492] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.198415 30274 raft_consensus.cc:740] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.198921 30101 leader_election.cc:304] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.199481 30274 consensus_queue.cc:260] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.203277 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e23f42ea624a1d82106059c0220385" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.204233 30061 raft_consensus.cc:2468] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.206655 30179 leader_election.cc:290] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.207546 30179 raft_consensus.cc:2804] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.208716 30179 raft_consensus.cc:493] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.209846 30179 raft_consensus.cc:3060] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.212801 30274 ts_tablet_manager.cc:1434] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:13:44.213462 30275 tablet_bootstrap.cc:654] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.214119 30274 tablet_bootstrap.cc:492] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.228996 30274 tablet_bootstrap.cc:654] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.235059 30288 raft_consensus.cc:493] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.235297 30275 tablet_bootstrap.cc:492] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.236478 30275 ts_tablet_manager.cc:1403] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.017s
I20260709 13:13:44.235924 30288 raft_consensus.cc:515] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.239132 30288 leader_election.cc:290] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.241634 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.242097 30275 raft_consensus.cc:359] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.242740 30061 raft_consensus.cc:2468] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.242962 30275 raft_consensus.cc:385] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.243247 30274 tablet_bootstrap.cc:492] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.243552 30275 raft_consensus.cc:740] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.243881 30274 ts_tablet_manager.cc:1403] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.004s
I20260709 13:13:44.244638 30275 consensus_queue.cc:260] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.244812 30099 leader_election.cc:304] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:44.247547 30275 ts_tablet_manager.cc:1434] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:44.247228 30274 raft_consensus.cc:359] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.248150 30274 raft_consensus.cc:385] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.248548 30274 raft_consensus.cc:740] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.248813 30275 tablet_bootstrap.cc:492] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.249614 30274 consensus_queue.cc:260] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.250736 30288 raft_consensus.cc:2804] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.251164 30288 raft_consensus.cc:493] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.251561 30288 raft_consensus.cc:3060] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.256711 30275 tablet_bootstrap.cc:654] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:44.267990 30101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:36727, user_credentials={real_user=slave}} blocked reactor thread for 69333.8us
I20260709 13:13:44.269354 30274 ts_tablet_manager.cc:1434] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:13:44.270998 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.272190 30274 tablet_bootstrap.cc:492] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
W20260709 13:13:44.273813 30101 leader_election.cc:343] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.260330 30288 raft_consensus.cc:515] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.282721 30288 leader_election.cc:290] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.285836 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.286764 30061 raft_consensus.cc:3060] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.292860 30273 raft_consensus.cc:493] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.293653 30273 raft_consensus.cc:515] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.296065 30274 tablet_bootstrap.cc:654] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.296665 30275 tablet_bootstrap.cc:492] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.297467 30275 ts_tablet_manager.cc:1403] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.010s
I20260709 13:13:44.298785 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.300626 30275 raft_consensus.cc:359] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
W20260709 13:13:44.300881 30027 leader_election.cc:343] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.301425 30275 raft_consensus.cc:385] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.301770 30275 raft_consensus.cc:740] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.302551 30275 consensus_queue.cc:260] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.304929 30275 ts_tablet_manager.cc:1434] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:44.305397 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:44.305924 30275 tablet_bootstrap.cc:492] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
W20260709 13:13:44.307600 30027 leader_election.cc:343] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.308199 30027 leader_election.cc:304] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.309414 30202 raft_consensus.cc:2749] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.311902 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.302801 30273 leader_election.cc:290] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
W20260709 13:13:44.313427 30101 leader_election.cc:343] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.314200 30275 tablet_bootstrap.cc:654] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.315083 30276 tablet_bootstrap.cc:492] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.315699 30276 ts_tablet_manager.cc:1403] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.155s	user 0.043s	sys 0.103s
I20260709 13:13:44.288443 30179 raft_consensus.cc:515] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.321664 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e23f42ea624a1d82106059c0220385" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.322290 29986 raft_consensus.cc:3060] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.321861 30276 raft_consensus.cc:359] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.322952 30276 raft_consensus.cc:385] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.323371 30276 raft_consensus.cc:740] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.324131 30276 consensus_queue.cc:260] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.325822 30275 tablet_bootstrap.cc:492] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.326344 30275 ts_tablet_manager.cc:1403] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:13:44.328380 29986 raft_consensus.cc:2468] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.329169 30276 ts_tablet_manager.cc:1434] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:13:44.329386 30275 raft_consensus.cc:359] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.329617 30101 leader_election.cc:304] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.330119 30275 raft_consensus.cc:385] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.330333 30276 tablet_bootstrap.cc:492] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.330505 30275 raft_consensus.cc:740] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.330654 30287 raft_consensus.cc:2804] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.331236 30287 raft_consensus.cc:697] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.332146 30287 consensus_queue.cc:237] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.334125 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e23f42ea624a1d82106059c0220385" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.334748 30060 raft_consensus.cc:3060] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.331305 30275 consensus_queue.cc:260] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.339087 30275 ts_tablet_manager.cc:1434] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:13:44.319113 30061 raft_consensus.cc:2468] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.342159 30179 leader_election.cc:290] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.340034 30275 tablet_bootstrap.cc:492] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.346128 30060 raft_consensus.cc:2468] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.350831 30276 tablet_bootstrap.cc:654] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.352051 30099 leader_election.cc:304] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.354420 30179 raft_consensus.cc:2804] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.354964 30179 raft_consensus.cc:697] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.356772 30275 tablet_bootstrap.cc:654] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:44.357726 29932 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:44.355901 30179 consensus_queue.cc:237] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.357776 29882 catalog_manager.cc:5697] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.364708 30274 tablet_bootstrap.cc:492] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.365535 30274 ts_tablet_manager.cc:1403] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.095s	user 0.020s	sys 0.003s
I20260709 13:13:44.369975 30274 raft_consensus.cc:359] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.371003 30274 raft_consensus.cc:385] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.371380 30274 raft_consensus.cc:740] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.372583 30274 consensus_queue.cc:260] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.376111 30274 ts_tablet_manager.cc:1434] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:13:44.377189 30287 raft_consensus.cc:493] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.378784 30287 raft_consensus.cc:515] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.379649 30274 tablet_bootstrap.cc:492] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.380890 30287 leader_election.cc:290] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.382237 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.383285 30060 raft_consensus.cc:2468] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.384274 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.386209 30099 leader_election.cc:304] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
W20260709 13:13:44.386909 30101 leader_election.cc:343] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.387194 30287 raft_consensus.cc:2804] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.387643 30287 raft_consensus.cc:493] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.387964 30287 raft_consensus.cc:3060] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.389523 30274 tablet_bootstrap.cc:654] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.392256 30275 tablet_bootstrap.cc:492] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.392783 30275 ts_tablet_manager.cc:1403] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.005s
I20260709 13:13:44.392967 29881 catalog_manager.cc:5697] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.395433 30275 raft_consensus.cc:359] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.396234 30275 raft_consensus.cc:385] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.395957 30287 raft_consensus.cc:515] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.396600 30275 raft_consensus.cc:740] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.397367 30275 consensus_queue.cc:260] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.399693 30275 ts_tablet_manager.cc:1434] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:44.400334 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.401516 30274 tablet_bootstrap.cc:492] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.401685 30287 leader_election.cc:290] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.402181 30274 ts_tablet_manager.cc:1403] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 13:13:44.402441 30276 tablet_bootstrap.cc:492] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.402897 30275 tablet_bootstrap.cc:492] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: Bootstrap starting.
I20260709 13:13:44.402995 30276 ts_tablet_manager.cc:1403] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.011s
I20260709 13:13:44.405478 30274 raft_consensus.cc:359] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.406101 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.406327 30274 raft_consensus.cc:385] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.406250 30276 raft_consensus.cc:359] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.406952 30060 raft_consensus.cc:3060] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.407230 30274 raft_consensus.cc:740] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.408075 30274 consensus_queue.cc:260] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.409657 30275 tablet_bootstrap.cc:654] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.410800 30274 ts_tablet_manager.cc:1434] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:13:44.411882 30274 tablet_bootstrap.cc:492] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.414701 30060 raft_consensus.cc:2468] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.415267 30276 raft_consensus.cc:385] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.416098 30276 raft_consensus.cc:740] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.417843 30099 leader_election.cc:304] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:44.418143 30276 consensus_queue.cc:260] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.418814 30274 tablet_bootstrap.cc:654] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.418788 30287 raft_consensus.cc:2804] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.419552 30287 raft_consensus.cc:697] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.420434 30287 consensus_queue.cc:237] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
W20260709 13:13:44.428261 30101 leader_election.cc:343] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.440351 30276 ts_tablet_manager.cc:1434] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.008s
I20260709 13:13:44.446216 30276 tablet_bootstrap.cc:492] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.446560 30274 tablet_bootstrap.cc:492] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.447234 30274 ts_tablet_manager.cc:1403] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.008s
I20260709 13:13:44.449271 30275 tablet_bootstrap.cc:492] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: No bootstrap required, opened a new log
I20260709 13:13:44.449882 30275 ts_tablet_manager.cc:1403] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.008s
I20260709 13:13:44.453061 30275 raft_consensus.cc:359] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.453814 30275 raft_consensus.cc:385] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.454169 30275 raft_consensus.cc:740] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.454733 30276 tablet_bootstrap.cc:654] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.454849 30275 consensus_queue.cc:260] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.458140 30274 raft_consensus.cc:359] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.458997 30274 raft_consensus.cc:385] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.459324 30274 raft_consensus.cc:740] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.460131 29881 catalog_manager.cc:5697] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.461045 30276 tablet_bootstrap.cc:492] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.461472 30275 ts_tablet_manager.cc:1434] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:44.461663 30276 ts_tablet_manager.cc:1403] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:13:44.461844 30202 raft_consensus.cc:493] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.462246 30274 consensus_queue.cc:260] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.462342 30202 raft_consensus.cc:515] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.464322 30274 ts_tablet_manager.cc:1434] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:13:44.466784 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.467824 30274 tablet_bootstrap.cc:492] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.466826 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
W20260709 13:13:44.469563 30027 leader_election.cc:343] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:44.470279 30027 leader_election.cc:343] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.470656 30027 leader_election.cc:304] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.471522 30273 raft_consensus.cc:2749] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.464989 30202 leader_election.cc:290] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.465145 30276 raft_consensus.cc:359] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.473503 30276 raft_consensus.cc:385] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.474056 30276 raft_consensus.cc:740] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.475140 30274 tablet_bootstrap.cc:654] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.475327 30276 consensus_queue.cc:260] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.478399 30276 ts_tablet_manager.cc:1434] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:13:44.479523 30276 tablet_bootstrap.cc:492] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.485953 30276 tablet_bootstrap.cc:654] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.486343 30274 tablet_bootstrap.cc:492] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.486827 30274 ts_tablet_manager.cc:1403] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 13:13:44.488955 30274 raft_consensus.cc:359] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.489643 30274 raft_consensus.cc:385] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.489899 30274 raft_consensus.cc:740] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.490573 30274 consensus_queue.cc:260] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.492758 30274 ts_tablet_manager.cc:1434] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:44.493592 30274 tablet_bootstrap.cc:492] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: Bootstrap starting.
I20260709 13:13:44.494952 30276 tablet_bootstrap.cc:492] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.495631 30276 ts_tablet_manager.cc:1403] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:13:44.498582 30276 raft_consensus.cc:359] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.499140 30276 raft_consensus.cc:385] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.499418 30276 raft_consensus.cc:740] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.500212 30274 tablet_bootstrap.cc:654] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.500130 30276 consensus_queue.cc:260] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.500746 30287 raft_consensus.cc:493] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.501271 30287 raft_consensus.cc:515] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.502579 30276 ts_tablet_manager.cc:1434] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:13:44.503645 30276 tablet_bootstrap.cc:492] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.504043 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103898800044427887c32667ce7e7d06" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.504558 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103898800044427887c32667ce7e7d06" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.504771 29986 raft_consensus.cc:2468] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.505254 30060 raft_consensus.cc:2468] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.506009 30101 leader_election.cc:304] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.506784 30179 raft_consensus.cc:2804] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.507280 30179 raft_consensus.cc:493] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.507716 30179 raft_consensus.cc:3060] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.507299 30287 leader_election.cc:290] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.511150 30276 tablet_bootstrap.cc:654] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.517268 30179 raft_consensus.cc:515] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.521157 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103898800044427887c32667ce7e7d06" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.521363 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103898800044427887c32667ce7e7d06" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.521749 29986 raft_consensus.cc:3060] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.521955 30060 raft_consensus.cc:3060] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.523166 30276 tablet_bootstrap.cc:492] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.523730 30276 ts_tablet_manager.cc:1403] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:13:44.526840 30276 raft_consensus.cc:359] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.527570 30276 raft_consensus.cc:385] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.527868 30276 raft_consensus.cc:740] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.528726 30060 raft_consensus.cc:2468] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.529525 30179 leader_election.cc:290] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.530486 30099 leader_election.cc:304] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:44.531170 30179 raft_consensus.cc:2804] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.531431 29986 raft_consensus.cc:2468] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.531647 30179 raft_consensus.cc:697] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.528856 30276 consensus_queue.cc:260] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.532725 30179 consensus_queue.cc:237] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.534431 30276 ts_tablet_manager.cc:1434] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:13:44.535501 30276 tablet_bootstrap.cc:492] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.535873 30274 tablet_bootstrap.cc:492] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: No bootstrap required, opened a new log
I20260709 13:13:44.536432 30274 ts_tablet_manager.cc:1403] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 13:13:44.538928 30202 raft_consensus.cc:493] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.539484 30202 raft_consensus.cc:515] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.540032 30274 raft_consensus.cc:359] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.540975 30274 raft_consensus.cc:385] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.541258 30274 raft_consensus.cc:740] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.541575 30202 leader_election.cc:290] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.542120 30276 tablet_bootstrap.cc:654] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.542613 30274 consensus_queue.cc:260] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.542584 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:44.543277 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.551354 30134 raft_consensus.cc:2468] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 0.
W20260709 13:13:44.553511 30027 leader_election.cc:343] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.555128 30027 leader_election.cc:304] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.556260 30273 raft_consensus.cc:2804] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.553515 30274 ts_tablet_manager.cc:1434] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:44.556676 30273 raft_consensus.cc:493] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.557291 30273 raft_consensus.cc:3060] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.563434 30273 raft_consensus.cc:515] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.563557 29883 catalog_manager.cc:5697] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.565588 30273 leader_election.cc:290] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.566797 30276 tablet_bootstrap.cc:492] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.566702 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:44.567492 30276 ts_tablet_manager.cc:1403] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.007s
I20260709 13:13:44.567538 30134 raft_consensus.cc:3060] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.567639 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.570695 30276 raft_consensus.cc:359] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.571444 30276 raft_consensus.cc:385] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.571753 30276 raft_consensus.cc:740] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.572491 30276 consensus_queue.cc:260] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.574107 29986 raft_consensus.cc:3060] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.574774 30276 ts_tablet_manager.cc:1434] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:44.575822 30276 tablet_bootstrap.cc:492] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: Bootstrap starting.
I20260709 13:13:44.576248 30134 raft_consensus.cc:2468] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 1.
I20260709 13:13:44.577796 30179 raft_consensus.cc:493] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.578299 30179 raft_consensus.cc:515] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.581347 29986 raft_consensus.cc:2468] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 1.
I20260709 13:13:44.581719 30276 tablet_bootstrap.cc:654] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.582343 30179 leader_election.cc:290] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.581604 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.583798 29984 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.585130 30101 leader_election.cc:304] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.585816 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.586040 30179 raft_consensus.cc:2804] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.586499 30179 raft_consensus.cc:493] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.586557 30060 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.586932 30179 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.585872 30027 leader_election.cc:304] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:44.590925 30273 raft_consensus.cc:2804] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.592708 30273 raft_consensus.cc:697] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:44.593386 30179 raft_consensus.cc:515] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.593529 30273 consensus_queue.cc:237] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.595400 30276 tablet_bootstrap.cc:492] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: No bootstrap required, opened a new log
I20260709 13:13:44.595953 30276 ts_tablet_manager.cc:1403] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.008s
I20260709 13:13:44.596774 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.597545 29984 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.598191 30179 leader_election.cc:290] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.599113 30276 raft_consensus.cc:359] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.599845 30276 raft_consensus.cc:385] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.600150 30276 raft_consensus.cc:740] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.600860 30276 consensus_queue.cc:260] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.601698 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.602304 30060 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.603171 30276 ts_tablet_manager.cc:1434] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:44.606921 29984 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.608301 30101 leader_election.cc:304] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.609249 30179 raft_consensus.cc:2804] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.609776 30179 raft_consensus.cc:697] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.610842 30179 consensus_queue.cc:237] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.613823 29883 catalog_manager.cc:5697] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 1 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.620180 30060 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.620497 29882 catalog_manager.cc:5697] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.623611 30301 raft_consensus.cc:493] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.624194 30301 raft_consensus.cc:515] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.628118 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:44.628298 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.628957 30134 raft_consensus.cc:2468] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:44.629019 30061 raft_consensus.cc:2468] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:44.630511 29950 leader_election.cc:304] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.631917 30300 raft_consensus.cc:2804] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.632586 30300 raft_consensus.cc:493] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.632920 30300 raft_consensus.cc:3060] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.634243 30301 leader_election.cc:290] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.637732 30301 raft_consensus.cc:493] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.638913 30301 raft_consensus.cc:515] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.641369 30301 leader_election.cc:290] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.641614 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.641997 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:44.640651 30300 raft_consensus.cc:515] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.642596 30060 raft_consensus.cc:2393] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 415b92c00aa34a7fa42ca43284a17345 in current term 1: Already voted for candidate 3515c7aa152340c0ba2b1d6d702427d8 in this term.
I20260709 13:13:44.643693 29950 leader_election.cc:304] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 415b92c00aa34a7fa42ca43284a17345; no voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:44.643951 30300 leader_election.cc:290] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.644603 30300 raft_consensus.cc:3060] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.645076 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:44.645619 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.645704 30134 raft_consensus.cc:3060] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.646217 30060 raft_consensus.cc:3060] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.651371 30060 raft_consensus.cc:2468] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:44.651784 30300 raft_consensus.cc:2749] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:44.652707 29950 leader_election.cc:304] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.652972 30134 raft_consensus.cc:2468] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:44.653451 30300 raft_consensus.cc:2804] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.654124 30300 raft_consensus.cc:697] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:44.654999 30300 consensus_queue.cc:237] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.662182 29883 catalog_manager.cc:5697] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.695977 30300 raft_consensus.cc:493] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.696673 30300 raft_consensus.cc:515] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.698752 30300 leader_election.cc:290] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.699474 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.699899 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8" is_pre_election: true
I20260709 13:13:44.700280 30060 raft_consensus.cc:2468] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:44.700582 30134 raft_consensus.cc:2468] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 0.
I20260709 13:13:44.701400 29950 leader_election.cc:304] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.702073 30300 raft_consensus.cc:2804] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.702445 30300 raft_consensus.cc:493] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.702669 30300 raft_consensus.cc:3060] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.707551 30300 raft_consensus.cc:515] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.709153 30300 leader_election.cc:290] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.710125 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.710232 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:44.710795 30060 raft_consensus.cc:3060] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.710999 30134 raft_consensus.cc:3060] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.715750 30060 raft_consensus.cc:2468] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:44.716358 30134 raft_consensus.cc:2468] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 1.
I20260709 13:13:44.716851 29950 leader_election.cc:304] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.717700 30300 raft_consensus.cc:2804] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.718220 30300 raft_consensus.cc:697] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:44.719038 30300 consensus_queue.cc:237] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.725842 30179 raft_consensus.cc:493] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.726327 30179 raft_consensus.cc:515] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.726603 29883 catalog_manager.cc:5697] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 0 to 1, leader changed from <none> to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.728037 30179 leader_election.cc:290] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.728950 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345" is_pre_election: true
I20260709 13:13:44.729135 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da" is_pre_election: true
I20260709 13:13:44.729748 30060 raft_consensus.cc:2468] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.729684 29984 raft_consensus.cc:2468] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 0.
I20260709 13:13:44.731117 30099 leader_election.cc:304] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:44.732332 30179 raft_consensus.cc:2804] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.733186 30179 raft_consensus.cc:493] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.733525 30179 raft_consensus.cc:3060] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.739177 30179 raft_consensus.cc:515] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.740901 30179 leader_election.cc:290] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:44.741938 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.741855 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:44.742717 30060 raft_consensus.cc:3060] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.742900 29986 raft_consensus.cc:3060] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.749748 29986 raft_consensus.cc:2468] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.749748 30060 raft_consensus.cc:2468] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 1.
I20260709 13:13:44.750887 30101 leader_election.cc:304] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:44.752069 30179 raft_consensus.cc:2804] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.752620 30179 raft_consensus.cc:697] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.753545 30287 consensus_queue.cc:1048] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.753465 30179 consensus_queue.cc:237] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.775909 29986 raft_consensus.cc:3060] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.779953 29882 catalog_manager.cc:5697] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:44.784060 30179 consensus_queue.cc:1048] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.784264 30287 consensus_queue.cc:1048] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:44.802624 30288 consensus_queue.cc:1048] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.820546 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "103898800044427887c32667ce7e7d06"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:44.821269 30134 raft_consensus.cc:606] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.828964 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77e23f42ea624a1d82106059c0220385"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:44.829416 30134 raft_consensus.cc:606] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.834257 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:44.834851 30134 raft_consensus.cc:606] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:44.842569 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:44.843117 30134 raft_consensus.cc:606] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:44.843667 30287 consensus_queue.cc:1048] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.848886 29984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
mode: GRACEFUL
new_leader_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:59558
I20260709 13:13:44.849436 29984 raft_consensus.cc:606] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Received request to transfer leadership to TS 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:44.852505 30179 raft_consensus.cc:993] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:44.852923 30179 raft_consensus.cc:1081] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:44.855355 29984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:59552
I20260709 13:13:44.855983 29984 raft_consensus.cc:493] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.856393 29984 raft_consensus.cc:3060] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.858479 30288 consensus_queue.cc:1048] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.858873 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:44.859618 30134 raft_consensus.cc:606] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:44.865538 29984 raft_consensus.cc:515] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.866452 29986 raft_consensus.cc:1240] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Rejecting Update request from peer 3515c7aa152340c0ba2b1d6d702427d8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:44.867630 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
mode: GRACEFUL
new_leader_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:60740
I20260709 13:13:44.868340 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.869939 30288 consensus_queue.cc:1059] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.868367 30134 raft_consensus.cc:606] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Received request to transfer leadership to TS 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:44.870582 30179 raft_consensus.cc:3055] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.871721 30179 raft_consensus.cc:740] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.872629 30179 consensus_queue.cc:260] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.873370 30179 raft_consensus.cc:3060] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.885149 29984 leader_election.cc:290] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:44.886581 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112dfd3da4d1470da8efb487fd60bbb7" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:44.895078 30134 raft_consensus.cc:2468] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:44.896413 29952 leader_election.cc:304] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 3bb1ee647860425cb0e270e6da9657da
I20260709 13:13:44.897280 30300 raft_consensus.cc:2804] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.897822 30300 raft_consensus.cc:697] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:44.897795 30061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
mode: GRACEFUL
new_leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:36198
I20260709 13:13:44.898555 30061 raft_consensus.cc:606] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Received request to transfer leadership to TS 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:44.898872 30300 consensus_queue.cc:237] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.906033 29881 catalog_manager.cc:5697] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.969764 30179 consensus_queue.cc:1048] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.976203 30288 raft_consensus.cc:993] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:44.976887 30179 raft_consensus.cc:1081] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:44.979408 29986 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "103898800044427887c32667ce7e7d06"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:59552
I20260709 13:13:44.983395 30287 consensus_queue.cc:1048] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:44.984567 29986 raft_consensus.cc:493] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.985021 29986 raft_consensus.cc:3060] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.992244 29986 raft_consensus.cc:515] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.995662 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103898800044427887c32667ce7e7d06" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:44.995702 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103898800044427887c32667ce7e7d06" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:44.996337 30061 raft_consensus.cc:3060] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.996619 30133 raft_consensus.cc:3055] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.997030 30133 raft_consensus.cc:740] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:44.997821 30133 consensus_queue.cc:260] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:44.999015 30133 raft_consensus.cc:3060] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.005909 30061 raft_consensus.cc:2468] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:45.006168 30133 raft_consensus.cc:2468] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:45.007155 29950 leader_election.cc:304] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:45.007228 29986 leader_election.cc:290] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:45.008394 30300 raft_consensus.cc:2804] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.008927 30300 raft_consensus.cc:697] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:45.008791 30179 consensus_queue.cc:1048] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.009739 30300 consensus_queue.cc:237] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.018602 30287 raft_consensus.cc:993] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.019227 30287 raft_consensus.cc:1081] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.018600 29882 catalog_manager.cc:5697] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.021971 30060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:36192
I20260709 13:13:45.022506 30060 raft_consensus.cc:493] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.022835 30060 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.024358 30288 consensus_queue.cc:1048] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.033808 30060 raft_consensus.cc:515] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.034844 30061 raft_consensus.cc:1240] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Rejecting Update request from peer 3515c7aa152340c0ba2b1d6d702427d8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:45.036820 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:45.036871 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:45.035805 30060 leader_election.cc:290] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:45.037485 30288 consensus_queue.cc:1059] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.037712 29984 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.039803 30133 raft_consensus.cc:3055] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:45.040190 30133 raft_consensus.cc:740] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:45.041013 30133 consensus_queue.cc:260] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.042309 30133 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.045929 29984 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:45.047132 30027 leader_election.cc:304] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:45.047956 30273 raft_consensus.cc:2804] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.048465 30273 raft_consensus.cc:697] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:45.049260 30273 consensus_queue.cc:237] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.050304 30133 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
W20260709 13:13:45.050910 30288 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:13:45.058379 29882 catalog_manager.cc:5697] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 2 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.103787 30273 consensus_queue.cc:1048] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.113153 30273 raft_consensus.cc:993] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: : Instructing follower 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:45.113780 30202 raft_consensus.cc:1081] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Signalling peer 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:45.113154 30333 consensus_queue.cc:1048] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.116808 30133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:60726
I20260709 13:13:45.117343 30133 raft_consensus.cc:493] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.117698 30133 raft_consensus.cc:3060] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.125131 30133 raft_consensus.cc:515] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.128873 30133 leader_election.cc:290] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:45.131935 29986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:45.134713 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65cce9db64bee8a5e57f10f903552" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:45.135368 30060 raft_consensus.cc:3055] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:45.135696 30060 raft_consensus.cc:740] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:45.136435 30060 consensus_queue.cc:260] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.137365 30060 raft_consensus.cc:3060] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.142305 30060 raft_consensus.cc:2468] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:45.143163 30099 leader_election.cc:304] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 415b92c00aa34a7fa42ca43284a17345
I20260709 13:13:45.143883 30288 raft_consensus.cc:2804] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.144434 30288 raft_consensus.cc:697] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:45.145318 30288 consensus_queue.cc:237] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.151685 29882 catalog_manager.cc:5697] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 1 to 2, leader changed from 3bb1ee647860425cb0e270e6da9657da (127.17.171.194) to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.164785 30300 consensus_queue.cc:1048] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.178589 30300 consensus_queue.cc:1048] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.180217 30337 consensus_queue.cc:1048] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.196319 30300 raft_consensus.cc:993] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: : Instructing follower 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.196822 30300 raft_consensus.cc:1081] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Signalling peer 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.201668 30061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:36196
I20260709 13:13:45.202297 30061 raft_consensus.cc:493] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.202708 30061 raft_consensus.cc:3060] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.209497 30342 consensus_queue.cc:1048] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.209710 30061 raft_consensus.cc:515] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.212209 30061 leader_election.cc:290] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:45.216645 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:45.218549 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3840c7ad6aaa47da9f4aa34bb867f902" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:45.219347 29984 raft_consensus.cc:3055] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:45.219750 29984 raft_consensus.cc:740] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:45.220878 29984 consensus_queue.cc:260] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.222155 29984 raft_consensus.cc:3060] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.232702 29984 raft_consensus.cc:2468] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:45.233811 30027 leader_election.cc:304] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:45.234548 30334 raft_consensus.cc:2804] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.235006 30334 raft_consensus.cc:697] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:45.235757 30334 consensus_queue.cc:237] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.242441 29882 catalog_manager.cc:5697] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 1 to 2, leader changed from 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193) to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 2 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.260514 30287 raft_consensus.cc:993] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.261070 30288 raft_consensus.cc:1081] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.262564 30061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:36192
I20260709 13:13:45.263060 30061 raft_consensus.cc:493] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.263401 30061 raft_consensus.cc:3060] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.267817 30061 raft_consensus.cc:515] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.269380 30061 leader_election.cc:290] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:45.270480 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:45.270560 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cca354fe6de4dec9f690f0263b3801c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:45.271178 29984 raft_consensus.cc:3060] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.271306 30133 raft_consensus.cc:3055] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:45.271735 30133 raft_consensus.cc:740] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:45.272588 30133 consensus_queue.cc:260] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.273522 30133 raft_consensus.cc:3060] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.276754 29984 raft_consensus.cc:2468] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:45.277951 30027 leader_election.cc:304] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:45.278757 30334 raft_consensus.cc:2804] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.278895 30133 raft_consensus.cc:2468] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:45.279255 30334 raft_consensus.cc:697] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:45.280239 30334 consensus_queue.cc:237] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.287806 29882 catalog_manager.cc:5697] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 2 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.290143 30287 raft_consensus.cc:993] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:45.290683 30288 raft_consensus.cc:1081] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 415b92c00aa34a7fa42ca43284a17345 to start an election
I20260709 13:13:45.292338 29984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77e23f42ea624a1d82106059c0220385"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
 from {username='slave'} at 127.0.0.1:59552
I20260709 13:13:45.292876 29984 raft_consensus.cc:493] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.293226 29984 raft_consensus.cc:3060] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.298753 29984 raft_consensus.cc:515] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.300434 29984 leader_election.cc:290] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Requested vote from peers 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:45.301062 30061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e23f42ea624a1d82106059c0220385" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:45.301712 30061 raft_consensus.cc:3060] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.301499 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77e23f42ea624a1d82106059c0220385" candidate_uuid: "415b92c00aa34a7fa42ca43284a17345" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:45.302259 30133 raft_consensus.cc:3055] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:45.302603 30133 raft_consensus.cc:740] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:45.303411 30133 consensus_queue.cc:260] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.304669 30133 raft_consensus.cc:3060] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.308976 30061 raft_consensus.cc:2468] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:45.310297 29950 leader_election.cc:304] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bb1ee647860425cb0e270e6da9657da, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:45.311065 30301 raft_consensus.cc:2804] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.311463 30301 raft_consensus.cc:697] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Leader. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:45.311592 30133 raft_consensus.cc:2468] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 415b92c00aa34a7fa42ca43284a17345 in term 2.
I20260709 13:13:45.312270 30301 consensus_queue.cc:237] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.318470 29882 catalog_manager.cc:5697] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "415b92c00aa34a7fa42ca43284a17345" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.324898 30288 consensus_queue.cc:1048] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.325695 30287 consensus_queue.cc:1048] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.336966 30179 raft_consensus.cc:993] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: : Instructing follower 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.337872 30287 raft_consensus.cc:1081] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Signalling peer 3bb1ee647860425cb0e270e6da9657da to start an election
I20260709 13:13:45.342926 30061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
 from {username='slave'} at 127.0.0.1:36192
I20260709 13:13:45.343406 30060 raft_consensus.cc:3060] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.343518 30061 raft_consensus.cc:493] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:45.344033 30061 raft_consensus.cc:3060] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.350505 30060 raft_consensus.cc:1275] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.350322 30061 raft_consensus.cc:515] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.352222 30301 consensus_queue.cc:1048] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.352473 30061 leader_election.cc:290] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195:33633)
I20260709 13:13:45.353564 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
I20260709 13:13:45.354151 30133 raft_consensus.cc:3055] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:45.354478 30133 raft_consensus.cc:740] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:45.355257 30133 consensus_queue.cc:260] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.356019 30133 raft_consensus.cc:3060] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.359750 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd915ecaf30495ea123adc4f05e596c" candidate_uuid: "3bb1ee647860425cb0e270e6da9657da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:45.360426 29984 raft_consensus.cc:3060] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.363155 30133 raft_consensus.cc:2468] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:45.364495 30027 leader_election.cc:304] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:45.365635 30334 raft_consensus.cc:2804] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:45.367413 30334 raft_consensus.cc:697] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Leader. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:45.367515 29984 raft_consensus.cc:2468] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bb1ee647860425cb0e270e6da9657da in term 2.
I20260709 13:13:45.369122 30334 consensus_queue.cc:237] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:45.369477 30133 raft_consensus.cc:1275] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.377302 30301 consensus_queue.cc:1048] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.378654 29881 catalog_manager.cc:5697] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da reported cstate change: term changed from 1 to 2, leader changed from 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195) to 3bb1ee647860425cb0e270e6da9657da (127.17.171.194). New cstate: current_term: 2 leader_uuid: "3bb1ee647860425cb0e270e6da9657da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.442237 30133 raft_consensus.cc:1275] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.443502 30334 consensus_queue.cc:1048] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.452112 29984 raft_consensus.cc:1275] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.453825 30202 consensus_queue.cc:1048] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.465219 30133 raft_consensus.cc:1275] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.466760 30301 consensus_queue.cc:1048] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.474601 30061 raft_consensus.cc:1275] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.476284 30300 consensus_queue.cc:1048] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.543644 30061 raft_consensus.cc:1275] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.544871 30179 consensus_queue.cc:1048] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.551422 29984 raft_consensus.cc:3060] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.558360 29984 raft_consensus.cc:1275] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.559607 30287 consensus_queue.cc:1048] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.655006 30133 raft_consensus.cc:3060] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:45.661721 30133 raft_consensus.cc:1275] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.662938 30202 consensus_queue.cc:1048] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.670496 29984 raft_consensus.cc:1275] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.672274 30202 consensus_queue.cc:1048] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.814505 30133 raft_consensus.cc:1275] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.814550 30134 raft_consensus.cc:1275] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.815804 30202 consensus_queue.cc:1048] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.815934 30337 consensus_queue.cc:1048] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.828299 30061 raft_consensus.cc:1275] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 415b92c00aa34a7fa42ca43284a17345: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.830392 29984 raft_consensus.cc:1275] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.830317 30340 consensus_queue.cc:1048] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.834245 30202 consensus_queue.cc:1048] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.838639 29984 raft_consensus.cc:1275] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.840617 30202 consensus_queue.cc:1048] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:45.849413 30133 raft_consensus.cc:1275] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Refusing update from remote peer 3bb1ee647860425cb0e270e6da9657da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.852767 30333 consensus_queue.cc:1048] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [LEADER]: Connected to new peer: Peer: permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.902518 29881 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33708:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:47.922140 29881 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33708:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:47.997529 30378 tablet.cc:1724] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.016211 18095 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:13:48.121726 30027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:36727, user_credentials={real_user=slave}} blocked reactor thread for 54836.9us
I20260709 13:13:48.130126 30397 tablet.cc:1724] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.065683 30383 tablet.cc:1724] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:48.174584 30386 log.cc:927] Time spent T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:13:48.187227 30403 tablet.cc:1724] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.187706 30405 tablet.cc:1724] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.196800 30378 tablet.cc:1724] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:48.217694 30012 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2c11745a94364377a31cdfe49b87781c)
I20260709 13:13:48.230792 30401 tablet.cc:1724] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:48.236371 30027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:33633, user_credentials={real_user=slave}} blocked reactor thread for 109349us
I20260709 13:13:48.243806 30404 tablet.cc:1724] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:48.260274 30161 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:112dfd3da4d1470da8efb487fd60bbb7)
I20260709 13:13:48.274538 30407 tablet.cc:1724] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:48.277074 30400 log.cc:927] Time spent T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:13:48.283792 30087 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:3840c7ad6aaa47da9f4aa34bb867f902)
I20260709 13:13:48.294963 30411 tablet.cc:1724] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.339969 30403 tablet.cc:1724] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.333355 30378 tablet.cc:1724] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.356652 30404 tablet.cc:1724] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.359397 30405 tablet.cc:1724] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.362820 30397 tablet.cc:1724] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.326140 30383 tablet.cc:1724] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.358243 30416 tablet.cc:1724] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.373507 30413 tablet.cc:1724] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.393049 30418 tablet.cc:1724] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.403836 29986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
mode: GRACEFUL
new_leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:59560
I20260709 13:13:48.405285 29986 raft_consensus.cc:606] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Received request to transfer leadership to TS 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:48.419837 30411 tablet.cc:1724] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:48.435608 30101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:36727, user_credentials={real_user=slave}} blocked reactor thread for 103262us
I20260709 13:13:48.458029 30418 tablet.cc:1724] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.439316 30401 tablet.cc:1724] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.476493 30407 tablet.cc:1724] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.478773 30404 tablet.cc:1724] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.457751 30383 tablet.cc:1724] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.498292 30405 tablet.cc:1724] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.527132 30061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
mode: GRACEFUL
new_leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:36204
I20260709 13:13:48.529476 30061 raft_consensus.cc:606] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Received request to transfer leadership to TS 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:48.530296 30378 tablet.cc:1724] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:48.532971 18095 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:48.533937 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:48.543653 30415 raft_consensus.cc:993] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: : Instructing follower 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.544103 30415 raft_consensus.cc:1081] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Signalling peer 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.546253 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:60732
I20260709 13:13:48.546774 30134 raft_consensus.cc:493] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.547158 30134 raft_consensus.cc:3060] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.553815 30134 raft_consensus.cc:515] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.555590 29981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1"
dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
mode: GRACEFUL
new_leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:59560
I20260709 13:13:48.556339 29981 raft_consensus.cc:606] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Received request to transfer leadership to TS 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:48.556630 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:48.557281 29985 raft_consensus.cc:3055] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:48.557588 29985 raft_consensus.cc:740] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:48.558347 29985 consensus_queue.cc:260] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.559474 30061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16"
dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
mode: GRACEFUL
new_leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:36204
I20260709 13:13:48.559926 30134 leader_election.cc:290] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:48.559198 29882 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93: soft_deleted_table [id=e512472fde7b4249a449e73c345db39b] alter complete (version 1)
I20260709 13:13:48.562187 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c11745a94364377a31cdfe49b87781c" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:48.560302 30061 raft_consensus.cc:606] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Received request to transfer leadership to TS 3515c7aa152340c0ba2b1d6d702427d8
I20260709 13:13:48.563094 30059 raft_consensus.cc:3060] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.559435 29985 raft_consensus.cc:3060] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.573053 30059 raft_consensus.cc:2468] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:48.574239 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:48.574501 30099 leader_election.cc:304] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:48.574946 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:48.575518 30419 raft_consensus.cc:2804] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:48.576115 30419 raft_consensus.cc:697] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:48.576635 29985 raft_consensus.cc:2468] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:48.577018 30419 consensus_queue.cc:237] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.588497 29882 catalog_manager.cc:5697] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 1 to 2, leader changed from 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193) to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.674543 30387 raft_consensus.cc:993] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: : Instructing follower 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.675114 30406 raft_consensus.cc:1081] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Signalling peer 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.676702 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:60726
I20260709 13:13:48.677230 30134 raft_consensus.cc:493] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.677523 30134 raft_consensus.cc:3060] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.682461 30134 raft_consensus.cc:515] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.683931 30134 leader_election.cc:290] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:48.684952 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:48.685096 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae17330de1514df686ef51ff126ecb16" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:48.685781 29985 raft_consensus.cc:3060] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.685912 30059 raft_consensus.cc:3055] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:48.686316 30059 raft_consensus.cc:740] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:48.686992 30059 consensus_queue.cc:260] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.688123 30059 raft_consensus.cc:3060] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:48.692150 29985 raft_consensus.cc:2468] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:48.693333 30101 leader_election.cc:304] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:48.694072 30419 raft_consensus.cc:2804] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:48.694136 30059 raft_consensus.cc:2468] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 2.
I20260709 13:13:48.694629 30419 raft_consensus.cc:697] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:48.695511 30419 consensus_queue.cc:237] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.703851 29882 catalog_manager.cc:5697] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 1 to 2, leader changed from 3bb1ee647860425cb0e270e6da9657da (127.17.171.194) to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.795264 30300 raft_consensus.cc:993] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: : Instructing follower 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.795955 30353 raft_consensus.cc:1081] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Signalling peer 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.797493 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:60732
I20260709 13:13:48.797957 30134 raft_consensus.cc:493] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.798278 30134 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.802758 30134 raft_consensus.cc:515] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:48.804312 30134 leader_election.cc:290] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 3 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:48.805215 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:48.805401 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83eced0ac14bdd9ec73990bd1cf3e1" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:48.805804 29985 raft_consensus.cc:3055] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.806008 30059 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.806236 29985 raft_consensus.cc:740] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 415b92c00aa34a7fa42ca43284a17345, State: Running, Role: LEADER
I20260709 13:13:48.807181 29985 consensus_queue.cc:260] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:48.808418 29985 raft_consensus.cc:3060] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.812038 30059 raft_consensus.cc:2468] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 3.
I20260709 13:13:48.813248 30099 leader_election.cc:304] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 3bb1ee647860425cb0e270e6da9657da; no voters: 
I20260709 13:13:48.814026 30419 raft_consensus.cc:2804] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.814177 29985 raft_consensus.cc:2468] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 3.
I20260709 13:13:48.814471 30419 raft_consensus.cc:697] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:48.815335 30419 consensus_queue.cc:237] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } }
I20260709 13:13:48.822531 29882 catalog_manager.cc:5697] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 2 to 3, leader changed from 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193) to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.842319 30387 raft_consensus.cc:993] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: : Instructing follower 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.842955 30399 raft_consensus.cc:1081] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Signalling peer 3515c7aa152340c0ba2b1d6d702427d8 to start an election
I20260709 13:13:48.844688 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94"
dest_uuid: "3515c7aa152340c0ba2b1d6d702427d8"
 from {username='slave'} at 127.0.0.1:60726
I20260709 13:13:48.845324 30134 raft_consensus.cc:493] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:48.845672 30134 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.850925 30134 raft_consensus.cc:515] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.852285 30134 leader_election.cc:290] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 3 election: Requested vote from peers 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727), 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161)
I20260709 13:13:48.853170 29981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "415b92c00aa34a7fa42ca43284a17345"
I20260709 13:13:48.853775 29981 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.854122 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b99ac39d8084ef38142d0f99b6cba94" candidate_uuid: "3515c7aa152340c0ba2b1d6d702427d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3bb1ee647860425cb0e270e6da9657da"
I20260709 13:13:48.854660 30059 raft_consensus.cc:3055] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.854909 30059 raft_consensus.cc:740] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bb1ee647860425cb0e270e6da9657da, State: Running, Role: LEADER
I20260709 13:13:48.855578 30059 consensus_queue.cc:260] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.856551 30059 raft_consensus.cc:3060] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.859257 29981 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 3.
I20260709 13:13:48.860352 30101 leader_election.cc:304] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3515c7aa152340c0ba2b1d6d702427d8, 415b92c00aa34a7fa42ca43284a17345; no voters: 
I20260709 13:13:48.861069 30419 raft_consensus.cc:2804] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.861614 30419 raft_consensus.cc:697] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 LEADER]: Becoming Leader. State: Replica: 3515c7aa152340c0ba2b1d6d702427d8, State: Running, Role: LEADER
I20260709 13:13:48.861693 30059 raft_consensus.cc:2468] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3515c7aa152340c0ba2b1d6d702427d8 in term 3.
I20260709 13:13:48.862435 30419 consensus_queue.cc:237] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } }
I20260709 13:13:48.869174 29882 catalog_manager.cc:5697] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 reported cstate change: term changed from 2 to 3, leader changed from 3bb1ee647860425cb0e270e6da9657da (127.17.171.194) to 3515c7aa152340c0ba2b1d6d702427d8 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "3515c7aa152340c0ba2b1d6d702427d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3515c7aa152340c0ba2b1d6d702427d8" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 33633 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.052713 29981 raft_consensus.cc:1275] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:49.054373 30419 consensus_queue.cc:1048] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.065117 30059 raft_consensus.cc:1275] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:49.068533 30433 consensus_queue.cc:1048] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.149667 29981 raft_consensus.cc:1275] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.151113 30433 consensus_queue.cc:1048] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.160832 30059 raft_consensus.cc:1275] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:49.162472 30287 consensus_queue.cc:1048] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.305531 29981 raft_consensus.cc:1275] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:49.307154 30419 consensus_queue.cc:1048] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:49.310937 30059 raft_consensus.cc:1275] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:49.312582 30419 consensus_queue.cc:1048] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:49.370455 30059 raft_consensus.cc:1275] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:49.371713 30433 consensus_queue.cc:1048] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bb1ee647860425cb0e270e6da9657da" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 36161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.380245 29985 raft_consensus.cc:1275] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Refusing update from remote peer 3515c7aa152340c0ba2b1d6d702427d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:49.382195 30433 consensus_queue.cc:1048] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "415b92c00aa34a7fa42ca43284a17345" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 36727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:49.632893 18095 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:49.637743 18095 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:49.638120 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:49.642819 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:49.643249 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:50.671777 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:13:50.696694 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:50.697474 18095 tablet_replica.cc:333] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.698184 18095 raft_consensus.cc:2243] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.698676 18095 raft_consensus.cc:2272] T 6fd915ecaf30495ea123adc4f05e596c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.700680 18095 tablet_replica.cc:333] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.701275 18095 raft_consensus.cc:2243] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.701722 18095 raft_consensus.cc:2272] T 29b65cce9db64bee8a5e57f10f903552 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.703517 18095 tablet_replica.cc:333] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
W20260709 13:13:50.703671 30027 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:13:50.704133 18095 raft_consensus.cc:2243] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.704715 18095 raft_consensus.cc:2272] T 1cca354fe6de4dec9f690f0263b3801c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:50.706586 30027 consensus_peers.cc:597] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.706607 18095 tablet_replica.cc:333] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.707391 18095 raft_consensus.cc:2243] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.708148 18095 raft_consensus.cc:2272] T 112dfd3da4d1470da8efb487fd60bbb7 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.710002 18095 tablet_replica.cc:333] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.710559 18095 raft_consensus.cc:2243] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.710971 18095 raft_consensus.cc:2272] T 2c11745a94364377a31cdfe49b87781c P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.712750 18095 tablet_replica.cc:333] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.713269 18095 raft_consensus.cc:2243] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.713677 18095 raft_consensus.cc:2272] T 7b99ac39d8084ef38142d0f99b6cba94 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.715422 18095 tablet_replica.cc:333] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.715999 18095 raft_consensus.cc:2243] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.716444 18095 raft_consensus.cc:2272] T ae17330de1514df686ef51ff126ecb16 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.719096 18095 tablet_replica.cc:333] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.719830 18095 raft_consensus.cc:2243] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.720614 18095 raft_consensus.cc:2272] T 78a8c0da960b413490ebf233eb3f062b P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.723260 18095 tablet_replica.cc:333] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
W20260709 13:13:50.723299 30027 consensus_peers.cc:597] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.723949 18095 raft_consensus.cc:2243] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.724502 18095 raft_consensus.cc:2272] T 9e61311de6644f69907191a785638cd1 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.727072 18095 tablet_replica.cc:333] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.727679 18095 raft_consensus.cc:2243] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.728514 18095 raft_consensus.cc:2272] T 77e23f42ea624a1d82106059c0220385 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:50.730087 30101 consensus_peers.cc:597] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.730336 18095 tablet_replica.cc:333] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.731067 18095 raft_consensus.cc:2243] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.731518 18095 raft_consensus.cc:2272] T a5846273cb9648e1acf047b87cdef4d0 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.733819 18095 tablet_replica.cc:333] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.734344 18095 raft_consensus.cc:2243] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.734689 18095 raft_consensus.cc:2272] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 415b92c00aa34a7fa42ca43284a17345 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.736657 18095 tablet_replica.cc:333] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.737129 18095 raft_consensus.cc:2243] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.737499 18095 raft_consensus.cc:2272] T ffd7960a8ed9419093aa296492d025b5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.739434 18095 tablet_replica.cc:333] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.739938 18095 raft_consensus.cc:2243] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.740330 18095 raft_consensus.cc:2272] T 3840c7ad6aaa47da9f4aa34bb867f902 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.742017 18095 tablet_replica.cc:333] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.742470 18095 raft_consensus.cc:2243] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.743171 18095 raft_consensus.cc:2272] T b0532343b23845abb2a77293666e91b9 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.745299 18095 tablet_replica.cc:333] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.745757 18095 raft_consensus.cc:2243] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.746412 18095 raft_consensus.cc:2272] T c75e3a0f21834a2f8062848fbb87f7e7 P 415b92c00aa34a7fa42ca43284a17345 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.748289 18095 tablet_replica.cc:333] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.748714 18095 raft_consensus.cc:2243] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.749375 18095 raft_consensus.cc:2272] T 103898800044427887c32667ce7e7d06 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.751148 18095 tablet_replica.cc:333] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345: stopping tablet replica
I20260709 13:13:50.751549 18095 raft_consensus.cc:2243] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.752346 18095 raft_consensus.cc:2272] T 7d62ef4433bf4bf393ea115626eafba5 P 415b92c00aa34a7fa42ca43284a17345 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:50.775414 30027 consensus_peers.cc:597] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.794461 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
W20260709 13:13:50.804217 30027 consensus_peers.cc:597] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:36727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:50.804746 30027 consensus_peers.cc:597] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:36727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:50.805034 30101 consensus_peers.cc:597] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:36727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.831070 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
I20260709 13:13:50.864571 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:50.865409 18095 tablet_replica.cc:333] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.866397 18095 raft_consensus.cc:2243] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.866868 18095 raft_consensus.cc:2272] T 29b65cce9db64bee8a5e57f10f903552 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.868727 18095 tablet_replica.cc:333] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.869237 18095 raft_consensus.cc:2243] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.869925 18095 raft_consensus.cc:2272] T 6fd915ecaf30495ea123adc4f05e596c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.871613 18095 tablet_replica.cc:333] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.872072 18095 raft_consensus.cc:2243] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.872538 18095 raft_consensus.cc:2272] T 103898800044427887c32667ce7e7d06 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.874181 18095 tablet_replica.cc:333] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.874670 18095 raft_consensus.cc:2243] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.875006 18095 raft_consensus.cc:2272] T 2c11745a94364377a31cdfe49b87781c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.876768 18095 tablet_replica.cc:333] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.877307 18095 raft_consensus.cc:2243] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.877714 18095 raft_consensus.cc:2272] T 7b99ac39d8084ef38142d0f99b6cba94 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.879350 18095 tablet_replica.cc:333] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.880132 18095 raft_consensus.cc:2243] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.880625 18095 raft_consensus.cc:2272] T ae17330de1514df686ef51ff126ecb16 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:50.881151 30101 consensus_peers.cc:597] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:36727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.882804 18095 tablet_replica.cc:333] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.883385 18095 raft_consensus.cc:2243] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.883939 18095 raft_consensus.cc:2272] T 78a8c0da960b413490ebf233eb3f062b P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.886035 18095 tablet_replica.cc:333] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.886507 18095 raft_consensus.cc:2243] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.887197 18095 raft_consensus.cc:2272] T 1cca354fe6de4dec9f690f0263b3801c P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.888965 18095 tablet_replica.cc:333] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.889439 18095 raft_consensus.cc:2243] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.889822 18095 raft_consensus.cc:2272] T 112dfd3da4d1470da8efb487fd60bbb7 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.891513 18095 tablet_replica.cc:333] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.891994 18095 raft_consensus.cc:2243] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.892764 18095 raft_consensus.cc:2272] T a5846273cb9648e1acf047b87cdef4d0 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.894728 18095 tablet_replica.cc:333] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.895300 18095 raft_consensus.cc:2243] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.896036 18095 raft_consensus.cc:2272] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.898120 18095 tablet_replica.cc:333] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.898690 18095 raft_consensus.cc:2243] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.899124 18095 raft_consensus.cc:2272] T b0532343b23845abb2a77293666e91b9 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.901279 18095 tablet_replica.cc:333] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.901763 18095 raft_consensus.cc:2243] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:50.901998 30101 consensus_peers.cc:597] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:36727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.902186 18095 raft_consensus.cc:2272] T c75e3a0f21834a2f8062848fbb87f7e7 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.904838 18095 tablet_replica.cc:333] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.905560 18095 raft_consensus.cc:2243] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.906107 18095 raft_consensus.cc:2272] T 77e23f42ea624a1d82106059c0220385 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.907908 18095 tablet_replica.cc:333] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.908475 18095 raft_consensus.cc:2243] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.909444 18095 raft_consensus.cc:2272] T 9e61311de6644f69907191a785638cd1 P 3bb1ee647860425cb0e270e6da9657da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.912220 18095 tablet_replica.cc:333] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
W20260709 13:13:50.912649 30099 consensus_peers.cc:597] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161): Couldn't send request to peer 3bb1ee647860425cb0e270e6da9657da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.912765 18095 raft_consensus.cc:2243] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.913331 18095 raft_consensus.cc:2272] T 7d62ef4433bf4bf393ea115626eafba5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.915278 18095 tablet_replica.cc:333] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.915769 18095 raft_consensus.cc:2243] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:50.916252 18095 raft_consensus.cc:2272] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3bb1ee647860425cb0e270e6da9657da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:50.918112 18095 tablet_replica.cc:333] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da: stopping tablet replica
I20260709 13:13:50.918557 18095 raft_consensus.cc:2243] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:50.919327 18095 raft_consensus.cc:2272] T ffd7960a8ed9419093aa296492d025b5 P 3bb1ee647860425cb0e270e6da9657da [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:50.947171 30101 consensus_peers.cc:597] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 415b92c00aa34a7fa42ca43284a17345 (127.17.171.193:36727): Couldn't send request to peer 415b92c00aa34a7fa42ca43284a17345. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:36727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.960222 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
W20260709 13:13:50.982204 30099 consensus_peers.cc:597] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161): Couldn't send request to peer 3bb1ee647860425cb0e270e6da9657da. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:50.998680 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
I20260709 13:13:51.031998 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:51.032933 18095 tablet_replica.cc:333] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.033592 18095 raft_consensus.cc:2243] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.034427 18095 raft_consensus.cc:2272] T 29b65cce9db64bee8a5e57f10f903552 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.036478 18095 tablet_replica.cc:333] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.037055 18095 raft_consensus.cc:2243] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.037497 18095 raft_consensus.cc:2272] T 6fd915ecaf30495ea123adc4f05e596c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.039407 18095 tablet_replica.cc:333] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.039988 18095 raft_consensus.cc:2243] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.040819 18095 raft_consensus.cc:2272] T 2c11745a94364377a31cdfe49b87781c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.042579 18095 tablet_replica.cc:333] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.043135 18095 raft_consensus.cc:2243] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.043576 18095 raft_consensus.cc:2272] T 112dfd3da4d1470da8efb487fd60bbb7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.045341 18095 tablet_replica.cc:333] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.045871 18095 raft_consensus.cc:2243] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.046329 18095 raft_consensus.cc:2272] T 1cca354fe6de4dec9f690f0263b3801c P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.048039 18095 tablet_replica.cc:333] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.048601 18095 raft_consensus.cc:2243] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.049324 18095 raft_consensus.cc:2272] T 7a83eced0ac14bdd9ec73990bd1cf3e1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.051210 18095 tablet_replica.cc:333] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.051894 18095 raft_consensus.cc:2243] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.052476 18095 raft_consensus.cc:2272] T ffd7960a8ed9419093aa296492d025b5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.055127 18095 tablet_replica.cc:333] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.055719 18095 raft_consensus.cc:2243] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.056155 18095 raft_consensus.cc:2272] T 9e61311de6644f69907191a785638cd1 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:51.056486 30099 consensus_peers.cc:597] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 -> Peer 3bb1ee647860425cb0e270e6da9657da (127.17.171.194:36161): Couldn't send request to peer 3bb1ee647860425cb0e270e6da9657da. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:36161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.058223 18095 tablet_replica.cc:333] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.058852 18095 raft_consensus.cc:2243] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.059284 18095 raft_consensus.cc:2272] T 77e23f42ea624a1d82106059c0220385 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.061147 18095 tablet_replica.cc:333] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.061688 18095 raft_consensus.cc:2243] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.062418 18095 raft_consensus.cc:2272] T 7b99ac39d8084ef38142d0f99b6cba94 P 3515c7aa152340c0ba2b1d6d702427d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.064128 18095 tablet_replica.cc:333] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.064781 18095 raft_consensus.cc:2243] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.065495 18095 raft_consensus.cc:2272] T ae17330de1514df686ef51ff126ecb16 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.067370 18095 tablet_replica.cc:333] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.067914 18095 raft_consensus.cc:2243] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.068732 18095 raft_consensus.cc:2272] T 78a8c0da960b413490ebf233eb3f062b P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.070807 18095 tablet_replica.cc:333] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.071341 18095 raft_consensus.cc:2243] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.071768 18095 raft_consensus.cc:2272] T 103898800044427887c32667ce7e7d06 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.073587 18095 tablet_replica.cc:333] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.074149 18095 raft_consensus.cc:2243] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.074561 18095 raft_consensus.cc:2272] T c75e3a0f21834a2f8062848fbb87f7e7 P 3515c7aa152340c0ba2b1d6d702427d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.076581 18095 tablet_replica.cc:333] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.077080 18095 raft_consensus.cc:2243] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.077500 18095 raft_consensus.cc:2272] T 3840c7ad6aaa47da9f4aa34bb867f902 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.079257 18095 tablet_replica.cc:333] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.079789 18095 raft_consensus.cc:2243] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.080250 18095 raft_consensus.cc:2272] T b0532343b23845abb2a77293666e91b9 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.082118 18095 tablet_replica.cc:333] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.082646 18095 raft_consensus.cc:2243] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.083067 18095 raft_consensus.cc:2272] T a5846273cb9648e1acf047b87cdef4d0 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.085019 18095 tablet_replica.cc:333] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8: stopping tablet replica
I20260709 13:13:51.085462 18095 raft_consensus.cc:2243] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:51.085875 18095 raft_consensus.cc:2272] T 7d62ef4433bf4bf393ea115626eafba5 P 3515c7aa152340c0ba2b1d6d702427d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.123710 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
I20260709 13:13:51.153553 18095 master.cc:562] Master@127.17.171.254:45571 shutting down...
I20260709 13:13:51.175535 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:51.176054 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:51.176395 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P 13dc9e81c07c48ce902d63a833363a93: stopping tablet replica
I20260709 13:13:51.196897 18095 master.cc:584] Master@127.17.171.254:45571 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12048 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:51.246685 18095 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.17.171.254:44081
I20260709 13:13:51.247728 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:51.253785 30449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.254271 30448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.254433 30451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:51.254966 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:51.255923 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:51.256106 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:51.256328 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602831256304 us; error 0 us; skew 500 ppm
I20260709 13:13:51.256893 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:51.259315 18095 webserver.cc:533] Webserver started at http://127.17.171.254:37523/ using document root <none> and password file <none>
I20260709 13:13:51.259807 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:51.259996 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:51.260314 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:51.261472 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/master-0-root/instance:
uuid: "77b7219341e849a58918839c60d754aa"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.265903 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:13:51.269307 30456 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.270188 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:51.270427 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/master-0-root
uuid: "77b7219341e849a58918839c60d754aa"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.270668 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:51.301347 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:51.302500 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:51.340374 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.254:44081
I20260709 13:13:51.340476 30507 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.254:44081 every 8 connection(s)
I20260709 13:13:51.344125 30508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.354916 30508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa: Bootstrap starting.
I20260709 13:13:51.359776 30508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.364187 30508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa: No bootstrap required, opened a new log
I20260709 13:13:51.366945 30508 raft_consensus.cc:359] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b7219341e849a58918839c60d754aa" member_type: VOTER }
I20260709 13:13:51.367339 30508 raft_consensus.cc:385] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.367599 30508 raft_consensus.cc:740] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b7219341e849a58918839c60d754aa, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.368265 30508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b7219341e849a58918839c60d754aa" member_type: VOTER }
I20260709 13:13:51.368736 30508 raft_consensus.cc:399] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:51.368945 30508 raft_consensus.cc:493] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:51.369248 30508 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.374320 30508 raft_consensus.cc:515] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b7219341e849a58918839c60d754aa" member_type: VOTER }
I20260709 13:13:51.374868 30508 leader_election.cc:304] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77b7219341e849a58918839c60d754aa; no voters: 
I20260709 13:13:51.376087 30508 leader_election.cc:290] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:51.376516 30511 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.377912 30511 raft_consensus.cc:697] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 1 LEADER]: Becoming Leader. State: Replica: 77b7219341e849a58918839c60d754aa, State: Running, Role: LEADER
I20260709 13:13:51.378582 30511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b7219341e849a58918839c60d754aa" member_type: VOTER }
I20260709 13:13:51.379058 30508 sys_catalog.cc:565] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:51.382862 30512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77b7219341e849a58918839c60d754aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b7219341e849a58918839c60d754aa" member_type: VOTER } }
I20260709 13:13:51.383570 30512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:51.383533 30513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77b7219341e849a58918839c60d754aa. Latest consensus state: current_term: 1 leader_uuid: "77b7219341e849a58918839c60d754aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77b7219341e849a58918839c60d754aa" member_type: VOTER } }
I20260709 13:13:51.384270 30513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:51.386608 30517 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:51.394697 30517 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:51.395716 18095 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:51.404098 30517 catalog_manager.cc:1383] Generated new cluster ID: be3b431f2c984521b3b8b08722eb3860
I20260709 13:13:51.404480 30517 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:51.419935 30517 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:51.421401 30517 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:51.439236 30517 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa: Generated new TSK 0
I20260709 13:13:51.439918 30517 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:51.462952 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:51.469480 30529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.470749 30530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.472676 30532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:51.472723 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:51.473853 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:51.474131 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:51.474311 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602831474286 us; error 0 us; skew 500 ppm
I20260709 13:13:51.474825 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:51.477128 18095 webserver.cc:533] Webserver started at http://127.17.171.193:39491/ using document root <none> and password file <none>
I20260709 13:13:51.477602 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:51.477805 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:51.478062 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:51.479130 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-0-root/instance:
uuid: "886299e596884e3980c72d6dee3e1f08"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.483552 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:51.487213 30537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.488096 18095 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:51.488422 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-0-root
uuid: "886299e596884e3980c72d6dee3e1f08"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.488659 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:51.508538 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:51.509663 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:51.511071 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:51.513373 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:51.513547 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.513844 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:51.514037 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.553043 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.193:45451
I20260709 13:13:51.553156 30599 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.193:45451 every 8 connection(s)
I20260709 13:13:51.558395 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:51.565310 30604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.566018 30605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.570163 30608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:51.570219 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:51.571382 30600 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44081
I20260709 13:13:51.571815 30600 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:51.572525 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:51.572757 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:51.572690 30600 heartbeater.cc:507] Master 127.17.171.254:44081 requested a full tablet report, sending...
I20260709 13:13:51.573122 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602831573102 us; error 0 us; skew 500 ppm
I20260709 13:13:51.573740 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:51.575151 30473 ts_manager.cc:194] Registered new tserver with Master: 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451)
I20260709 13:13:51.576547 18095 webserver.cc:533] Webserver started at http://127.17.171.194:42591/ using document root <none> and password file <none>
I20260709 13:13:51.577095 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:51.577190 30473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44202
I20260709 13:13:51.577315 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:51.577723 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:51.578925 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-1-root/instance:
uuid: "4f47d480eda141c7b0c7ca8108ccce91"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.583278 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:13:51.586498 30612 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.587266 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:51.587558 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-1-root
uuid: "4f47d480eda141c7b0c7ca8108ccce91"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.587850 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:51.597114 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:51.598223 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:51.599596 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:51.601791 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:51.602021 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.602288 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:51.602540 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.641297 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.194:41557
I20260709 13:13:51.641429 30674 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.194:41557 every 8 connection(s)
I20260709 13:13:51.646395 18095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:51.653383 30678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.655123 30679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:51.658319 30681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:51.658736 30675 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44081
I20260709 13:13:51.659276 30675 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:51.659412 18095 server_base.cc:1061] running on GCE node
I20260709 13:13:51.660351 30675 heartbeater.cc:507] Master 127.17.171.254:44081 requested a full tablet report, sending...
I20260709 13:13:51.660451 18095 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:51.660816 18095 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:51.661000 18095 hybrid_clock.cc:648] HybridClock initialized: now 1783602831660981 us; error 0 us; skew 500 ppm
I20260709 13:13:51.661580 18095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:51.662562 30473 ts_manager.cc:194] Registered new tserver with Master: 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:51.664031 30473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44216
I20260709 13:13:51.664453 18095 webserver.cc:533] Webserver started at http://127.17.171.195:43427/ using document root <none> and password file <none>
I20260709 13:13:51.665088 18095 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:51.665351 18095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:51.665632 18095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:51.666766 18095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-2-root/instance:
uuid: "84987389a5624cf4814b4ef8ae2c3686"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.671118 18095 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:13:51.674420 30686 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.675196 18095 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:51.675503 18095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-2-root
uuid: "84987389a5624cf4814b4ef8ae2c3686"
format_stamp: "Formatted at 2026-07-09 13:13:51 on dist-test-slave-jhlz"
I20260709 13:13:51.675796 18095 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task7QTpmk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602479336840-18095-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:51.706250 18095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:51.707316 18095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:51.708803 18095 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:51.710999 18095 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:51.711227 18095 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.711470 18095 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:51.711652 18095 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:51.752074 18095 rpc_server.cc:307] RPC server started. Bound to: 127.17.171.195:37463
I20260709 13:13:51.752220 30748 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.17.171.195:37463 every 8 connection(s)
I20260709 13:13:51.766614 30749 heartbeater.cc:344] Connected to a master server at 127.17.171.254:44081
I20260709 13:13:51.767086 30749 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:51.767865 30749 heartbeater.cc:507] Master 127.17.171.254:44081 requested a full tablet report, sending...
I20260709 13:13:51.770008 30473 ts_manager.cc:194] Registered new tserver with Master: 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:51.770248 18095 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014824314s
I20260709 13:13:51.771469 30473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44230
I20260709 13:13:51.795917 30473 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44240:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:51.798507 30473 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:51.934618 30640 tablet_service.cc:1511] Processing CreateTablet for tablet ea4aaa3fe68f4e1091bd86e945184441 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:51.937080 30640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4aaa3fe68f4e1091bd86e945184441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.939599 30637 tablet_service.cc:1511] Processing CreateTablet for tablet ae98431f347b4392acd57c23a4dc21fd (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:51.942271 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce18184c2c74dcc9fb95fcbbcc1c966 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:51.943496 30565 tablet_service.cc:1511] Processing CreateTablet for tablet ea4aaa3fe68f4e1091bd86e945184441 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:51.945317 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4aaa3fe68f4e1091bd86e945184441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.945102 30638 tablet_service.cc:1511] Processing CreateTablet for tablet aca185d9207440aaa5cb8fbde9ab09e9 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:51.949501 30563 tablet_service.cc:1511] Processing CreateTablet for tablet aca185d9207440aaa5cb8fbde9ab09e9 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:51.950438 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce18184c2c74dcc9fb95fcbbcc1c966 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:51.950999 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca185d9207440aaa5cb8fbde9ab09e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.951886 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce18184c2c74dcc9fb95fcbbcc1c966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.953482 30561 tablet_service.cc:1511] Processing CreateTablet for tablet 9d62ec4f06284fb693cc27236a966983 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:51.955693 30712 tablet_service.cc:1511] Processing CreateTablet for tablet aca185d9207440aaa5cb8fbde9ab09e9 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:51.956140 30560 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae3e6b9e2e944d8801dd6c0a2b16201 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:51.957494 30712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca185d9207440aaa5cb8fbde9ab09e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.958704 30559 tablet_service.cc:1511] Processing CreateTablet for tablet 76fdd0be02b146be88f0798c65663f94 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:51.960803 30558 tablet_service.cc:1511] Processing CreateTablet for tablet 7f319c74c7ec4ac8a22ecaf36824dc42 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:51.961396 30711 tablet_service.cc:1511] Processing CreateTablet for tablet ae98431f347b4392acd57c23a4dc21fd (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:51.963023 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae98431f347b4392acd57c23a4dc21fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.962669 30710 tablet_service.cc:1511] Processing CreateTablet for tablet 9d62ec4f06284fb693cc27236a966983 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:51.965408 30635 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae3e6b9e2e944d8801dd6c0a2b16201 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:51.953485 30636 tablet_service.cc:1511] Processing CreateTablet for tablet 9d62ec4f06284fb693cc27236a966983 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:51.967839 30634 tablet_service.cc:1511] Processing CreateTablet for tablet 76fdd0be02b146be88f0798c65663f94 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:51.961364 30562 tablet_service.cc:1511] Processing CreateTablet for tablet ae98431f347b4392acd57c23a4dc21fd (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:51.970362 30633 tablet_service.cc:1511] Processing CreateTablet for tablet 7f319c74c7ec4ac8a22ecaf36824dc42 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:51.973100 30557 tablet_service.cc:1511] Processing CreateTablet for tablet dd328bf039114ae6b522a99e25f0f85d (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:51.975805 30632 tablet_service.cc:1511] Processing CreateTablet for tablet dd328bf039114ae6b522a99e25f0f85d (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:51.978425 30713 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce18184c2c74dcc9fb95fcbbcc1c966 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:51.980576 30714 tablet_service.cc:1511] Processing CreateTablet for tablet ea4aaa3fe68f4e1091bd86e945184441 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:51.964115 30710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d62ec4f06284fb693cc27236a966983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.982668 30713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce18184c2c74dcc9fb95fcbbcc1c966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.985118 30709 tablet_service.cc:1511] Processing CreateTablet for tablet 4ae3e6b9e2e944d8801dd6c0a2b16201 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:51.988485 30708 tablet_service.cc:1511] Processing CreateTablet for tablet 76fdd0be02b146be88f0798c65663f94 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:51.991716 30707 tablet_service.cc:1511] Processing CreateTablet for tablet 7f319c74c7ec4ac8a22ecaf36824dc42 (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:51.994624 30706 tablet_service.cc:1511] Processing CreateTablet for tablet dd328bf039114ae6b522a99e25f0f85d (DEFAULT_TABLE table=test-workload [id=3b1c59af22e243dca4f9ccbeca87d576]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:51.996654 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea4aaa3fe68f4e1091bd86e945184441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.997494 30709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae3e6b9e2e944d8801dd6c0a2b16201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.000767 30707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f319c74c7ec4ac8a22ecaf36824dc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.003327 30706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd328bf039114ae6b522a99e25f0f85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.013391 30632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd328bf039114ae6b522a99e25f0f85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.016593 30633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f319c74c7ec4ac8a22ecaf36824dc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.020555 30638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca185d9207440aaa5cb8fbde9ab09e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.024715 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce18184c2c74dcc9fb95fcbbcc1c966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.028622 30634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76fdd0be02b146be88f0798c65663f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.003351 30558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f319c74c7ec4ac8a22ecaf36824dc42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.042429 30708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76fdd0be02b146be88f0798c65663f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.044516 30635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae3e6b9e2e944d8801dd6c0a2b16201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.044528 30559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76fdd0be02b146be88f0798c65663f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.052604 30560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae3e6b9e2e944d8801dd6c0a2b16201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.056563 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae98431f347b4392acd57c23a4dc21fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.056969 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae98431f347b4392acd57c23a4dc21fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.064487 30636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d62ec4f06284fb693cc27236a966983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.064967 30561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d62ec4f06284fb693cc27236a966983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.075871 30557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd328bf039114ae6b522a99e25f0f85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.083058 30765 tablet_bootstrap.cc:492] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.097501 30765 tablet_bootstrap.cc:654] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.113113 30766 tablet_bootstrap.cc:492] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.127899 30767 tablet_bootstrap.cc:492] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.147199 30767 tablet_bootstrap.cc:654] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.152029 30766 tablet_bootstrap.cc:654] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.214730 30765 tablet_bootstrap.cc:492] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.215260 30765 ts_tablet_manager.cc:1403] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.133s	user 0.038s	sys 0.031s
I20260709 13:13:52.218498 30765 raft_consensus.cc:359] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.219540 30765 raft_consensus.cc:385] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.219861 30765 raft_consensus.cc:740] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.220813 30765 consensus_queue.cc:260] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.233366 30600 heartbeater.cc:499] Master 127.17.171.254:44081 was elected leader, sending a full tablet report...
I20260709 13:13:52.233666 30765 ts_tablet_manager.cc:1434] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:13:52.234499 30767 tablet_bootstrap.cc:492] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.234774 30765 tablet_bootstrap.cc:492] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.235141 30767 ts_tablet_manager.cc:1403] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.034s
I20260709 13:13:52.238497 30767 raft_consensus.cc:359] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.239274 30767 raft_consensus.cc:385] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.239638 30767 raft_consensus.cc:740] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.240666 30767 consensus_queue.cc:260] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.241952 30765 tablet_bootstrap.cc:654] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.252895 30766 tablet_bootstrap.cc:492] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.253548 30766 ts_tablet_manager.cc:1403] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.141s	user 0.021s	sys 0.024s
I20260709 13:13:52.256878 30766 raft_consensus.cc:359] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.250741 30767 ts_tablet_manager.cc:1434] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:13:52.257959 30766 raft_consensus.cc:385] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.259932 30675 heartbeater.cc:499] Master 127.17.171.254:44081 was elected leader, sending a full tablet report...
I20260709 13:13:52.260210 30766 raft_consensus.cc:740] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.260543 30767 tablet_bootstrap.cc:492] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.261209 30766 consensus_queue.cc:260] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.267812 30765 tablet_bootstrap.cc:492] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.268707 30767 tablet_bootstrap.cc:654] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.268810 30765 ts_tablet_manager.cc:1403] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.013s
I20260709 13:13:52.273355 30749 heartbeater.cc:499] Master 127.17.171.254:44081 was elected leader, sending a full tablet report...
I20260709 13:13:52.274115 30766 ts_tablet_manager.cc:1434] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:13:52.273548 30765 raft_consensus.cc:359] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.274685 30765 raft_consensus.cc:385] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.275043 30765 raft_consensus.cc:740] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.275539 30766 tablet_bootstrap.cc:492] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.275949 30765 consensus_queue.cc:260] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.278925 30765 ts_tablet_manager.cc:1434] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:52.280333 30765 tablet_bootstrap.cc:492] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.283921 30766 tablet_bootstrap.cc:654] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.289584 30765 tablet_bootstrap.cc:654] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.291605 30767 tablet_bootstrap.cc:492] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.292271 30767 ts_tablet_manager.cc:1403] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:13:52.295732 30767 raft_consensus.cc:359] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.296545 30767 raft_consensus.cc:385] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.297071 30767 raft_consensus.cc:740] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.298069 30767 consensus_queue.cc:260] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.300678 30767 ts_tablet_manager.cc:1434] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:52.301748 30767 tablet_bootstrap.cc:492] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.308542 30767 tablet_bootstrap.cc:654] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.317431 30767 tablet_bootstrap.cc:492] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.317610 30765 tablet_bootstrap.cc:492] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.317935 30767 ts_tablet_manager.cc:1403] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.006s
I20260709 13:13:52.318195 30765 ts_tablet_manager.cc:1403] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.021s
I20260709 13:13:52.320348 30766 tablet_bootstrap.cc:492] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.320899 30766 ts_tablet_manager.cc:1403] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.024s
I20260709 13:13:52.321203 30767 raft_consensus.cc:359] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.321493 30765 raft_consensus.cc:359] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.322013 30767 raft_consensus.cc:385] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.322279 30765 raft_consensus.cc:385] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.322371 30767 raft_consensus.cc:740] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.322715 30765 raft_consensus.cc:740] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.323513 30767 consensus_queue.cc:260] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.323729 30765 consensus_queue.cc:260] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.323978 30766 raft_consensus.cc:359] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.324725 30766 raft_consensus.cc:385] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.325026 30766 raft_consensus.cc:740] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.325776 30767 ts_tablet_manager.cc:1434] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:52.325973 30766 consensus_queue.cc:260] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.326864 30767 tablet_bootstrap.cc:492] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.331205 30765 ts_tablet_manager.cc:1434] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:13:52.331810 30766 ts_tablet_manager.cc:1434] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:52.332355 30765 tablet_bootstrap.cc:492] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.332816 30766 tablet_bootstrap.cc:492] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.334177 30767 tablet_bootstrap.cc:654] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.339931 30766 tablet_bootstrap.cc:654] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.341218 30765 tablet_bootstrap.cc:654] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.345906 30767 tablet_bootstrap.cc:492] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.346423 30767 ts_tablet_manager.cc:1403] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:52.349434 30767 raft_consensus.cc:359] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.350183 30767 raft_consensus.cc:385] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.350489 30767 raft_consensus.cc:740] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.351749 30766 tablet_bootstrap.cc:492] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.351481 30767 consensus_queue.cc:260] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.352373 30766 ts_tablet_manager.cc:1403] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:13:52.354142 30767 ts_tablet_manager.cc:1434] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:13:52.355247 30767 tablet_bootstrap.cc:492] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.355890 30766 raft_consensus.cc:359] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.357002 30766 raft_consensus.cc:385] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.357383 30766 raft_consensus.cc:740] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.359691 30766 consensus_queue.cc:260] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.361198 30765 tablet_bootstrap.cc:492] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.361733 30765 ts_tablet_manager.cc:1403] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260709 13:13:52.362497 30767 tablet_bootstrap.cc:654] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.364066 30766 ts_tablet_manager.cc:1434] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:52.365191 30766 tablet_bootstrap.cc:492] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.364902 30765 raft_consensus.cc:359] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.365696 30765 raft_consensus.cc:385] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.366029 30765 raft_consensus.cc:740] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.367055 30765 consensus_queue.cc:260] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.372916 30766 tablet_bootstrap.cc:654] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.373827 30765 ts_tablet_manager.cc:1434] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 13:13:52.374747 30767 tablet_bootstrap.cc:492] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.375099 30765 tablet_bootstrap.cc:492] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.375499 30767 ts_tablet_manager.cc:1403] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:52.379794 30767 raft_consensus.cc:359] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.380596 30767 raft_consensus.cc:385] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.380903 30767 raft_consensus.cc:740] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.381760 30767 consensus_queue.cc:260] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.386526 30766 tablet_bootstrap.cc:492] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.387112 30766 ts_tablet_manager.cc:1403] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 13:13:52.387154 30767 ts_tablet_manager.cc:1434] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:13:52.388382 30767 tablet_bootstrap.cc:492] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
W20260709 13:13:52.390487 30521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:52.390615 30766 raft_consensus.cc:359] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.391512 30766 raft_consensus.cc:385] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.391804 30766 raft_consensus.cc:740] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.392742 30766 consensus_queue.cc:260] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.394378 30765 tablet_bootstrap.cc:654] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.395399 30767 tablet_bootstrap.cc:654] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.396922 30766 ts_tablet_manager.cc:1434] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:52.397985 30766 tablet_bootstrap.cc:492] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.407243 30766 tablet_bootstrap.cc:654] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.407696 30767 tablet_bootstrap.cc:492] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.408295 30767 ts_tablet_manager.cc:1403] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:13:52.408636 30771 raft_consensus.cc:493] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.409247 30771 raft_consensus.cc:515] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.411578 30767 raft_consensus.cc:359] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.412006 30771 leader_election.cc:290] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.408586 30765 tablet_bootstrap.cc:492] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.413751 30765 ts_tablet_manager.cc:1403] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.004s
I20260709 13:13:52.413266 30767 raft_consensus.cc:385] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.414764 30767 raft_consensus.cc:740] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.416152 30767 consensus_queue.cc:260] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.416842 30765 raft_consensus.cc:359] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.417637 30765 raft_consensus.cc:385] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.418001 30765 raft_consensus.cc:740] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.418857 30765 consensus_queue.cc:260] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.412806 30772 raft_consensus.cc:493] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.422626 30772 raft_consensus.cc:515] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.425454 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
W20260709 13:13:52.427484 30539 leader_election.cc:343] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.432001 30772 leader_election.cc:290] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.434062 30767 ts_tablet_manager.cc:1434] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.000s
I20260709 13:13:52.433844 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.435109 30724 raft_consensus.cc:2468] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:52.436580 30539 leader_election.cc:304] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:52.437820 30771 raft_consensus.cc:2804] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.438249 30771 raft_consensus.cc:493] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.438258 30766 tablet_bootstrap.cc:492] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.438704 30771 raft_consensus.cc:3060] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.439285 30766 ts_tablet_manager.cc:1403] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.004s
I20260709 13:13:52.440740 30767 tablet_bootstrap.cc:492] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.442543 30766 raft_consensus.cc:359] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.443240 30766 raft_consensus.cc:385] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.443531 30766 raft_consensus.cc:740] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.444386 30766 consensus_queue.cc:260] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.447845 30767 tablet_bootstrap.cc:654] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.449069 30765 ts_tablet_manager.cc:1434] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:13:52.449905 30774 raft_consensus.cc:493] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.450690 30765 tablet_bootstrap.cc:492] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.450441 30774 raft_consensus.cc:515] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.451188 30766 ts_tablet_manager.cc:1434] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:52.452307 30766 tablet_bootstrap.cc:492] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.453300 30774 leader_election.cc:290] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:52.458755 30765 tablet_bootstrap.cc:654] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.468533 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
W20260709 13:13:52.470988 30613 leader_election.cc:343] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.449905 30771 raft_consensus.cc:515] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.484481 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
W20260709 13:13:52.486045 30539 leader_election.cc:343] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.487424 30766 tablet_bootstrap.cc:654] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.487939 30771 leader_election.cc:290] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.488580 30771 raft_consensus.cc:493] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.488338 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:52.489264 30724 raft_consensus.cc:3060] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.500000 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.500867 30650 raft_consensus.cc:2468] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 0.
I20260709 13:13:52.502345 30688 leader_election.cc:304] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:52.503257 30774 raft_consensus.cc:2804] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.503630 30774 raft_consensus.cc:493] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.503986 30774 raft_consensus.cc:3060] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.500001 30724 raft_consensus.cc:2468] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.506897 30539 leader_election.cc:304] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:52.507704 30793 raft_consensus.cc:2804] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.510596 30766 tablet_bootstrap.cc:492] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.511322 30766 ts_tablet_manager.cc:1403] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.059s	user 0.003s	sys 0.009s
I20260709 13:13:52.516525 30789 raft_consensus.cc:493] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.517310 30789 raft_consensus.cc:515] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.515604 30766 raft_consensus.cc:359] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.520015 30766 raft_consensus.cc:385] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.520442 30766 raft_consensus.cc:740] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.521466 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
W20260709 13:13:52.523473 30613 leader_election.cc:343] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.523285 30766 consensus_queue.cc:260] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.525480 30789 leader_election.cc:290] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.530570 30766 ts_tablet_manager.cc:1434] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:13:52.532104 30766 tablet_bootstrap.cc:492] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.546195 30774 raft_consensus.cc:515] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.489187 30771 raft_consensus.cc:515] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.548651 30766 tablet_bootstrap.cc:654] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.551506 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4aaa3fe68f4e1091bd86e945184441" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.552294 30650 raft_consensus.cc:2468] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:52.553442 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.553473 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.554456 30724 raft_consensus.cc:2468] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
W20260709 13:13:52.555758 30614 leader_election.cc:343] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.556221 30614 leader_election.cc:304] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91; no voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:52.557488 30614 leader_election.cc:304] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:52.558300 30772 raft_consensus.cc:2749] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.558990 30772 raft_consensus.cc:2804] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.559363 30772 raft_consensus.cc:493] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.559701 30772 raft_consensus.cc:3060] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.566915 30771 leader_election.cc:290] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.567114 30799 raft_consensus.cc:493] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.567903 30799 raft_consensus.cc:515] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.568874 30539 leader_election.cc:304] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:52.569887 30771 raft_consensus.cc:2804] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.570250 30771 raft_consensus.cc:493] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.570493 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4aaa3fe68f4e1091bd86e945184441" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.571887 30799 leader_election.cc:290] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:52.572331 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.573112 30650 raft_consensus.cc:2468] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 0.
I20260709 13:13:52.574592 30688 leader_election.cc:304] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:52.575846 30799 raft_consensus.cc:2804] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.576248 30799 raft_consensus.cc:493] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.576363 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:52.576668 30799 raft_consensus.cc:3060] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.577122 30575 raft_consensus.cc:2468] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 0.
W20260709 13:13:52.577687 30539 leader_election.cc:343] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.578823 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:52.579488 30575 raft_consensus.cc:2468] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 0.
I20260709 13:13:52.579394 30766 tablet_bootstrap.cc:492] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.581202 30766 ts_tablet_manager.cc:1403] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.011s
I20260709 13:13:52.570573 30771 raft_consensus.cc:3060] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.585515 30766 raft_consensus.cc:359] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.587779 30766 raft_consensus.cc:385] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.588248 30802 raft_consensus.cc:493] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.588264 30766 raft_consensus.cc:740] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.591964 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:52.592864 30575 raft_consensus.cc:3060] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.594022 30766 consensus_queue.cc:260] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.592520 30772 raft_consensus.cc:515] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.603848 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:52.604502 30650 raft_consensus.cc:3060] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.605026 30575 raft_consensus.cc:2468] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 1.
I20260709 13:13:52.605499 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:52.606499 30687 leader_election.cc:304] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:52.605370 30799 raft_consensus.cc:515] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
W20260709 13:13:52.607841 30613 leader_election.cc:343] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.601859 30793 raft_consensus.cc:697] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:52.589097 30802 raft_consensus.cc:515] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.612957 30802 leader_election.cc:290] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:52.612766 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:52.613747 30649 raft_consensus.cc:3060] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.615000 30650 raft_consensus.cc:2468] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 1.
I20260709 13:13:52.615702 30802 raft_consensus.cc:2804] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.616335 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:52.616396 30802 raft_consensus.cc:697] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:52.617218 30724 raft_consensus.cc:3060] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.617723 30802 consensus_queue.cc:237] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.609007 30772 leader_election.cc:290] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.608621 30774 leader_election.cc:290] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:52.626029 30793 consensus_queue.cc:237] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.623196 30799 leader_election.cc:290] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:52.630980 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce18184c2c74dcc9fb95fcbbcc1c966" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
W20260709 13:13:52.632483 30688 leader_election.cc:343] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.632275 30724 raft_consensus.cc:2468] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:52.634291 30766 ts_tablet_manager.cc:1434] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.013s
I20260709 13:13:52.634143 30614 leader_election.cc:304] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:52.635390 30766 tablet_bootstrap.cc:492] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.635763 30772 raft_consensus.cc:2804] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.636600 30772 raft_consensus.cc:697] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:52.637837 30772 consensus_queue.cc:237] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.640266 30767 tablet_bootstrap.cc:492] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.640918 30771 raft_consensus.cc:515] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.641489 30767 ts_tablet_manager.cc:1403] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.002s
I20260709 13:13:52.635972 30649 raft_consensus.cc:2468] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 1.
I20260709 13:13:52.636622 30765 tablet_bootstrap.cc:492] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.647049 30688 leader_election.cc:304] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:52.647414 30798 raft_consensus.cc:493] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.647624 30765 ts_tablet_manager.cc:1403] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.197s	user 0.047s	sys 0.089s
I20260709 13:13:52.648116 30798 raft_consensus.cc:515] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.648972 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4aaa3fe68f4e1091bd86e945184441" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:52.649585 30650 raft_consensus.cc:3060] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.669636 30765 raft_consensus.cc:359] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.671868 30765 raft_consensus.cc:385] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:52.670964 30687 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.17.171.193:45451, user_credentials={real_user=slave}} blocked reactor thread for 64691us
I20260709 13:13:52.672709 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4aaa3fe68f4e1091bd86e945184441" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:52.673962 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
W20260709 13:13:52.674362 30539 leader_election.cc:343] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.674853 30575 raft_consensus.cc:3060] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.677227 30473 catalog_manager.cc:5697] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.676266 30771 leader_election.cc:290] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.680365 30802 raft_consensus.cc:2804] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.680953 30802 raft_consensus.cc:697] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:52.681809 30802 consensus_queue.cc:237] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.682195 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce18184c2c74dcc9fb95fcbbcc1c966" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:52.685632 30767 raft_consensus.cc:359] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.686354 30767 raft_consensus.cc:385] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.686650 30767 raft_consensus.cc:740] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.688148 30650 raft_consensus.cc:2468] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.689373 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.689877 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.690618 30724 raft_consensus.cc:2468] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:52.692221 30539 leader_election.cc:304] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:52.693202 30539 leader_election.cc:304] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 84987389a5624cf4814b4ef8ae2c3686
I20260709 13:13:52.694437 30771 raft_consensus.cc:2804] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.694828 30771 raft_consensus.cc:493] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:52.695122 30539 leader_election.cc:343] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.695472 30810 raft_consensus.cc:2804] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.695940 30798 leader_election.cc:290] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.698544 30575 raft_consensus.cc:2468] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 1.
I20260709 13:13:52.698992 30767 consensus_queue.cc:260] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.700448 30810 raft_consensus.cc:697] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
W20260709 13:13:52.701768 30687 leader_election.cc:343] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.702255 30687 leader_election.cc:304] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686; no voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:52.702847 30766 tablet_bootstrap.cc:654] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.703222 30804 raft_consensus.cc:2749] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.701625 30810 consensus_queue.cc:237] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.703933 30765 raft_consensus.cc:740] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.695179 30771 raft_consensus.cc:3060] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.707754 30767 ts_tablet_manager.cc:1434] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.005s
I20260709 13:13:52.708992 30767 tablet_bootstrap.cc:492] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.714398 30472 catalog_manager.cc:5697] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.718696 30766 tablet_bootstrap.cc:492] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.721313 30767 tablet_bootstrap.cc:654] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.720229 30472 catalog_manager.cc:5697] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.720382 30766 ts_tablet_manager.cc:1403] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.000s
I20260709 13:13:52.719192 30471 catalog_manager.cc:5697] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.728539 30766 raft_consensus.cc:359] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.729502 30766 raft_consensus.cc:385] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.729856 30766 raft_consensus.cc:740] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.730887 30766 consensus_queue.cc:260] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.728540 30765 consensus_queue.cc:260] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.734210 30766 ts_tablet_manager.cc:1434] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:52.735277 30765 ts_tablet_manager.cc:1434] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.005s
I20260709 13:13:52.735674 30766 tablet_bootstrap.cc:492] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:52.742409 30766 tablet_bootstrap.cc:654] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.742515 30765 tablet_bootstrap.cc:492] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.745055 30793 raft_consensus.cc:493] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.745615 30793 raft_consensus.cc:515] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.745682 30771 raft_consensus.cc:515] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.747851 30793 leader_election.cc:290] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.750203 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.752213 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.752609 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:52.752928 30649 raft_consensus.cc:2468] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
W20260709 13:13:52.756881 30539 leader_election.cc:343] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.757982 30771 leader_election.cc:290] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.769367 30539 leader_election.cc:304] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
W20260709 13:13:52.772714 30539 leader_election.cc:343] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.774804 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:52.775415 30724 raft_consensus.cc:3060] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.784768 30724 raft_consensus.cc:2468] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.786619 30539 leader_election.cc:304] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:52.787493 30793 raft_consensus.cc:2804] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.787649 30766 tablet_bootstrap.cc:492] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:52.787912 30793 raft_consensus.cc:493] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.788534 30793 raft_consensus.cc:3060] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.788537 30766 ts_tablet_manager.cc:1403] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.000s
I20260709 13:13:52.771164 30765 tablet_bootstrap.cc:654] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.795456 30766 raft_consensus.cc:359] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.796108 30766 raft_consensus.cc:385] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.800531 30766 raft_consensus.cc:740] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.799727 30793 raft_consensus.cc:515] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.801265 30766 consensus_queue.cc:260] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.803473 30766 ts_tablet_manager.cc:1434] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:13:52.805771 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:52.806378 30649 raft_consensus.cc:3060] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.806603 30802 raft_consensus.cc:493] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.807175 30802 raft_consensus.cc:515] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } }
I20260709 13:13:52.808270 30793 leader_election.cc:290] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.809442 30802 leader_election.cc:290] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451)
I20260709 13:13:52.809610 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:52.810427 30724 raft_consensus.cc:3060] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.811304 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4aaa3fe68f4e1091bd86e945184441" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:52.806602 30771 raft_consensus.cc:2804] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.810684 30471 catalog_manager.cc:5697] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.812949 30771 raft_consensus.cc:697] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:52.813047 30650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea4aaa3fe68f4e1091bd86e945184441" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.813867 30650 raft_consensus.cc:2393] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 84987389a5624cf4814b4ef8ae2c3686 in current term 1: Already voted for candidate 886299e596884e3980c72d6dee3e1f08 in this term.
I20260709 13:13:52.813854 30771 consensus_queue.cc:237] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.815269 30688 leader_election.cc:304] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686; no voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:52.817538 30802 raft_consensus.cc:3060] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.818682 30649 raft_consensus.cc:2468] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.820030 30539 leader_election.cc:304] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:52.821082 30793 raft_consensus.cc:2804] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.820040 30724 raft_consensus.cc:2468] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.821746 30767 tablet_bootstrap.cc:492] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.822276 30767 ts_tablet_manager.cc:1403] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.114s	user 0.029s	sys 0.040s
I20260709 13:13:52.821625 30793 raft_consensus.cc:697] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:52.824025 30793 consensus_queue.cc:237] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.824781 30802 raft_consensus.cc:2749] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.825103 30767 raft_consensus.cc:359] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.825801 30767 raft_consensus.cc:385] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.830892 30765 tablet_bootstrap.cc:492] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.831645 30765 ts_tablet_manager.cc:1403] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.007s
I20260709 13:13:52.835137 30765 raft_consensus.cc:359] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.835845 30765 raft_consensus.cc:385] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.828560 30767 raft_consensus.cc:740] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.836155 30765 raft_consensus.cc:740] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.839583 30767 consensus_queue.cc:260] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.839632 30765 consensus_queue.cc:260] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.842059 30765 ts_tablet_manager.cc:1434] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:13:52.843086 30765 tablet_bootstrap.cc:492] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.843549 30767 ts_tablet_manager.cc:1434] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:13:52.843536 30471 catalog_manager.cc:5697] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.844947 30767 tablet_bootstrap.cc:492] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:52.845502 30471 catalog_manager.cc:5697] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.849634 30765 tablet_bootstrap.cc:654] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.850471 30767 tablet_bootstrap.cc:654] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.855309 30767 tablet_bootstrap.cc:492] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:52.855757 30767 ts_tablet_manager.cc:1403] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:52.856206 30765 tablet_bootstrap.cc:492] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.856732 30765 ts_tablet_manager.cc:1403] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:13:52.858466 30767 raft_consensus.cc:359] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.859211 30767 raft_consensus.cc:385] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.859455 30767 raft_consensus.cc:740] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.860293 30767 consensus_queue.cc:260] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.860566 30765 raft_consensus.cc:359] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.861299 30765 raft_consensus.cc:385] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.861572 30765 raft_consensus.cc:740] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.862239 30765 consensus_queue.cc:260] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.862736 30767 ts_tablet_manager.cc:1434] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:52.864351 30765 ts_tablet_manager.cc:1434] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:52.865332 30765 tablet_bootstrap.cc:492] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:52.870484 30765 tablet_bootstrap.cc:654] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.872457 30793 raft_consensus.cc:493] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.873111 30793 raft_consensus.cc:515] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.874902 30765 tablet_bootstrap.cc:492] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:52.875386 30765 ts_tablet_manager.cc:1403] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:52.875201 30793 leader_election.cc:290] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.875871 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce18184c2c74dcc9fb95fcbbcc1c966" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:52.876302 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce18184c2c74dcc9fb95fcbbcc1c966" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:52.876588 30649 raft_consensus.cc:2468] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:52.877031 30724 raft_consensus.cc:2468] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:52.877568 30539 leader_election.cc:304] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:52.878275 30765 raft_consensus.cc:359] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.878389 30793 raft_consensus.cc:2804] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.878860 30765 raft_consensus.cc:385] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.878955 30793 raft_consensus.cc:493] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.879179 30765 raft_consensus.cc:740] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.879398 30793 raft_consensus.cc:3060] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.879912 30765 consensus_queue.cc:260] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.882015 30765 ts_tablet_manager.cc:1434] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:52.886366 30793 raft_consensus.cc:515] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.888427 30793 leader_election.cc:290] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:52.889139 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce18184c2c74dcc9fb95fcbbcc1c966" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:52.889449 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce18184c2c74dcc9fb95fcbbcc1c966" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:52.889816 30649 raft_consensus.cc:3060] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.890060 30724 raft_consensus.cc:3060] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.895843 30724 raft_consensus.cc:2468] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.896373 30649 raft_consensus.cc:2468] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:52.896844 30539 leader_election.cc:304] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:52.897622 30793 raft_consensus.cc:2804] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.898080 30793 raft_consensus.cc:697] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:52.898849 30793 consensus_queue.cc:237] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:52.905833 30471 catalog_manager.cc:5697] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.028039 30772 raft_consensus.cc:493] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.028026 30802 raft_consensus.cc:493] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.028124 30575 raft_consensus.cc:3060] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.028918 30802 raft_consensus.cc:515] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.028805 30772 raft_consensus.cc:515] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.031279 30802 leader_election.cc:290] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:53.031843 30772 leader_election.cc:290] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:53.032104 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:53.032676 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:53.032804 30574 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 0.
I20260709 13:13:53.033811 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:53.034384 30687 leader_election.cc:304] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:53.034619 30724 raft_consensus.cc:2393] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f47d480eda141c7b0c7ca8108ccce91 in current term 1: Already voted for candidate 886299e596884e3980c72d6dee3e1f08 in this term.
I20260709 13:13:53.032735 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:53.035274 30649 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 0.
I20260709 13:13:53.035308 30802 raft_consensus.cc:2804] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.035888 30802 raft_consensus.cc:493] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.035751 30614 leader_election.cc:304] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91; no voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:53.036325 30802 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.037079 30772 raft_consensus.cc:3060] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.039137 30789 consensus_queue.cc:1048] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.043465 30802 raft_consensus.cc:515] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.044427 30772 raft_consensus.cc:2749] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.046504 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:53.046861 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:53.047204 30575 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.047459 30649 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.054769 30649 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 1.
I20260709 13:13:53.055655 30802 leader_election.cc:290] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:53.054769 30575 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 1.
I20260709 13:13:53.057535 30687 leader_election.cc:304] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:53.058686 30802 raft_consensus.cc:2804] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.059191 30802 raft_consensus.cc:697] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:53.060024 30802 consensus_queue.cc:237] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.060222 30789 consensus_queue.cc:1048] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.060863 30804 consensus_queue.cc:1048] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.077519 30472 catalog_manager.cc:5697] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 1 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.079365 30802 consensus_queue.cc:1048] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.084532 30771 consensus_queue.cc:1048] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.131580 30649 raft_consensus.cc:3060] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.135994 30810 consensus_queue.cc:1048] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.143139 30810 consensus_queue.cc:1048] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.148432 30793 consensus_queue.cc:1048] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.209064 30793 consensus_queue.cc:1048] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.210014 30810 consensus_queue.cc:1048] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.221110 30804 consensus_queue.cc:1048] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.224576 30810 consensus_queue.cc:1048] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.229846 30798 consensus_queue.cc:1048] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.237452 30804 consensus_queue.cc:1048] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.354816 30798 consensus_queue.cc:1048] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.371297 30723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
mode: GRACEFUL
new_leader_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:13:53.372231 30723 raft_consensus.cc:606] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Received request to transfer leadership to TS 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:53.371827 30793 consensus_queue.cc:1048] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.395373 30575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
mode: GRACEFUL
new_leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:41244
I20260709 13:13:53.395967 30575 raft_consensus.cc:606] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Received request to transfer leadership to TS 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:53.401429 30723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
mode: GRACEFUL
new_leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:13:53.401965 30723 raft_consensus.cc:606] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Received request to transfer leadership to TS 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:53.406742 30575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
mode: GRACEFUL
new_leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:41244
I20260709 13:13:53.407243 30575 raft_consensus.cc:606] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Received request to transfer leadership to TS 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:53.411991 30723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
mode: GRACEFUL
new_leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:13:53.412626 30723 raft_consensus.cc:606] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Received request to transfer leadership to TS 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:53.425275 30649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
mode: GRACEFUL
new_leader_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:51354
I20260709 13:13:53.425772 30649 raft_consensus.cc:606] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Received request to transfer leadership to TS 84987389a5624cf4814b4ef8ae2c3686
I20260709 13:13:53.485576 30789 raft_consensus.cc:993] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: : Instructing follower 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:13:53.486047 30849 raft_consensus.cc:1081] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Signalling peer 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:13:53.487639 30723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:52008
I20260709 13:13:53.488178 30723 raft_consensus.cc:493] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.488533 30723 raft_consensus.cc:3060] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.494067 30723 raft_consensus.cc:515] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.495868 30723 leader_election.cc:290] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:53.496811 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:53.497032 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd328bf039114ae6b522a99e25f0f85d" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:53.497414 30575 raft_consensus.cc:3060] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.497650 30649 raft_consensus.cc:3055] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.498013 30649 raft_consensus.cc:740] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:53.498708 30649 consensus_queue.cc:260] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.499672 30649 raft_consensus.cc:3060] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.503100 30575 raft_consensus.cc:2468] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 2.
I20260709 13:13:53.504415 30687 leader_election.cc:304] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:53.504961 30649 raft_consensus.cc:2468] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 2.
I20260709 13:13:53.505148 30804 raft_consensus.cc:2804] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.505739 30804 raft_consensus.cc:697] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 2 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:53.506559 30804 consensus_queue.cc:237] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.512921 30473 catalog_manager.cc:5697] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 1 to 2, leader changed from 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194) to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.590710 30802 raft_consensus.cc:993] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: : Instructing follower 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:53.591172 30804 raft_consensus.cc:1081] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Signalling peer 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:53.592648 30575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:41236
I20260709 13:13:53.593180 30575 raft_consensus.cc:493] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.593523 30575 raft_consensus.cc:3060] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.598582 30575 raft_consensus.cc:515] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.600499 30575 leader_election.cc:290] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:53.601243 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:53.601622 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca185d9207440aaa5cb8fbde9ab09e9" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:53.601913 30649 raft_consensus.cc:3060] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.602257 30723 raft_consensus.cc:3055] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.602583 30723 raft_consensus.cc:740] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:53.603420 30723 consensus_queue.cc:260] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.604722 30723 raft_consensus.cc:3060] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.609294 30649 raft_consensus.cc:2468] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:53.610585 30539 leader_election.cc:304] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:53.611370 30793 raft_consensus.cc:2804] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.611811 30793 raft_consensus.cc:697] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:53.611960 30723 raft_consensus.cc:2468] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:53.612636 30793 consensus_queue.cc:237] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.618893 30473 catalog_manager.cc:5697] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 1 to 2, leader changed from 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195) to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.631820 30804 consensus_queue.cc:1048] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.639001 30799 consensus_queue.cc:1048] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.648746 30804 raft_consensus.cc:993] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: : Instructing follower 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.649255 30799 raft_consensus.cc:1081] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Signalling peer 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.651062 30649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:13:53.651684 30649 raft_consensus.cc:493] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.652140 30649 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.657806 30649 raft_consensus.cc:515] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.659495 30649 leader_election.cc:290] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:53.660637 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:53.660764 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:53.661443 30575 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.661530 30723 raft_consensus.cc:3055] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.661988 30723 raft_consensus.cc:740] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:53.662751 30723 consensus_queue.cc:260] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.663929 30723 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.668615 30575 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.669919 30613 leader_election.cc:304] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:53.670830 30849 raft_consensus.cc:2804] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.671319 30723 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.671527 30849 raft_consensus.cc:697] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:53.673135 30849 consensus_queue.cc:237] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.679868 30473 catalog_manager.cc:5697] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 1 to 2, leader changed from 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195) to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.729230 30793 raft_consensus.cc:993] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: : Instructing follower 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.729835 30810 raft_consensus.cc:1081] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Signalling peer 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.731400 30649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:13:53.731915 30649 raft_consensus.cc:493] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.732326 30649 raft_consensus.cc:3060] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.737452 30649 raft_consensus.cc:515] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.739358 30649 leader_election.cc:290] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:53.740347 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:53.740413 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d62ec4f06284fb693cc27236a966983" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:53.741143 30723 raft_consensus.cc:3060] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.741140 30804 raft_consensus.cc:993] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: : Instructing follower 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.741403 30575 raft_consensus.cc:3055] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.741993 30799 raft_consensus.cc:1081] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Signalling peer 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.742012 30575 raft_consensus.cc:740] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:53.743009 30575 consensus_queue.cc:260] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.743908 30649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:51340
I20260709 13:13:53.744122 30575 raft_consensus.cc:3060] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.744560 30649 raft_consensus.cc:493] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.744972 30649 raft_consensus.cc:3060] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.748595 30723 raft_consensus.cc:2468] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.749344 30575 raft_consensus.cc:2468] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.750196 30614 leader_election.cc:304] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:53.751148 30849 raft_consensus.cc:2804] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.751616 30849 raft_consensus.cc:697] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:53.752033 30649 raft_consensus.cc:515] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.752514 30849 consensus_queue.cc:237] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.754316 30649 leader_election.cc:290] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:53.754973 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:53.755609 30575 raft_consensus.cc:3060] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.755957 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ae3e6b9e2e944d8801dd6c0a2b16201" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:53.756631 30723 raft_consensus.cc:3055] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.756918 30723 raft_consensus.cc:740] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:53.757767 30723 consensus_queue.cc:260] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.758765 30723 raft_consensus.cc:3060] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.761849 30575 raft_consensus.cc:2468] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.761606 30473 catalog_manager.cc:5697] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 1 to 2, leader changed from 886299e596884e3980c72d6dee3e1f08 (127.17.171.193) to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.762938 30613 leader_election.cc:304] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:53.763695 30849 raft_consensus.cc:2804] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.764147 30849 raft_consensus.cc:697] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:53.765015 30849 consensus_queue.cc:237] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.765484 30723 raft_consensus.cc:2468] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.775035 30473 catalog_manager.cc:5697] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 1 to 2, leader changed from 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195) to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.797079 30793 raft_consensus.cc:993] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: : Instructing follower 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.797549 30810 raft_consensus.cc:1081] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Signalling peer 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:53.799083 30649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:13:53.799682 30649 raft_consensus.cc:493] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.800065 30649 raft_consensus.cc:3060] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.805372 30649 raft_consensus.cc:515] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.807030 30649 leader_election.cc:290] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:53.808187 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:53.808270 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fdd0be02b146be88f0798c65663f94" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:53.808987 30575 raft_consensus.cc:3055] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.808993 30723 raft_consensus.cc:3060] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.809561 30575 raft_consensus.cc:740] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:53.810384 30575 consensus_queue.cc:260] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.811427 30575 raft_consensus.cc:3060] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.814682 30723 raft_consensus.cc:2468] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.815757 30614 leader_election.cc:304] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:53.816577 30849 raft_consensus.cc:2804] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:53.817108 30849 raft_consensus.cc:697] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:53.817414 30575 raft_consensus.cc:2468] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:53.818029 30849 consensus_queue.cc:237] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:53.824798 30473 catalog_manager.cc:5697] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 1 to 2, leader changed from 886299e596884e3980c72d6dee3e1f08 (127.17.171.193) to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.996465 30723 raft_consensus.cc:1275] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:53.997819 30810 consensus_queue.cc:1048] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.005954 30649 raft_consensus.cc:1275] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.007666 30771 consensus_queue.cc:1048] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.052215 30575 raft_consensus.cc:1275] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.053531 30799 consensus_queue.cc:1048] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.061479 30649 raft_consensus.cc:1275] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.063473 30802 consensus_queue.cc:1048] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.100119 30723 raft_consensus.cc:1275] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.101735 30849 consensus_queue.cc:1048] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.110152 30575 raft_consensus.cc:1275] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.111896 30853 consensus_queue.cc:1048] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.139518 30723 raft_consensus.cc:1275] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.140903 30849 consensus_queue.cc:1048] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.152407 30575 raft_consensus.cc:1275] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.154137 30849 consensus_queue.cc:1048] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.234368 30723 raft_consensus.cc:1275] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.235821 30849 consensus_queue.cc:1048] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.243610 30575 raft_consensus.cc:1275] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.244514 30573 raft_consensus.cc:1275] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.245447 30789 consensus_queue.cc:1048] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.246209 30849 consensus_queue.cc:1048] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:54.256796 30723 raft_consensus.cc:1275] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.258106 30855 consensus_queue.cc:1048] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:13:56.297320 30671 debug-util.cc:398] Leaking SignalData structure 0x7b08001cfc20 after lost signal to thread 18098
W20260709 13:13:56.298352 30671 debug-util.cc:398] Leaking SignalData structure 0x7b080030ed80 after lost signal to thread 30507
W20260709 13:13:56.299465 30671 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9d40 after lost signal to thread 30599
W20260709 13:13:56.300459 30671 debug-util.cc:398] Leaking SignalData structure 0x7b08001caa80 after lost signal to thread 30674
W20260709 13:13:56.301427 30671 debug-util.cc:398] Leaking SignalData structure 0x7b080012b5e0 after lost signal to thread 30748
I20260709 13:13:56.532496 30470 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44248:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:56.537070 30470 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:56.606490 30558 tablet_service.cc:1511] Processing CreateTablet for tablet 238c83bb2d9c4952bc5c36c41d44c10f (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:56.607786 30558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238c83bb2d9c4952bc5c36c41d44c10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.608867 30708 tablet_service.cc:1511] Processing CreateTablet for tablet 238c83bb2d9c4952bc5c36c41d44c10f (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:56.609120 30636 tablet_service.cc:1511] Processing CreateTablet for tablet 238c83bb2d9c4952bc5c36c41d44c10f (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:56.610246 30708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238c83bb2d9c4952bc5c36c41d44c10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.610373 30636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238c83bb2d9c4952bc5c36c41d44c10f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.614446 30557 tablet_service.cc:1511] Processing CreateTablet for tablet 7b825688805442ac98524b4634f3fbfb (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:56.614602 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 903daee7798d4242b416839be0a3548a (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:56.615880 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903daee7798d4242b416839be0a3548a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.618016 30559 tablet_service.cc:1511] Processing CreateTablet for tablet 849c328736d34f2384f2a517c07504c4 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:56.618317 30707 tablet_service.cc:1511] Processing CreateTablet for tablet 7b825688805442ac98524b4634f3fbfb (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:56.619503 30707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b825688805442ac98524b4634f3fbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.619967 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 903daee7798d4242b416839be0a3548a (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:56.620582 30559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849c328736d34f2384f2a517c07504c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.621474 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903daee7798d4242b416839be0a3548a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.622994 30557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b825688805442ac98524b4634f3fbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.625178 30714 tablet_service.cc:1511] Processing CreateTablet for tablet 903daee7798d4242b416839be0a3548a (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:56.626438 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 903daee7798d4242b416839be0a3548a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.629189 30637 tablet_service.cc:1511] Processing CreateTablet for tablet 7b825688805442ac98524b4634f3fbfb (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:56.630473 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b825688805442ac98524b4634f3fbfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.633140 30633 tablet_service.cc:1511] Processing CreateTablet for tablet 849c328736d34f2384f2a517c07504c4 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:56.634459 30633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849c328736d34f2384f2a517c07504c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.662019 30713 tablet_service.cc:1511] Processing CreateTablet for tablet 849c328736d34f2384f2a517c07504c4 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:56.663497 30713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849c328736d34f2384f2a517c07504c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.667347 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 42e1f229cb8b4098873e83b1211f280c (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:56.669368 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e1f229cb8b4098873e83b1211f280c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.689603 30637 tablet_service.cc:1511] Processing CreateTablet for tablet 42e1f229cb8b4098873e83b1211f280c (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:56.691118 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e1f229cb8b4098873e83b1211f280c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.695663 30882 tablet_bootstrap.cc:492] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:56.696620 30711 tablet_service.cc:1511] Processing CreateTablet for tablet 42e1f229cb8b4098873e83b1211f280c (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:56.698793 30562 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbca4d1fcac4e4eb4a95dee72f63ca6 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:56.709978 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e1f229cb8b4098873e83b1211f280c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.710016 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbca4d1fcac4e4eb4a95dee72f63ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.717262 30714 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbca4d1fcac4e4eb4a95dee72f63ca6 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:56.718662 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbca4d1fcac4e4eb4a95dee72f63ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.700654 30881 tablet_bootstrap.cc:492] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:56.724721 30883 tablet_bootstrap.cc:492] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:56.702718 30639 tablet_service.cc:1511] Processing CreateTablet for tablet 5fbca4d1fcac4e4eb4a95dee72f63ca6 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:56.730764 30882 tablet_bootstrap.cc:654] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.726828 30639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fbca4d1fcac4e4eb4a95dee72f63ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.747745 30883 tablet_bootstrap.cc:654] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.747391 30559 tablet_service.cc:1511] Processing CreateTablet for tablet 20a6d149be1b43e4b457820e0ead6a9c (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:56.748911 30559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a6d149be1b43e4b457820e0ead6a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.751972 30633 tablet_service.cc:1511] Processing CreateTablet for tablet 20a6d149be1b43e4b457820e0ead6a9c (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:56.753854 30882 tablet_bootstrap.cc:492] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:56.760716 30633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a6d149be1b43e4b457820e0ead6a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.764542 30882 ts_tablet_manager.cc:1403] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.012s
I20260709 13:13:56.766780 30714 tablet_service.cc:1511] Processing CreateTablet for tablet 20a6d149be1b43e4b457820e0ead6a9c (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:56.768285 30714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a6d149be1b43e4b457820e0ead6a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.767725 30882 raft_consensus.cc:359] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.768810 30882 raft_consensus.cc:385] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.769200 30882 raft_consensus.cc:740] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.770118 30882 consensus_queue.cc:260] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.760948 30883 tablet_bootstrap.cc:492] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:56.777325 30883 ts_tablet_manager.cc:1403] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 13:13:56.772580 30882 ts_tablet_manager.cc:1434] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:56.781864 30881 tablet_bootstrap.cc:654] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.782657 30882 tablet_bootstrap.cc:492] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:56.786819 30637 tablet_service.cc:1511] Processing CreateTablet for tablet e75387df6d574f4c80a1f33e5f0b2746 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:56.788270 30637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75387df6d574f4c80a1f33e5f0b2746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.790894 30711 tablet_service.cc:1511] Processing CreateTablet for tablet e75387df6d574f4c80a1f33e5f0b2746 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:56.792276 30711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75387df6d574f4c80a1f33e5f0b2746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.792868 30883 raft_consensus.cc:359] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.793675 30883 raft_consensus.cc:385] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.794205 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 692dcfadd6c74e30952663b5fb02a134 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:56.800113 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692dcfadd6c74e30952663b5fb02a134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.803054 30636 tablet_service.cc:1511] Processing CreateTablet for tablet 692dcfadd6c74e30952663b5fb02a134 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:56.804381 30636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692dcfadd6c74e30952663b5fb02a134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.795168 30559 tablet_service.cc:1511] Processing CreateTablet for tablet e75387df6d574f4c80a1f33e5f0b2746 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:56.809312 30559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75387df6d574f4c80a1f33e5f0b2746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.793985 30883 raft_consensus.cc:740] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.818522 30882 tablet_bootstrap.cc:654] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.822113 30713 tablet_service.cc:1511] Processing CreateTablet for tablet 692dcfadd6c74e30952663b5fb02a134 (DEFAULT_TABLE table=soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:56.824803 30713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 692dcfadd6c74e30952663b5fb02a134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.816232 30883 consensus_queue.cc:260] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.841137 30883 ts_tablet_manager.cc:1434] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:13:56.842921 30883 tablet_bootstrap.cc:492] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:56.849637 30883 tablet_bootstrap.cc:654] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.850827 30881 tablet_bootstrap.cc:492] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:56.851853 30881 ts_tablet_manager.cc:1403] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.152s	user 0.006s	sys 0.014s
I20260709 13:13:56.870599 30881 raft_consensus.cc:359] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.874509 30881 raft_consensus.cc:385] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.875048 30881 raft_consensus.cc:740] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.873940 30882 tablet_bootstrap.cc:492] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:56.876644 30882 ts_tablet_manager.cc:1403] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.005s
I20260709 13:13:56.876206 30881 consensus_queue.cc:260] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
W20260709 13:13:56.878316 30676 tablet.cc:2406] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:56.880038 30882 raft_consensus.cc:359] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.880890 30882 raft_consensus.cc:385] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.881189 30882 raft_consensus.cc:740] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.883800 30881 ts_tablet_manager.cc:1434] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:13:56.884949 30881 tablet_bootstrap.cc:492] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:56.887766 30882 consensus_queue.cc:260] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.890367 30882 ts_tablet_manager.cc:1434] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:56.891399 30882 tablet_bootstrap.cc:492] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:56.893318 30883 tablet_bootstrap.cc:492] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:56.893888 30883 ts_tablet_manager.cc:1403] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.003s
I20260709 13:13:56.897015 30883 raft_consensus.cc:359] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.897717 30883 raft_consensus.cc:385] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.897994 30883 raft_consensus.cc:740] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.898680 30883 consensus_queue.cc:260] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.898010 30882 tablet_bootstrap.cc:654] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.901806 30881 tablet_bootstrap.cc:654] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.907464 30883 ts_tablet_manager.cc:1434] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:56.907966 30881 tablet_bootstrap.cc:492] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:56.908592 30881 ts_tablet_manager.cc:1403] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:13:56.912459 30882 tablet_bootstrap.cc:492] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:56.908603 30883 tablet_bootstrap.cc:492] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:56.913175 30882 ts_tablet_manager.cc:1403] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:13:56.916416 30882 raft_consensus.cc:359] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.917171 30882 raft_consensus.cc:385] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.917455 30882 raft_consensus.cc:740] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.918148 30882 consensus_queue.cc:260] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.920042 30883 tablet_bootstrap.cc:654] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.920311 30882 ts_tablet_manager.cc:1434] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:56.921357 30882 tablet_bootstrap.cc:492] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:56.912431 30881 raft_consensus.cc:359] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.924023 30881 raft_consensus.cc:385] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.924404 30881 raft_consensus.cc:740] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.925308 30881 consensus_queue.cc:260] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.929453 30882 tablet_bootstrap.cc:654] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.931444 30867 raft_consensus.cc:493] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.931977 30867 raft_consensus.cc:515] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.934216 30867 leader_election.cc:290] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:56.935817 30881 ts_tablet_manager.cc:1434] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:13:56.936872 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903daee7798d4242b416839be0a3548a" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:56.937511 30724 raft_consensus.cc:2468] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:56.938128 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903daee7798d4242b416839be0a3548a" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:56.938808 30575 raft_consensus.cc:2468] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:56.940147 30881 tablet_bootstrap.cc:492] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:56.946139 30613 leader_election.cc:304] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:56.953477 30881 tablet_bootstrap.cc:654] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.953842 30867 raft_consensus.cc:2804] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.954438 30867 raft_consensus.cc:493] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.954864 30867 raft_consensus.cc:3060] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.964135 30882 tablet_bootstrap.cc:492] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:56.968820 30882 ts_tablet_manager.cc:1403] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.010s
I20260709 13:13:56.969321 30881 tablet_bootstrap.cc:492] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:56.973249 30881 ts_tablet_manager.cc:1403] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.001s
I20260709 13:13:56.976006 30882 raft_consensus.cc:359] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.976621 30881 raft_consensus.cc:359] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.977138 30882 raft_consensus.cc:385] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.976801 30867 raft_consensus.cc:515] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.977545 30882 raft_consensus.cc:740] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.978449 30882 consensus_queue.cc:260] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.979812 30867 leader_election.cc:290] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:56.980918 30882 ts_tablet_manager.cc:1434] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:56.981930 30882 tablet_bootstrap.cc:492] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:56.984400 30881 raft_consensus.cc:385] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.984751 30881 raft_consensus.cc:740] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.988507 30881 consensus_queue.cc:260] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:56.989240 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903daee7798d4242b416839be0a3548a" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:56.989850 30575 raft_consensus.cc:3060] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.995668 30881 ts_tablet_manager.cc:1434] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:13:56.997982 30882 tablet_bootstrap.cc:654] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.000867 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903daee7798d4242b416839be0a3548a" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.001559 30724 raft_consensus.cc:3060] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.001940 30881 tablet_bootstrap.cc:492] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:57.011291 30883 tablet_bootstrap.cc:492] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.011821 30883 ts_tablet_manager.cc:1403] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.008s
I20260709 13:13:57.015043 30883 raft_consensus.cc:359] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.015826 30883 raft_consensus.cc:385] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.016153 30883 raft_consensus.cc:740] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.016907 30883 consensus_queue.cc:260] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.019445 30883 ts_tablet_manager.cc:1434] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:57.021390 30575 raft_consensus.cc:2468] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.023026 30881 tablet_bootstrap.cc:654] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.023669 30613 leader_election.cc:304] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.025679 30883 tablet_bootstrap.cc:492] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:57.026386 30895 raft_consensus.cc:2804] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.032137 30724 raft_consensus.cc:2468] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.031824 30895 raft_consensus.cc:697] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.034296 30882 tablet_bootstrap.cc:492] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:57.034086 30895 consensus_queue.cc:237] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.034823 30882 ts_tablet_manager.cc:1403] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.001s
I20260709 13:13:57.037406 30892 raft_consensus.cc:493] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.041210 30892 raft_consensus.cc:515] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.052994 30892 leader_election.cc:290] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.053691 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:57.054621 30575 raft_consensus.cc:2468] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.058239 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.059813 30724 raft_consensus.cc:2468] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.060633 30613 leader_election.cc:304] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.061949 30883 tablet_bootstrap.cc:654] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.062969 30882 raft_consensus.cc:359] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.065363 30882 raft_consensus.cc:385] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.065776 30882 raft_consensus.cc:740] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.066483 30882 consensus_queue.cc:260] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.065001 30892 raft_consensus.cc:2804] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.071844 30892 raft_consensus.cc:493] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.072268 30892 raft_consensus.cc:3060] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.069419 30882 ts_tablet_manager.cc:1434] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:13:57.073657 30882 tablet_bootstrap.cc:492] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:57.075462 30473 catalog_manager.cc:5697] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.082612 30882 tablet_bootstrap.cc:654] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.090337 30881 tablet_bootstrap.cc:492] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:57.091250 30881 ts_tablet_manager.cc:1403] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.017s
I20260709 13:13:57.092396 30895 raft_consensus.cc:493] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.093111 30895 raft_consensus.cc:515] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.095019 30882 tablet_bootstrap.cc:492] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:57.095588 30882 ts_tablet_manager.cc:1403] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 13:13:57.096900 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:57.097998 30895 leader_election.cc:290] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.087786 30892 raft_consensus.cc:515] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
W20260709 13:13:57.098416 30613 leader_election.cc:343] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.098603 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
W20260709 13:13:57.100096 30614 leader_election.cc:343] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.100603 30614 leader_election.cc:304] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91; no voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:57.101069 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:57.101743 30575 raft_consensus.cc:3060] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.100255 30892 leader_election.cc:290] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.102835 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.105438 30724 raft_consensus.cc:3060] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.103358 30895 raft_consensus.cc:2749] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.114801 30724 raft_consensus.cc:2468] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.104225 30881 raft_consensus.cc:359] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.116537 30575 raft_consensus.cc:2468] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.117684 30881 raft_consensus.cc:385] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.118175 30881 raft_consensus.cc:740] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.118664 30613 leader_election.cc:304] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.118975 30881 consensus_queue.cc:260] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.122254 30881 ts_tablet_manager.cc:1434] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:13:57.123324 30881 tablet_bootstrap.cc:492] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:57.123325 30892 raft_consensus.cc:2804] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.124442 30892 raft_consensus.cc:697] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.125319 30892 consensus_queue.cc:237] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.115658 30882 raft_consensus.cc:359] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.129659 30882 raft_consensus.cc:385] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.130019 30882 raft_consensus.cc:740] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.130525 30881 tablet_bootstrap.cc:654] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.131238 30882 consensus_queue.cc:260] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.134275 30882 ts_tablet_manager.cc:1434] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.003s
I20260709 13:13:57.139834 30883 tablet_bootstrap.cc:492] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.140547 30883 ts_tablet_manager.cc:1403] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.115s	user 0.040s	sys 0.008s
I20260709 13:13:57.142951 30881 tablet_bootstrap.cc:492] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:57.143610 30882 tablet_bootstrap.cc:492] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:57.143582 30881 ts_tablet_manager.cc:1403] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:13:57.143924 30883 raft_consensus.cc:359] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.144915 30883 raft_consensus.cc:385] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.145226 30883 raft_consensus.cc:740] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.146126 30883 consensus_queue.cc:260] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.147542 30881 raft_consensus.cc:359] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.148413 30881 raft_consensus.cc:385] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.148787 30883 ts_tablet_manager.cc:1434] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:57.148787 30881 raft_consensus.cc:740] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.150075 30883 tablet_bootstrap.cc:492] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:57.150022 30881 consensus_queue.cc:260] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.150594 30868 raft_consensus.cc:493] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.151137 30868 raft_consensus.cc:515] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.152944 30881 ts_tablet_manager.cc:1434] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:57.153218 30868 leader_election.cc:290] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.154208 30881 tablet_bootstrap.cc:492] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:57.155589 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238c83bb2d9c4952bc5c36c41d44c10f" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:57.155627 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238c83bb2d9c4952bc5c36c41d44c10f" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.156391 30649 raft_consensus.cc:2468] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.156584 30724 raft_consensus.cc:2468] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.157752 30539 leader_election.cc:304] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.163949 30881 tablet_bootstrap.cc:654] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.164029 30868 raft_consensus.cc:2804] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.164793 30868 raft_consensus.cc:493] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.165174 30882 tablet_bootstrap.cc:654] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.164590 30470 catalog_manager.cc:5697] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.165211 30868 raft_consensus.cc:3060] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.169337 30883 tablet_bootstrap.cc:654] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.179764 30868 raft_consensus.cc:515] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.182996 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238c83bb2d9c4952bc5c36c41d44c10f" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:57.183570 30649 raft_consensus.cc:3060] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.187278 30892 raft_consensus.cc:493] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.187849 30892 raft_consensus.cc:515] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.188535 30883 tablet_bootstrap.cc:492] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.189280 30883 ts_tablet_manager.cc:1403] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.004s
I20260709 13:13:57.190006 30892 leader_election.cc:290] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.191249 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c328736d34f2384f2a517c07504c4" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.191609 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c328736d34f2384f2a517c07504c4" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:57.191937 30724 raft_consensus.cc:2468] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
W20260709 13:13:57.193024 30613 leader_election.cc:343] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.194006 30614 leader_election.cc:304] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:57.193389 30883 raft_consensus.cc:359] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.194907 30883 raft_consensus.cc:385] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.195089 30892 raft_consensus.cc:2804] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.195366 30883 raft_consensus.cc:740] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.195629 30892 raft_consensus.cc:493] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.196072 30892 raft_consensus.cc:3060] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.196599 30883 consensus_queue.cc:260] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.204107 30892 raft_consensus.cc:515] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.206964 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c328736d34f2384f2a517c07504c4" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:57.207500 30575 raft_consensus.cc:3060] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.208426 30649 raft_consensus.cc:2468] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:57.209707 30539 leader_election.cc:304] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.210548 30898 raft_consensus.cc:2804] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.210666 30883 ts_tablet_manager.cc:1434] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:13:57.212865 30883 tablet_bootstrap.cc:492] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:57.214636 30575 raft_consensus.cc:2468] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.215189 30898 raft_consensus.cc:697] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:57.216133 30898 consensus_queue.cc:237] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.219468 30613 leader_election.cc:304] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.220489 30895 raft_consensus.cc:2804] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.220978 30895 raft_consensus.cc:697] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.221786 30895 consensus_queue.cc:237] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.222098 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238c83bb2d9c4952bc5c36c41d44c10f" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.222695 30724 raft_consensus.cc:3060] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.232509 30883 tablet_bootstrap.cc:654] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.236263 30868 leader_election.cc:290] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.239092 30724 raft_consensus.cc:2468] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:57.242261 30892 leader_election.cc:290] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.244282 30883 tablet_bootstrap.cc:492] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.243535 30470 catalog_manager.cc:5697] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.244796 30883 ts_tablet_manager.cc:1403] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
I20260709 13:13:57.245409 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c328736d34f2384f2a517c07504c4" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.248255 30723 raft_consensus.cc:3060] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.253363 30473 catalog_manager.cc:5697] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.257544 30881 tablet_bootstrap.cc:492] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:57.257587 30882 tablet_bootstrap.cc:492] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:57.258322 30881 ts_tablet_manager.cc:1403] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.104s	user 0.038s	sys 0.036s
I20260709 13:13:57.258389 30882 ts_tablet_manager.cc:1403] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.010s
I20260709 13:13:57.262272 30882 raft_consensus.cc:359] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.263396 30882 raft_consensus.cc:385] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.263721 30882 raft_consensus.cc:740] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.264189 30883 raft_consensus.cc:359] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.265034 30883 raft_consensus.cc:385] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.264712 30882 consensus_queue.cc:260] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.265305 30883 raft_consensus.cc:740] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.266208 30883 consensus_queue.cc:260] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.267333 30881 raft_consensus.cc:359] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.268082 30881 raft_consensus.cc:385] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.268885 30883 ts_tablet_manager.cc:1434] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:57.269492 30723 raft_consensus.cc:2468] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.269888 30882 ts_tablet_manager.cc:1434] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:57.270968 30882 tablet_bootstrap.cc:492] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:57.276597 30881 raft_consensus.cc:740] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.277595 30881 consensus_queue.cc:260] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.278257 30882 tablet_bootstrap.cc:654] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.280058 30881 ts_tablet_manager.cc:1434] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:13:57.281162 30881 tablet_bootstrap.cc:492] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:57.281286 30883 tablet_bootstrap.cc:492] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:57.291608 30883 tablet_bootstrap.cc:654] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.295343 30881 tablet_bootstrap.cc:654] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.301519 30882 tablet_bootstrap.cc:492] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:57.301903 30883 tablet_bootstrap.cc:492] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.302016 30882 ts_tablet_manager.cc:1403] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.013s
I20260709 13:13:57.302489 30883 ts_tablet_manager.cc:1403] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.003s
I20260709 13:13:57.304983 30882 raft_consensus.cc:359] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.305280 30883 raft_consensus.cc:359] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.305749 30882 raft_consensus.cc:385] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.305999 30883 raft_consensus.cc:385] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.306028 30882 raft_consensus.cc:740] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.306299 30881 tablet_bootstrap.cc:492] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:57.306422 30883 raft_consensus.cc:740] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.307168 30881 ts_tablet_manager.cc:1403] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 13:13:57.306921 30882 consensus_queue.cc:260] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.307526 30883 consensus_queue.cc:260] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.309732 30882 ts_tablet_manager.cc:1434] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:57.310695 30882 tablet_bootstrap.cc:492] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: Bootstrap starting.
I20260709 13:13:57.312628 30883 ts_tablet_manager.cc:1434] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:13:57.313670 30883 tablet_bootstrap.cc:492] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:57.313898 30881 raft_consensus.cc:359] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.314679 30881 raft_consensus.cc:385] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.314977 30881 raft_consensus.cc:740] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.315838 30881 consensus_queue.cc:260] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.320869 30883 tablet_bootstrap.cc:654] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.322811 30881 ts_tablet_manager.cc:1434] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:57.323940 30881 tablet_bootstrap.cc:492] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:57.330579 30881 tablet_bootstrap.cc:654] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.340003 30883 tablet_bootstrap.cc:492] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.340538 30883 ts_tablet_manager.cc:1403] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.006s
I20260709 13:13:57.341950 30898 raft_consensus.cc:493] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.342705 30898 raft_consensus.cc:515] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.343168 30883 raft_consensus.cc:359] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.343909 30883 raft_consensus.cc:385] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.344208 30883 raft_consensus.cc:740] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.345073 30883 consensus_queue.cc:260] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.347106 30883 ts_tablet_manager.cc:1434] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:57.346910 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:57.347916 30649 raft_consensus.cc:2468] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.348125 30883 tablet_bootstrap.cc:492] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: Bootstrap starting.
I20260709 13:13:57.352605 30882 tablet_bootstrap.cc:654] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.353572 30539 leader_election.cc:304] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.354892 30868 raft_consensus.cc:2804] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.355067 30883 tablet_bootstrap.cc:654] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.355468 30868 raft_consensus.cc:493] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.355954 30868 raft_consensus.cc:3060] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.361024 30898 leader_election.cc:290] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.363358 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.364445 30723 raft_consensus.cc:2468] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.380242 30883 tablet_bootstrap.cc:492] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: No bootstrap required, opened a new log
I20260709 13:13:57.385125 30883 ts_tablet_manager.cc:1403] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.015s
I20260709 13:13:57.374434 30868 raft_consensus.cc:515] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.388211 30883 raft_consensus.cc:359] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.383147 30881 tablet_bootstrap.cc:492] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:57.388909 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:57.389791 30649 raft_consensus.cc:3060] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.389863 30881 ts_tablet_manager.cc:1403] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.029s
I20260709 13:13:57.390017 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.390801 30723 raft_consensus.cc:3060] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.393481 30881 raft_consensus.cc:359] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.380322 30882 tablet_bootstrap.cc:492] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: No bootstrap required, opened a new log
I20260709 13:13:57.395175 30882 ts_tablet_manager.cc:1403] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.007s
I20260709 13:13:57.396778 30649 raft_consensus.cc:2468] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:57.397927 30539 leader_election.cc:304] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.398329 30882 raft_consensus.cc:359] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.398818 30898 raft_consensus.cc:2804] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.399092 30882 raft_consensus.cc:385] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.399305 30895 raft_consensus.cc:493] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.399355 30898 raft_consensus.cc:697] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:57.399471 30882 raft_consensus.cc:740] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.400066 30895 raft_consensus.cc:515] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.400699 30898 consensus_queue.cc:237] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.400776 30882 consensus_queue.cc:260] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.401412 30723 raft_consensus.cc:2468] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:57.402431 30895 leader_election.cc:290] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.388955 30883 raft_consensus.cc:385] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.402926 30868 leader_election.cc:290] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.402976 30881 raft_consensus.cc:385] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.404261 30882 ts_tablet_manager.cc:1434] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:57.404232 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6d149be1b43e4b457820e0ead6a9c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.403106 30883 raft_consensus.cc:740] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.404484 30881 raft_consensus.cc:740] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.409749 30881 consensus_queue.cc:260] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.412536 30724 raft_consensus.cc:2468] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.405956 30883 consensus_queue.cc:260] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.414990 30883 ts_tablet_manager.cc:1434] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:13:57.412704 30881 ts_tablet_manager.cc:1434] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:13:57.416921 30881 tablet_bootstrap.cc:492] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: Bootstrap starting.
I20260709 13:13:57.418040 30614 leader_election.cc:304] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:57.418987 30867 raft_consensus.cc:2804] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.419355 30867 raft_consensus.cc:493] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.419687 30867 raft_consensus.cc:3060] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.424010 30881 tablet_bootstrap.cc:654] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.426956 30867 raft_consensus.cc:515] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.404219 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6d149be1b43e4b457820e0ead6a9c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:57.433190 30575 raft_consensus.cc:2468] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.436218 30867 leader_election.cc:290] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.437105 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6d149be1b43e4b457820e0ead6a9c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:57.437716 30575 raft_consensus.cc:3060] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.438174 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a6d149be1b43e4b457820e0ead6a9c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.438819 30724 raft_consensus.cc:3060] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.442786 30472 catalog_manager.cc:5697] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.445008 30575 raft_consensus.cc:2468] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.444664 30881 tablet_bootstrap.cc:492] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: No bootstrap required, opened a new log
I20260709 13:13:57.445744 30724 raft_consensus.cc:2468] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.446242 30613 leader_election.cc:304] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.445845 30881 ts_tablet_manager.cc:1403] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:13:57.447794 30895 raft_consensus.cc:2804] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.448339 30895 raft_consensus.cc:697] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.449154 30895 consensus_queue.cc:237] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.450398 30894 consensus_queue.cc:1048] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.459707 30868 raft_consensus.cc:493] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.460393 30868 raft_consensus.cc:515] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.462841 30868 leader_election.cc:290] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.468297 30881 raft_consensus.cc:359] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.469202 30881 raft_consensus.cc:385] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.469574 30881 raft_consensus.cc:740] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.470438 30881 consensus_queue.cc:260] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
W20260709 13:13:57.472033 30521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:57.464511 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:57.473604 30649 raft_consensus.cc:2468] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.474982 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.476022 30722 raft_consensus.cc:2468] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.477167 30539 leader_election.cc:304] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.479004 30898 raft_consensus.cc:2804] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.479372 30898 raft_consensus.cc:493] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.479692 30898 raft_consensus.cc:3060] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.472946 30881 ts_tablet_manager.cc:1434] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:57.487740 30898 raft_consensus.cc:515] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.492364 30894 consensus_queue.cc:1048] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.493687 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:57.494333 30649 raft_consensus.cc:3060] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.500288 30892 raft_consensus.cc:493] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.500869 30892 raft_consensus.cc:515] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.503253 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.503939 30724 raft_consensus.cc:3060] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.504696 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:57.505316 30575 raft_consensus.cc:2468] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.511766 30613 leader_election.cc:304] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.515228 30470 catalog_manager.cc:5697] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.516968 30894 raft_consensus.cc:2804] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.517519 30894 raft_consensus.cc:493] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.517913 30894 raft_consensus.cc:3060] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.518280 30892 leader_election.cc:290] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.519315 30649 raft_consensus.cc:2468] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:57.520205 30898 leader_election.cc:290] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.522018 30724 raft_consensus.cc:2468] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 1.
I20260709 13:13:57.523573 30539 leader_election.cc:304] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.524763 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.525499 30723 raft_consensus.cc:2468] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.527128 30894 raft_consensus.cc:515] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.529022 30898 raft_consensus.cc:2804] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.533568 30898 raft_consensus.cc:697] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:57.535549 30898 consensus_queue.cc:237] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.542230 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:57.544796 30573 raft_consensus.cc:3060] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.550324 30472 catalog_manager.cc:5697] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 1 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.554020 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.554688 30724 raft_consensus.cc:3060] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.559638 30895 raft_consensus.cc:493] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.560276 30895 raft_consensus.cc:515] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.562489 30894 leader_election.cc:290] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.562700 30573 raft_consensus.cc:2468] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.562389 30895 leader_election.cc:290] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.564388 30613 leader_election.cc:304] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.565385 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.565689 30895 raft_consensus.cc:2804] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.566066 30722 raft_consensus.cc:2468] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.566231 30895 raft_consensus.cc:697] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.562391 30724 raft_consensus.cc:2468] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.567193 30895 consensus_queue.cc:237] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.567624 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08" is_pre_election: true
I20260709 13:13:57.568341 30573 raft_consensus.cc:2468] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 0.
I20260709 13:13:57.569301 30613 leader_election.cc:304] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.570223 30867 raft_consensus.cc:2804] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.569798 30898 raft_consensus.cc:493] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.571890 30867 raft_consensus.cc:493] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.572320 30867 raft_consensus.cc:3060] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.572033 30898 raft_consensus.cc:515] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.574195 30898 leader_election.cc:290] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.576503 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91" is_pre_election: true
I20260709 13:13:57.577596 30723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686" is_pre_election: true
I20260709 13:13:57.578256 30723 raft_consensus.cc:2468] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 0.
I20260709 13:13:57.579511 30539 leader_election.cc:304] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:57.579735 30867 raft_consensus.cc:515] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.580453 30898 raft_consensus.cc:2804] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.580812 30898 raft_consensus.cc:493] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.581144 30898 raft_consensus.cc:3060] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.570946 30892 consensus_queue.cc:1048] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:13:57.583849 30649 raft_consensus.cc:2393] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 886299e596884e3980c72d6dee3e1f08 in current term 1: Already voted for candidate 4f47d480eda141c7b0c7ca8108ccce91 in this term.
I20260709 13:13:57.583863 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:57.585625 30867 leader_election.cc:290] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.586647 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.587257 30724 raft_consensus.cc:3060] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.595075 30724 raft_consensus.cc:2468] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 1.
I20260709 13:13:57.596256 30614 leader_election.cc:304] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:57.597401 30867 raft_consensus.cc:2804] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.598167 30867 raft_consensus.cc:697] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.599048 30867 consensus_queue.cc:237] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.601987 30898 raft_consensus.cc:515] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.607473 30573 raft_consensus.cc:2393] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f47d480eda141c7b0c7ca8108ccce91 in current term 1: Already voted for candidate 886299e596884e3980c72d6dee3e1f08 in this term.
I20260709 13:13:57.610117 30898 leader_election.cc:290] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.619433 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:57.606307 30472 catalog_manager.cc:5697] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.623431 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fbca4d1fcac4e4eb4a95dee72f63ca6" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.624121 30724 raft_consensus.cc:2393] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 886299e596884e3980c72d6dee3e1f08 in current term 1: Already voted for candidate 4f47d480eda141c7b0c7ca8108ccce91 in this term.
I20260709 13:13:57.625398 30539 leader_election.cc:304] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 886299e596884e3980c72d6dee3e1f08; no voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686
I20260709 13:13:57.626273 30908 raft_consensus.cc:2749] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.628997 30895 consensus_queue.cc:1048] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.659583 30898 consensus_queue.cc:1048] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.660988 30472 catalog_manager.cc:5697] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 1 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.674340 30868 consensus_queue.cc:1048] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.736289 30867 consensus_queue.cc:1048] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.751519 30892 consensus_queue.cc:1048] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.783972 30649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
mode: GRACEFUL
new_leader_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:51354
I20260709 13:13:57.784539 30649 raft_consensus.cc:606] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Received request to transfer leadership to TS 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:57.790132 30649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "903daee7798d4242b416839be0a3548a"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
mode: GRACEFUL
new_leader_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:51354
I20260709 13:13:57.790676 30649 raft_consensus.cc:606] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Received request to transfer leadership to TS 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:57.796288 30649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "849c328736d34f2384f2a517c07504c4"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
mode: GRACEFUL
new_leader_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:51354
I20260709 13:13:57.796895 30649 raft_consensus.cc:606] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Received request to transfer leadership to TS 886299e596884e3980c72d6dee3e1f08
I20260709 13:13:57.802594 30573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
mode: GRACEFUL
new_leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:41244
I20260709 13:13:57.803196 30573 raft_consensus.cc:606] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Received request to transfer leadership to TS 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:57.807056 30898 consensus_queue.cc:1048] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.818917 30868 consensus_queue.cc:1048] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.821794 30573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
mode: GRACEFUL
new_leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:41244
I20260709 13:13:57.822559 30573 raft_consensus.cc:606] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Received request to transfer leadership to TS 4f47d480eda141c7b0c7ca8108ccce91
I20260709 13:13:57.831229 30648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
mode: GRACEFUL
new_leader_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:51354
I20260709 13:13:57.831874 30648 raft_consensus.cc:606] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Received request to transfer leadership to TS 84987389a5624cf4814b4ef8ae2c3686
I20260709 13:13:57.840742 30892 consensus_queue.cc:1048] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.848205 30868 raft_consensus.cc:993] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: : Instructing follower 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:57.848759 30868 raft_consensus.cc:1081] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Signalling peer 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:57.850538 30649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:13:57.851150 30649 raft_consensus.cc:493] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.851505 30649 raft_consensus.cc:3060] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.857928 30867 consensus_queue.cc:1048] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.865154 30649 raft_consensus.cc:515] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.868626 30573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:57.869306 30573 raft_consensus.cc:3055] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:57.869650 30573 raft_consensus.cc:740] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:57.870523 30573 consensus_queue.cc:260] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.871733 30573 raft_consensus.cc:3060] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.877494 30649 leader_election.cc:290] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.878787 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e1f229cb8b4098873e83b1211f280c" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.879511 30724 raft_consensus.cc:3060] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.887912 30724 raft_consensus.cc:2468] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:57.889214 30614 leader_election.cc:304] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:13:57.890288 30867 raft_consensus.cc:2804] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:57.890691 30573 raft_consensus.cc:2468] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:57.890874 30867 raft_consensus.cc:697] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.891789 30867 consensus_queue.cc:237] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.900938 30470 catalog_manager.cc:5697] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 1 to 2, leader changed from 886299e596884e3980c72d6dee3e1f08 (127.17.171.193) to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.969614 30894 raft_consensus.cc:993] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: : Instructing follower 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:57.970117 30894 raft_consensus.cc:1081] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Signalling peer 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:57.971756 30573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "903daee7798d4242b416839be0a3548a"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:41232
I20260709 13:13:57.972419 30573 raft_consensus.cc:493] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:57.972759 30573 raft_consensus.cc:3060] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.978647 30573 raft_consensus.cc:515] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.980590 30573 leader_election.cc:290] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:57.981897 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903daee7798d4242b416839be0a3548a" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:57.981660 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "903daee7798d4242b416839be0a3548a" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:57.982575 30649 raft_consensus.cc:3055] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:57.982702 30724 raft_consensus.cc:3060] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.983012 30649 raft_consensus.cc:740] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:57.983927 30867 consensus_queue.cc:1048] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.984023 30649 consensus_queue.cc:260] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:57.985750 30649 raft_consensus.cc:3060] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:57.990504 30908 consensus_queue.cc:1048] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.991537 30724 raft_consensus.cc:2468] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:58.004021 30539 leader_election.cc:304] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:58.005566 30898 raft_consensus.cc:2804] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.006085 30898 raft_consensus.cc:697] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:58.007042 30898 consensus_queue.cc:237] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.015312 30868 consensus_queue.cc:1048] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.017571 30892 consensus_queue.cc:1048] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.020457 30649 raft_consensus.cc:2468] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:58.024032 30470 catalog_manager.cc:5697] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 1 to 2, leader changed from 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194) to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.040524 30892 raft_consensus.cc:993] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: : Instructing follower 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:58.041076 30867 raft_consensus.cc:1081] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Signalling peer 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:58.046715 30573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:41232
I20260709 13:13:58.047291 30573 raft_consensus.cc:493] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.047659 30573 raft_consensus.cc:3060] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.053102 30867 raft_consensus.cc:993] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: : Instructing follower 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:13:58.053310 30868 raft_consensus.cc:993] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: : Instructing follower 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:58.053679 30867 raft_consensus.cc:1081] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Signalling peer 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:13:58.053833 30868 raft_consensus.cc:1081] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Signalling peer 4f47d480eda141c7b0c7ca8108ccce91 to start an election
I20260709 13:13:58.055698 30723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:52008
I20260709 13:13:58.056269 30723 raft_consensus.cc:493] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.056597 30723 raft_consensus.cc:3060] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.056670 30650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
 from {username='slave'} at 127.0.0.1:51332
I20260709 13:13:58.057307 30650 raft_consensus.cc:493] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.057691 30650 raft_consensus.cc:3060] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.064013 30723 raft_consensus.cc:515] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.066810 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:58.066784 30650 raft_consensus.cc:515] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.067605 30575 raft_consensus.cc:3060] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.070588 30574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:13:58.071226 30574 raft_consensus.cc:3055] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.071535 30574 raft_consensus.cc:740] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:58.071959 30724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75387df6d574f4c80a1f33e5f0b2746" candidate_uuid: "4f47d480eda141c7b0c7ca8108ccce91" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:58.055054 30573 raft_consensus.cc:515] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.072630 30724 raft_consensus.cc:3060] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.072324 30574 consensus_queue.cc:260] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.073531 30574 raft_consensus.cc:3060] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.074177 30573 leader_election.cc:290] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:58.080897 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:58.081513 30722 raft_consensus.cc:3060] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.086244 30575 raft_consensus.cc:2468] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 2.
I20260709 13:13:58.087702 30687 leader_election.cc:304] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:58.088598 30931 raft_consensus.cc:2804] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.089154 30931 raft_consensus.cc:697] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:13:58.090366 30722 raft_consensus.cc:2468] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:58.090042 30931 consensus_queue.cc:237] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.091435 30723 leader_election.cc:290] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:13:58.093545 30648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "692dcfadd6c74e30952663b5fb02a134" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:58.093902 30574 raft_consensus.cc:2468] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:58.094211 30648 raft_consensus.cc:3055] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.094633 30648 raft_consensus.cc:740] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:58.095472 30648 consensus_queue.cc:260] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.096753 30648 raft_consensus.cc:3060] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.097301 30539 leader_election.cc:304] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:58.097663 30613 leader_election.cc:304] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:58.099377 30898 raft_consensus.cc:2804] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.099009 30472 catalog_manager.cc:5697] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 1 to 2, leader changed from 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194) to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:58.101125 30892 raft_consensus.cc:2804] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.101678 30892 raft_consensus.cc:697] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Leader. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:58.102540 30892 consensus_queue.cc:237] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.106488 30648 raft_consensus.cc:2468] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 2.
I20260709 13:13:58.111151 30894 consensus_queue.cc:1048] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.111910 30724 raft_consensus.cc:2468] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f47d480eda141c7b0c7ca8108ccce91 in term 2.
I20260709 13:13:58.111229 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b825688805442ac98524b4634f3fbfb" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:58.121150 30649 raft_consensus.cc:3055] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.126012 30649 raft_consensus.cc:740] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:58.130623 30649 consensus_queue.cc:260] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.131769 30649 raft_consensus.cc:3060] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.135195 30722 raft_consensus.cc:1240] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Rejecting Update request from peer 4f47d480eda141c7b0c7ca8108ccce91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:58.129503 30650 leader_election.cc:290] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:58.141454 30473 catalog_manager.cc:5697] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 reported cstate change: term changed from 1 to 2, leader changed from 886299e596884e3980c72d6dee3e1f08 (127.17.171.193) to 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194). New cstate: current_term: 2 leader_uuid: "4f47d480eda141c7b0c7ca8108ccce91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.161262 30898 raft_consensus.cc:697] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:58.162273 30898 consensus_queue.cc:237] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.165472 30867 consensus_queue.cc:1048] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.195633 30649 raft_consensus.cc:2468] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:58.203187 30472 catalog_manager.cc:5697] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 1 to 2, leader changed from 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194) to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.296658 30867 raft_consensus.cc:993] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: : Instructing follower 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:58.297223 30894 raft_consensus.cc:1081] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Signalling peer 886299e596884e3980c72d6dee3e1f08 to start an election
I20260709 13:13:58.298888 30574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "849c328736d34f2384f2a517c07504c4"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
 from {username='slave'} at 127.0.0.1:41232
I20260709 13:13:58.299536 30574 raft_consensus.cc:493] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.299919 30574 raft_consensus.cc:3060] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.308326 30574 raft_consensus.cc:515] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.310614 30574 leader_election.cc:290] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Requested vote from peers 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557), 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195:37463)
I20260709 13:13:58.311949 30722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c328736d34f2384f2a517c07504c4" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
I20260709 13:13:58.312719 30722 raft_consensus.cc:3060] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.312702 30649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849c328736d34f2384f2a517c07504c4" candidate_uuid: "886299e596884e3980c72d6dee3e1f08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:13:58.313589 30649 raft_consensus.cc:3055] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.314442 30649 raft_consensus.cc:740] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:13:58.315248 30649 consensus_queue.cc:260] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.316396 30649 raft_consensus.cc:3060] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.320858 30722 raft_consensus.cc:2468] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:58.321770 30721 raft_consensus.cc:1240] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Rejecting Update request from peer 4f47d480eda141c7b0c7ca8108ccce91 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:58.322149 30539 leader_election.cc:304] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:13:58.323056 30868 raft_consensus.cc:2804] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.323526 30868 raft_consensus.cc:697] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Becoming Leader. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:13:58.324558 30649 raft_consensus.cc:2468] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 886299e596884e3980c72d6dee3e1f08 in term 2.
I20260709 13:13:58.324440 30868 consensus_queue.cc:237] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:13:58.336246 30472 catalog_manager.cc:5697] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 reported cstate change: term changed from 1 to 2, leader changed from 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194) to 886299e596884e3980c72d6dee3e1f08 (127.17.171.193). New cstate: current_term: 2 leader_uuid: "886299e596884e3980c72d6dee3e1f08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.452440 30721 raft_consensus.cc:1275] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.453701 30894 consensus_queue.cc:1048] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.461419 30574 raft_consensus.cc:1275] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.462855 30895 consensus_queue.cc:1048] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.539496 30721 raft_consensus.cc:1275] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.541080 30895 consensus_queue.cc:1048] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.548568 30649 raft_consensus.cc:1275] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.551483 30575 raft_consensus.cc:1275] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 4f47d480eda141c7b0c7ca8108ccce91: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.553534 30868 consensus_queue.cc:1048] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.555894 30895 consensus_queue.cc:1048] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.566394 30721 raft_consensus.cc:1275] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.568076 30945 consensus_queue.cc:1048] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:58.574569 30649 raft_consensus.cc:1275] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.579682 30945 consensus_queue.cc:1048] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.595288 30722 raft_consensus.cc:1275] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.597199 30868 consensus_queue.cc:1048] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.675280 30649 raft_consensus.cc:1275] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.677021 30931 consensus_queue.cc:1048] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.695534 30574 raft_consensus.cc:1275] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.697214 30952 consensus_queue.cc:1048] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.794778 30721 raft_consensus.cc:1275] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.796114 30945 consensus_queue.cc:1048] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.805452 30649 raft_consensus.cc:1275] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 886299e596884e3980c72d6dee3e1f08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.806893 30945 consensus_queue.cc:1048] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:00.837939 30471 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44248:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:00.857311 30471 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44248:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:00.898723 18095 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:01.086205 30988 log.cc:927] Time spent T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:14:01.099985 30613 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.193:45451, user_credentials={real_user=slave}} blocked reactor thread for 51555.7us
I20260709 13:14:01.064445 30991 tablet.cc:1724] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.117134 30999 tablet.cc:1724] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:01.160748 30995 log.cc:927] Time spent T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:01.153219 31008 tablet.cc:1724] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:01.202152 31001 log.cc:927] Time spent T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:14:01.212268 30998 log.cc:927] Time spent T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:14:01.234871 30650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42"
dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
mode: GRACEFUL
new_leader_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:49332
I20260709 13:14:01.235909 30650 raft_consensus.cc:606] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Received request to transfer leadership to TS 84987389a5624cf4814b4ef8ae2c3686
I20260709 13:14:01.238976 31013 tablet.cc:1724] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.242197 31012 tablet.cc:1724] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.256893 30999 tablet.cc:1724] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.277387 31018 tablet.cc:1724] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:01.282277 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.17.171.195:37463, user_credentials={real_user=slave}} blocked reactor thread for 111795us
I20260709 13:14:01.296275 31025 tablet.cc:1724] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.274995 31016 tablet.cc:1724] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.310384 31022 tablet.cc:1724] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.299398 31020 tablet.cc:1724] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.303717 31019 tablet.cc:1724] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.297143 31023 tablet.cc:1724] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.323551 31025 tablet.cc:1724] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.341480 31008 tablet.cc:1724] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.354142 31013 tablet.cc:1724] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.324877 30991 tablet.cc:1724] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.334982 30999 tablet.cc:1724] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.375834 31008 tablet.cc:1724] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.377365 31025 tablet.cc:1724] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.377787 30999 tablet.cc:1724] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.384958 31007 raft_consensus.cc:993] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: : Instructing follower 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:14:01.385507 31007 raft_consensus.cc:1081] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Signalling peer 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:14:01.387663 30719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:52008
I20260709 13:14:01.388264 30719 raft_consensus.cc:493] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.388626 30719 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.381336 31016 tablet.cc:1724] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.396358 30719 raft_consensus.cc:515] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:14:01.399168 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:14:01.399541 30646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f319c74c7ec4ac8a22ecaf36824dc42" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:14:01.399822 30575 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.400151 30646 raft_consensus.cc:3055] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:01.400538 30646 raft_consensus.cc:740] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f47d480eda141c7b0c7ca8108ccce91, State: Running, Role: LEADER
I20260709 13:14:01.401351 30646 consensus_queue.cc:260] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:14:01.401312 31018 tablet.cc:1724] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.402819 30646 raft_consensus.cc:3060] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.408658 30575 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 3.
I20260709 13:14:01.425348 30687 leader_election.cc:304] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84987389a5624cf4814b4ef8ae2c3686, 886299e596884e3980c72d6dee3e1f08; no voters: 
I20260709 13:14:01.426373 30957 raft_consensus.cc:2804] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:01.426883 30957 raft_consensus.cc:697] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 3 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:14:01.427677 30957 consensus_queue.cc:237] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:14:01.398824 30719 leader_election.cc:290] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 3 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:14:01.410542 30646 raft_consensus.cc:2468] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 3.
I20260709 13:14:01.397769 31022 tablet.cc:1724] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.417507 30573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd"
dest_uuid: "886299e596884e3980c72d6dee3e1f08"
mode: GRACEFUL
new_leader_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:60222
I20260709 13:14:01.437701 30573 raft_consensus.cc:606] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Received request to transfer leadership to TS 84987389a5624cf4814b4ef8ae2c3686
I20260709 13:14:01.415445 31008 tablet.cc:1724] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.444118 18095 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:01.444959 18095 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:01.443625 31012 tablet.cc:1724] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.421959 31023 tablet.cc:1724] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.459993 30472 catalog_manager.cc:5697] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 2 to 3, leader changed from 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194) to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 3 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.468483 30470 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa: soft_deleted_table [id=9f93b5b8484d43e28634f858024071a1] alter complete (version 1)
I20260709 13:14:01.726840 30989 raft_consensus.cc:993] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: : Instructing follower 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:14:01.727299 30868 raft_consensus.cc:1081] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Signalling peer 84987389a5624cf4814b4ef8ae2c3686 to start an election
I20260709 13:14:01.728888 30719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd"
dest_uuid: "84987389a5624cf4814b4ef8ae2c3686"
 from {username='slave'} at 127.0.0.1:52004
I20260709 13:14:01.729393 30719 raft_consensus.cc:493] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.729707 30719 raft_consensus.cc:3060] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.735400 30719 raft_consensus.cc:515] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:14:01.737546 30719 leader_election.cc:290] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 2 election: Requested vote from peers 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451), 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557)
I20260709 13:14:01.738095 30575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "886299e596884e3980c72d6dee3e1f08"
I20260709 13:14:01.738803 30647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae98431f347b4392acd57c23a4dc21fd" candidate_uuid: "84987389a5624cf4814b4ef8ae2c3686" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f47d480eda141c7b0c7ca8108ccce91"
I20260709 13:14:01.739413 30647 raft_consensus.cc:3060] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.738776 30575 raft_consensus.cc:3055] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.740216 30575 raft_consensus.cc:740] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 886299e596884e3980c72d6dee3e1f08, State: Running, Role: LEADER
I20260709 13:14:01.741058 30575 consensus_queue.cc:260] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:14:01.741946 30575 raft_consensus.cc:3060] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.745435 30647 raft_consensus.cc:2468] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 2.
I20260709 13:14:01.746675 30688 leader_election.cc:304] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f47d480eda141c7b0c7ca8108ccce91, 84987389a5624cf4814b4ef8ae2c3686; no voters: 
I20260709 13:14:01.746676 30575 raft_consensus.cc:2468] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84987389a5624cf4814b4ef8ae2c3686 in term 2.
I20260709 13:14:01.747488 30957 raft_consensus.cc:2804] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.747946 30957 raft_consensus.cc:697] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 2 LEADER]: Becoming Leader. State: Replica: 84987389a5624cf4814b4ef8ae2c3686, State: Running, Role: LEADER
I20260709 13:14:01.748725 30957 consensus_queue.cc:237] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } }
I20260709 13:14:01.758728 30470 catalog_manager.cc:5697] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 reported cstate change: term changed from 1 to 2, leader changed from 886299e596884e3980c72d6dee3e1f08 (127.17.171.193) to 84987389a5624cf4814b4ef8ae2c3686 (127.17.171.195). New cstate: current_term: 2 leader_uuid: "84987389a5624cf4814b4ef8ae2c3686" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84987389a5624cf4814b4ef8ae2c3686" member_type: VOTER last_known_addr { host: "127.17.171.195" port: 37463 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.817261 30647 raft_consensus.cc:1275] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 3 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:01.818574 30957 consensus_queue.cc:1048] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:01.828668 30575 raft_consensus.cc:1275] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 3 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:01.831794 31036 consensus_queue.cc:1048] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:02.246695 30575 raft_consensus.cc:1275] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.248361 31036 consensus_queue.cc:1048] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "886299e596884e3980c72d6dee3e1f08" member_type: VOTER last_known_addr { host: "127.17.171.193" port: 45451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:02.260434 30647 raft_consensus.cc:1275] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Refusing update from remote peer 84987389a5624cf4814b4ef8ae2c3686: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.262221 31036 consensus_queue.cc:1048] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f47d480eda141c7b0c7ca8108ccce91" member_type: VOTER last_known_addr { host: "127.17.171.194" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.510217 18095 tablet_server.cc:179] TabletServer@127.17.171.193:0 shutting down...
I20260709 13:14:02.545552 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:02.546315 18095 tablet_replica.cc:333] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.547318 18095 raft_consensus.cc:2243] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.547920 18095 raft_consensus.cc:2272] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.550717 18095 tablet_replica.cc:333] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.551450 18095 raft_consensus.cc:2243] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.552050 18095 raft_consensus.cc:2272] T 20a6d149be1b43e4b457820e0ead6a9c P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.554793 18095 tablet_replica.cc:333] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.555426 18095 raft_consensus.cc:2243] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.556483 18095 raft_consensus.cc:2272] T 849c328736d34f2384f2a517c07504c4 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.558938 18095 tablet_replica.cc:333] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.559638 18095 raft_consensus.cc:2243] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.560285 18095 raft_consensus.cc:2272] T e75387df6d574f4c80a1f33e5f0b2746 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.562783 18095 tablet_replica.cc:333] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.563612 18095 raft_consensus.cc:2243] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.564790 18095 raft_consensus.cc:2272] T 7b825688805442ac98524b4634f3fbfb P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.568110 18095 tablet_replica.cc:333] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.568835 18095 raft_consensus.cc:2243] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.569471 18095 raft_consensus.cc:2272] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.572497 18095 tablet_replica.cc:333] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.573110 18095 raft_consensus.cc:2243] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.574182 18095 raft_consensus.cc:2272] T aca185d9207440aaa5cb8fbde9ab09e9 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.577210 18095 tablet_replica.cc:333] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.578014 18095 raft_consensus.cc:2243] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.578596 18095 raft_consensus.cc:2272] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 886299e596884e3980c72d6dee3e1f08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.583246 18095 tablet_replica.cc:333] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.584218 18095 raft_consensus.cc:2243] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.585671 18095 raft_consensus.cc:2272] T 238c83bb2d9c4952bc5c36c41d44c10f P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.589351 18095 tablet_replica.cc:333] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.590003 18095 raft_consensus.cc:2243] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.590950 18095 raft_consensus.cc:2272] T 903daee7798d4242b416839be0a3548a P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.593797 18095 tablet_replica.cc:333] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.594408 18095 raft_consensus.cc:2243] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.594964 18095 raft_consensus.cc:2272] T 692dcfadd6c74e30952663b5fb02a134 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.597608 18095 tablet_replica.cc:333] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.598194 18095 raft_consensus.cc:2243] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.598681 18095 raft_consensus.cc:2272] T 9d62ec4f06284fb693cc27236a966983 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.601257 18095 tablet_replica.cc:333] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.601814 18095 raft_consensus.cc:2243] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.602340 18095 raft_consensus.cc:2272] T dd328bf039114ae6b522a99e25f0f85d P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.604924 18095 tablet_replica.cc:333] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.605490 18095 raft_consensus.cc:2243] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.606006 18095 raft_consensus.cc:2272] T 76fdd0be02b146be88f0798c65663f94 P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.608850 30687 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:14:02.609262 18095 tablet_replica.cc:333] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.610360 18095 raft_consensus.cc:2243] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.611230 18095 raft_consensus.cc:2272] T 42e1f229cb8b4098873e83b1211f280c P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.612669 30687 consensus_peers.cc:597] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.614527 18095 tablet_replica.cc:333] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.615140 18095 raft_consensus.cc:2243] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.615545 18095 raft_consensus.cc:2272] T ae98431f347b4392acd57c23a4dc21fd P 886299e596884e3980c72d6dee3e1f08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.618242 18095 tablet_replica.cc:333] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.618768 18095 raft_consensus.cc:2243] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.619624 18095 raft_consensus.cc:2272] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.621912 18095 tablet_replica.cc:333] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08: stopping tablet replica
I20260709 13:14:02.622319 18095 raft_consensus.cc:2243] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.623536 18095 raft_consensus.cc:2272] T ea4aaa3fe68f4e1091bd86e945184441 P 886299e596884e3980c72d6dee3e1f08 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.627633 30687 consensus_peers.cc:597] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.635350 30613 consensus_peers.cc:597] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.675108 18095 tablet_server.cc:196] TabletServer@127.17.171.193:0 shutdown complete.
W20260709 13:14:02.678982 30613 consensus_peers.cc:597] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.713312 30613 consensus_peers.cc:597] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.721961 30613 consensus_peers.cc:597] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.724577 18095 tablet_server.cc:179] TabletServer@127.17.171.194:0 shutting down...
I20260709 13:14:02.752508 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:02.753297 18095 tablet_replica.cc:333] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.754055 18095 raft_consensus.cc:2243] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.755059 18095 raft_consensus.cc:2272] T 20a6d149be1b43e4b457820e0ead6a9c P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.757887 18095 tablet_replica.cc:333] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.759130 18095 raft_consensus.cc:2243] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.760004 18095 raft_consensus.cc:2272] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.762282 18095 tablet_replica.cc:333] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.762898 18095 raft_consensus.cc:2243] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.763490 18095 raft_consensus.cc:2272] T 849c328736d34f2384f2a517c07504c4 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.765960 18095 tablet_replica.cc:333] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.766630 18095 raft_consensus.cc:2243] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.767927 18095 raft_consensus.cc:2272] T 42e1f229cb8b4098873e83b1211f280c P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.770509 18095 tablet_replica.cc:333] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.771472 18095 raft_consensus.cc:2243] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.772068 18095 raft_consensus.cc:2272] T ae98431f347b4392acd57c23a4dc21fd P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.775238 30613 consensus_peers.cc:597] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.775624 18095 tablet_replica.cc:333] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.776499 18095 raft_consensus.cc:2243] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.777361 18095 raft_consensus.cc:2272] T e75387df6d574f4c80a1f33e5f0b2746 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.779736 18095 tablet_replica.cc:333] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.780507 18095 raft_consensus.cc:2243] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.780982 18095 raft_consensus.cc:2272] T aca185d9207440aaa5cb8fbde9ab09e9 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.783526 18095 tablet_replica.cc:333] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.784099 18095 raft_consensus.cc:2243] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.785190 18095 raft_consensus.cc:2272] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.787752 18095 tablet_replica.cc:333] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.788702 18095 raft_consensus.cc:2243] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.789386 18095 raft_consensus.cc:2272] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 4f47d480eda141c7b0c7ca8108ccce91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.793007 18095 tablet_replica.cc:333] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.793922 18095 raft_consensus.cc:2243] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.794689 18095 raft_consensus.cc:2272] T 7b825688805442ac98524b4634f3fbfb P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.798205 18095 tablet_replica.cc:333] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.799189 18095 raft_consensus.cc:2243] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.800026 18095 raft_consensus.cc:2272] T 692dcfadd6c74e30952663b5fb02a134 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.802593 18095 tablet_replica.cc:333] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.803121 18095 raft_consensus.cc:2243] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.803588 18095 raft_consensus.cc:2272] T dd328bf039114ae6b522a99e25f0f85d P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.806071 18095 tablet_replica.cc:333] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.806576 18095 raft_consensus.cc:2243] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.807472 18095 raft_consensus.cc:2272] T 9d62ec4f06284fb693cc27236a966983 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.809988 18095 tablet_replica.cc:333] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.810516 18095 raft_consensus.cc:2243] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.810943 18095 raft_consensus.cc:2272] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.813474 18095 tablet_replica.cc:333] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.814028 18095 raft_consensus.cc:2243] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.814458 18095 raft_consensus.cc:2272] T ea4aaa3fe68f4e1091bd86e945184441 P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.817052 18095 tablet_replica.cc:333] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.817610 18095 raft_consensus.cc:2243] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.818604 18095 raft_consensus.cc:2272] T 76fdd0be02b146be88f0798c65663f94 P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.821051 18095 tablet_replica.cc:333] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.821543 18095 raft_consensus.cc:2243] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.822177 18095 raft_consensus.cc:2272] T 238c83bb2d9c4952bc5c36c41d44c10f P 4f47d480eda141c7b0c7ca8108ccce91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.824760 18095 tablet_replica.cc:333] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91: stopping tablet replica
I20260709 13:14:02.825332 18095 raft_consensus.cc:2243] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.825907 18095 raft_consensus.cc:2272] T 903daee7798d4242b416839be0a3548a P 4f47d480eda141c7b0c7ca8108ccce91 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:02.837463 30688 consensus_peers.cc:597] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Couldn't send request to peer 4f47d480eda141c7b0c7ca8108ccce91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:02.868686 30687 consensus_peers.cc:597] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.893247 18095 tablet_server.cc:196] TabletServer@127.17.171.194:0 shutdown complete.
W20260709 13:14:02.893978 30687 consensus_peers.cc:597] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 886299e596884e3980c72d6dee3e1f08 (127.17.171.193:45451): Couldn't send request to peer 886299e596884e3980c72d6dee3e1f08. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.193:45451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.932780 18095 tablet_server.cc:179] TabletServer@127.17.171.195:0 shutting down...
I20260709 13:14:02.965121 18095 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:02.965982 18095 tablet_replica.cc:333] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.967192 18095 raft_consensus.cc:2243] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.967825 18095 raft_consensus.cc:2272] T 20a6d149be1b43e4b457820e0ead6a9c P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.971309 18095 tablet_replica.cc:333] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.972118 18095 raft_consensus.cc:2243] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:02.972075 30688 consensus_peers.cc:597] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Couldn't send request to peer 4f47d480eda141c7b0c7ca8108ccce91. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:41557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:02.973162 18095 raft_consensus.cc:2272] T 5fbca4d1fcac4e4eb4a95dee72f63ca6 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.975492 18095 tablet_replica.cc:333] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.976416 18095 raft_consensus.cc:2243] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.977192 18095 raft_consensus.cc:2272] T 849c328736d34f2384f2a517c07504c4 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.980391 18095 tablet_replica.cc:333] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.981082 18095 raft_consensus.cc:2243] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.981612 18095 raft_consensus.cc:2272] T 76fdd0be02b146be88f0798c65663f94 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.983856 18095 tablet_replica.cc:333] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.984477 18095 raft_consensus.cc:2243] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.984934 18095 raft_consensus.cc:2272] T e75387df6d574f4c80a1f33e5f0b2746 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.987049 18095 tablet_replica.cc:333] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.987555 18095 raft_consensus.cc:2243] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.987998 18095 raft_consensus.cc:2272] T 7b825688805442ac98524b4634f3fbfb P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.990110 18095 tablet_replica.cc:333] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.990648 18095 raft_consensus.cc:2243] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.991029 18095 raft_consensus.cc:2272] T 4ae3e6b9e2e944d8801dd6c0a2b16201 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.993191 18095 tablet_replica.cc:333] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.993705 18095 raft_consensus.cc:2243] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:02.994167 18095 raft_consensus.cc:2272] T aca185d9207440aaa5cb8fbde9ab09e9 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.996275 18095 tablet_replica.cc:333] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:02.996749 18095 raft_consensus.cc:2243] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:02.997542 18095 raft_consensus.cc:2272] T 7f319c74c7ec4ac8a22ecaf36824dc42 P 84987389a5624cf4814b4ef8ae2c3686 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:02.999675 18095 tablet_replica.cc:333] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.000322 18095 raft_consensus.cc:2243] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.000869 18095 raft_consensus.cc:2272] T 903daee7798d4242b416839be0a3548a P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.003086 18095 tablet_replica.cc:333] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.003633 18095 raft_consensus.cc:2243] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.004287 18095 raft_consensus.cc:2272] T 238c83bb2d9c4952bc5c36c41d44c10f P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.007331 18095 tablet_replica.cc:333] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.007977 18095 raft_consensus.cc:2243] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:03.008360 30688 consensus_peers.cc:597] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 -> Peer 4f47d480eda141c7b0c7ca8108ccce91 (127.17.171.194:41557): Couldn't send request to peer 4f47d480eda141c7b0c7ca8108ccce91. Status: Network error: Client connection negotiation failed: client connection to 127.17.171.194:41557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.008571 18095 raft_consensus.cc:2272] T ea4aaa3fe68f4e1091bd86e945184441 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.010728 18095 tablet_replica.cc:333] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.011188 18095 raft_consensus.cc:2243] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.011588 18095 raft_consensus.cc:2272] T 1ce18184c2c74dcc9fb95fcbbcc1c966 P 84987389a5624cf4814b4ef8ae2c3686 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.013857 18095 tablet_replica.cc:333] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.014357 18095 raft_consensus.cc:2243] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.015136 18095 raft_consensus.cc:2272] T 692dcfadd6c74e30952663b5fb02a134 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.017352 18095 tablet_replica.cc:333] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.017817 18095 raft_consensus.cc:2243] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.018229 18095 raft_consensus.cc:2272] T 9d62ec4f06284fb693cc27236a966983 P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.020414 18095 tablet_replica.cc:333] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.020859 18095 raft_consensus.cc:2243] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.021642 18095 raft_consensus.cc:2272] T dd328bf039114ae6b522a99e25f0f85d P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.023520 18095 tablet_replica.cc:333] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.023955 18095 raft_consensus.cc:2243] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.024451 18095 raft_consensus.cc:2272] T 42e1f229cb8b4098873e83b1211f280c P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.026602 18095 tablet_replica.cc:333] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686: stopping tablet replica
I20260709 13:14:03.027025 18095 raft_consensus.cc:2243] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.027743 18095 raft_consensus.cc:2272] T ae98431f347b4392acd57c23a4dc21fd P 84987389a5624cf4814b4ef8ae2c3686 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.070744 18095 tablet_server.cc:196] TabletServer@127.17.171.195:0 shutdown complete.
I20260709 13:14:03.107942 18095 master.cc:562] Master@127.17.171.254:44081 shutting down...
I20260709 13:14:03.130414 18095 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.130970 18095 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.131246 18095 tablet_replica.cc:333] T 00000000000000000000000000000000 P 77b7219341e849a58918839c60d754aa: stopping tablet replica
I20260709 13:14:03.152130 18095 master.cc:584] Master@127.17.171.254:44081 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11959 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24008 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (363705 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:14:03.209846 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:14:03.210104 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:14:03.210291 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:14:03.210492 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:14:03.210685 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:14:03.210884 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~77 seconds ago
I20260709 13:14:03.211095 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~150 seconds ago
I20260709 13:14:03.211356 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 13:14:03.211645 18095 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
